Buildings.ThermalZones.Detailed.Validation.BESTEST.UsersGuide

User's Guide

Information

The package Buildings.ThermalZones.Detailed.Validation.BESTEST contains the models that were used for the BESTEST validation (ANSI/ASHRAE 2020). The basic model from which all other models extend from is Buildings.ThermalZones.Detailed.Validation.BESTEST.Cases6xx.Case600FF.

All examples have a script that runs an annual simulation and plots the results with the minimum, mean and maximum value listed in the ANSI/ASHRAE Standard 140-2020.

The script compares the following quantities:

Note that in addition to the BESTESTs, the window model has been validated separately in Nouidui et al. (2012).

Implementation

Heating and cooling is controlled using the PI controller Buildings.Controls.OBC.CDL.Continuous.PID with anti-windup.

Hourly averaged values and annual mean values are computed using an instance of Buildings.Controls.OBC.CDL.Continuous.MovingAverage.

Validation results

The data used for validation are from "RESULTS5-2A.xlsx" in folder "/Sec5-2AFiles/Informative Materials" of Supplemental Files for ANSI/ASHRAE Standard 140-2020, Method of Test for Evaluating Building Performance Simulation Software.

Heating and cooling cases

The simulations of cases with heating and cooling are validated by comparing the annual heating and cooling energy, the peak heating and cooling demand with the validation data. In addition, one day load profiles are also validated. The detailed comparison, which also shows the peak load hours, are shown in the table after the plots below.

annual_cooling.png annual_heating.png

peak_cooling.png peak_heating.png

hourly_load_600_Jan4.png hourly_load_900_Jan4.png

Annual heating load (MWh)
Case BSIMAC CSE DeST EnergyPlus ESP-r TRNSYS MBL
Case600 4.050 3.993 4.047 4.324 4.362 4.504 4.477
Case610 4.163 4.066 4.144 4.375 4.527 4.592 4.502
Case620 4.370 4.094 4.297 4.485 4.514 4.719 4.576
Case630 4.923 4.356 4.677 4.784 5.051 5.139 4.754
Case640 2.682 2.403 2.619 2.662 2.654 2.653 2.752
Case650 0.000 0.000 0.000 0.000 0.000 0.000 0.000
Case660 3.574 3.602 3.821 3.707 3.787 3.790 3.621
Case670 5.484 5.300 5.573 5.616 5.975 6.140 6.515
Case680 2.219 1.786 1.732 2.180 2.132 2.286 2.241
Case685 4.532 4.574 4.646 4.877 4.904 5.042 4.962
Case695 2.709 2.415 2.385 2.802 2.732 2.892 2.781
Case900 1.726 1.379 1.591 1.664 1.585 1.814 1.699
Case910 2.163 1.648 1.860 1.956 2.067 2.132 1.867
Case920 3.500 2.956 3.259 3.337 3.300 3.607 3.310
Case930 4.270 3.524 3.933 3.994 4.278 4.384 3.731
Case940 1.389 0.863 1.149 1.067 1.015 1.169 1.197
Case950 0.000 0.000 0.000 0.000 0.000 0.000 0.000
Case960 0.000 2.522 2.771 2.689 2.624 2.860 2.652
Case980 0.720 0.246 0.266 0.411 0.351 0.450 0.438
Case985 2.801 2.120 2.279 2.369 2.283 2.536 2.356
Case995 1.330 0.755 0.770 1.006 0.905 1.077 0.978
Annual cooling load (MWh)
Case BSIMAC CSE DeST EnergyPlus ESP-r TRNSYS MBL
Case600 5.822 5.913 5.432 6.027 6.162 5.780 6.039
Case610 4.299 4.382 4.173 4.333 4.233 4.117 4.873
Case620 4.404 4.079 3.909 4.060 4.246 3.841 4.129
Case630 3.074 3.020 2.787 2.836 2.595 2.573 3.356
Case640 5.804 5.644 5.237 5.763 5.893 5.477 5.801
Case650 4.629 4.654 4.186 4.817 4.945 4.632 4.890
Case660 3.014 3.340 3.260 3.232 3.219 2.966 3.369
Case670 6.539 6.578 5.954 6.623 6.520 6.198 6.441
Case680 5.938 6.430 5.932 6.444 6.529 6.310 6.164
Case685 9.130 8.859 8.238 9.119 9.121 8.851 9.009
Case695 8.755 8.974 8.386 9.172 9.149 9.039 8.781
Case900 2.714 2.464 2.383 2.489 2.488 2.267 2.389
Case910 1.484 1.415 1.490 1.383 1.283 1.191 1.610
Case920 3.128 2.789 2.706 2.731 2.814 2.549 2.670
Case930 2.161 2.075 1.908 1.919 1.654 1.672 2.184
Case940 2.613 2.397 2.343 2.424 2.428 2.203 2.340
Case950 0.586 0.598 0.618 0.707 0.656 0.642 0.711
Case960 0.000 0.926 0.909 0.907 0.950 0.789 0.946
Case980 3.501 3.995 3.758 3.712 3.775 3.519 3.404
Case985 7.273 6.234 5.880 6.359 6.249 6.113 6.153
Case995 7.482 7.202 6.771 7.203 7.149 7.064 6.792

Peak heating load (kW)
Case BSIMAC CSE DeST EnergyPlus ESP-r TRNSYS MBL
kWhour kWhour kWhour kWhour kWhour kWhour kWhour
Case600 3.255 26-Nov:8 3.020 01-Jan:1 3.035 01-Jan:0 3.204 31-Dec:24 3.228 01-Jan:1 3.359 01-Jan:1 3.214 31-Dec:24
Case610 3.166 26-Nov:8 3.021 01-Jan:1 3.039 01-Jan:0 3.192 31-Dec:24 3.233 01-Jan:1 3.360 01-Jan:1 3.215 31-Dec:24
Case620 3.145 31-Dec:24 3.038 01-Jan:1 3.068 01-Jan:0 3.229 31-Dec:24 3.253 01-Jan:1 3.385 01-Jan:1 3.239 31-Dec:24
Case630 3.252 31-Dec:24 3.039 01-Jan:1 3.072 01-Jan:0 3.207 31-Dec:24 3.259 01-Jan:1 3.388 01-Jan:1 3.241 31-Dec:24
Case640 4.633 08-Feb:9 4.222 26-Nov:8 4.658 26-Nov:7 4.559 26-Nov:8 4.101 26-Nov:8 4.039 26-Nov:8 4.393 26-Nov:8
Case650 0.000 N/A 0.000 01-Jan:1 0.000 N/A 0.000 01-Jan:1 0.000 01-Jan:1 0.000 31-Dec:0 0.000 31-Dec:24
Case660 2.620 26-Nov:8 2.758 01-Jan:1 2.798 01-Jan:0 2.831 31-Dec:24 2.846 01-Jan:1 2.955 01-Jan:1 2.715 31-Dec:24
Case670 4.122 26-Nov:8 3.655 01-Jan:1 3.812 01-Jan:0 3.854 26-Nov:7 3.992 26-Nov:7 4.221 26-Nov:8 4.302 26-Nov:7
Case680 2.126 26-Nov:8 1.778 09-Feb:6 1.811 01-Jan:1 2.052 26-Nov:7 2.022 09-Feb:7 2.115 26-Nov:8 2.008 26-Nov:7
Case685 3.169 26-Nov:8 3.032 01-Jan:1 3.054 01-Jan:0 3.223 31-Dec:24 3.247 01-Jan:1 3.374 01-Jan:1 3.221 31-Dec:24
Case695 2.138 26-Nov:8 1.795 01-Jan:1 1.855 01-Jan:1 2.072 31-Dec:24 2.025 26-Nov:7 2.118 26-Nov:8 2.045 31-Dec:24
Case900 2.551 08-Feb:24 2.443 09-Feb:6 2.453 09-Feb:5 2.687 09-Feb:6 2.633 09-Feb:7 2.778 09-Feb:7 2.657 9-Feb:7
Case910 2.761 08-Feb:24 2.469 09-Feb:6 2.474 09-Feb:5 2.699 09-Feb:6 2.684 09-Feb:7 2.799 09-Feb:6 2.664 9-Feb:7
Case920 2.895 26-Nov:8 2.512 09-Feb:6 2.513 09-Feb:5 2.770 09-Feb:6 2.706 09-Feb:7 2.864 09-Feb:6 2.735 9-Feb:6
Case930 2.968 31-Dec:24 2.537 09-Feb:6 2.549 09-Feb:5 2.785 09-Feb:6 2.765 09-Feb:6 2.900 09-Feb:6 2.745 9-Feb:6
Case940 3.882 08-Feb:9 3.052 01-Jan:9 3.659 09-Feb:7 3.143 31-Dec:9 3.122 09-Feb:9 3.405 01-Jan:9 4.224 9-Feb:8
Case950 0.000 N/A 0.000 01-Jan:1 0.000 N/A 0.000 01-Jan:1 0.000 01-Jan:1 0.000 31-Dec:0 0.000 31-Dec:24
Case960 0.000 N/A 2.132 09-Feb:6 2.085 01-Jan:0 2.259 09-Feb:6 2.201 09-Feb:6 2.300 09-Feb: 2.133 9-Feb:6
Case980 1.693 08-Feb:24 1.254 09-Feb:6 1.382 09-Feb:5 1.538 09-Feb:6 1.473 09-Feb:7 1.592 09-Feb:7 1.586 1-Jan:1
Case985 2.754 08-Feb:24 2.452 09-Feb:6 2.458 09-Feb:5 2.695 09-Feb:6 2.642 09-Feb:7 2.785 09-Feb:6 2.654 9-Feb:7
Case995 1.711 26-Nov:8 1.370 09-Feb:6 1.462 09-Feb:5 1.622 09-Feb:6 1.560 09-Feb:7 1.662 09-Feb:6 1.584 9-Feb:7
Peak cooling load (kW)
Case BSIMAC CSE DeST EnergyPlus ESP-r TRNSYS MBL
kWhour kWhour kWhour kWhour kWhour kWhour kWhour
Case600 5.650 22-Jan:15 6.481 22-Jan:14 5.422 22-Jan:14 6.352 22-Jan:14 6.193 22-Jan:14 6.046 22-Jan:14 6.247 22-Jan:14
Case610 5.466 22-Jan:15 6.432 01-Dec:14 5.331 22-Jan:14 6.135 01-Dec:14 5.934 22-Jan:14 5.868 01-Dec:14 6.105 1-Dec:14
Case620 4.704 26-Jun:18 4.493 26-Jun:17 3.955 26-Jun:17 4.797 26-Jun:17 4.622 26-Jun:17 4.588 26-Jun:17 4.651 26-Jun:17
Case630 4.121 26-Jun:18 3.998 26-Jun:18 3.526 26-Jun:17 4.212 26-Jun:17 3.971 26-Jun:17 3.949 26-Jun:17 4.184 26-Jun:18
Case640 5.650 22-Jan:15 6.429 22-Jan:14 5.365 22-Jan:14 6.297 22-Jan:14 6.127 22-Jan:14 5.967 22-Jan:14 6.209 22-Jan:14
Case650 5.648 22-Jan:15 6.290 01-Dec:14 5.045 18-Oct:14 6.138 18-Oct:14 5.961 18-Oct:14 5.797 18-Oct:14 5.996 1-Dec:14
Case660 3.343 18-Oct:15 3.933 01-Oct:13 3.355 11-Oct:14 3.770 18-Oct:14 3.530 01-Oct:14 3.457 18-Oct:14 3.654 18-Oct:14
Case670 6.217 18-Oct:14 6.925 01-Oct:13 5.839 10-Oct:13 6.806 22-Jan:14 6.482 18-Oct:14 6.401 18-Oct:14 6.620 22-Jan:14
Case680 5.761 22-Jan:15 7.051 22-Jan:14 5.861 22-Jan:14 6.770 22-Jan:14 6.676 22-Jan:14 6.557 22-Jan:14 6.556 22-Jan:14
Case685 6.318 22-Jan:15 7.159 22-Jan:14 6.071 22-Jan:14 7.107 22-Jan:14 6.934 22-Jan:14 6.867 22-Jan:14 6.982 22-Jan:14
Case695 6.232 22-Jan:15 7.541 22-Jan:14 6.355 22-Jan:14 7.334 22-Jan:14 7.239 22-Jan:14 7.175 22-Jan:14 7.110 22-Jan:14
Case900 3.039 01-Oct:15 3.376 01-Oct:14 2.556 11-Sep:14 3.040 01-Oct:14 2.896 12-Oct:15 2.940 01-Oct:14 2.964 1-Oct:15
Case910 2.493 18-Oct:14 2.722 02-Oct:15 2.103 12-Oct:14 2.222 18-Oct:15 2.212 02-Oct:15 2.081 12-Oct:15 2.284 1-Oct:15
Case920 3.481 26-Jun:18 3.057 26-Jun:18 2.710 26-Jun:17 3.260 26-Jun:18 3.099 26-Jun:18 3.154 26-Jun:18 3.182 26-Jun:18
Case930 3.052 26-Jun:18 2.662 26-Jun:18 2.335 26-Jun:17 2.782 26-Jun:18 2.494 26-Jun:18 2.613 26-Jun:18 2.808 26-Jun:18
Case940 3.158 01-Oct:15 3.376 01-Oct:14 2.556 11-Sep:14 3.040 01-Oct:14 2.891 12-Oct:15 2.938 01-Oct:14 2.964 1-Oct:15
Case950 2.366 10-Sep:15 2.364 04-Sep:15 2.054 11-Sep:14 2.388 11-Sep:15 2.202 10-Sep:15 2.236 11-Sep:15 2.341 11-Sep:15
Case960 0.000 N/A 1.377 26-Jun:17 1.367 26-Jun:16 1.480 26-Jun:17 1.403 26-Jun:17 1.338 26-Jun:17 1.463 26-Jun:17
Case980 3.384 18-Oct:14 3.668 02-Oct:14 2.930 18-Oct:14 3.450 18-Oct:15 3.341 12-Oct:15 3.313 12-Oct:14 3.278 18-Oct:15
Case985 3.977 18-Oct:14 4.225 01-Oct:14 3.208 11-Oct:14 3.915 18-Oct:15 3.736 12-Oct:15 3.885 01-Oct:14 3.834 1-Oct:15
Case995 4.129 22-Jan:14 4.224 22-Jan:15 3.315 22-Jan:14 4.177 22-Jan:15 3.954 22-Jan:15 4.115 22-Jan:15 3.950 22-Jan:15

Free floating cases

The following plots compare the maximum, minimum and average zone temperature simulated with the Modelica Buildings Library with the values simulated by other tools. The simulation is also validated by comparing one-day simulation results in different days, and by comparing the distribution of the annual temperature. The detailed comparisons, which also show the peak temperature hour, are shown in the table after the plots.

max_temperature.png min_temperature.png

FF_temperature_600FF_Feb1.png FF_temperature_900FF_Feb1.png

FF_temperature_650FF_Jul14.png FF_temperature_950FF_Jul14.png

ave_temperature.png bin_temperature_900FF.png

Maximum temperature (°C)
Case BSIMAC CSE DeST EnergyPlus ESP-r TRNSYS MBL
°Chour °Chour °Chour °Chour °Chour °Chour °Chour
Case600FF 63.4 18-Oct:17 68.4 01-Oct:16 65.0 11-Oct:15 63.8 18-Oct:16 64.6 01-Oct:16 62.4 01-Oct:15 63.6 18-Oct:16
Case650FF 62.1 18-Oct:17 66.8 01-Oct:16 62.6 11-Oct:15 62.5 18-Oct:16 63.3 01-Oct:16 61.1 01-Oct:15 62.5 18-Oct:16
Case680FF 72.5 22-Jan:17 78.5 22-Jan:16 75.0 12-Oct:15 70.1 22-Jan:16 72.2 12-Oct:16 69.8 22-Jan:16 69.1 22-Jan:16
Case900FF 46.0 01-Oct:17 45.1 04-Sep:15 44.5 11-Sep:15 44.3 12-Sep:15 44.3 12-Sep:16 43.3 12-Sep:15 43.7 12-Sep:16
Case950FF 37.1 01-Oct:17 36.8 11-Sep:15 36.4 11-Sep:15 36.7 11-Sep:16 36.4 05-Aug:16 36.1 11-Sep:16 36.6 11-Sep:16
Case960 0.000 N/A 48.9 02-Oct:16 53.2 20-Oct:14 49.9 12-Oct:15 49.5 12-Oct:15 48.1 12-Oct:15 47.9 12-Oct:16
Case980FF 49.7 01-Oct:17 52.2 12-Sep:15 52.8 21-Oct:14 49.6 12-Sep:16 50.2 12-Sep:15 48.5 12-Sep:15 48.4 12-Sep:16
Minimum temperature (°C)
Case BSIMAC CSE DeST EnergyPlus ESP-r TRNSYS MBL
°Chour °Chour °Chour °Chour °Chour °Chour °Chour
Case600FF -9.9 26-Nov:8 -12.9 09-Feb:7 -13.5 09-Feb:6 -12.6 09-Feb:7 -13.5 09-Feb:7 -13.8 09-Feb:7 -12.9 9-Feb:7
Case650FF -16.7 31-Dec:24 -17.8 01-Jan:1 -17.4 30-Dec:23 -17.1 31-Dec:24 -17.5 01-Jan:1 -17.5 31-Dec:24 -16.8 31-Dec:24
Case680FF -5.7 08-Feb:11 -6.2 09-Feb:7 -6.9 09-Feb:7 -7.1 09-Feb:7 -7.2 09-Feb:7 -8.1 09-Feb:7 -7.3 9-Feb:7
Case900FF 0.6 08-Feb:11 2.2 09-Feb:7 1.3 09-Feb:7 1.2 09-Feb:7 1.6 09-Feb:7 0.6 09-Feb:7 1.2 9-Feb:7
Case950FF -13.2 31-Dec:24 -13.2 01-Jan:1 -13.4 30-Dec:23 -12.8 09-Feb:7 -12.5 09-Feb:6 -12.8 09-Feb:6 -11.8 9-Feb:6
Case960 0.000 N/A 8.0 09-Feb:8 6.7 09-Feb:6 5.1 09-Feb:7 5.0 09-Feb:7 4.2 09-Feb:7 4.0 9-Feb:7
Case980FF 7.3 08-Feb:11 12.5 04-Nov:7 12.4 05-Nov:6 9.9 04-Nov:7 10.5 04-Nov:8 9.5 04-Nov:7 9.7 4-Nov:8

Implementation

To generate the data shown in this user guide, run

  cd Buildings/Resources/src/ThermalZones/Detailed/Validation/BESTEST
  python3 simulateAndPlot.py

References

ANSI/ASHRAE. 2007. ANSI/ASHRAE Standard 140-2007, Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs.

Thierry Stephane Nouidui, Michael Wetter, and Wangda Zuo. Validation of the window model of the Modelica Buildings library. Proc. of the 5th SimBuild Conference, Madison, WI, USA, August 2012.

Extends from Modelica.Icons.Information (Icon for general information packages).