Buildings.ThermalZones.Detailed.Validation.BESTEST.UsersGuide
User's Guide
Information
The package Buildings.ThermalZones.Detailed.Validation.BESTEST contains the models that were used for the BESTEST validation (ANSI/ASHRAE 2007). The basic model from which all other models extend from is Buildings.ThermalZones.Detailed.Validation.BESTEST.Cases6xx.Case600FF.
All examples have a script that runs an annual simulation and plots the results with the minimum, mean and maximum value listed in the ANSI/ASHRAE Standard 140-2007.
The script compares the following quantities:
- For free floating cases, the annual hourly integrated minimum (and maximum) zone air temperature, and the annual mean zone air temperature.
- For cases with heating and cooling, the annual heating and cooling energy, and the annual hourly integrated minimum (and maximum) peak heating and cooling power.
Note that in addition to the BESTESTs, the window model has been validated separately in Nouidui et al. (2012).
Implementation
Heating and cooling is controlled using the PI controller Buildings.Controls.Continuous.LimPID with anti-windup.
Hourly averaged values and annual mean values are computed using an instance of Buildings.Controls.OBC.CDL.Continuous.MovingMean.
Validation results
The data used for validation are from "RESULTS5-2A.xlsx" in folder "/Sec5-2AFiles/Informative Materials" of Supplemental Files for ANSI/ASHRAE Standard 140-2017, Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs.
Heating and cooling cases
The simulations of cases with heating and cooling are validated by comparing the annual heating and cooling energy, the peak heating and cooling demand with the validation data. In addition, one day load profiles are also validated. The detailed comparison, which also shows the peak load hours, are shown in the table after the plots below.
| Annual heating load (MWh) | |||||||||
| Case | ESP/DMU | BLAST/US-IT | DOE21D/NREL | SRES-SUN/NREL | SRES/BRE | S3PAS/SPAIN | TSYS/BEL-BRE | TASE/FINLAND | MBL/LBNL |
|---|---|---|---|---|---|---|---|---|---|
| Case600 | 4.296 | 4.773 | 5.709 | 5.226 | 5.596 | 4.882 | 4.872 | 5.362 | 5.292 |
| Case610 | 4.355 | 4.806 | 5.786 | 5.280 | 5.620 | 4.971 | 4.970 | 5.383 | 5.320 |
| Case620 | 4.613 | 5.049 | 5.944 | 5.554 | 5.734 | 5.564 | 5.073 | 5.728 | 5.454 |
| Case630 | 5.050 | 5.359 | 6.469 | 5.883 | 6.001 | 6.095 | 5.624 | 0.000 | 5.713 |
| Case640 | 2.751 | 2.888 | 3.543 | 3.255 | 3.803 | 3.065 | 3.043 | 3.309 | 3.429 |
| Case650 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
| Case900 | 1.170 | 1.610 | 1.872 | 1.897 | 1.988 | 1.730 | 1.655 | 2.041 | 1.788 |
| Case920 | 3.313 | 3.752 | 4.255 | 4.093 | 4.058 | 4.235 | 3.776 | 4.300 | 3.901 |
| Case940 | 0.793 | 1.021 | 1.239 | 1.231 | 1.411 | 1.179 | 1.080 | 1.323 | 1.186 |
| Case950 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
| Case960 | 2.311 | 2.664 | 2.928 | 2.884 | 2.851 | 2.943 | 3.373 | 2.816 | 3.100 |
| Annual cooling load (MWh) | |||||||||
| Case | ESP/DMU | BLAST/US-IT | DOE21D/NREL | SRES-SUN/NREL | SRES/BRE | S3PAS/SPAIN | TSYS/BEL-BRE | TASE/FINLAND | MBL/LBNL |
| Case600 | 6.137 | 6.433 | 7.079 | 7.278 | 7.964 | 6.492 | 6.492 | 6.778 | 6.687 |
| Case610 | 3.915 | 4.851 | 4.852 | 5.448 | 5.778 | 4.764 | 4.601 | 5.506 | 5.168 |
| Case620 | 3.417 | 4.092 | 4.334 | 4.633 | 5.004 | 4.011 | 3.901 | 4.351 | 4.113 |
| Case630 | 2.129 | 3.108 | 2.489 | 3.493 | 3.701 | 2.489 | 2.416 | 0.000 | 3.179 |
| Case640 | 5.952 | 6.183 | 6.759 | 7.026 | 7.811 | 6.247 | 6.246 | 6.508 | 6.472 |
| Case650 | 4.816 | 5.140 | 5.795 | 5.894 | 6.545 | 5.088 | 5.119 | 5.456 | 5.363 |
| Case900 | 2.132 | 2.600 | 2.455 | 3.165 | 3.415 | 2.572 | 2.485 | 2.599 | 2.192 |
| Case920 | 1.840 | 2.616 | 2.440 | 2.943 | 3.092 | 2.457 | 2.418 | 2.613 | 2.308 |
| Case940 | 2.079 | 2.536 | 2.340 | 3.036 | 3.241 | 2.489 | 2.383 | 2.516 | 2.113 |
| Case950 | 0.387 | 0.526 | 0.538 | 0.921 | 0.589 | 0.551 | 0.561 | 0.771 | 0.473 |
| Case960 | 0.488 | 0.666 | 0.428 | 0.803 | 0.718 | 0.643 | 0.411 | 0.786 | 0.615 |
| Peak heating load (kW) | ||||||||||||||||
| Case | ESP/DMU | BLAST/US-IT | DOE21D/NREL | SRES-SUN/NREL | S3PAS/SPAIN | TSYS/BEL-BRE | TASE/FINLAND | MBL/LBNL | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | |
| Case600 | 3.437 | 04-Jan:5 | 3.940 | 04-Jan:5 | 4.045 | 04-Jan:5 | 4.258 | 04-Jan:2 | 4.037 | 04-Jan:2 | 3.931 | 04-Jan:6 | 4.354 | 04-Jan:2 | 4.172 | 4-Jan:6 |
| Case610 | 3.437 | 04-Jan:5 | 3.941 | 04-Jan:5 | 4.034 | 04-Jan:5 | 4.258 | 04-Jan:2 | 4.037 | 04-Jan:2 | 3.922 | 04-Jan:6 | 4.354 | 04-Jan:2 | 4.172 | 4-Jan:6 |
| Case620 | 3.591 | 04-Jan:6 | 3.941 | 04-Jan:5 | 4.046 | 04-Jan:5 | 4.277 | 04-Jan:2 | 4.277 | 04-Jan:2 | 3.922 | 04-Jan:6 | 4.379 | 04-Jan:2 | 4.172 | 4-Jan:6 |
| Case630 | 3.592 | 04-Jan:7 | 3.941 | 04-Jan:5 | 4.025 | 04-Jan:5 | 4.280 | 04-Jan:2 | 4.278 | 04-Jan:2 | 3.922 | 04-Jan:6 | 0.000 | N/A | 4.172 | 4-Jan:6 |
| Case640 | 5.232 | 04-Jan:7 | 5.486 | 04-Jan:8 | 5.943 | 04-Jan:8 | 6.530 | 04-Jan:8 | 6.347 | 04-Jan:8 | 5.722 | 04-Jan:8 | 6.954 | 04-Jan:8 | 6.957 | 4-Jan:8 |
| Case650 | 0.000 | N/A | 0.000 | 04-Jan:N/A | 0.000 | N/A | 0.000 | N/A | 0.000 | N/A | 0.000 | N/A | 0.000 | N/A | 0.000 | 31-Dec:24 |
| Case900 | 2.850 | 04-Jan:7 | 3.453 | 04-Jan:7 | 3.557 | 04-Jan:7 | 3.760 | 04-Jan:7 | 3.608 | 04-Jan:8 | 3.517 | 04-Jan:7 | 3.797 | 04-Jan:7 | 3.579 | 4-Jan:7 |
| Case920 | 3.308 | 04-Jan:7 | 3.703 | 04-Jan:7 | 3.805 | 04-Jan:7 | 4.013 | 04-Jan:7 | 4.029 | 04-Jan:7 | 3.708 | 04-Jan:7 | 4.061 | 04-Jan:7 | 3.885 | 4-Jan:7 |
| Case940 | 3.980 | 04-Jan:7 | 5.028 | 04-Jan:8 | 5.665 | 04-Jan:8 | 6.116 | 04-Jan:8 | 6.117 | 04-Jan:8 | 5.122 | 03-Jan:9 | 6.428 | 04-Jan:8 | 6.017 | 4-Jan:8 |
| Case950 | 0.000 | N/A | 0.000 | N/A | 0.000 | N/A | 0.000 | N/A | 0.000 | N/A | 0.000 | N/A | 0.000 | N/A | 0.000 | 31-Dec:24 |
| Case960 | 2.410 | 04-Jan:7 | 2.751 | 04-Jan:8 | 2.727 | 04-Jan:8 | 2.863 | 04-Jan:8 | 2.852 | 04-Jan:8 | 2.522 | 04-Jan:8 | 2.779 | 04-Jan:8 | 2.880 | 4-Jan:8 |
| Peak cooling load (kW) | ||||||||||||||||
| Case | ESP/DMU | BLAST/US-IT | DOE21D/NREL | SRES-SUN/NREL | S3PAS/SPAIN | TSYS/BEL-BRE | TASE/FINLAND | MBL/LBNL | ||||||||
| kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | kW | hour | |
| Case600 | 6.194 | 17-Oct:13 | 5.965 | 16-Oct:14 | 6.656 | 16-Oct:13 | 6.827 | 16-Oct:14 | 6.286 | 25-Nov:14 | 6.486 | 16-Oct:14 | 6.812 | 17-Oct:14 | 6.598 | 17-Oct:13 |
| Case610 | 5.669 | 25-Nov:13 | 5.824 | 25-Nov:14 | 6.064 | 13-Jan:14 | 6.371 | 25-Nov:14 | 6.170 | 25-Nov:14 | 5.675 | 25-Nov:14 | 6.146 | 17-Oct:14 | 6.254 | 25-Nov:13 |
| Case620 | 3.634 | 26-Jul:16 | 4.075 | 26-Jul:17 | 4.430 | 26-Jul:17 | 4.593 | 26-Jul:17 | 4.297 | 26-Jul:17 | 4.275 | 26-Jul:17 | 5.096 | 26-Jul:16 | 4.033 | 26-Jul:17 |
| Case630 | 3.072 | 26-Jul:16 | 3.704 | 26-Jul:17 | 3.588 | 26-Jul:17 | 4.116 | 26-Jul:17 | 3.665 | 26-Jul:17 | 3.608 | 26-Jul:17 | 0.000 | N/A | 3.547 | 26-Jul:17 |
| Case640 | 6.161 | 17-Oct:13 | 5.892 | 16-Oct:14 | 6.576 | 16-Oct:14 | 6.776 | 16-Oct:14 | 6.250 | 25-Nov:14 | 6.442 | 16-Oct:14 | 6.771 | 17-Oct:14 | 6.539 | 17-Oct:13 |
| Case650 | 6.031 | 17-Oct:13 | 5.831 | 16-Oct:14 | 6.516 | 16-Oct:14 | 6.671 | 16-Oct:14 | 6.143 | 25-Nov:14 | 6.378 | 17-Oct:14 | 6.679 | 17-Oct:14 | 6.475 | 17-Oct:14 |
| Case900 | 2.888 | 17-Oct:14 | 3.155 | 06-Oct:15 | 3.458 | 17-Oct:14 | 3.871 | 17-Oct:14 | 3.334 | 17-Oct:15 | 3.567 | 17-Oct:15 | 3.457 | 17-Oct:15 | 3.125 | 17-Oct:15 |
| Case920 | 2.385 | 26-Jul:16 | 2.933 | 26-Jul:17 | 3.109 | 26-Jul:17 | 3.487 | 26-Jul:17 | 3.071 | 26-Jul:17 | 3.050 | 26-Jul:17 | 3.505 | 26-Jul:17 | 2.849 | 26-Jul:17 |
| Case940 | 2.888 | 17-Oct:14 | 3.155 | 06-Oct:15 | 3.458 | 17-Oct:14 | 3.871 | 17-Oct:14 | 3.334 | 17-Oct:15 | 3.567 | 17-Oct:15 | 3.457 | 17-Oct:15 | 3.124 | 17-Oct:15 |
| Case950 | 2.033 | 02-Sep:14 | 2.621 | 02-Sep:15 | 2.664 | 02-Sep:15 | 3.170 | 02-Sep:14 | 2.677 | 02-Sep:15 | 2.686 | 02-Sep:15 | 2.867 | 02-Sep:14 | 2.425 | 2-Sep:15 |
| Case960 | 0.953 | 16-Aug:16 | 1.144 | 26-Jul:16 | 1.057 | 26-Jul:16 | 1.370 | 26-Jul:16 | 1.179 | 26-Jul:16 | 1.378 | 26-Jul:16 | 1.403 | 26-Jul:16 | 1.252 | 27-Jul:16 |
Free floating cases
The following plots compare the maximum, minimum and average zone temperature simulated with the Modelica Buildings Library with the values simulated by other tools. The simulation is also validated by comparing one-day simulation results in different days, and by comparing the distribution of the annual temperature. The detailed comparisons, which also show the peak temperature hour, are shown in the table after the plots.
| Maximum temperature (°C) | ||||||||||||||||
| Case | ESP/DMU | BLAST/US-IT | DOE21D/NREL | SRES-SUN/NREL | S3PAS/SPAIN | TSYS/BEL-BRE | TASE/FINLAND | MBL/LBNL | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | |
| Case600FF | 64.9 | 17-Oct:15 | 65.1 | 16-Oct:15 | 69.5 | 17-Oct:15 | 68.6 | 16-Oct:15 | 64.9 | 16-Oct:16 | 65.3 | 17-Oct:16 | 65.3 | 15-Oct:16 | 65.3 | 17-Oct:16 |
| Case650FF | 63.2 | 17-Oct:15 | 63.5 | 16-Oct:15 | 68.2 | 17-Oct:15 | 67.0 | 16-Oct:15 | 63.3 | 16-Oct:16 | 63.7 | 17-Oct:16 | 63.8 | 16-Oct:16 | 64.0 | 17-Oct:16 |
| Case900FF | 41.8 | 17-Oct:15 | 43.4 | 02-Sep:16 | 42.7 | 02-Sep:15 | 44.8 | 02-Sep:15 | 43.0 | 02-Sep:15 | 42.5 | 17-Oct:15 | 43.2 | 15-Sep:15 | 42.2 | 2-Sep:16 |
| Case950FF | 35.5 | 02-Sep:16 | 36.2 | 02-Sep:16 | 35.9 | 02-Sep:16 | 38.5 | 02-Sep:15 | 36.1 | 02-Sep:16 | 35.7 | 02-Sep:15 | 37.6 | 15-Sep:16 | 36.2 | 2-Sep:16 |
| Minimum temperature (°C) | ||||||||||||||||
| Case | ESP/DMU | BLAST/US-IT | DOE21D/NREL | SRES-SUN/NREL | S3PAS/SPAIN | TSYS/BEL-BRE | TASE/FINLAND | MBL/LBNL | ||||||||
| °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | °C | hour | |
| Case600FF | -15.6 | 04-Jan:7 | -17.1 | 04-Jan:8 | -18.8 | 04-Jan:8 | -18.0 | 04-Jan:7 | -17.8 | 04-Jan:8 | -17.8 | 04-Jan:7 | -18.5 | 08-Jan:9 | -19.0 | 4-Jan:8 |
| Case650FF | -22.6 | 04-Jan:6 | -23.0 | 04-Jan:7 | -21.6 | 04-Jan:2 | -23.0 | 04-Jan:2 | -22.9 | 04-Jan:2 | -22.8 | 04-Jan:7 | -22.9 | 02-Jan:23 | -23.3 | 4-Jan:3 |
| Case900FF | -1.6 | 04-Jan:8 | -3.2 | 04-Jan:8 | -4.3 | 04-Jan:8 | -4.5 | 04-Jan:8 | -4.0 | 04-Jan:8 | -6.4 | 04-Jan:8 | -5.6 | 08-Jan:9 | -5.3 | 4-Jan:8 |
| Case950FF | -19.5 | 04-Jan:6 | -20.0 | 04-Jan:7 | -18.6 | 04-Jan:7 | -19.7 | 04-Jan:7 | -20.2 | 04-Jan:7 | -19.3 | 04-Jan:7 | -20.0 | 07-Jan:22 | -20.6 | 4-Jan:7 |
Implementation
To generate the data shown in this user guide, run
cd Buildings/Resources/src/ThermalZones/Detailed/Validation/BESTEST python3 simulateAndPlot.py
References
ANSI/ASHRAE. 2007. ANSI/ASHRAE Standard 140-2007, Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs.
Thierry Stephane Nouidui, Michael Wetter, and Wangda Zuo. Validation of the window model of the Modelica Buildings library. Proc. of the 5th SimBuild Conference, Madison, WI, USA, August 2012.
Extends from Modelica.Icons.Information (Icon for general information packages).