Evaluating different levels of information on the calibration of building energy simulation models

A poorly calibrated model undermines confidence in the effectiveness of building energy simulation, impeding the widespread application of advanced energy conservation measures (ECMs). Striking a balance between information-gathering efforts and achieving sufficient model credibility is crucial but often obscured by ambiguities. To address this gap, we model and calibrate a test bed with different levels of information (LOI). Beginning with an initial model based on building geometry (LOI 1), we progressively introduce additional information, including nameplate information (LOI 2), envelope conductivity (LOI 3), zone infiltration rate (LOI 4), AHU fan power (LOI 5), and HVAC data (LOI 6). The models are evaluated for accuracy, consistency, and the robustness of their predictions. Our results indicate that adding more information for calibration leads to improved data fit. However, this improvement is not uniform across all observed outputs due to identifiability issues. Furthermore, for energy-saving analysis, adding more information can significantly affect the projected energy savings by up to two times. Nevertheless, for ECM ranking, models that did not meet ASHRAE 14 accuracy thresholds can yield correct retrofit decisions. These findings underscore equifinality in modeling complex building systems. Clearly, predictive accuracy is not synonymous with model credibility. Therefore, to balance efforts in information-gathering and model reliability, it is crucial to (1) determine the minimum level of information required for calibration compatible with its intended purpose and (2) calibrate models with information closely linked to all outputs of interest, particularly when simultaneous accuracy for multiple outputs is necessary.