Techniques of Increasing Model Validity and Credibility
Techniques of Increasing Model Validity and Credibility
i. Make use of all existing information through conversations with subject matter,
observations of the system, existing theory, relevant results from similar simulation
studies and modeler’s experience and intuition.
ii. Interacting with manager on a regular basis as it is essential to maintain manager’s
interest and involvement as well as continued focus on the nature of the problem.
iii. Maintain a written assumption document by performing a structured walk-through of the
document with both SMEs and managers as well as correcting the missing or invalid
assumptions.
iv. Use of qualitative techniques to validate model components through performing a
sensitivity analysis to determine which factor significantly impact performance.
v. Validate output from the overall simulation model through:
Comparison with expert opinion. The model faces validity if consistent with perceived system
behavior
Comparison with an existing system by use of turning test where a human judge is involved in
natural language conversation with a human and a machine and if the judge cannot reliably tell
which of the partner the machine is then the machine has passed the test. Calibration of the
model is applicable where by parameters are tweaked until model output agree with system
output and by using one dataset for calibration and another independent data set for validation.
Statistical procedures can as well be used.
TECHNIQUES OF DEBUGGING
Trace-based debugging.
Code file Insert breakpoints Run separate slices Locate error Fix error
Spectrum-based debugging
Delta debugging
The process of delta debugging is to minimize automated test cases. It takes test cases that may
cause the error and prepares an error report. From that error report, minimal test cases are selected
based on their high probability of producing the error. The minimum test cases will regenerate the
same error and thus help the developer locate the bug behind it.
Test cases with possible error Code file Execute Error report