Validating the Simulation
Simulation Advantage: It can run hundreds of tests simulating millions of seconds per strategy per day.
Simulation Drawback: It is not a real system.
Solution: Run a smaller number of tests on a real computing cluster to verify simulation results.
Notes:
We ran 50 tests on the computing cluster, testing three different strategies. Remember, each scenario runs for at least 10,000 seconds; sometimes they run considerably longer. On a real system, those are real seconds. These tests took several months.
Running 1,000 such tests is impractical. We used the real system results primarily to demonstrate that the simulation results were accurate. They did so.