Mandatory: Sim testing

[JiriHrdina]

OK folks,
I've posted a folder on the CPHL site for you to each download and see the results of the sim testing.
I've tested 5 different scenarios and for each scenario I've simmed 10 seasons.

Within the folder you'll find a folder for each scenario, and then 10 folders underneath with each of those seasons.

Within those folders there are a bunch of files - with the most important ones being the standings, and scoring leaders.

Each GM must review these results (or as much of the results as you want) and then tell us which scenarios they prefer.

The folders can be downloaded here
cphl.calgarypuck.com/download/Coach.zip

Ignore the fact that name of the zip file is Coach - that was just the easiest way to get the files on the FTP site.

I've set up a quick survey to capture your feedback:
http://www.surveymonkey.com/s/H32TXH8

This is mandatory as it represents a very important decision for this league going forward.

I have my own thoughts on each scenario including what I've observed but I'll hold off sharing those until after the survey results are in.

Questions?

Let's set next Friday for a deadline excluding any GMs that are away.

[devo22]

thanks for doing this! Lots to discover here, will take some time to really evaluate it properly ... will try to do it this weekend.

[JiriHrdina]

BTW Injuries and CON were turned off for all tests. Since I was simming full seasons in one go - the sim would stop halfway when a team had too many injuries to fill a roster.

[Da_Chief]

So far not so random as far as where the Isles finish.

[TurdFerguson]

Have not looked yet, but how many league championships for the Stars? 7...8?

[Swayze11]

Originally Posted by TurdFerguson

Have not looked yet, but how many league championships for the Stars? 7...8?

We don't sim the AHL anymore, remember?

[Caged Great]

some of them have a lot of variation in the tests. One of them had me finishing dead last in one run through and winning the division in the next under the same conditions. That kind of randomness is probably not good. I ranked them all in terms of consistency of results based off of where teams should finish based off their rosters and how random the results were..

[Daradon]

Wow! Nice job, much thanks.

I'll get on it on Sun and Mon.

[Flickered Flame]

Just a question, how many settings did you adjust/change in each of the 5 different scenarios? And if you only changed one setting at a time, did you change it back to whatever it was before running to next scenario?

[JiriHrdina]

Each scenario represents combinations of key settings and the sim was reloaded from the start for each test

[mbeauchamp76]

As far as standings go here is the average point totals over 10 seasons per scenario for the Eastern Conference. Will hopefully get to the Western Conference soon. I found that there was more variation between the seasons within the scenario than between the scenarios themselves (taking into account the average). Some teams had as high as 40 point variations between seasons within the same scenario and like Matt said finishing anywhere from 1st to last in their division. Things average out somewhat over many seasons. Again there is a ton of factors remaining constant and no one will ever know how much that effects the overall results. Nonetheless this is a very interesting exercise. NYI finished 1st in the East 39 out of 50 tests and finished below 4th once.

[mbeauchamp76]

If you guys would like to see more of this let me know and I will be glad to post all scenarios for both conferences

[silentsim]

Originally Posted by mbeauchamp76

If you guys would like to see more of this let me know and I will be glad to post all scenarios for both conferences

Please do for West very interesting to see this

[mbeauchamp76]

Should have everything up tonight

[mbeauchamp76]

[mbeauchamp76]

[mbeauchamp76]

[mbeauchamp76]

[mbeauchamp76]

[mbeauchamp76]