Benchmarking Results Discussion

[reedrosenbluth]

Let's use this discussion to talk about the results of the benchmarking suite.

The latest benchmarking results can be viewed here.

Open Questions:

1. "Linear" functions exhibiting quadratic behavior
   a. cost_analysis_type_check, cost_analysis_iterable_func, cost_trait_checker, cost_type_checker
2. Why does line of fit for cost_read_only appear above data points?
3. How should we deal with functions like cost_create_map where the data seems to be all over the place?
   a. this is caused by io?
4. Is it surprising that cost_load_contract is so linear, and fit so well?