Abstract
We consider the problem of comparing algorithms on real-world data. This raises several challenges which include how to model the problem at an appropriate level, and how to compare algorithms on not just the data sets at hand, but also anticipated (larger) future data sets. We will use two examples -- scheduling jobs on google datacenters and scheduling a weapons maintenance and decommissioning facility.