For our forthcoming paper at the IEEE Symposium on Visual Languages and Human-Centric Computing I built a visualization for testing and debugging optimization simulators and algorithms.
The visualization is built on d3js and runs in the web browser. If you visit mdpvis.github.io you can interact with a wildfire suppression policy domain. If you have your own MDP domain, you can plug in a MDP simulator URL accessible to your local computer and MDPvis will fetch Monte Carlo rollouts.
Please contact me if you want your MDP simulator or optimizer listed on the visualization!