Thompson sampling

Gradient-less counterfactuals.