will brown @willccbb

doing RL *literally* in production doesn’t really work outside of narrow settings like RLHF but the right way to do continual RL *is* exactly this semi-synthetic task loop, which you can do on-the-fly by mining tasks from traces + evolving high-fidelity sims from observations