-
Q-Learning with Scalar Adjoint Matching: Cheaper Off-Policy RL for Flow Policies
A closed-form scalar adjoint removes the per-step vector–Jacobian products of adjoint matching, and a value penalty at the policy's own actions makes it work.
-
Trust Region Q Adjoint Matching: Stable Off-Policy RL for Flow Policies
A new stable off-policy fine-tuning algorithm for pretrained flow-based policies, combining trust-region principles with stochastic optimal control.