RETD

Regularized Emphatic Temporal Difference learning is an improved variant of ETD. It stabilizes ETD's sampling dynamics under constant step-size settings through a normalized post-shock repair mechanism and a leaky scalar state storage signal, while keeping follow-on traces and importance ratios unchanged to avoid introducing additional bias.