RealFeedApp Group-level reward reduces counterfactual bias
The study demonstrates that standard alignment techniques like reinforcement learning increase response quality differences across demographics, thereby amplifying counterfactual bias. The authors propose a policy gradient technique using a group-level reward function to address this issue.
#language model#alignment#counterfactual invariance#demographics#bias#policy gradient
