Add support for DPPO [WIP]#5065

catherinelee274 wants to merge 3 commits intohuggingface:mainhuggingface/trl:mainfrom

catherinelee274:clee_dppocatherinelee274/trl:clee_dppoCopy head branch name to clipboard