察元AI教程库 · 文章 · 微调

一种基于自监督强化学习的大型语言模型微调方法,利用交叉注意力信号

We propose a novel reinforcement learning framework for post training large language models that does not rely on human in the loop feedback. Instead, our approach uses cross attention signals within …

作者:Andrew Kiruluta, Andreas Lemos, Priscilla Burity · 语言:en

前往原址学习

简介

We propose a novel reinforcement learning framework for post training large language models that does not rely on human in the loop feedback. Instead, our approach uses cross attention signals within the model itself to derive a self supervised reward, thereby guiding iterative fine tuning of the model policy. By analyzing how the model attends to the input prompt during generation, we construct m

返回教程库 · 察元AI产品家族