察元AI教程库 · 文章 · 微调

关于预训练和微调语言模型中大规模话语结构的理解

With a growing number of BERTology work analyzing different components of pre-trained language models, we extend this line of research through an in-depth analysis of discourse information in pre-trai…

作者:Patrick Huber, Giuseppe Carenini · 语言:en

前往原址学习

简介

With a growing number of BERTology work analyzing different components of pre-trained language models, we extend this line of research through an in-depth analysis of discourse information in pre-trained and fine-tuned language models. We move beyond prior work along three dimensions: First, we describe a novel approach to infer discourse structures from arbitrarily long documents. Second, we prop

返回教程库 · 察元AI产品家族