察元AI教程库 · 文章 · 大模型

真理作为轨迹：内部表示揭示的大语言模型推理机制

Existing explainability methods for Large Language Models (LLMs) typically treat hidden states as static points in activation space, assuming that correct and incorrect inferences can be separated usi…

作者:Hamed Damirchi, Ignacio Meza De la Jara, Ehsan Abbasnejad · 语言:en

前往原址学习

简介

Existing explainability methods for Large Language Models (LLMs) typically treat hidden states as static points in activation space, assuming that correct and incorrect inferences can be separated using representations from an individual layer. However, these activations are saturated with polysemantic features, leading to linear probes learning surface-level lexical patterns rather than underlyin

返回教程库 · 察元AI产品家族