Skip to content

fixed the logit lens implementation inside ActivationCache.accumulated_resid to match the standard definition in literature and the expected and defined behavior as per the documentation in the docstring and in the docs#1077

Open
hartigel wants to merge 3 commits intoTransformerLensOrg:mainfrom
hartigel:fix-logit-lens-implementation