Skip to content

Commit b1fdfae

Browse files
authored
readme
1 parent c082d15 commit b1fdfae

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44

55
Implementation of <a href="https://arxiv.org/abs/2305.01644">Key-Locked Rank One Editing</a>. <a href="https://research.nvidia.com/labs/par/Perfusion/">Project page</a>
66

7-
Thought the work may be overhyped at first, but upon reading the paper, it seems they successfully built upon a (I think) crucial <a href="https://arxiv.org/abs/2202.05262">memory editing paper</a> (<a href="https://www.youtube.com/watch?v=_NMQyOu2HTo">Yannic Kilcher interview with authors</a>)! This will be a boon for all types of attention networks.
7+
It seems they successfully applied the Rank-1 editing technique from a <a href="https://arxiv.org/abs/2202.05262">memory editing paper for LLM</a>, with a few improvements. They also identified that the keys determine the "where" of the new concept, while the values determine the "what", and propose local / global-key locking to a superclass concept (while learning the values).
88

99
## Citations
1010

0 commit comments

Comments
 (0)