Skip to content

Commit 548d4f9

Browse files
committed
remove wip as core logic is there, update readme
1 parent d2b2b5d commit 548d4f9

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

README.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,11 @@
11
<img src="./key-locked-rank-1-editing.png" width="450px"></img>
22

3-
## Perfusion - Pytorch (wip)
3+
## Perfusion - Pytorch
44

55
Implementation of <a href="https://arxiv.org/abs/2305.01644">Key-Locked Rank One Editing</a>. <a href="https://research.nvidia.com/labs/par/Perfusion/">Project page</a>
66

7+
The selling point of this paper is extremely low extra parameters per added concept, down to 100kb.
8+
79
It seems they successfully applied the Rank-1 editing technique from a <a href="https://arxiv.org/abs/2202.05262">memory editing paper for LLM</a>, with a few improvements. They also identified that the keys determine the "where" of the new concept, while the values determine the "what", and propose local / global-key locking to a superclass concept (while learning the values).
810

911
## Appreciation

0 commit comments

Comments
 (0)