Skip to content

Commit d2b2b5d

Browse files
authored
note to future self
1 parent ad968a9 commit d2b2b5d

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -78,10 +78,10 @@ values = wrapped_to_values(
7878

7979
## Todo
8080

81-
- [] handle rank-1 update for multiple concepts
81+
- [ ] handle rank-1 update for multiple concepts
8282
- [x] handle training with multiple concepts
8383
- [ ] handle multiple concepts in one prompt at inference - summation of the sigmoid term + outputs
84-
84+
- [ ] offer a magic function that automatically tries to wire up the cross attention by looking for appropriately named `nn.Linear` and auto-inferring which ones are keys or values
8585
- [x] take care of the function that takes in the dataset and text encoder and precomputes the covariance matrix needed for the rank-1 update
8686
- [x] instead of having the researcher worry about different learning rates, offer the fractional gradient trick from other paper (to learn the concept embedding)
8787

0 commit comments

Comments
 (0)