You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -78,10 +78,10 @@ values = wrapped_to_values(
78
78
79
79
## Todo
80
80
81
-
-[] handle rank-1 update for multiple concepts
81
+
-[] handle rank-1 update for multiple concepts
82
82
-[x] handle training with multiple concepts
83
83
-[ ] handle multiple concepts in one prompt at inference - summation of the sigmoid term + outputs
84
-
84
+
-[ ] offer a magic function that automatically tries to wire up the cross attention by looking for appropriately named `nn.Linear` and auto-inferring which ones are keys or values
85
85
-[x] take care of the function that takes in the dataset and text encoder and precomputes the covariance matrix needed for the rank-1 update
86
86
-[x] instead of having the researcher worry about different learning rates, offer the fractional gradient trick from other paper (to learn the concept embedding)
0 commit comments