Setting cross_attn_{i+1}_d{1} but not cross_attn_{i+1}_d{j} on purpose or typo in id_module.py? #25
Description
Dear author,
When I dig deeper into the code, I found this rather confusing. The iterature seems to repeated create d{1} rather than d{j}. Would like to confirm is this setup on purpose or a typo?