You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
#### Motivation
Fixing an internal issue where
`ml6team/keyphrase-generation-t5-small-inspec` and the `t5-small` models
were failing due to `RuntimeError: weight lm_head.weight does not exist`
error.
#### Modifications
We added the `lm_head.weight` alias to the list of known aliases for
`t5` type models. (It was discovered within the `metadata` of the tensor
file during inspection)
```
"lm_head.weight":["decoder.embed_tokens.weight"]
```
#### Result
Now we're able to launch `t5` based
`ml6team/keyphrase-generation-t5-small-inspec` and `t5-small` models
using `tgis_native`!
```
DEPLOYMENT_FRAMEWORK=tgis_native MODEL_NAME=ml6team/keyphrase-generation-t5-small-inspec text-generation-launcher
```
---------
Signed-off-by: Prashant Gupta <[email protected]>
Signed-off-by: Joe Runde <[email protected]>
Co-authored-by: Joe Runde <[email protected]>
0 commit comments