Models are safetensor but this cannot run safetensor models.

[Delcos]

Safetensors don't support transformers, nor the tokenizer or the CausalLM which are used.

[harubaru]

Have you installed the safetensors dependency?

[Delcos]

Yeah, the script can't use from transformers, it needs to use safetensor instead. Or it could check for safetensor models and if non are found default to pytorch models, but as of now when running it gives an error about not finding any models.

[Delcos]

Yeah, the script can't use from transformers, it needs to use safetensor instead. Or it could check for safetensor models and if non are found default to pytorch models, but as of now when running it gives an error about not finding any models.

The model itself is really interesting though, I know it's not the main focus but a simple model card on Huggingface would be good too. To know what training data was used.

[harubaru]

model card will be written when i finish training the base models