Skip to content

Hardware requirements for training and development Β #2617

@pipoupiwam

Description

@pipoupiwam

Hi everybody!
First of all thank you for your amazing work, I discovered Open Assistant yesterday on youtube, and am very impressed !

I would like to experiment with Open Assistant on my local setup, i browsed the repository and issues for hardware requirements ( VRAM ).

What are the VRAM requirements for running the model ?
Would a 4090 be sufficient ( 24 GB ) ?

I would like to experiment by training the model on custom datasets, is it possible with a 4090 ? If not, what would be the hardware requirements ?

Thank you and have a nice day !

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions