GPT-OSS Running Live on reComputer Jetson! | Seeed Studio Wiki

[giscus[bot]]

GPT-OSS Running Live on reComputer Jetson! | Seeed Studio Wiki

This wiki demonstrates how to deploy the open-source GPT-OSS-20B large language model on an NVIDIA Jetson Orin NX using llama.cpp, showcasing edge AI capabilities. It provides step-by-step instructions for installation, model conversion, quantization, and running inference with optional web UI integration.

https://wiki.seeedstudio.com/deploy_gptoss_on_jetson/?goal=0_4b071a49e3-70de60eb1c-49503149&mc_cid=70de60eb1c&mc_eid=929cbb17d4

[jefflarkin]

Step 3 does not work for me. First it errors that the mistral_common module isn't installed and then, after pip installing it manually, it errors that there is no config.json in the destination folder.

[nfs0619]

Thank you for your feedback. We have received your message and are currently arranging for debugging. If you do not receive further updates, please feel free to reach out to our technical support at [email protected] for further assistance. Thank you for your support and understanding.

[ReKST-117]

Hi, may I confirm which device did you used? And could you please take a screenshot of the error raised?