Search results

Llama模型转完ONNX之后，输入可以是input_embeds吗

Status: Open.

#30 In tpoisonooo/llama.onnx;

· OswaldoBornemann opened on Sep 10, 2024

Error in converting llama

Status: Open.

#29 In tpoisonooo/llama.onnx;

· purejomo opened on Aug 9, 2024

一种改进next_token计算的方式

Status: Open.

#27 In tpoisonooo/llama.onnx;

· luchangli03 opened on Jul 20, 2023

如何分段转换llama模型为onnx？

Status: Open.

#26 In tpoisonooo/llama.onnx;

· jxcomeon opened on Jul 14, 2023

GPU Inference

Status: Open.

#25 In tpoisonooo/llama.onnx;

· tpoisonooo opened on Jul 6, 2023

cannot import name 'MemoryPoolSimple' from 'public'

Status: Open.

#23 In tpoisonooo/llama.onnx;

· JiangFeng07 opened on Jul 3, 2023

请问如何支持batch的推理？

Status: Open.

#22 In tpoisonooo/llama.onnx;

· VincentJYZhang opened on Jun 25, 2023

onnx模型推理

Status: Open.

#21 In tpoisonooo/llama.onnx;

· KaiyuHu2001 opened on Jun 21, 2023

Could you add torch.onnx.export() in tools/export-onnx.py

Status: Open.

#20 In tpoisonooo/llama.onnx;

· foreveronehundred opened on Jun 19, 2023

7B onnx模型(float16) 占用显存超过32G

Status: Open.

#19 In tpoisonooo/llama.onnx;

· iamhere1 opened on Jun 13, 2023

transfer fp32 to fp16 error

Status: Open.

#18 In tpoisonooo/llama.onnx;

· Ted8000 opened on Jun 13, 2023

Inference with GPU took too much GPU RAM

Status: Open.

#16 In tpoisonooo/llama.onnx;

· DungMinhDao opened on Jun 1, 2023