Skip to content

[Bug]: AutoDeploy: nano3 TP8 accuracy degradation #8953

@lucaslie

Description

@lucaslie

Investigate and fix TP=8 GSM8K accuracy issue for nano3 model, see #8744 and #8744 (comment)

Metadata

Metadata

Labels

AutoDeploy<NV> AutoDeploy BackendbugSomething isn't working

Type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions