You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
fix: add @ModuleInfo to BertModel.pooler and NomicBertModel.pooler
These Linear? properties are replaced by QuantizedLinear during
quantization via Module.update(modules:). Without @ModuleInfo,
the non-throwing update(modules:) wrapper hits try! on the thrown
needModuleInfo error, causing SIGABRT when loading quantized
embedding models.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
0 commit comments