openvinotoolkit nncf Q A · Discussions · GitHub

Sort by: Latest activity

Q&A Discussions

Ask the community for help

You must be logged in to vote

How to use NNCF to perform unsigned asymmetric quantization?

huangqiu15444 asked Feb 21, 2025 in Q&A · Unanswered

8
You must be logged in to vote

[Quantization] Int8 Dynamic Quantization for LLM

yang-ahuan asked Feb 26, 2025 in Q&A · Unanswered

1
You must be logged in to vote

NNCF Module not detected

JohnMartynSmith asked Feb 20, 2025 in Q&A · Answered

1
You must be logged in to vote

No compression_loss needed for QAT?

EmonLu asked Oct 18, 2024 in Q&A · Answered

1
You must be logged in to vote

In QAT (Quantization-Aware Training), why does the model fail to converge if a pre-trained model is not loaded?

huangqiu15444 asked Sep 14, 2024 in Q&A · Unanswered

1
You must be logged in to vote

some errors for yolov8

meaquanana asked May 4, 2024 in Q&A · Unanswered

6
You must be logged in to vote

version 2.12.0 release

earth-chris asked Jul 16, 2024 in Q&A · Answered

2
You must be logged in to vote

Inference issue with Quantized yolov8 OpenVINO model

chandra-ps612 asked Jul 30, 2024 in Q&A · Unanswered

0
You must be logged in to vote

how to convert yoloNAS model to int8?

MinGiSa asked Mar 25, 2024 in Q&A · Closed · Answered

5
You must be logged in to vote

How should I modify the model ?

jzdcf asked Jul 9, 2024 in Q&A · Unanswered

1
You must be logged in to vote

Dataset calibration for Custom data on Yolov8 instance segmentation

Priyanshu88 asked Jun 19, 2024 in Q&A · Unanswered

16
You must be logged in to vote

NNCF could not compile GPU quantizaiton extensions

siyhust asked May 30, 2024 in Q&A · Closed · Unanswered

4
You must be logged in to vote

Quantizing with accuracy control for CNN autoencoder models

korotaS asked Apr 17, 2024 in Q&A · Answered

2
You must be logged in to vote

How to choose the quantization method

camhpj asked Mar 21, 2024 in Q&A · Answered

2
You must be logged in to vote

RuntimeError: Could not infer the backend framework from the model type when used with stable diffusion.

ranjithum asked Dec 27, 2023 in Q&A · Unanswered

3
You must be logged in to vote

how to do a PTQ with Fast R-CNN?

MinGiSa asked Mar 5, 2024 in Q&A · Closed · Answered

3
You must be logged in to vote

Use NNCF in transformers + optimum-intel ?

tigerinus asked Dec 8, 2023 in Q&A · Unanswered

3
You must be logged in to vote

Regarding the quantization matmul operator and softmax operator in PyTorch

xiexiaozheng asked Nov 6, 2023 in Q&A · Unanswered

2
You must be logged in to vote

QAT for YOLOv8

YaKalmar0 asked Sep 28, 2023 in Q&A · Unanswered

2
You must be logged in to vote

Statistics collection stuck under 50% complete but the bias correction success in 100%

Zakihran13 asked Jul 2, 2023 in Q&A · Unanswered

3
You must be logged in to vote

How to prepare the dataset for nncf?

jeck00119 asked Jul 27, 2023 in Q&A · Unanswered

1
You must be logged in to vote

default_collate error while trying to quantize my pytorch model

CostatoMarco asked Jun 18, 2023 in Q&A · Answered

4
You must be logged in to vote

Quantized weights filesize

lucala asked May 11, 2023 in Q&A · Unanswered

4
You must be logged in to vote

How to add FakeQuantize Node in graph

shjiyang-intel asked Apr 14, 2023 in Q&A · Unanswered

2
You must be logged in to vote

How to print/display/show integer quantized weights?

V0XNIHILI asked Mar 17, 2023 in Q&A · Answered

4