Skip to content

Commit 4a65cf6

Browse files
Add WARNING messages explanation.
1 parent 47a730d commit 4a65cf6

File tree

8 files changed

+88
-11
lines changed

8 files changed

+88
-11
lines changed

docs/_sources/guidelines/XQuant_Extension_Tool.rst.txt

Lines changed: 23 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -81,7 +81,7 @@ To be more specific, execute the following steps:
8181
8282
.. note::
8383

84-
If log of *mct.set_log_folder* does not exist, the *Unbalanced Concatnation* described below will not be executed.
84+
If log of *mct.set_log_folder* does not exist, the *Unbalanced Concatenation* described below will not be executed.
8585

8686
XQuantConfig Format and Examples
8787
======================================
@@ -158,14 +158,34 @@ Understanding the Judgeable Troubleshoots
158158
=======================================================
159159

160160
The following items are automatically identified by the XQuant Extension Tool.
161-
162-
Please refer to the respective Troubleshooting Manuals for details.
161+
When this tool detects these issues, corresponding WARNING messages are displayed in your console.
162+
Please refer to the respective Troubleshooting Manuals and change the configuration as needed.
163163

164164
* `Outlier Removal <https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/outlier_removal.html#ug-outlier-removal>`_
165+
166+
::
167+
168+
WARNING:Model Compression Toolkit:There are output values that deviate significantly from the average. Refer to the following images and the TroubleShooting Documentation (MCT XQuant Extension Tool) of 'Outlier Removal'.
169+
170+
165171
* `Shift Negative Activation <https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/shift_negative_activation.html#ug-shift-negative-activation>`_
172+
173+
::
174+
175+
WARNING:Model Compression Toolkit:There are activations that contain negative values. Refer to the troubleshooting manual of "Shift Negative Activation".
176+
166177
* `Unbalanced "concatenation" <https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/unbalanced_concatenation.html#ug-unbalanced-concatenation>`_
178+
179+
::
180+
181+
WARNING:Model Compression Toolkit:There are unbalanced range layers concatnated. Refer to the troubleshooting manual of 'Unbalanced "concatenation"'.
182+
167183
* `Mixed Precision with model output loss objective <https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/mixed_precision_with_model_output_loss_objective.html#ug-mixed-precision-with-model-output-loss-objective>`_
168184

185+
::
186+
187+
WARNING:Model Compression Toolkit:the quantization bitwidth of the last layer is an extremely small number. Refer to the troubleshooting manual of 'Mixed Precision with model output loss objective'.
188+
169189
Understanding the General Troubleshoots
170190
============================================
171191

docs/docs_troubleshoot/_sources/troubleshoots/unbalanced_concatenation.rst.txt

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -46,3 +46,9 @@ When you discover the concatenation layers with inputs that have notably differe
4646

4747

4848
2. Add a scaling operation between problematic "concatenation" layers in your float model.
49+
50+
When the Unbalanced "concatenation" layers detected, the following formula message will be displayed.
51+
You can add the displayed scaling operation between the layers to your network.
52+
53+
::
54+
WARNING:Model Compression Toolkit:first layer:features.15.conv.2, second layer:features.15.conv.3, if you add a scaling operation, recommended scaling:first layer * 5.758747418625537

docs/docs_troubleshoot/searchindex.js

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

docs/docs_troubleshoot/troubleshoots/unbalanced_concatenation.html

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -79,6 +79,12 @@ <h2>Solution<a class="headerlink" href="#solution" title="Link to this heading">
7979
<ol class="arabic simple" start="2">
8080
<li><p>Add a scaling operation between problematic “concatenation” layers in your float model.</p></li>
8181
</ol>
82+
<p>When the Unbalanced “concatenation” layers detected, the following formula message will be displayed.
83+
You can add the displayed scaling operation between the layers to your network.</p>
84+
<dl class="simple">
85+
<dt>::</dt><dd><p>WARNING:Model Compression Toolkit:first layer:features.15.conv.2, second layer:features.15.conv.3, if you add a scaling operation, recommended scaling:first layer * 5.758747418625537</p>
86+
</dd>
87+
</dl>
8288
</section>
8389
</section>
8490

docs/guidelines/XQuant_Extension_Tool.html

Lines changed: 22 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -123,7 +123,7 @@ <h2>How to Run<a class="headerlink" href="#how-to-run" title="Link to this headi
123123
</div>
124124
<div class="admonition note">
125125
<p class="admonition-title">Note</p>
126-
<p>If log of <em>mct.set_log_folder</em> does not exist, the <em>Unbalanced Concatnation</em> described below will not be executed.</p>
126+
<p>If log of <em>mct.set_log_folder</em> does not exist, the <em>Unbalanced Concatenation</em> described below will not be executed.</p>
127127
</div>
128128
</section>
129129
<section id="xquantconfig-format-and-examples">
@@ -202,14 +202,33 @@ <h2>Understanding the Quantization Error Graph<a class="headerlink" href="#under
202202
</section>
203203
<section id="understanding-the-judgeable-troubleshoots">
204204
<h2>Understanding the Judgeable Troubleshoots<a class="headerlink" href="#understanding-the-judgeable-troubleshoots" title="Link to this heading"></a></h2>
205-
<p>The following items are automatically identified by the XQuant Extension Tool.</p>
206-
<p>Please refer to the respective Troubleshooting Manuals for details.</p>
205+
<p>The following items are automatically identified by the XQuant Extension Tool.
206+
When this tool detects these issues, corresponding WARNING messages are displayed in your console.
207+
Please refer to the respective Troubleshooting Manuals and change the configuration as needed.</p>
207208
<ul class="simple">
208209
<li><p><a class="reference external" href="https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/outlier_removal.html#ug-outlier-removal">Outlier Removal</a></p></li>
210+
</ul>
211+
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">WARNING</span><span class="p">:</span><span class="n">Model</span> <span class="n">Compression</span> <span class="n">Toolkit</span><span class="p">:</span><span class="n">There</span> <span class="n">are</span> <span class="n">output</span> <span class="n">values</span> <span class="n">that</span> <span class="n">deviate</span> <span class="n">significantly</span> <span class="kn">from</span><span class="w"> </span><span class="nn">the</span> <span class="n">average</span><span class="o">.</span> <span class="n">Refer</span> <span class="n">to</span> <span class="n">the</span> <span class="n">following</span> <span class="n">images</span> <span class="ow">and</span> <span class="n">the</span> <span class="n">TroubleShooting</span> <span class="n">Documentation</span> <span class="p">(</span><span class="n">MCT</span> <span class="n">XQuant</span> <span class="n">Extension</span> <span class="n">Tool</span><span class="p">)</span> <span class="n">of</span> <span class="s1">&#39;Outlier Removal&#39;</span><span class="o">.</span>
212+
</pre></div>
213+
</div>
214+
<ul class="simple">
209215
<li><p><a class="reference external" href="https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/shift_negative_activation.html#ug-shift-negative-activation">Shift Negative Activation</a></p></li>
216+
</ul>
217+
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">WARNING</span><span class="p">:</span><span class="n">Model</span> <span class="n">Compression</span> <span class="n">Toolkit</span><span class="p">:</span><span class="n">There</span> <span class="n">are</span> <span class="n">activations</span> <span class="n">that</span> <span class="n">contain</span> <span class="n">negative</span> <span class="n">values</span><span class="o">.</span> <span class="n">Refer</span> <span class="n">to</span> <span class="n">the</span> <span class="n">troubleshooting</span> <span class="n">manual</span> <span class="n">of</span> <span class="s2">&quot;Shift Negative Activation&quot;</span><span class="o">.</span>
218+
</pre></div>
219+
</div>
220+
<ul class="simple">
210221
<li><p><a class="reference external" href="https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/unbalanced_concatenation.html#ug-unbalanced-concatenation">Unbalanced “concatenation”</a></p></li>
222+
</ul>
223+
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">WARNING</span><span class="p">:</span><span class="n">Model</span> <span class="n">Compression</span> <span class="n">Toolkit</span><span class="p">:</span><span class="n">There</span> <span class="n">are</span> <span class="n">unbalanced</span> <span class="nb">range</span> <span class="n">layers</span> <span class="n">concatnated</span><span class="o">.</span> <span class="n">Refer</span> <span class="n">to</span> <span class="n">the</span> <span class="n">troubleshooting</span> <span class="n">manual</span> <span class="n">of</span> <span class="s1">&#39;Unbalanced &quot;concatenation&quot;&#39;</span><span class="o">.</span>
224+
</pre></div>
225+
</div>
226+
<ul class="simple">
211227
<li><p><a class="reference external" href="https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/mixed_precision_with_model_output_loss_objective.html#ug-mixed-precision-with-model-output-loss-objective">Mixed Precision with model output loss objective</a></p></li>
212228
</ul>
229+
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">WARNING</span><span class="p">:</span><span class="n">Model</span> <span class="n">Compression</span> <span class="n">Toolkit</span><span class="p">:</span><span class="n">the</span> <span class="n">quantization</span> <span class="n">bitwidth</span> <span class="n">of</span> <span class="n">the</span> <span class="n">last</span> <span class="n">layer</span> <span class="ow">is</span> <span class="n">an</span> <span class="n">extremely</span> <span class="n">small</span> <span class="n">number</span><span class="o">.</span> <span class="n">Refer</span> <span class="n">to</span> <span class="n">the</span> <span class="n">troubleshooting</span> <span class="n">manual</span> <span class="n">of</span> <span class="s1">&#39;Mixed Precision with model output loss objective&#39;</span><span class="o">.</span>
230+
</pre></div>
231+
</div>
213232
</section>
214233
<section id="understanding-the-general-troubleshoots">
215234
<h2>Understanding the General Troubleshoots<a class="headerlink" href="#understanding-the-general-troubleshoots" title="Link to this heading"></a></h2>

docs/searchindex.js

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

docsrc/source/guidelines/XQuant_Extension_Tool.rst

Lines changed: 23 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -81,7 +81,7 @@ To be more specific, execute the following steps:
8181
8282
.. note::
8383

84-
If log of *mct.set_log_folder* does not exist, the *Unbalanced Concatnation* described below will not be executed.
84+
If log of *mct.set_log_folder* does not exist, the *Unbalanced Concatenation* described below will not be executed.
8585

8686
XQuantConfig Format and Examples
8787
======================================
@@ -158,14 +158,34 @@ Understanding the Judgeable Troubleshoots
158158
=======================================================
159159

160160
The following items are automatically identified by the XQuant Extension Tool.
161-
162-
Please refer to the respective Troubleshooting Manuals for details.
161+
When this tool detects these issues, corresponding WARNING messages are displayed in your console.
162+
Please refer to the respective Troubleshooting Manuals and change the configuration as needed.
163163

164164
* `Outlier Removal <https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/outlier_removal.html#ug-outlier-removal>`_
165+
166+
::
167+
168+
WARNING:Model Compression Toolkit:There are output values that deviate significantly from the average. Refer to the following images and the TroubleShooting Documentation (MCT XQuant Extension Tool) of 'Outlier Removal'.
169+
170+
165171
* `Shift Negative Activation <https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/shift_negative_activation.html#ug-shift-negative-activation>`_
172+
173+
::
174+
175+
WARNING:Model Compression Toolkit:There are activations that contain negative values. Refer to the troubleshooting manual of "Shift Negative Activation".
176+
166177
* `Unbalanced "concatenation" <https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/unbalanced_concatenation.html#ug-unbalanced-concatenation>`_
178+
179+
::
180+
181+
WARNING:Model Compression Toolkit:There are unbalanced range layers concatnated. Refer to the troubleshooting manual of 'Unbalanced "concatenation"'.
182+
167183
* `Mixed Precision with model output loss objective <https://sonysemiconductorsolutions.github.io/mct-model-optimization/docs_troubleshoot/troubleshoots/mixed_precision_with_model_output_loss_objective.html#ug-mixed-precision-with-model-output-loss-objective>`_
168184

185+
::
186+
187+
WARNING:Model Compression Toolkit:the quantization bitwidth of the last layer is an extremely small number. Refer to the troubleshooting manual of 'Mixed Precision with model output loss objective'.
188+
169189
Understanding the General Troubleshoots
170190
============================================
171191

docsrc/source_troubleshoot/troubleshoots/unbalanced_concatenation.rst

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -46,3 +46,9 @@ When you discover the concatenation layers with inputs that have notably differe
4646

4747

4848
2. Add a scaling operation between problematic "concatenation" layers in your float model.
49+
50+
When the Unbalanced "concatenation" layers detected, the following formula message will be displayed.
51+
You can add the displayed scaling operation between the layers to your network.
52+
53+
::
54+
WARNING:Model Compression Toolkit:first layer:features.15.conv.2, second layer:features.15.conv.3, if you add a scaling operation, recommended scaling:first layer * 5.758747418625537

0 commit comments

Comments
 (0)