-
Notifications
You must be signed in to change notification settings - Fork 79
Expand file tree
/
Copy pathPruningConfig.html
More file actions
180 lines (165 loc) · 11.6 KB
/
PruningConfig.html
File metadata and controls
180 lines (165 loc) · 11.6 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
<!DOCTYPE html>
<html lang="en" data-content_root="../../../">
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" /><meta name="viewport" content="width=device-width, initial-scale=1" />
<title>Pruning Configuration — MCT Documentation: ver 2.6.0</title>
<link rel="stylesheet" type="text/css" href="../../../static/pygments.css?v=03e43079" />
<link rel="stylesheet" type="text/css" href="../../../static/bizstyle.css?v=5283bb3d" />
<link rel="stylesheet" type="text/css" href="../../../static/css/custom.css?v=01243f34" />
<script src="../../../static/documentation_options.js?v=ae39cb24"></script>
<script src="../../../static/doctools.js?v=9bcbadda"></script>
<script src="../../../static/sphinx_highlight.js?v=dc90522c"></script>
<script src="../../../static/bizstyle.js"></script>
<link rel="index" title="Index" href="../../../genindex.html" />
<link rel="search" title="Search" href="../../../search.html" />
<meta name="viewport" content="width=device-width,initial-scale=1.0" />
<!--[if lt IE 9]>
<script src="static/css3-mediaqueries.js"></script>
<![endif]-->
</head><body>
<div class="related" role="navigation" aria-label="Related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="../../../genindex.html" title="General Index"
accesskey="I">index</a></li>
<li class="nav-item nav-item-0"><a href="../../../index.html">MCT Documentation: ver 2.6.0</a> »</li>
<li class="nav-item nav-item-this"><a href="">Pruning Configuration</a></li>
</ul>
</div>
<div class="document">
<div class="documentwrapper">
<div class="bodywrapper">
<div class="body" role="main">
<section id="pruning-configuration">
<span id="ug-pruningconfig"></span><h1>Pruning Configuration<a class="headerlink" href="#pruning-configuration" title="Link to this heading">¶</a></h1>
<dl class="py class">
<dt class="sig sig-object py" id="model_compression_toolkit.pruning.PruningConfig">
<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">model_compression_toolkit.pruning.</span></span><span class="sig-name descname"><span class="pre">PruningConfig</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">num_score_approximations</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">PRUNING_NUM_SCORE_APPROXIMATIONS</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">importance_metric</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">ImportanceMetric.LFH</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">channels_filtering_strategy</span></span><span class="o"><span class="pre">=</span></span><span class="default_value"><span class="pre">ChannelsFilteringStrategy.GREEDY</span></span></em><span class="sig-paren">)</span><a class="headerlink" href="#model_compression_toolkit.pruning.PruningConfig" title="Link to this definition">¶</a></dt>
<dd><p>Configuration class for specifying how a neural network should be pruned.</p>
<dl class="py attribute">
<dt class="sig sig-object py" id="model_compression_toolkit.pruning.PruningConfig.num_score_approximations">
<span class="sig-name descname"><span class="pre">num_score_approximations</span></span><a class="headerlink" href="#model_compression_toolkit.pruning.PruningConfig.num_score_approximations" title="Link to this definition">¶</a></dt>
<dd><p>The number of score approximations to perform
when calculating channel importance.</p>
<dl class="field-list simple">
<dt class="field-odd">Type<span class="colon">:</span></dt>
<dd class="field-odd"><p>int</p>
</dd>
</dl>
</dd></dl>
<dl class="py attribute">
<dt class="sig sig-object py" id="model_compression_toolkit.pruning.PruningConfig.importance_metric">
<span class="sig-name descname"><span class="pre">importance_metric</span></span><a class="headerlink" href="#model_compression_toolkit.pruning.PruningConfig.importance_metric" title="Link to this definition">¶</a></dt>
<dd><p>The metric used to calculate channel importance.</p>
<dl class="field-list simple">
<dt class="field-odd">Type<span class="colon">:</span></dt>
<dd class="field-odd"><p><a class="reference internal" href="#model_compression_toolkit.pruning.ImportanceMetric" title="model_compression_toolkit.pruning.ImportanceMetric">ImportanceMetric</a></p>
</dd>
</dl>
</dd></dl>
<dl class="py attribute">
<dt class="sig sig-object py" id="model_compression_toolkit.pruning.PruningConfig.channels_filtering_strategy">
<span class="sig-name descname"><span class="pre">channels_filtering_strategy</span></span><a class="headerlink" href="#model_compression_toolkit.pruning.PruningConfig.channels_filtering_strategy" title="Link to this definition">¶</a></dt>
<dd><p>The strategy used to filter out channels.</p>
<dl class="field-list simple">
<dt class="field-odd">Type<span class="colon">:</span></dt>
<dd class="field-odd"><p><a class="reference internal" href="#model_compression_toolkit.pruning.ChannelsFilteringStrategy" title="model_compression_toolkit.pruning.ChannelsFilteringStrategy">ChannelsFilteringStrategy</a></p>
</dd>
</dl>
</dd></dl>
<p>Initializes a PruningConfig object with default or specified parameters.</p>
<dl class="field-list simple">
<dt class="field-odd">Parameters<span class="colon">:</span></dt>
<dd class="field-odd"><ul class="simple">
<li><p><strong>num_score_approximations</strong> (<em>int</em>) – The number of times to approximate the scoring
for channel importance. Defaults to a predefined
constant value.</p></li>
<li><p><strong>importance_metric</strong> (<a class="reference internal" href="#model_compression_toolkit.pruning.ImportanceMetric" title="model_compression_toolkit.pruning.ImportanceMetric"><em>ImportanceMetric</em></a>) – The method used for calculating the importance
of channels in a network. Defaults to label-free
Hessian (LFH) approximation.</p></li>
<li><p><strong>channels_filtering_strategy</strong> (<a class="reference internal" href="#model_compression_toolkit.pruning.ChannelsFilteringStrategy" title="model_compression_toolkit.pruning.ChannelsFilteringStrategy"><em>ChannelsFilteringStrategy</em></a>) – The strategy for selecting
which channels to prune.
Defaults to a greedy approach.</p></li>
</ul>
</dd>
</dl>
</dd></dl>
<section id="importancemetric">
<h2>ImportanceMetric<a class="headerlink" href="#importancemetric" title="Link to this heading">¶</a></h2>
<dl class="py class">
<dt class="sig sig-object py" id="model_compression_toolkit.pruning.ImportanceMetric">
<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">model_compression_toolkit.pruning.</span></span><span class="sig-name descname"><span class="pre">ImportanceMetric</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">value</span></span></em><span class="sig-paren">)</span><a class="headerlink" href="#model_compression_toolkit.pruning.ImportanceMetric" title="Link to this definition">¶</a></dt>
<dd><p>Enum for specifying the metric used to determine the importance of channels when pruning:</p>
<p>LFH - Label-Free Hessian uses hessian info for measuring each channel’s sensitivity.</p>
</dd></dl>
</section>
<section id="channelsfilteringstrategy">
<h2>ChannelsFilteringStrategy<a class="headerlink" href="#channelsfilteringstrategy" title="Link to this heading">¶</a></h2>
<dl class="py class">
<dt class="sig sig-object py" id="model_compression_toolkit.pruning.ChannelsFilteringStrategy">
<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">model_compression_toolkit.pruning.</span></span><span class="sig-name descname"><span class="pre">ChannelsFilteringStrategy</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">value</span></span></em><span class="sig-paren">)</span><a class="headerlink" href="#model_compression_toolkit.pruning.ChannelsFilteringStrategy" title="Link to this definition">¶</a></dt>
<dd><p>Enum for specifying the strategy used for filtering (pruning) channels:</p>
<p>GREEDY - Prune the least important channel groups up to the allowed resources utilization limit (for now, only weights_memory is considered).</p>
</dd></dl>
</section>
</section>
<div class="clearer"></div>
</div>
</div>
</div>
<div class="sphinxsidebar" role="navigation" aria-label="Main">
<div class="sphinxsidebarwrapper">
<div>
<h3><a href="../../../index.html">Table of Contents</a></h3>
<ul>
<li><a class="reference internal" href="#">Pruning Configuration</a><ul>
<li><a class="reference internal" href="#model_compression_toolkit.pruning.PruningConfig"><code class="docutils literal notranslate"><span class="pre">PruningConfig</span></code></a><ul>
<li><a class="reference internal" href="#model_compression_toolkit.pruning.PruningConfig.num_score_approximations"><code class="docutils literal notranslate"><span class="pre">PruningConfig.num_score_approximations</span></code></a></li>
<li><a class="reference internal" href="#model_compression_toolkit.pruning.PruningConfig.importance_metric"><code class="docutils literal notranslate"><span class="pre">PruningConfig.importance_metric</span></code></a></li>
<li><a class="reference internal" href="#model_compression_toolkit.pruning.PruningConfig.channels_filtering_strategy"><code class="docutils literal notranslate"><span class="pre">PruningConfig.channels_filtering_strategy</span></code></a></li>
</ul>
</li>
<li><a class="reference internal" href="#importancemetric">ImportanceMetric</a><ul>
<li><a class="reference internal" href="#model_compression_toolkit.pruning.ImportanceMetric"><code class="docutils literal notranslate"><span class="pre">ImportanceMetric</span></code></a></li>
</ul>
</li>
<li><a class="reference internal" href="#channelsfilteringstrategy">ChannelsFilteringStrategy</a><ul>
<li><a class="reference internal" href="#model_compression_toolkit.pruning.ChannelsFilteringStrategy"><code class="docutils literal notranslate"><span class="pre">ChannelsFilteringStrategy</span></code></a></li>
</ul>
</li>
</ul>
</li>
</ul>
</div>
<search id="searchbox" style="display: none" role="search">
<h3 id="searchlabel">Quick search</h3>
<div class="searchformwrapper">
<form class="search" action="../../../search.html" method="get">
<input type="text" name="q" aria-labelledby="searchlabel" autocomplete="off" autocorrect="off" autocapitalize="off" spellcheck="false"/>
<input type="submit" value="Go" />
</form>
</div>
</search>
<script>document.getElementById('searchbox').style.display = "block"</script>
</div>
</div>
<div class="clearer"></div>
</div>
<div class="related" role="navigation" aria-label="Related">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="../../../genindex.html" title="General Index"
>index</a></li>
<li class="nav-item nav-item-0"><a href="../../../index.html">MCT Documentation: ver 2.6.0</a> »</li>
<li class="nav-item nav-item-this"><a href="">Pruning Configuration</a></li>
</ul>
</div>
<div class="footer" role="contentinfo">
© Copyright 2022, Sony Semiconductor Solutions.
Created using <a href="https://www.sphinx-doc.org/">Sphinx</a> 8.1.3.
</div>
</body>
</html>