Skip to content

Commit 285266a

Browse files
committed
removing redundant tables
1 parent 3c42e16 commit 285266a

File tree

1 file changed

+2
-46
lines changed

1 file changed

+2
-46
lines changed

doc/documents/Examples_Tutorials/Examples_Tutorials.rst

Lines changed: 2 additions & 46 deletions
Original file line numberDiff line numberDiff line change
@@ -215,26 +215,7 @@ Fractional bits are calculated as container size minus integer bits.
215215
For 8-bit depth of data, this is sufficient, but for 16-bit minor corrections are required. MLI uses 40bit accumulator which provides 9 extra bits for processing up to 512 MAC operations in a row on 16x16 operands. For longer MAC series, keep some bits in the operands unused to guarantee that the result does not saturate in accumulation (for more info see :ref:`quant_acc_bit_depth` ).
216216

217217
Consider a small example not directly related to the CIFAR-10:
218-
219-
.. table:: Integer Bits Derivation Considering Accumulator Restrictions
220-
:widths: auto
221-
222-
+--------------+-------------------------------------+----------------------------------------+--------------------------------------------+
223-
| | **Integer bit Requirements** | **Accumulator Restrictions** | **Integer bit requirements** |
224-
| | **(fx8 operands)** | | **(fx16 operands)** |
225-
| +------------+-------------+----------+--------------+------------+------------+------------+-------------+-----------------+
226-
| | Layer | Layer | Layer | Macs per | Required | not enough | Layer | Layer | Layer |
227-
| | input bits | weight bits | out bits | output value | extra bits | bits | input bits | weight bits | out bits |
228-
| | | | | | | | (updated) | (updated) | (updated) |
229-
+==============+============+=============+==========+==============+============+============+============+=============+=================+
230-
| Layer X conv | 5 | -1 | 5 || 801 | 10 | 10 – 9 = 1 | 5 + 1 = 6 | -1 || 6 |
231-
| | | | || (32*5*5+1) | | | | || (next layer in)|
232-
+--------------+------------+-------------+----------+--------------+------------+------------+------------+-------------+-----------------+
233-
| Layer X+1 FC | 5 | -1 | 5 || 1025 | 11 | 11 – 9 = 2 | 5 + 1 = 6 | -1 + 1 = 0 | 5 |
234-
| | | | || (64*16+1) | | | | | |
235-
+--------------+------------+-------------+----------+--------------+------------+------------+------------+-------------+-----------------+
236-
..
237-
218+
238219
.. table:: Integer Bits Derivation Considering Accumulator Restrictions
239220
:widths: 30, 30, 20, 20
240221
:align: center
@@ -281,31 +262,6 @@ For the following fully connected layer, 11 extra bits are required and you need
281262

282263
For 8-bit operands,you do not need to perform this adjustment unless your MAC series is more than 131072 operations in which case, apply similar approach. After considering accumulator restrictions for CIFAR-10 example with 16-bit operands, you get the following table:
283264

284-
.. table:: Integer Bits Derivation from CIFAR-10 Model Statistics Considering Accumulator Restrictions
285-
:widths: auto
286-
287-
+--------------+-------------------------------------+----------------------------------------+--------------------------------------------+
288-
| | **Integer bit requirements** | **Accumulator restrictions** | **Integer bit requirements** |
289-
| | **(fx8 operands)** | | **(fx16 operands)** |
290-
| +------------+-------------+----------+--------------+------------+------------+------------+-------------+-----------------+
291-
| | Layer | Layer | Layer | Macs per | Required | not enough | Layer | Layer | Layer |
292-
| | input bits | weight bits | out bits | output value | extra bits | bits | input bits | weight bits | out bits |
293-
| | | | | | | | (updated) | (updated) | (updated) |
294-
+==============+============+=============+==========+==============+============+============+============+=============+=================+
295-
| Layer 1_conv | 0 | -1 | 3 || 76 | 7 | 0 | 0 | -1 || 4 |
296-
| | | | || (3*5*5+1) | | | | || (next layer in)|
297-
+--------------+------------+-------------+----------+--------------+------------+------------+------------+-------------+-----------------+
298-
| Layer 2_conv | 3 | -1 | 5 || 801 | 10 | 10 – 9 = 1 | 3 + 1 = 4 | -1 | 5 |
299-
| | | | || (32*5*5+1) | | | | | |
300-
+--------------+------------+-------------+----------+--------------+------------+------------+------------+-------------+-----------------+
301-
| Layer 3_conv | 5 | -1 | 5 || 401 | 9 | 9 – 9 = 0 | 5 | -1 || 6 |
302-
| | | | || (16*5*5+1) | | | | || (next layer in)|
303-
+--------------+------------+-------------+----------+--------------+------------+------------+------------+-------------+-----------------+
304-
| Layer 4_fc | 5 | -1 | 5 || 513 | 10 | 10 – 9 = 1 | 5 + 1 = 6 | -1 | 5 |
305-
| | | | || (32*16+1) | | | | | |
306-
+--------------+------------+-------------+----------+--------------+------------+------------+------------+-------------+-----------------+
307-
..
308-
309265
.. table:: Integer Bits Derivation from CIFAR-10 Model Statistics Considering Accumulator Restrictions
310266
:widths: 30, 30, 20, 20, 20, 20
311267
:align: center
@@ -663,5 +619,5 @@ Here is one of the options:
663619
..
664620
665621
.. note::
666-
Here 2 memories instead of 3 may be used w/o effect on XY performance.
622+
You can use two memories instead of three without effect on XY performance.
667623
..

0 commit comments

Comments
 (0)