Skip to content

Commit 13dcbf4

Browse files
authored
Merge pull request #262 from luxonis/fix_node_docs
Fix stereoDepth/colorCamera node docs
2 parents 2d20d02 + 33c1739 commit 13dcbf4

File tree

2 files changed

+40
-27
lines changed

2 files changed

+40
-27
lines changed

docs/source/components/nodes/color_camera.rst

Lines changed: 29 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -24,27 +24,40 @@ Inputs and Outputs
2424

2525
.. code-block::
2626
27-
┌───────────────────┐ still
28-
│ ├───────────►
29-
inputConfig │ │
30-
──────────────►│ │ preview
31-
│ ColorCamera ├───────────►
32-
inputControl │ │
33-
──────────────►│ │ video
34-
│ ├───────────►
35-
└───────────────────┘
27+
ColorCamera node
28+
┌──────────────────────────────┐
29+
│ ┌─────────────┐ │
30+
│ │ Image │ raw │ raw
31+
│ │ Sensor │---┬--------├────────►
32+
│ └────▲────────┘ | │
33+
│ │ ┌--------┘ │
34+
│ ┌─┴───▼─┐ │ isp
35+
inputControl │ │ │-------┬-------├────────►
36+
──────────────►│------│ ISP │ ┌─────▼────┐ │ video
37+
│ │ │ | |--├────────►
38+
│ └───────┘ │ Image │ │ still
39+
inputConfig │ │ Post- │--├────────►
40+
──────────────►│----------------|Processing│ │ preview
41+
│ │ │--├────────►
42+
│ └──────────┘ │
43+
└──────────────────────────────┘
3644
3745
**Message types**
3846

3947
- :code:`inputConfig` - :ref:`ImageManipConfig`
4048
- :code:`inputControl` - :ref:`CameraControl`
41-
- :code:`still` - :ref:`ImgFrame`
42-
- :code:`preview` - :ref:`ImgFrame`
43-
- :code:`video` - :ref:`ImgFrame`
44-
45-
:code:`Preview` is RGB (or BGR planar/interleaved if configured) and is mostly suited for small size previews and to feed the image
46-
into :ref:`NeuralNetwork`. :code:`video` and :code:`still` are both NV12, so are suitable for bigger sizes. :code:`still` image gets created when
47-
a capture event is sent to the ColorCamera, so it's like taking a photo.
49+
- :code:`raw` - :ref:`ImgFrame` - RAW10 bayer data. Demo code for unpacking `here <https://github.com/luxonis/depthai-experiments/blob/3f1b2b2/gen2-color-isp-raw/main.py#L13-L32>`__
50+
- :code:`isp` - :ref:`ImgFrame` - YUV420 planar (same as YU12/IYUV/I420)
51+
- :code:`still` - :ref:`ImgFrame` - NV12, suitable for bigger size frames. The image gets created when a capture event is sent to the ColorCamera, so it's like taking a photo
52+
- :code:`preview` - :ref:`ImgFrame` - RGB (or BGR planar/interleaved if configured), mostly suited for small size previews and to feed the image into :ref:`NeuralNetwork`
53+
- :code:`video` - :ref:`ImgFrame` - NV12, suitable for bigger size frames
54+
55+
**ISP** (image signal processor) is used for bayer transformation, demosaicing, noise reduction, and other image enhancements.
56+
It interacts with the 3A algorithms: **auto-focus**, **auto-exposure**, and **auto-white-balance**, which are handling image sensor
57+
adjustments such as exposure time, sensitivity (ISO), and lens position (if the camera module has a motorized lens) at runtime.
58+
Click `here <https://en.wikipedia.org/wiki/Image_processor>`__ for more information.
59+
60+
**Image Post-Processing** converts YUV420 planar frames from the **ISP** into :code:`video`/:code:`preview`/:code:`still` frames.
4861

4962
Usage
5063
#####

docs/source/components/nodes/stereo_depth.rst

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -53,26 +53,26 @@ Inputs and Outputs
5353
Disparity
5454
#########
5555

56-
When calculating the disparity, each pixel in the disparity map gets assigned a confidence value 0..255 by the stereo matching algorithm, as:
57-
- 0 - maximum confidence that it holds a valid value
58-
- 255 - minimum confidence, so there are chances the value is incorrect
56+
When calculating the disparity, each pixel in the disparity map gets assigned a confidence value :code:`0..255` by the stereo matching algorithm,
57+
as:
58+
59+
- :code:`0` - maximum confidence that it holds a valid value
60+
- :code:`255` - minimum confidence, so there is more chance that the value is incorrect
61+
5962
(this confidence score is kind-of inverted, if say comparing with NN)
6063

6164
For the final disparity map, a filtering is applied based on the confidence threshold value: the pixels that have their confidence score larger than
62-
the threshold get invalidated, i.e. their disparity value is set to zero.
65+
the threshold get invalidated, i.e. their disparity value is set to zero. You can set the confidence threshold with :code:`stereo.setConfidenceThreshold()`.
6366

6467
Current limitations
6568
###################
6669

67-
If one or more of the additional depth modes (lrcheck, extended, subpixel) are enabled, then:
68-
69-
- :code:`depth` output is FP16.
70-
- median filtering is disabled on device.
71-
- with subpixel, either depth or disparity has valid data.
70+
If one or more of the additional depth modes (:code:`lrcheck`, :code:`extended`, :code:`subpixel`) are enabled, then:
7271

73-
Otherwise, depth output is U16 (in milimeters) and median is functional.
72+
- median filtering is disabled on device
73+
- with subpixel, if both :code:`depth` and :code:`disparity` are used, only :code:`depth` will have valid output
7474

75-
Like on Gen1, either :code:`depth` or :code:`disparity` has valid data.
75+
Otherwise, :code:`depth` output is **U16** (in millimeters) and median is functional.
7676

7777
Usage
7878
#####

0 commit comments

Comments
 (0)