File tree Expand file tree Collapse file tree 1 file changed +11
-3
lines changed Expand file tree Collapse file tree 1 file changed +11
-3
lines changed Original file line number Diff line number Diff line change @@ -12,12 +12,20 @@ by using an IEEE Double with a mantissa truncated to n bits of precision. The d
12
12
7 bits of precision. Additionally, the min, max and sum of the samples are stored as IEEE Double values
13
13
alongside the histogram.
14
14
15
+ For a given value, the bucket is found by the following:
16
+ bucket = (double)(val & 0xffffe00000000000L)
17
+
18
+ The result is a consistent set of buckets that scale with the value of the data. Larger values
19
+ have a larger absolute error, but with a consistent error proportion.
20
+
15
21
Statistics
16
22
----------
17
23
18
- min - accurate (stored)
19
- max - accurate (stored)
20
- sum - accurate (stored)
24
+ min - accurate (stored)
25
+ max - accurate (stored)
26
+ sum - accurate (stored)
27
+ count - accurate (derived)
28
+ mean - accurate (derived)
21
29
quantiles - estimated. accuracy depends on precision of the histogram and value stored. n bits of
22
30
precision provides accuracy to within (1 / (2^n)) * value. ex: 7 bits of precision provides accuracy
23
31
to within 1% of the computed value.
You can’t perform that action at this time.
0 commit comments