#314: Add support for sum of truncated values

[ABLL526]

-Add support for sum of truncated values.
-Added the aggregatedTruncTotal and absAggregatedTruncTotal Measures.

Closes #314

Release notes:
-Added the aggregatedTruncTotal and absAggregatedTruncTotal Measures.
-Added the tests for these Measures.

[github-actions]

JaCoCo model module code coverage report - scala 2.13.11

Overall Project	56.51%	🍏

There is no coverage information present for the Files changed

[github-actions]

JaCoCo agent module code coverage report - scala 2.13.11

Overall Project	78.98% -8.83%	🍏
Files changed	61.54%	❌

File	Coverage
MeasuresBuilder.scala	100%	🍏
Measure.scala	88.17% -31.12%	❌

[github-actions]

JaCoCo reader module code coverage report - scala 2.13.11

Overall Project	95.16%	🍏

There is no coverage information present for the Files changed

[github-actions]

JaCoCo server module code coverage report - scala 2.13.11

Overall Project	68.39%	🍏

There is no coverage information present for the Files changed

[salamonpavel]

val supportedMeasureNames is not used

[ABLL526]

I have only added the names, it must be dead code possibly. I will comment out the val and rerun the tests.

[salamonpavel]

Why have you decided to use double casting approach instead of using standard functions from package org.apache.spark.sql to round values before summing them?

  /**
   * Returns the value of the column `e` rounded to 0 decimal places with HALF_UP round mode.
   *
   * @group math_funcs
   * @since 1.5.0
   */
  def round(e: Column): Column = round(e, 0)

  /**
   * Round the value of `e` to `scale` decimal places with HALF_UP round mode
   * if `scale` is greater than or equal to 0 or at integral part when `scale` is less than 0.
   *
   * @group math_funcs
   * @since 1.5.0
   */
  def round(e: Column, scale: Int): Column = withExpr { Round(e.expr, Literal(scale)) }

  /**
   * Returns the value of the column `e` rounded to 0 decimal places with HALF_EVEN round mode.
   *
   * @group math_funcs
   * @since 2.0.0
   */
  def bround(e: Column): Column = bround(e, 0)

  /**
   * Round the value of `e` to `scale` decimal places with HALF_EVEN round mode
   * if `scale` is greater than or equal to 0 or at integral part when `scale` is less than 0.
   *
   * @group math_funcs
   * @since 2.0.0
   */
  def bround(e: Column, scale: Int): Column = withExpr { BRound(e.expr, Literal(scale)) }

[ABLL526]

Thank you. It was mentioned in the issue that this method was used in ATUM but let me change it accordingly. Since I think this method you have mentioned is more correct.

[ABLL526]

The round function does not work with negative numbers, unfortunately. We need a truncation function that will simply remove the decimals. But I have found another way that also works to ensure proper functionality without resorting to a double cast.

[salamonpavel]

yup, combination of floor and ceil should work fine

scala> df.show
+-----+
|value|
+-----+
| -1.1|
|  1.1|
| -1.7|
|  1.7|
| -0.8|
|  0.8|
+-----+


scala> df.select(when(col("value") >= 0, floor(col("value"))).otherwise(ceil(col("value")))).show
+-------------------------------------------------------------+
|CASE WHEN (value >= 0) THEN FLOOR(value) ELSE CEIL(value) END|
+-------------------------------------------------------------+
|                                                           -1|
|                                                            1|
|                                                           -1|
|                                                            1|
|                                                            0|
|                                                            0|
+-------------------------------------------------------------+

[salamonpavel]

ResultValueType.LongValue?

[ABLL526]

Yes, I like that. Good catch. Thank you.

[salamonpavel]

LGTM