Skip to content
This repository was archived by the owner on Mar 27, 2024. It is now read-only.

Commit 2659106

Browse files
author
Hong
authored
[OAP-TOOLS-221] Update Changelog for OAP 1.4.0 (#266)
1 parent 5ee0685 commit 2659106

File tree

2 files changed

+54
-53
lines changed

2 files changed

+54
-53
lines changed

‎CHANGELOG.md‎

Lines changed: 53 additions & 52 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# Change log
2-
Generated on 2022-06-30
2+
Generated on 2022-07-05
33

44
## Release 1.4.0
55

@@ -52,64 +52,65 @@ Generated on 2022-06-30
5252
#### PRs
5353
|||
5454
|:---|:---|
55+
|[#1005](https://github.com/oap-project/gazelle_plugin/pull/1005)|[NSE-800] Fix an assembly warning|
5556
|[#1002](https://github.com/oap-project/gazelle_plugin/pull/1002)|[NSE-800] Pack the classes into one single jar|
5657
|[#988](https://github.com/oap-project/gazelle_plugin/pull/988)|[NSE-987] fix string date|
5758
|[#977](https://github.com/oap-project/gazelle_plugin/pull/977)|[NSE-126] set default codegen opt to O1|
58-
|[#975](https://github.com/oap-project/gazelle_plugin/pull/975)|[NSE-927] Add macro __AVX512BW__ check for different CPU architecture|
59+
|[#975](https://github.com/oap-project/gazelle_plugin/pull/975)|[NSE-927] Add macro AVX512BW check for different CPU architecture|
5960
|[#962](https://github.com/oap-project/gazelle_plugin/pull/962)|[NSE-359] disable unit tests on spark32 package|
6061
|[#966](https://github.com/oap-project/gazelle_plugin/pull/966)|[NSE-913] Add support for Hadoop 3.3.1 when packaging|
6162
|[#936](https://github.com/oap-project/gazelle_plugin/pull/936)|[NSE-943] Optimize IsNULL() function for Row2Columnar|
6263
|[#937](https://github.com/oap-project/gazelle_plugin/pull/937)|[NSE-927] Implement AVX512 optimization selection in Runtime and merge two C2R code files into one.|
63-
|[#951](https://github.com/oap-project/gazelle_plugin/pull/951)|[DNM] update sparklog|
64-
|[#938](https://github.com/oap-project/gazelle_plugin/pull/938)|[NSE-581] implement rlike/regexp_like|
65-
|[#946](https://github.com/oap-project/gazelle_plugin/pull/946)|[DNM] update on sparklog script|
66-
|[#939](https://github.com/oap-project/gazelle_plugin/pull/939)|[NSE-581] adding ShortType/FloatType in ColumnarLiteral|
67-
|[#934](https://github.com/oap-project/gazelle_plugin/pull/934)|[NSE-927] Extract and inline functions for native ColumnartoRow|
68-
|[#933](https://github.com/oap-project/gazelle_plugin/pull/933)|[NSE-581] Improve GetArrayItem(Split()) performance|
69-
|[#922](https://github.com/oap-project/gazelle_plugin/pull/922)|[NSE-912] Remove extra handleSafe costs|
70-
|[#925](https://github.com/oap-project/gazelle_plugin/pull/925)|[NSE-926] Support a UDF: URLDecoder|
71-
|[#924](https://github.com/oap-project/gazelle_plugin/pull/924)|[NSE-927] Enable AVX512 in Binary length calculation for native ColumnartoRow|
72-
|[#918](https://github.com/oap-project/gazelle_plugin/pull/918)|[NSE-856] Optimize of string/binary split|
73-
|[#908](https://github.com/oap-project/gazelle_plugin/pull/908)| [NSE-848] Optimize performance for Column2Row|
74-
|[#900](https://github.com/oap-project/gazelle_plugin/pull/900)|[NSE-869] Add 'first' agg function support|
75-
|[#917](https://github.com/oap-project/gazelle_plugin/pull/917)|[NSE-886] Add pmod expression support|
76-
|[#916](https://github.com/oap-project/gazelle_plugin/pull/916)|[NSE-909] fix slow test|
77-
|[#915](https://github.com/oap-project/gazelle_plugin/pull/915)|[NSE-857] Further optimizations of validity buffer split|
78-
|[#912](https://github.com/oap-project/gazelle_plugin/pull/912)|[NSE-909] "INSERT OVERWRITE x SELECT /*+ REPARTITION(2) */ * FROM y L…|
79-
|[#896](https://github.com/oap-project/gazelle_plugin/pull/896)|[NSE-889] Failed to write with ParquetFileFormat while using ArrowWriteExtension|
80-
|[#911](https://github.com/oap-project/gazelle_plugin/pull/911)|[NSE-910] fix bug of PR903|
81-
|[#901](https://github.com/oap-project/gazelle_plugin/pull/901)|[NSE-891] Spark executor lost while DatasetFileWriter failed with speculation|
82-
|[#907](https://github.com/oap-project/gazelle_plugin/pull/907)|[NSE-857] split validity buffer by reducer|
83-
|[#902](https://github.com/oap-project/gazelle_plugin/pull/902)|[NSE-892] Allow to use jar cmd not in PATH|
84-
|[#898](https://github.com/oap-project/gazelle_plugin/pull/898)|[NSE-867][FOLLOWUP] Add substring_index function support|
85-
|[#894](https://github.com/oap-project/gazelle_plugin/pull/894)|[NSE-855] allocate large block of memory for all reducer #881|
86-
|[#880](https://github.com/oap-project/gazelle_plugin/pull/880)|[NSE-857] Fill destination buffer by reducer|
87-
|[#839](https://github.com/oap-project/gazelle_plugin/pull/839)|[DNM] some optimizations to shuffle's split function|
88-
|[#879](https://github.com/oap-project/gazelle_plugin/pull/879)|[NSE-878]Wip get phyplan bugfix|
89-
|[#877](https://github.com/oap-project/gazelle_plugin/pull/877)|[NSE-876] Fix writing arrow hang with OutputWriter.path|
90-
|[#873](https://github.com/oap-project/gazelle_plugin/pull/873)|[NSE-872] implement replace function|
91-
|[#850](https://github.com/oap-project/gazelle_plugin/pull/850)|[NSE-854] Small Shuffle Size disable wholestagecodegen|
92-
|[#868](https://github.com/oap-project/gazelle_plugin/pull/868)|[NSE-867] Add substring_index function support|
93-
|[#847](https://github.com/oap-project/gazelle_plugin/pull/847)|[NSE-818] Support length, char_length, locate & regexp_extract|
94-
|[#865](https://github.com/oap-project/gazelle_plugin/pull/865)|[NSE-864] Enable native parquet write by default|
95-
|[#811](https://github.com/oap-project/gazelle_plugin/pull/811)|[NSE-810] disable codegen for SMJ with local limit|
96-
|[#860](https://github.com/oap-project/gazelle_plugin/pull/860)|remove sensitive info from physical plan|
97-
|[#853](https://github.com/oap-project/gazelle_plugin/pull/853)|[NSE-852] Unit test fix for NSE-843|
98-
|[#844](https://github.com/oap-project/gazelle_plugin/pull/844)|[NSE-843] ArrowDataSouce: Arrow dataset inspect() is called every tim…|
99-
|[#842](https://github.com/oap-project/gazelle_plugin/pull/842)|fix in eventlog script|
100-
|[#841](https://github.com/oap-project/gazelle_plugin/pull/841)|fix bug of script|
101-
|[#829](https://github.com/oap-project/gazelle_plugin/pull/829)|[NSE-828] Add native CoalesceBatches implementation|
102-
|[#830](https://github.com/oap-project/gazelle_plugin/pull/830)|[NSE-831] Support more expression types in getting attribute|
103-
|[#815](https://github.com/oap-project/gazelle_plugin/pull/815)|[NSE-610] Shrink hashmap to use less memory|
104-
|[#822](https://github.com/oap-project/gazelle_plugin/pull/822)|[NSE-821] Fix Wholestage Codegen on unsupported pattern|
105-
|[#824](https://github.com/oap-project/gazelle_plugin/pull/824)|[NSE-823] Use `SPARK_VERSION_SHORT` instead of `SPARK_VERSION` to find SparkShims|
106-
|[#826](https://github.com/oap-project/gazelle_plugin/pull/826)|[NSE-827] fix GHA|
107-
|[#819](https://github.com/oap-project/gazelle_plugin/pull/819)|[DNM] complete sparklog script|
108-
|[#802](https://github.com/oap-project/gazelle_plugin/pull/802)|[NSE-794] Fix count() with decimal value|
109-
|[#801](https://github.com/oap-project/gazelle_plugin/pull/801)|[NSE-786] Adding docs for shim layers|
110-
|[#790](https://github.com/oap-project/gazelle_plugin/pull/790)|[NSE-781]Add eventlog analyzer tool|
111-
|[#789](https://github.com/oap-project/gazelle_plugin/pull/789)|[NSE-788] Quick fix for randomSplit on reordered partitions|
112-
|[#780](https://github.com/oap-project/gazelle_plugin/pull/780)|[NSE-784] fallback Sort after SortHashAgg|
64+
|[#951](https://github.com/oap-project/gazelle_plugin/pull/951)| [DNM] update sparklog |
65+
|[#938](https://github.com/oap-project/gazelle_plugin/pull/938)| [NSE-581] implement rlike/regexp_like |
66+
|[#946](https://github.com/oap-project/gazelle_plugin/pull/946)| [DNM] update on sparklog script |
67+
|[#939](https://github.com/oap-project/gazelle_plugin/pull/939)| [NSE-581] adding ShortType/FloatType in ColumnarLiteral |
68+
|[#934](https://github.com/oap-project/gazelle_plugin/pull/934)| [NSE-927] Extract and inline functions for native ColumnartoRow |
69+
|[#933](https://github.com/oap-project/gazelle_plugin/pull/933)| [NSE-581] Improve GetArrayItem(Split()) performance |
70+
|[#922](https://github.com/oap-project/gazelle_plugin/pull/922)| [NSE-912] Remove extra handleSafe costs |
71+
|[#925](https://github.com/oap-project/gazelle_plugin/pull/925)| [NSE-926] Support a UDF: URLDecoder |
72+
|[#924](https://github.com/oap-project/gazelle_plugin/pull/924)| [NSE-927] Enable AVX512 in Binary length calculation for native ColumnartoRow |
73+
|[#918](https://github.com/oap-project/gazelle_plugin/pull/918)| [NSE-856] Optimize of string/binary split |
74+
|[#908](https://github.com/oap-project/gazelle_plugin/pull/908)| [NSE-848] Optimize performance for Column2Row |
75+
|[#900](https://github.com/oap-project/gazelle_plugin/pull/900)| [NSE-869] Add 'first' agg function support |
76+
|[#917](https://github.com/oap-project/gazelle_plugin/pull/917)| [NSE-886] Add pmod expression support |
77+
|[#916](https://github.com/oap-project/gazelle_plugin/pull/916)| [NSE-909] fix slow test |
78+
|[#915](https://github.com/oap-project/gazelle_plugin/pull/915)| [NSE-857] Further optimizations of validity buffer split |
79+
|[#912](https://github.com/oap-project/gazelle_plugin/pull/912)| [NSE-909] "INSERT OVERWRITE x SELECT /*+ REPARTITION(2) */ * FROM y L… |
80+
|[#896](https://github.com/oap-project/gazelle_plugin/pull/896)| [NSE-889] Failed to write with ParquetFileFormat while using ArrowWriteExtension |
81+
|[#911](https://github.com/oap-project/gazelle_plugin/pull/911)| [NSE-910] fix bug of PR903 |
82+
|[#901](https://github.com/oap-project/gazelle_plugin/pull/901)| [NSE-891] Spark executor lost while DatasetFileWriter failed with speculation |
83+
|[#907](https://github.com/oap-project/gazelle_plugin/pull/907)| [NSE-857] split validity buffer by reducer |
84+
|[#902](https://github.com/oap-project/gazelle_plugin/pull/902)| [NSE-892] Allow to use jar cmd not in PATH |
85+
|[#898](https://github.com/oap-project/gazelle_plugin/pull/898)| [NSE-867][FOLLOWUP] Add substring_index function support |
86+
|[#894](https://github.com/oap-project/gazelle_plugin/pull/894)| [NSE-855] allocate large block of memory for all reducer #881 |
87+
|[#880](https://github.com/oap-project/gazelle_plugin/pull/880)| [NSE-857] Fill destination buffer by reducer |
88+
|[#839](https://github.com/oap-project/gazelle_plugin/pull/839)| [DNM] some optimizations to shuffle's split function |
89+
|[#879](https://github.com/oap-project/gazelle_plugin/pull/879)| [NSE-878]Wip get phyplan bugfix |
90+
|[#877](https://github.com/oap-project/gazelle_plugin/pull/877)| [NSE-876] Fix writing arrow hang with OutputWriter.path |
91+
|[#873](https://github.com/oap-project/gazelle_plugin/pull/873)| [NSE-872] implement replace function |
92+
|[#850](https://github.com/oap-project/gazelle_plugin/pull/850)| [NSE-854] Small Shuffle Size disable wholestagecodegen |
93+
|[#868](https://github.com/oap-project/gazelle_plugin/pull/868)| [NSE-867] Add substring_index function support |
94+
|[#847](https://github.com/oap-project/gazelle_plugin/pull/847)| [NSE-818] Support length, char_length, locate & regexp_extract |
95+
|[#865](https://github.com/oap-project/gazelle_plugin/pull/865)| [NSE-864] Enable native parquet write by default |
96+
|[#811](https://github.com/oap-project/gazelle_plugin/pull/811)| [NSE-810] disable codegen for SMJ with local limit |
97+
|[#860](https://github.com/oap-project/gazelle_plugin/pull/860)| remove sensitive info from physical plan |
98+
|[#853](https://github.com/oap-project/gazelle_plugin/pull/853)| [NSE-852] Unit test fix for NSE-843 |
99+
|[#844](https://github.com/oap-project/gazelle_plugin/pull/844)| [NSE-843] ArrowDataSouce: Arrow dataset inspect() is called every tim… |
100+
|[#842](https://github.com/oap-project/gazelle_plugin/pull/842)| fix in eventlog script |
101+
|[#841](https://github.com/oap-project/gazelle_plugin/pull/841)| fix bug of script |
102+
|[#829](https://github.com/oap-project/gazelle_plugin/pull/829)| [NSE-828] Add native CoalesceBatches implementation |
103+
|[#830](https://github.com/oap-project/gazelle_plugin/pull/830)| [NSE-831] Support more expression types in getting attribute |
104+
|[#815](https://github.com/oap-project/gazelle_plugin/pull/815)| [NSE-610] Shrink hashmap to use less memory |
105+
|[#822](https://github.com/oap-project/gazelle_plugin/pull/822)| [NSE-821] Fix Wholestage Codegen on unsupported pattern |
106+
|[#824](https://github.com/oap-project/gazelle_plugin/pull/824)| [NSE-823] Use `SPARK_VERSION_SHORT` instead of `SPARK_VERSION` to find SparkShims |
107+
|[#826](https://github.com/oap-project/gazelle_plugin/pull/826)| [NSE-827] fix GHA |
108+
|[#819](https://github.com/oap-project/gazelle_plugin/pull/819)| [DNM] complete sparklog script |
109+
|[#802](https://github.com/oap-project/gazelle_plugin/pull/802)| [NSE-794] Fix count() with decimal value |
110+
|[#801](https://github.com/oap-project/gazelle_plugin/pull/801)| [NSE-786] Adding docs for shim layers |
111+
|[#790](https://github.com/oap-project/gazelle_plugin/pull/790)| [NSE-781]Add eventlog analyzer tool |
112+
|[#789](https://github.com/oap-project/gazelle_plugin/pull/789)| [NSE-788] Quick fix for randomSplit on reordered partitions |
113+
|[#780](https://github.com/oap-project/gazelle_plugin/pull/780)| [NSE-784] fallback Sort after SortHashAgg |
113114

114115

115116
### OAP MLlib

‎docs/OAP-Developer-Guide.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ We provide scripts to help automatically install dependencies required, please c
2323
Then the dependencies below will be installed:
2424

2525
* [Cmake](https://cmake.org/install/)
26-
* [GCC > 7](https://gcc.gnu.org/wiki/InstallingGCC)
26+
* [GCC > 9](https://gcc.gnu.org/wiki/InstallingGCC)
2727
* [OneAPI](https://software.intel.com/content/www/us/en/develop/tools/oneapi.html)
2828
* [Arrow](https://github.com/oap-project/arrow/tree/v4.0.0-oap-1.4.0)
2929
* [LLVM](https://llvm.org/)

0 commit comments

Comments
 (0)