Skip to content

Commit f362784

Browse files
committed
collation Analyzer sorting change
1 parent cd16aa5 commit f362784

File tree

2 files changed

+36
-0
lines changed

2 files changed

+36
-0
lines changed

site/content/3.12/release-notes/version-3.12/incompatible-changes-in-3-12.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -170,6 +170,24 @@ onward and will be removed in a future version.
170170
You can use [Stream Transactions](../../develop/transactions/stream-transactions.md)
171171
instead in most cases, and in some cases AQL can be sufficient.
172172

173+
## Breaking changes to the `collation` Analyzer
174+
175+
The [`collation` Analyzer](../../index-and-search/analyzers.md#collation) lets
176+
you adhere to the alphabetic order of a language in range queries. For example,
177+
using the Swedish locale (`sv`), `å` goes after `z` and not near `a`, which
178+
can impact queries.
179+
180+
Sorting by the output of the `collation` Analyzer like
181+
`SORT TOKENS(<text>, <collationAnalyzer>` did not produce meaningful results in
182+
previous versions. Sorting the letters `å`, `a`, `b`, `z` resulted in the order
183+
`b` `a` `å` `z` using an English locale (`en`) and `b` `å` `a` `z` using a
184+
Swedish locale (`sv`).
185+
186+
In v3.12, this now sorts properly to `a` `å` `b` `z` (English) and
187+
`a` `b` `z` `å` (Swedish). This change can make queries behave differently
188+
compared to v3.11 and older, and inverted indexes and Views using
189+
`collation` Analyzers need to be recreated to ensure that they work correctly.
190+
173191
## Control character escaping in audit log
174192

175193
The audit log feature of the Enterprise Edition previously logged query strings

site/content/4.0/release-notes/version-3.12/incompatible-changes-in-3-12.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -170,6 +170,24 @@ onward and will be removed in a future version.
170170
You can use [Stream Transactions](../../develop/transactions/stream-transactions.md)
171171
instead in most cases, and in some cases AQL can be sufficient.
172172

173+
## Breaking changes to the `collation` Analyzer
174+
175+
The [`collation` Analyzer](../../index-and-search/analyzers.md#collation) lets
176+
you adhere to the alphabetic order of a language in range queries. For example,
177+
using the Swedish locale (`sv`), `å` goes after `z` and not near `a`, which
178+
can impact queries.
179+
180+
Sorting by the output of the `collation` Analyzer like
181+
`SORT TOKENS(<text>, <collationAnalyzer>` did not produce meaningful results in
182+
previous versions. Sorting the letters `å`, `a`, `b`, `z` resulted in the order
183+
`b` `a` `å` `z` using an English locale (`en`) and `b` `å` `a` `z` using a
184+
Swedish locale (`sv`).
185+
186+
In v3.12, this now sorts properly to `a` `å` `b` `z` (English) and
187+
`a` `b` `z` `å` (Swedish). This change can make queries behave differently
188+
compared to v3.11 and older, and inverted indexes and Views using
189+
`collation` Analyzers need to be recreated to ensure that they work correctly.
190+
173191
## Control character escaping in audit log
174192

175193
The audit log feature of the Enterprise Edition previously logged query strings

0 commit comments

Comments
 (0)