File tree Expand file tree Collapse file tree 1 file changed +13
-0
lines changed Expand file tree Collapse file tree 1 file changed +13
-0
lines changed Original file line number Diff line number Diff line change @@ -29,12 +29,25 @@ description:
29
29
.
30
30
> import qualified Data.Text as T
31
31
.
32
+ == ICU Support
33
+ .
32
34
To use an extended and very rich family of functions for working
33
35
with Unicode text (including normalization, regular expressions,
34
36
non-standard encodings, text breaking, and locales), see
35
37
the [text-icu package](https://hackage.haskell.org/package/text-icu)
36
38
based on the well-respected and liberally
37
39
licensed [ICU library ](http://site.icu-project.org/).
40
+ .
41
+ == Internal Representation : UTF-16 vs. UTF-8
42
+ .
43
+ Currently the @text@ library uses UTF-16 as its internal representation
44
+ which is [neither a fixed-width nor always the most dense representation](http://utf8everywhere.org/)
45
+ for Unicode text. We're currently investigating the feasibility
46
+ of [changing Text's internal representation to UTF-8](https://github.com/text-utf8)
47
+ and if you need such a 'Text' type right now you might be interested in using the spin-off
48
+ packages <https://hackage.haskell.org/package/text-utf8 text-utf8> and
49
+ <https://hackage.haskell.org/package/text-short text-short> .
50
+
38
51
39
52
license : BSD2
40
53
license-file : LICENSE
You can’t perform that action at this time.
0 commit comments