commit | ccf29a08cb92872b297cad16c53ca7bbede5bd1d | [log] [tgz] |
---|---|---|
author | Marcel van Lohuizen <mpvl@golang.org> | Tue Feb 13 14:47:17 2018 +0100 |
committer | Marcel van Lohuizen <mpvl@golang.org> | Fri Feb 23 17:23:06 2018 +0000 |
tree | 65e71444d2c93f6c1c50ecf699ea6a6036ea745e | |
parent | 9e2b64d659da1afe07ce1c9c1dfefc09d188f21e [diff] |
language: change semantics of CompactIndex This is the first CL in a sequence to enhance both the performance and functionality of language Tags. First step is to have CompactIndex implement the semantics that it should have: rather than returning Und when there is no match, it should return the closest matching compact index. CompactIndex is often used this way, and when it is not it was typcially a bug. This fixes that. Next steps are to have the fast-path internal encoding of tag be a compact index. The step after that is to keep two compact indexes, allow representing both the language and locale part of a tag like: en-US-va-posix and en-GB-rg-gbsct The result will allow for dual-mode tags resulting from matching, simplifying the life of an API user. (In Java the API users will get two tags from a match and will have to decide on a case-by-case basis which tag to use for which purpose.) This design also allows for fast converstion to compact indices, making it unnecessary for message.Printers to extract this index. Change-Id: I019ac6df4a3e3c7e6c758173fc942667df65ff36 Reviewed-on: https://go-review.googlesource.com/95815 Run-TryBot: Marcel van Lohuizen <mpvl@golang.org> TryBot-Result: Gobot Gobot <gobot@golang.org> Reviewed-by: Nigel Tao <nigeltao@golang.org>
This repository holds supplementary Go libraries for text processing, many involving Unicode.
This repo uses Semantic versioning (http://semver.org/), so
Until version 1.0.0 of x/text is reached, the minor version is considered a major version. So going from 0.1.0 to 0.2.0 is considered to be a major version bump.
A major new CLDR version is mapped to a minor version increase in x/text. Any other new CLDR version is mapped to a patch version increase in x/text.
It is important that the Unicode version used in x/text
matches the one used by your Go compiler. The x/text
repository supports multiple versions of Unicode and will match the version of Unicode to that of the Go compiler. At the moment this is supported for Go compilers from version 1.7.
The easiest way to install is to run go get -u golang.org/x/text
. You can also manually git clone the repository to $GOPATH/src/golang.org/x/text
.
To submit changes to this repository, see http://golang.org/doc/contribute.html.
To generate the tables in this repository (except for the encoding tables), run go generate from this directory. By default tables are generated for the Unicode version in core and the CLDR version defined in golang.org/x/text/unicode/cldr.
Running go generate will as a side effect create a DATA subdirectory in this directory, which holds all files that are used as a source for generating the tables. This directory will also serve as a cache.
Run
go test ./...
from this directory to run all tests. Add the “-tags icu” flag to also run ICU conformance tests (if available). This requires that you have the correct ICU version installed on your system.
TODO:
To generate the tables in this repository (except for the encoding tables), run go generate
from this directory. By default tables are generated for the Unicode version in core and the CLDR version defined in golang.org/x/text/unicode/cldr.
Running go generate will as a side effect create a DATA subdirectory in this directory which holds all files that are used as a source for generating the tables. This directory will also serve as a cache.
To update a Unicode version run
UNICODE_VERSION=x.x.x go generate
where x.x.x
must correspond to a directory in http://www.unicode.org/Public/. If this version is newer than the version in core it will also update the relevant packages there. The idna package in x/net will always be updated.
To update a CLDR version run
CLDR_VERSION=version go generate
where version
must correspond to a directory in http://www.unicode.org/Public/cldr/.
Note that the code gets adapted over time to changes in the data and that backwards compatibility is not maintained. So updating to a different version may not work.
The files in DATA/{iana|icu|w3|whatwg} are currently not versioned.
This repository uses Gerrit for code changes. To learn how to submit changes to this repository, see https://golang.org/doc/contribute.html.
The main issue tracker for the image repository is located at https://github.com/golang/go/issues. Prefix your issue with “x/image:” in the subject line, so it is easy to find.