commit 8d2a9d08299cdad255bf70d3fd47d1e863aba941
author Marcel van Lohuizen <mpvl@golang.org> Fri Apr 03 10:18:08 2015 +0900
committer Marcel van Lohuizen <mpvl@golang.org> Mon Apr 20 07:59:04 2015 +0000
tree ed1ae10df78106d13bdbc98eeeacb349621d380c
parent c3788f36650b14e5a6e796e267de79ea10ea4fd7

encoding/unicode: new BOM policy for standard UTF-16.

The current options did not allow the UTF-16 encoding to be specified
accoding to RFC recommendations (as well as common practice). Added
UseBOM policy to fix this.

Implemented BOM policy internally as a bitmask of options. This makes
the semantics of the three options clearer (at least to me) at first
glance.

UTF16 now also assigns MIB constants to UTF-16 encodings, if possible.
Note that some configurations map to the same MIB identifier. RFC 2781
has requirements and recommendations. Some of the "configurations"
are merely recommendations, so multiple configurations could match.

Change-Id: Id2da4293b054cdd774c876d288127259afccffd1
Reviewed-on: https://go-review.googlesource.com/8395
Reviewed-by: Nigel Tao <nigeltao@golang.org>