aboutsummaryrefslogtreecommitdiff
path: root/tests/unicode
AgeCommit message (Collapse)Author
2020-03-30tests: Format all Python code with black, except tests in basics subdir.David Lechner
This adds the Python files in the tests/ directory to be formatted with ./tools/codeformat.py. The basics/ subdirectory is excluded for now so we aren't changing too much at once. In a few places `# fmt: off`/`# fmt: on` was used where the code had special formatting for readability or where the test was actually testing the specific formatting.
2019-12-28py/objslice: Add support for indices() method on slice objects.Nicko van Someren
Instances of the slice class are passed to __getitem__() on objects when the user indexes them with a slice. In practice the majority of the time (other than passing it on untouched) is to work out what the slice means in the context of an array dimension of a particular length. Since Python 2.3 there has been a method on the slice class, indices(), that takes a dimension length and returns the real start, stop and step, accounting for missing or negative values in the slice spec. This commit implements such a indices() method on the slice class. It is configurable at compile-time via MICROPY_PY_BUILTINS_SLICE_INDICES, disabled by default, enabled on unix, stm32 and esp32 ports. This commit also adds new tests for slice indices and for slicing unicode strings.
2018-11-26py/unicode: Fix check for valid utf8 being stricter about contn chars.Damien George
2017-09-06py/objstr: Add check for valid UTF-8 when making a str from bytes.tll
This patch adds a function utf8_check() to check for a valid UTF-8 encoded string, and calls it when constructing a str from raw bytes. The feature is selectable at compile time via MICROPY_PY_BUILTINS_STR_UNICODE_CHECK and is enabled if unicode is enabled. It costs about 110 bytes on Thumb-2, 150 bytes on Xtensa and 170 bytes on x86-64.
2016-10-17tests: Improve coverage of array, range, dict, slice, exc, unicode.Damien George
2016-07-25tests/unicode_subscr.py: Detailed test for subscripting unicode strings.Paul Sokolovsky
2015-09-07tests: Move int+unicode test to unicode-specific test directory.Damien George
2015-09-07py/lexer: Raise SyntaxError when unicode char point out of range.Damien George
2015-08-29py/objstr: Make string formatting 8-bit clean.Damien George
2015-06-09py: Support unicode (utf-8 encoded) identifiers in Python source.Damien George
Enabled simply by making the identifier lexing code 8-bit clean.
2015-04-04tests: Add missing tests for builtins, and many other things.Damien George
2015-01-29tests: Add some tests to improve coverage.Damien George
2014-10-21Use mode/encoding kwargs in io and unicode testsstijn
mode argument is used to assert it works encoding argument is used to make sure CPython uses the correct encoding as it does not automatically use utf-8
2014-07-19py: Add stream reading of n unicode chars; unicode support by default.Damien George
With unicode enabled, this patch allows reading a fixed number of characters from text-mode streams; eg file.read(5) will read 5 unicode chars, which can made of more than 5 bytes. For an ASCII stream (ie no chars > 127) it only needs to do 1 read. If there are lots of non-ASCII chars in a stream, then it needs multiple reads of the underlying object. Adds a new test for this case. Enables unicode support by default on unix and stmhal ports.
2014-06-27tests: Add basic test for unicode file i/o.Paul Sokolovsky
2014-06-27tests: Test for explicit start/end args to str methods for unicode.Paul Sokolovsky
2014-06-27tests: Add tests for unicode find()/rfind()/index().Paul Sokolovsky
2014-06-27tests: Add test for unicode string iteration.Paul Sokolovsky
2014-06-27tests: Add unicode test.Chris Angelico