coreutils/tests/cut, branch masterMirror of https://https.git.savannah.gnu.org/git/coreutils.git/
https://git.shady.money/coreutils/atom?h=master2026-04-15T14:08:27Ztests: avoid $SHELL -c "ulimit ..." pattern2026-04-15T14:08:27ZPádraig BradyP@draigBrady.com2026-04-15T14:08:27Zurn:sha1:d58ea74d01f649664e82499884206231b8a82f6e
As described in commit v9.10-283-g5cb0cca3b
avoid using ulimit with $SHELL -c, and explict
invocation of the shell like that can require lots of memory,
often due to loading the locale archive.
* tests/basenc/bounded-memory.sh: Avoid $SHELL -c with ulimit.
* tests/cut/bounded-memory.sh: Likewise.
* tests/expand/bounded-memory.sh Likewise.
* tests/pr/bounded-memory.sh Likewise.
* tests/unexpand/bounded-memory.sh Likewise.
* tests/fold/fold-zero-width.sh: Bring the ulimit bound
down to the standard 6M over the determined limit.
tests: cut: add remaining tests to ensure 100% coverage2026-04-06T14:52:58ZPádraig BradyP@draigBrady.com2026-04-06T13:36:28Zurn:sha1:65ee5e6d0ae8b15ecc4c3d366a40d7f9ec5c4c99
* tests/cut/cut.pl: Add new tests to ensure
`make coverage` shows 100% coverage for cut.c.
tests: cut: expand GB18030 tests2026-04-06T14:52:58ZPádraig BradyP@draigBrady.com2026-04-06T12:44:30Zurn:sha1:e4258ef02f2aedcd471e00607575c5812970e490
* tests/cut/mb-non-utf8.sh: Add more test cases.
cut: -f: fix handling of multi-byte delimiters that span buffers2026-04-06T14:52:58ZPádraig BradyP@draigBrady.com2026-04-02T20:56:23Zurn:sha1:1a44a25808f9bda727ffbda753ff2eeab3bf79cc
* src/cut.c (cut_fields_bytesearch): Ensure up to delim_bytes -1
is left for the next refill.
* tests/cut/cut.pl: Add a test case.
cut: fix logic issue with field delim in last byte of buffer2026-04-05T12:15:56ZPádraig BradyP@draigBrady.com2026-04-01T19:43:00Zurn:sha1:374ff00c36b46227a2522218ff75e906cef0ca0d
With field delimiter = line delimiter we need to know
if there is any more data to be read, as field delimiter
in the last byte of the file is treated differently.
So reiterate the loop to ensure enough read()s to make
the appropriate determination.
tests: cut: add more multi-byte tests2026-04-05T12:15:56ZPádraig BradyP@draigBrady.com2026-03-29T14:15:57Zurn:sha1:1c9e2232983394ee31e7809870f3265f1a503da4
* tests/cut/cut.pl: Add more multi-byte combinations.
cut: optimize UTF-8 input with 0xF5-0xFF delimiters2026-04-05T12:15:56ZPádraig BradyP@draigBrady.com2026-03-27T18:59:01Zurn:sha1:24571c41f32cc76df996e063a2b5b82561fc9374
* src/cut.c (bytesearch_field_delim_ok): Expand the range
of bytes that can be simply searched for. 0xF5-0xFF can't
appear in valid UTF-8 characters, and so may be used as
delimiters in UTF-8 input, so it's worth optimizing for.
* tests/cut/cut.pl: Add a test case (mainly as documentation).
cut: optimize when no delimiter in input2026-04-05T12:15:56ZPádraig BradyP@draigBrady.com2026-03-21T14:15:48Zurn:sha1:ea6a7ba547ea18302d255b5a4013d0ea2d5d2c88
This is about 20x faster.
Note we only do the delimiter search once per chunk,
and it's usually quick as delimiters wouldn't be too far
into the a chunk if present, so we don't bother
to cache the found delimiter.
tests: cut: ensure multi-byte delimiter is rejected in uni-byte locales2026-04-05T12:15:56ZPádraig BradyP@draigBrady.com2026-03-20T19:25:59Zurn:sha1:7d017f83bc77ce14cae1f3ec10f07d6eb1857d81
tests/cut/cut.pl: Check the appropriate diagnostic is presented.
cut: merge cut_fields and cut_fields_bytesearch2026-04-05T12:15:56ZPádraig BradyP@draigBrady.com2026-03-17T13:30:36Zurn:sha1:f6b3055f74a91284c039d449d086a8df38183653
TODO: See why this is much slower:
time LC_ALL=C.UTF-8 src/cut -f1 -dc as.in > /dev/null