Test & Maybe Release

feat: export `Tokenizer`, document how it can be used #299

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
test (16.x, macos-latest)	1m 1s
test (16.x, ubuntu-latest)	46s
test (16.x, windows-latest)	1m 32s
test (18.x, macos-latest)	1m 2s
test (18.x, ubuntu-latest)	46s
test (18.x, windows-latest)	1m 39s
test (lts/*, macos-latest)	1m 37s
test (lts/*, ubuntu-latest)	45s
test (lts/*, windows-latest)	1m 56s
test (current, macos-latest)	1m 7s
test (current, ubuntu-latest)	42s
test (current, windows-latest)	1m 9s
Release	0s
	14m 2s