Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Created by
brew bump
Created with
brew bump-formula-pr
.prerelease notes
stats
- the :heart: of qsv, got a little tune-up:This bug snuck in while implementing the
--cache-threshold
cache suppression option. Withstats
getting its cache mojo back - expect near-instant cache-backed response not only forstats
but also other "automagical" smart commands 🪄.diff
- @janriemer squashed some bugs without sacrificingdiff
's ludicrous speed! :wink:validate
: ThedynamicEnum
custom JSON Schema keyword column specifier support.You can now specify which column to validate against (by name or by 0-based column index), instead of always using the first column. This works for local & remote lookup files using the
http/s://
,ckan://
anddathere://
URL schemes.extdedup
now actually uses a proper memory-mapped backed on-disk hash table.Previously, it was only deduping in-memory as the odht crate was not properly wired to a memory mapped file :facepalm: (I took the name of the odht crate literally and thought it was handling it :shrug:). Thanks for the detailed bug report @Svenskunganka!
The
fetch
,fetchpost
&json
commands now use the latestjaq
engine, making for faster performance especially now that we're precompiling and caching the jaq filter.By two versions! py-polars 1.20.0 and 1.21.0 - giving the
sqlp
,joinp
,pivotp
&count
commands a little boost. :rocket:Added
diff
: add--delimiter
"convenience" option. Fulfills #2447 feat:diff
add--delimiter
"convenience" option dathere/qsv#2464slice
: add stdin and snappy compressed file support dathere/qsv@ab34a62validate
: add dynamicEnum column specifier support. Fulfills #2470 feat:validate
add dynamicEnum column specifier support dathere/qsv#2472Changed
fetch
,fetchpost
&json
:jaq
dependency upgrade - fromjaq-interpret
&jaq-parse
tojaq-core
/jaq-json
/jaq-std
refactor:jaq
crate upgrade dathere/qsv#2458fetch
&fetchpost
: cache compiled jaq filter refactor:fetch
&fetchpost
cache compiled jaq filter dathere/qsv#2467joinp
: adjust asofby test to reflect Polars py-1.20.0 behavior dathere/qsv@853a266stats
: compute string length stats for string type only refactor:stats
compute string length stats for string type only dathere/qsv#2471sqlp
: wordsmith fastpath explanation dathere/qsv@4e3f853csv-diff
to 0.1.1 dathere/qsv#2456Fixed
count
: Sometimes, polars count returns zero even if there are rows. Fixed by doing a regular csv reader count when polars count returns zero dathere/qsv@abcd365diff
: Fix name to index conversion by @janriemer. Fixes #2443diff
: Fix name to index conversion dathere/qsv#2457extdedup
: refactor/fix to actually have on-disk hash table backed by a mem-mapped file. Fixes #2462 refactor:extdedup
to actually have memory-mapped file backing on-disk hash table dathere/qsv#2475stats
: fix stats caching as it was inadvertently deleting the stats cache even when not necessary dathere/qsv@96e6d28Removed
foreach
: refactored to remove unmaintainedlocal-encoding
dependencyrefactor
:foreach
removelocal-encoding
dependency dathere/qsv#2454polars
feature from qsvdp binary variant. We'll use py-polars from DP+ directly.Full Changelog: dathere/qsv@2.1.0...2.2.0