Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Option to collect all cast errors for table.read() call #112

Open
xrysanthos opened this issue Nov 26, 2017 · 1 comment
Open

Option to collect all cast errors for table.read() call #112

xrysanthos opened this issue Nov 26, 2017 · 1 comment
Labels

Comments

@xrysanthos
Copy link
Contributor

xrysanthos commented Nov 26, 2017

Overview

For now table.read fails with a tableschema.Error on the first cast error. We'd like to have an ability to get all errors from the table.read() call.

Here is an example how it's implemented for tabulator with a force_parse option - https://github.com/frictionlessdata/tabulator-py#force-parse.

We e.g. could use a force_cast option.


From @spilio

It would be really useful if there was a configuration option for the Table.read() method that would allow for non-blocking execution - i.e. that would not stop on the first error but rather return a collection of all errors from the validation of the full stream.

There are scenarios that it is really difficult to have users fix one row at a time, plus it adds up effort and complexity on the integrator's side as the only way to mimic such behavior is through a recursive approach which is inefficient since it involves opening the stream multiple times and start reading from the line after the last failed one.

@roll
Copy link
Member

roll commented Dec 10, 2017

@spilio
@anuveyatsu
This idea is in the air. And it's implemented for tabulator-py. I've added a task description.

@roll roll changed the title Option for non-blocking CSV validation with collection of errors Option to collect all cast errors for table.read() call Dec 10, 2017
@roll roll added the feature label Dec 10, 2017
@roll roll closed this as completed Apr 6, 2020
@roll roll reopened this Apr 6, 2020
@roll roll added review and removed review labels Apr 20, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants