You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
The most useful thing for the charts on the overview page is that I can not only monitor my data, but also directly improve it. If I see WS and manual labels not being aligned in the confusion matrix, I instinctively want to check out the conflicts in the data browser. Currently I have to memorise what values for WS and manual I want to look at for what labeling task and then go into the data browser and manually put these values into the filter options. That is unfortunately a lot of manual effort and opens up the room for error.
Describe the solution you'd like
I really would like these charts to be linked to the data browser. So if I see a conflict in the confusion matrix, I want to be able to click on it and be redirected to the data browser with the right filters in place automatically.
The cool thing is, that in theory this can be done with every chart.
Label distribution: clicking on the "manually labeled" bar for label "business" redirects you to the data browser with the filter "(ML-label IN (business))"
Confidence distribution: Select a range of either percentiles (horizontal selection) or WS confidences (vertical selection) and redirect to the data browser with the WS confidence filter set to the respective values.
Confusion matrix: Click on one tile, e.g. "WS business / Manual sports", and be redirected to the data browser with the filters set to exactly that.
Inter annotator agreement: This one is a bit tricky as it could both mean that one wants to see the disagreement or one wants to see the records that were labeled by both. So that would need a little more discussion I think.
Describe alternatives you've considered
Doing everything manually.
Additional context
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
The most useful thing for the charts on the overview page is that I can not only monitor my data, but also directly improve it. If I see WS and manual labels not being aligned in the confusion matrix, I instinctively want to check out the conflicts in the data browser. Currently I have to memorise what values for WS and manual I want to look at for what labeling task and then go into the data browser and manually put these values into the filter options. That is unfortunately a lot of manual effort and opens up the room for error.
Describe the solution you'd like
I really would like these charts to be linked to the data browser. So if I see a conflict in the confusion matrix, I want to be able to click on it and be redirected to the data browser with the right filters in place automatically.
The cool thing is, that in theory this can be done with every chart.
Label distribution: clicking on the "manually labeled" bar for label "business" redirects you to the data browser with the filter "(ML-label IN (business))"
Confidence distribution: Select a range of either percentiles (horizontal selection) or WS confidences (vertical selection) and redirect to the data browser with the WS confidence filter set to the respective values.
Confusion matrix: Click on one tile, e.g. "WS business / Manual sports", and be redirected to the data browser with the filters set to exactly that.
Inter annotator agreement: This one is a bit tricky as it could both mean that one wants to see the disagreement or one wants to see the records that were labeled by both. So that would need a little more discussion I think.
Describe alternatives you've considered
Doing everything manually.
Additional context
The text was updated successfully, but these errors were encountered: