-
-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
SF-3156 Warn user when mismatch in translated and training books #2956
Conversation
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #2956 +/- ##
=======================================
Coverage 82.02% 82.02%
=======================================
Files 544 544
Lines 31673 31685 +12
Branches 5127 5147 +20
=======================================
+ Hits 25979 25989 +10
+ Misses 4939 4927 -12
- Partials 755 769 +14 ☔ View full report in Codecov by Sentry. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewed 5 of 5 files at r1, all commit messages.
Reviewable status: complete! all files reviewed, all discussions resolved (waiting on @RaymondLuong3)
4a4ca85
to
fda86e3
Compare
Shouldn't we prevent them from proceeding to the next step in this case? I can't think of any good reason why they'd actually want this. |
I could go either way. If we prevented them from proceeding when not all translated books selected have a matching reference book selected to train on, the user might realize they had made a mistake. That would be a positive. So perhaps that is worth doing. For the second scenario when the user has chosen a source without books matching the target project, I think the warning is good enough. If a project decides to train on only the back translation (maybe that will happen) then they would get just the warning rather than forced not to use the BT because its translation is behind the target project. |
What if we remove the book from the selected books list if no reference sources have it selected? |
@kylebuss, currently only source-target pairs are included for training. So I think we're already doing that, unless you're meaning something else by "selected books list" @RaymondLuong3, yes, good clarification. I'm only recommending we prevent proceeding for the first scenario. |
@josephmyers, I was mainly addressing the second scenario when the target has selected books but not all of those books were selected in the source. Rather than displaying a warning we could remove the missing book from the target list. I hope this clarifies what I'm meaning. As for the first scenario, there might be an edge case where we want the user to acknowledge before proceeding like we do with the language codes on the first step. One thought that comes to mind is if we down the road allow selected chapters to be include in training rather than the whole book. I don't know how likely of a scenario it would be for a project to use one source for NT and another for OT (like Hebrew -> English OT and Greek -> English NT), but in that case, if they have translated books in both OT and NT but the source only has OT we would want to allow them to proceed. |
@RaymondLuong3 I thought the wording could be improved and asked @bhartmoore who came up with these suggested changes:
|
fda86e3
to
74f0258
Compare
Thanks. I've updated the wording on the warning messages. I opened SF-3173 to add the require user to fix warning task. I am going to merge this as-is since it has already gone through testing and wasn't part of the original issue. |
The user should see warnings on the training step for two scenarios:
Warnings will appear for the user, but they can still proceed to generate a draft.
This change is