Stats are off at locale level after sync (Italian)

[flodolo]

Locale was at 100%. Mozilla accounts was updated with 25 new strings, which were pretranslated, and then translated.

The locale currently shows 43 missing strings (no clue where that number comes from). The following sync didn't fix the number.

CC @eemeli

[flodolo]

This fixed it, not sure if we were supposed to run it once after the first sync?

~ $ python manage.py calculate_stats
Calculating stats for 115 projects...
[pontoon-intro] Updated stats for 127 translated resources and 369 projectlocales
[firefox-multi-account-containers] Updated stats for 45 translated resources and 45 projectlocales
[focus-for-ios] Updated stats for 85 translated resources and 85 projectlocales
[mozilla-vpn-website] Updated stats for 38 translated resources and 38 projectlocales
[mozilla-vpn-extension] Updated stats for 25 translated resources and 25 projectlocales
[firefox-bridge] Updated stats for 3 translated resources and 3 projectlocales
[firefox-relay-add-on] Updated stats for 28 translated resources and 29 projectlocales
[firefox-for-ios] Updated stats for 98 translated resources and 98 projectlocales
[mozilla-festival] Updated stats for 7 translated resources and 7 projectlocales
[amo-frontend] Updated stats for 60 translated resources and 65 projectlocales
[tutorial] Updated stats for 92 translated resources and 369 projectlocales
[terminology] Updated stats for 232 translated resources and 367 projectlocales
[firefox-profiler] Updated stats for 20 translated resources and 20 projectlocales
[facebook-container] Updated stats for 86 translated resources and 88 projectlocales
[focus-for-android] Updated stats for 108 translated resources and 109 projectlocales
[sumo] Updated stats for 158 translated resources and 87 projectlocales
[amo] Updated stats for 122 translated resources and 64 projectlocales
[thunderbirdnet] Updated stats for 94 translated resources and 94 projectlocales
[privacy-not-included] Updated stats for 16 translated resources and 8 projectlocales
[mozilla-foundation-website] Updated stats for 32 translated resources and 8 projectlocales
[mozilla-accounts] Updated stats for 526 translated resources and 78 projectlocales
[firefox-monitor-website] Updated stats for 537 translated resources and 47 projectlocales
[firefox-relay-website] Updated stats for 328 translated resources and 28 projectlocales
[nimbus-experiments] Updated stats for 59 translated resources and 3 projectlocales
[mozilla-vpn-client] Updated stats for 1083 translated resources and 44 projectlocales
[firefox-for-android] Updated stats for 4057 translated resources and 134 projectlocales
[common-voice] Updated stats for 5279 translated resources and 318 projectlocales
[mozillaorg] Updated stats for 7696 translated resources and 99 projectlocales
[firefox] Updated stats for 36196 translated resources and 133 projectlocales
[seamonkey] Updated stats for 7786 translated resources and 24 projectlocales
[thunderbird] Updated stats for 21499 translated resources and 70 projectlocales
[foundation-website-content] Updated stats for 3055 translated resources and 8 projectlocales
[foundation-website-content-staging] Updated stats for 0 translated resources and 0 projectlocales
[lightning] Updated stats for 0 translated resources and 0 projectlocales
[activity-stream-new-tab] Updated stats for 0 translated resources and 0 projectlocales
[test-pilot-snoozetabs] Updated stats for 45 translated resources and 45 projectlocales
[webthings-gateway] Updated stats for 34 translated resources and 34 projectlocales
[affiliates] Updated stats for 26 translated resources and 31 projectlocales
[pocket] Updated stats for 102 translated resources and 111 projectlocales
[firefox-out-of-date-add-on] Updated stats for 72 translated resources and 89 projectlocales
[test-pilot-notes] Updated stats for 50 translated resources and 50 projectlocales
[firefox-for-fire-tv] Updated stats for 7 translated resources and 7 projectlocales
[marketplace-zippy] Updated stats for 41 translated resources and 41 projectlocales
[firefox-rocket] Updated stats for 22 translated resources and 22 projectlocales
[test-pilot-firefox-send] Updated stats for 84 translated resources and 86 projectlocales
[foundation-website] Updated stats for 5 translated resources and 5 projectlocales
[firefox-translations-add-on] Updated stats for 22 translated resources and 22 projectlocales
[mozillians] Updated stats for 48 translated resources and 48 projectlocales
[engagement-firefox-rocket-keyword-aso] Updated stats for 1 translated resource and 1 projectlocale
[engagement-heartbeat-apr2018] Updated stats for 9 translated resources and 9 projectlocales
[thunderbird-wetransfer-extension] Updated stats for 56 translated resources and 64 projectlocales
[scryer] Updated stats for 1 translated resource and 1 projectlocale
[spontaneous-speech] Updated stats for 0 translated resources and 1 projectlocale
[donate-thunderbird-content-staging] Updated stats for 1 translated resource and 56 projectlocales
[test-pilot-tab-center] Updated stats for 41 translated resources and 41 projectlocales
[marketplace-fireplace] Updated stats for 6 translated resources and 6 projectlocales
[jaws-esr-add-on] Updated stats for 23 translated resources and 23 projectlocales
[amo-linter] Updated stats for 55 translated resources and 56 projectlocales
[marketplace-stats] Updated stats for 34 translated resources and 36 projectlocales
[marketplace-commbadge] Updated stats for 40 translated resources and 43 projectlocales
[lockwise-for-android] Updated stats for 10 translated resources and 10 projectlocales
[firefox-updater] Updated stats for 21 translated resources and 22 projectlocales
[firefox-monitor-add-on] Updated stats for 41 translated resources and 41 projectlocales
[firefox-input] Updated stats for 86 translated resources and 95 projectlocales
[restore-logins-extension] Updated stats for 8 translated resources and 8 projectlocales
[global-consent-manager] Updated stats for 2 translated resources and 2 projectlocales
[lockwise-ios] Updated stats for 25 translated resources and 25 projectlocales
[test-pilot-min-vid] Updated stats for 42 translated resources and 43 projectlocales
[firefox-health-report] Updated stats for 80 translated resources and 82 projectlocales
[firefox-accounts-payments] Updated stats for 35 translated resources and 40 projectlocales
[focus-for-android-po] Updated stats for 102 translated resources and 102 projectlocales
[firefox-36-start] Updated stats for 19 translated resources and 19 projectlocales
[dns-over-https-studies] Updated stats for 5 translated resources and 5 projectlocales
[dns-over-https-roll-out] Updated stats for 9 translated resources and 9 projectlocales
[marketplace-spartacus] Updated stats for 54 translated resources and 57 projectlocales
[choose-independent] Updated stats for 4 translated resources and 4 projectlocales
[social-api-directory] Updated stats for 26 translated resources and 26 projectlocales
[android-l10n] Updated stats for 18 translated resources and 18 projectlocales
[mozilla-activate] Updated stats for 46 translated resources and 23 projectlocales
[slogans] Updated stats for 19 translated resources and 11 projectlocales
[lockwise-add-on] Updated stats for 44 translated resources and 22 projectlocales
[firefox-screenshots] Updated stats for 191 translated resources and 103 projectlocales
[mozilla-donate-website] Updated stats for 115 translated resources and 59 projectlocales
[marketplace] Updated stats for 91 translated resources and 48 projectlocales
[find-my-device] Updated stats for 84 translated resources and 46 projectlocales
[test-pilot-website] Updated stats for 96 translated resources and 48 projectlocales
[mozilla-learning-network] Updated stats for 83 translated resources and 29 projectlocales
[mdn] Updated stats for 13 translated resources and 4 projectlocales
[firefox-hello] Updated stats for 190 translated resources and 64 projectlocales
[thimble] Updated stats for 165 translated resources and 43 projectlocales
[fundraising] Updated stats for 103 translated resources and 35 projectlocales
[fuel-terminology] Updated stats for 4 translated resources and 1 projectlocale
[copyright-campaign] Updated stats for 20 translated resources and 5 projectlocales
[donate-thunderbird-content] Updated stats for 151 translated resources and 59 projectlocales
[surveys] Updated stats for 31 translated resources and 10 projectlocales
[buyers-guide] Updated stats for 7 translated resources and 1 projectlocale
[firefox-tiles] Updated stats for 119 translated resources and 92 projectlocales
[firefox-os-marketing] Updated stats for 31 translated resources and 11 projectlocales
[donate-mozilla-content-staging] Updated stats for 8 translated resources and 56 projectlocales
[mozilla-advocacy] Updated stats for 125 translated resources and 23 projectlocales
[foundation-website-content-staging-2] Updated stats for 89 translated resources and 7 projectlocales
[donate-mozilla-content] Updated stats for 198 translated resources and 59 projectlocales
[appstores] Updated stats for 720 translated resources and 59 projectlocales
[fennec] Updated stats for 2546 translated resources and 91 projectlocales
[fennec-beta] Updated stats for 2170 translated resources and 68 projectlocales
[snippets] Updated stats for 226 translated resources and 26 projectlocales
[firefox-os-20] Updated stats for 532 translated resources and 7 projectlocales
[mozillalang] Updated stats for 5034 translated resources and 102 projectlocales
[firefox-os-21] Updated stats for 595 translated resources and 7 projectlocales
[firefox-os-25] Updated stats for 937 translated resources and 10 projectlocales
[firefox-os] Updated stats for 948 translated resources and 10 projectlocales
[firefox-os-22] Updated stats for 848 translated resources and 9 projectlocales
[engagement] Updated stats for 299 translated resources and 6 projectlocales
[firefox-beta] Updated stats for 25425 translated resources and 82 projectlocales
[foundation-website-staging] Updated stats for 2441 translated resources and 7 projectlocales
Updated stats for 367 locales
Calculating stats complete for all projects.

[flodolo]

After a new batch of strings, stats look good.

New batch of strings (80 in notifications, but actually missing only 34, since they were migrated to a new file).

Right after sync, the number matches (at locale-level in the header, and at project-level).
After pretranslation, missing went down to 0.
After translation, everything is at 0.

Not sure if calculate_stats fixed it for good?

[flodolo]

Correction, I should have looked at the locale, which is way worse than before: now it says I have 542 strings missing (!!), and 9 unreviewed. There were never unreviewed strings at any point.

[eemeli]

I can't see any current error with the stats for Italian, Mozilla Accounts, or Mozilla Accounts in Italian. Is the issue here replicable anywhere?

[flodolo]

I can't see any current error with the stats for Italian, Mozilla Accounts, or Mozilla Accounts in Italian. Is the issue here replicable anywhere?

Not in Italian. @mathjazz mentioned that Slovenian was also broken, but I think that was fixed by me recalculating stats.

[mathjazz]

Slovenian looks good now.

[flodolo]

For the record, this happened again this morning.

Mozilla accounts was updated overnight, with a bunch of other projects (63 new strings in FxA, 3 new strings in Firefox iOS).

• Missing and unreviewed were completely off (there were only 59 missing, 0 unreviewed), pretranslated was correct.
• Translating strings didn't lower the number for either, but lowered the number for pretranslated.
• Once I was done translating, the project-level stats were correct, the locale-level stats didn't change.

I checked about 30 minutes later, and they seem to have fixed themselves, possibly because another project updated?

Jan 16 20:42:57 mozilla-pontoon app/worker.1 [firefox-for-ios] Updated stats for 98 translated resources, 98 projectlocales, and 367 locales
Jan 16 20:52:50 mozilla-pontoon app/worker.1 [firefox-for-android] Updated stats for 4057 translated resources, 134 projectlocales, and 367 locales
Jan 16 21:03:41 mozilla-pontoon app/worker.1 [mozilla-accounts] Updated stats for 597 translated resources, 79 projectlocales, and 367 locales
Jan 17 01:02:54 mozilla-pontoon app/worker.1 [mozilla-accounts] Updated stats for 597 translated resources, 79 projectlocales, and 367 locales
Jan 17 08:12:33 mozilla-pontoon app/worker.1 [foundation-website-content] Updated stats for 3059 translated resources, 8 projectlocales, and 367 locales
Jan 17 08:17:42 mozilla-pontoon app/worker.1 [foundation-website-content] Updated stats for 3061 translated resources, 8 projectlocales, and 367 locales

[flodolo]

I tried to replicate locally, but it didn't work. I've created a new branch in the fxa-content-server-l10n repository, and set it to a specific comment before the last update

git reset --hard 98c70052b5b0a5ad3808fdb5db78460bae4a3016

I set up Mozilla accounts against the branch, with German and Italian, and enabled pretranslation for both.

Synced the project, both locales are at 100% at this point.

I then cherry-picked the commit with new content (cabf791520e82c602dbb5b9e4adca42dc1efa875) on the branch, then synced again. Stats are still correct at this point (no missing, no unreviewed, only pretranslated strings).

I added Arabic, which is incomplete, and synced again (had to force it, because of the bug with new locales). Stats are still correct. Just in case, I put an unreviewed suggestion on Arabic.

I cherry-picked bbea17b5cc8e648c13acc271b59bcd8a4bc0fea9, which adds a new string. Stats are still correct after sync.

I honestly don't know how to replicate at this point.