Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Descriptions + release dates #346

Merged
merged 7 commits into from
Nov 23, 2023

Conversation

alexander-griffen
Copy link
Contributor

@alexander-griffen alexander-griffen commented Nov 15, 2023

Fixes #192 and fixes #304

  • Write migration to change release dates to text
  • Change import scripts to update release dates + descriptions
  • Visually check for typos in import scripts
  • Create migration/script to rerun all (relevant) imports
  • Test script locally

@alexander-griffen alexander-griffen self-assigned this Nov 15, 2023
@alexander-griffen alexander-griffen force-pushed the 192-store-display-dataset-dates-descriptions branch 2 times, most recently from eb11b1e to 8ed4cd6 Compare November 15, 2023 10:27
Copy link

codecov bot commented Nov 15, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (ae67f86) 82.50% compared to head (b724241) 82.24%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #346      +/-   ##
==========================================
- Coverage   82.50%   82.24%   -0.26%     
==========================================
  Files          87       87              
  Lines        2669     2636      -33     
  Branches      275      275              
==========================================
- Hits         2202     2168      -34     
  Misses        404      404              
- Partials       63       64       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@alexander-griffen alexander-griffen force-pushed the 192-store-display-dataset-dates-descriptions branch 3 times, most recently from 9c63c94 to 6b2de17 Compare November 15, 2023 16:25
@alexander-griffen alexander-griffen marked this pull request as ready for review November 15, 2023 16:27
@alexander-griffen alexander-griffen changed the title DRAFT - Descriptions + release dates Descriptions + release dates Nov 15, 2023
Copy link
Member

@struan struan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Few small things to check with the dates of datasets but otherwise good.

Import all script super helpful.

hub/management/commands/import_imd_data.py Outdated Show resolved Hide resolved
hub/management/commands/import_ruc_data.py Outdated Show resolved Hide resolved
There is a separate, more up-to-date fuel import dataset that exists in
the app, and this import isn't used. The test for this import is also
removed.
@alexander-griffen alexander-griffen force-pushed the 192-store-display-dataset-dates-descriptions branch from 6b2de17 to e1e4d72 Compare November 21, 2023 10:46
@alexander-griffen
Copy link
Contributor Author

Also need to change the templates to show release dates, and change source attributions

@alexander-griffen alexander-griffen force-pushed the 192-store-display-dataset-dates-descriptions branch from e1e4d72 to e021a98 Compare November 23, 2023 10:18
This commit covers updates to all of the dataset import
scripts, ensuring that their release date, description,
and source label are what is expected (according to the 'crowdsourcing'
sheet).
This change also removes part of the MP import script that runs all the
MP-related scripts, to avoid redundancy
@alexander-griffen alexander-griffen force-pushed the 192-store-display-dataset-dates-descriptions branch from e021a98 to b724241 Compare November 23, 2023 10:41
@alexander-griffen alexander-griffen merged commit b724241 into main Nov 23, 2023
6 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Provide more useful dataset descriptions Store and display release dates for all datasets
2 participants