Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

submissions analysis + webpage rendering #101

Merged
merged 16 commits into from
Dec 7, 2024
Merged

Conversation

celine-lee
Copy link
Collaborator

@celine-lee celine-lee commented Nov 27, 2024

Script to clone, evaluate, and present all submissions in celinelee/commit0_submissions on webpage.

Instructions to analyze submissions then render webpages are in docs/README.md:

Update HF dataset:

python docs/update_submissions_dataset.py

Run submissions analysis on SPLIT

python docs/render_submissions.py 
                       --do_setup --get_blank_details --get_reference_details # only once, at beginning of setting up environment
                       --analyze_submissions 
                       --split SPLIT

Render webpages on submissions.

python docs/render_submissions.py --render_webpages --overwrite_previous_eval

Deploy to website.

cd ../commit-0.github.io
mkdocs gh-deploy --config-file ../commit0/mkdocs.yml --remote-branch main

@wenting-zhao
Copy link
Collaborator

Hi @celine-lee thanks for the PR. Can you document in this PR how to run your code?

@wenting-zhao
Copy link
Collaborator

Also can you resolve the conflicts before I review?

@celine-lee celine-lee changed the title [WIP] submissions analysis + webpage rendering submissions analysis + webpage rendering Dec 6, 2024
@wenting-zhao
Copy link
Collaborator

This is awesome!

@wenting-zhao wenting-zhao merged commit df0dc34 into main Dec 7, 2024
2 checks passed
@wenting-zhao wenting-zhao deleted the analysis_in_docs branch December 7, 2024 01:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants