Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Running Greg’s work on EC2 to understand all data steps #1040

Open
2 of 6 tasks
LorneLeonard-NOAA opened this issue Jan 15, 2025 · 3 comments
Open
2 of 6 tasks

Running Greg’s work on EC2 to understand all data steps #1040

LorneLeonard-NOAA opened this issue Jan 15, 2025 · 3 comments
Assignees
Labels

Comments

@LorneLeonard-NOAA
Copy link

LorneLeonard-NOAA commented Jan 15, 2025

  • Setup EC2 instance to run FIM-Dev
  • Run Docker image
  • Test Greg's code with sample dataset
    • Confirm folder structures
    • Confirm file inputs
    • Evaluate sample output. confirm matches existing example
@LorneLeonard-NOAA
Copy link
Author

LorneLeonard-NOAA commented Jan 15, 2025

  • Folders require reorganization
  • Needed to create folders
  • Creation of fim_inputs.csv file.

Timing
real 16m1.708s
user 15m49.030s
sys 1m11.815s

Results from using EC2 FIM - Docker setup
image

@LorneLeonard-NOAA
Copy link
Author

Timing with 12 threads i.e. j = 12
real 16m6.453s
user 15m53.717s
sys 1m12.867s

@LorneLeonard-NOAA
Copy link
Author

Timing with 12 threads i.e. j = 12
docker run --cpus="4.0"

real 16m10.502s
user 15m52.569s
sys 1m11.547s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants