Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark differences when verbose turned on #2656

Open
lizziel opened this issue Dec 19, 2024 · 2 comments
Open

Benchmark differences when verbose turned on #2656

lizziel opened this issue Dec 19, 2024 · 2 comments
Assignees
Labels
category: Bug Something isn't working topic: Benchmarking and Testing Related to CI, integration tests, or scientific benchmarking

Comments

@lizziel
Copy link
Contributor

lizziel commented Dec 19, 2024

Your name

Lizzie Lundgren

Your affiliation

Harvard University

What happened? What did you expect to happen?

I used the dev version of GC-Classic 14.5.1 with and without verbose on and found differences in output. This was a 1hr benchmark simulation. The differences are small but pervasive. We should expect no differences from changing verbose in geoschem_config.yml.

What are the steps to reproduce the bug?

Run benchmark simulation (dev 14.5.1) with and without verbose on. Then diff the OutputDir directories.

Please attach any relevant configuration and log files.

No response

What GEOS-Chem version were you using?

14.5.1 dev

What environment were you running GEOS-Chem on?

Local cluster

What compiler and version were you using?

gcc 10.2

Will you be addressing this bug yourself?

Yes

In what configuration were you running GEOS-Chem?

GCClassic

What simulation were you running?

Full chemistry

As what resolution were you running GEOS-Chem?

4x5

What meterology fields did you use?

GEOS-FP

Additional information

I plan to look into whether this is also the case for GCHP.

@lizziel lizziel added the category: Bug Something isn't working label Dec 19, 2024
@lizziel lizziel changed the title Put a one-line description here Benchmark differences when verbose turned on Dec 19, 2024
@lizziel lizziel self-assigned this Dec 19, 2024
@lizziel lizziel added the topic: Benchmarking and Testing Related to CI, integration tests, or scientific benchmarking label Dec 19, 2024
@yantosca
Copy link
Contributor

Thanks @lizziel. I wonder if somehow we are toggling a function under verbose that changes model state? This could also be a problem in parallelization or initialization. Keep us posted!

@lizziel
Copy link
Contributor Author

lizziel commented Dec 19, 2024

Yes. I would like to pick this up after the GC-Classic reproducibility updates go into 14.6 dev just in case there are any impacts there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: Bug Something isn't working topic: Benchmarking and Testing Related to CI, integration tests, or scientific benchmarking
Projects
None yet
Development

No branches or pull requests

2 participants