Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create common BaseClass for Evaluation and Simulation #4

Open
wants to merge 29 commits into
base: main
Choose a base branch
from
Open

Create common BaseClass for Evaluation and Simulation #4

wants to merge 29 commits into from

Conversation

sunnybak
Copy link
Contributor

  • Add common BaseClass for Evaluation and Simulation
  • Implement shared methods and initialization logic in BaseClass
  • Ensure BaseClass is ready for subclassing by Evaluation and Simulation
  • Test the changes

This PR was written by Devin 👼

Link to Devin run: https://preview.devin.ai/devin/be7eee023e0d419f953d961d2220b05a

sunnybak and others added 29 commits July 25, 2024 08:07
@sunnybak
chore: fixes first msg printing, prints for evals, errors for API key
4d2a3d4
@devin-ai-integration
Add common BaseClass for Evaluation and Simulation
b49bf29
@devin-ai-integration
Refactor Evaluation and Simulation to inherit from BaseClass
1a6ad75
@devin-ai-integration
Add tests directory with unit tests
91de2ad
@devin-ai-integration
Restore absolute import paths in test files
2223255
@devin-ai-integration
Fix syntax error in types.py
3294cd7
@devin-ai-integration
Fix type hint for Evaluation class
cabcbe8
@devin-ai-integration
Provide final_state argument in RunData and fix subroutine call in un…
2bd27c0 
…it tests
@devin-ai-integration
Provide score and result arguments in EvalResult instances for unit t…
d3bd4eb 
…ests
@devin-ai-integration
Define callable subroutine method in BaseClass and fix NameError in e…
5ee6a50 
…valuation.py
@devin-ai-integration
Make BaseClass abstract and define abstract methods
24d7c45
@devin-ai-integration
Fix NameError in evaluation.py by using string literal for return typ…
953b39f 
…e hint
@devin-ai-integration
Implement ConcreteBaseClass for unit testing BaseClass
315d317
@devin-ai-integration
Implement concrete subclasses for unit testing and correct subroutine…
4e3bd92 
… method
@devin-ai-integration
Fix async subroutine method call in unit tests
e185fe4
@devin-ai-integration
Make subroutine method synchronous and update tests
3f739e9
@devin-ai-integration
Update import statements to use relative imports
cfef656
@devin-ai-integration
Use relative imports in types.py
1e39d69
@devin-ai-integration
Update import statements in test_evaluation.py to use relative imports
ef65171
@devin-ai-integration
Use relative imports in evaluation.py
356cd67
@devin-ai-integration
Use relative imports in datasets.py
29cf341
@devin-ai-integration
Implement basic visualization method in Evaluation class
8e4017a
@devin-ai-integration
Update subroutine method to raise NotImplementedError
c1c7d8d
@devin-ai-integration
Update unit tests for subroutine methods in BaseClass and Evaluation …
a24ef28 
…classes
@devin-ai-integration
Fix subroutine method to be callable in test classes
53e996c
@devin-ai-integration
Update unit tests and fix subroutine method implementations
0eb27f1
@devin-ai-integration
Fix subroutine method signature and update subroutine_with_evals in E…
6acfc13 
…valuation class
@devin-ai-integration
Update Evaluation unit tests to handle async subroutine method
ce11427
@devin-ai-integration
Fix subroutine method calls in test_evaluation.py
fc30870
@sunnybak sunnybak force-pushed the main branch 4 times, most recently from b397940 to fb97bd7 Compare August 23, 2024 18:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@sunnybak