Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

call benchmark #8

Open
jmikedupont2 opened this issue Oct 13, 2023 · 0 comments
Open

call benchmark #8

jmikedupont2 opened this issue Oct 13, 2023 · 0 comments

Comments

@jmikedupont2
Copy link
Member

Your plan for today's work on the AutoGPT Autonomous Agents Hackathon sounds great! To run the official benchmarks in GitHub Actions and provide a comment with the /agent-action command, you should be able to use a command like this:

/agent-action benchmark plan <bot_url> <benchmark_url>

Replace <bot_url> with the URL of your AutoGPT bot and <benchmark_url> with the URL of the official benchmarks. This should help you initiate the benchmarking process and get the results in a comment. Good luck with your hackathon project!

Certainly! You can use the Python click library to create a simple command-line parser for the part after the /agent-action command. Here's a basic example:

import click

@click.command()
@click.option('--action', prompt='Enter action (e.g., benchmark):')
@click.option('--plan', prompt='Enter plan:')
@click.option('--boturl', prompt='Enter bot URL:')
@click.option('--benchmarkurl', prompt='Enter benchmark URL:')
def parse_command(action, plan, boturl, benchmarkurl):
    if action == 'benchmark':
        # You can perform the necessary actions here, e.g., running benchmarks
        click.echo(f'Action: {action}')
        click.echo(f'Plan: {plan}')
        click.echo(f'Bot URL: {boturl}')
        click.echo(f'Benchmark URL: {benchmarkurl}')
    else:
        click.echo('Invalid action.')

if __name__ == '__main__':
    parse_command()

With this code, you can create a simple command-line parser that prompts the user for the action, plan, bot URL, and benchmark URL, and then processes the action if it's "benchmark." You can expand upon this by adding the logic to run benchmarks or perform other actions as needed.

Make sure you have the click library installed in your Python environment to use this code. You can install it using pip install click.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant