Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test benches #2

Closed
wants to merge 6 commits into from
Closed

Test benches #2

wants to merge 6 commits into from

Conversation

gruuya
Copy link
Collaborator

@gruuya gruuya commented Mar 15, 2024

Test CI benches again.

@gruuya
Copy link
Collaborator Author

gruuya commented Mar 15, 2024

/benchmark

Copy link

Benchmark results

Benchmarks comparing 81b0a01 (main) and df3b9e4 (PR)
Comparing 81b0a01 and df3b9e4
--------------------
Benchmark tpch.json
--------------------
┏━━━━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Query        ┃  81b0a01 ┃  df3b9e4 ┃       Change ┃
┡━━━━━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ QQuery 1     │ 442.47ms │ 439.51ms │    no change │
│ QQuery 2     │  60.03ms │  58.81ms │    no change │
│ QQuery 3     │ 144.57ms │ 143.76ms │    no change │
│ QQuery 4     │  83.95ms │  85.38ms │    no change │
│ QQuery 5     │ 200.31ms │ 267.62ms │ 1.34x slower │
│ QQuery 6     │ 105.19ms │ 142.57ms │ 1.36x slower │
│ QQuery 7     │ 280.88ms │ 289.32ms │    no change │
│ QQuery 8     │ 199.98ms │ 199.07ms │    no change │
│ QQuery 9     │ 292.75ms │ 295.88ms │    no change │
│ QQuery 10    │ 232.75ms │ 233.26ms │    no change │
│ QQuery 11    │  63.26ms │  62.48ms │    no change │
│ QQuery 12    │ 124.82ms │ 124.34ms │    no change │
│ QQuery 13    │ 174.01ms │ 179.38ms │    no change │
│ QQuery 14    │ 130.98ms │ 128.85ms │    no change │
│ QQuery 15    │ 189.61ms │ 201.42ms │ 1.06x slower │
│ QQuery 16    │  52.59ms │  54.76ms │    no change │
│ QQuery 17    │ 310.82ms │ 308.70ms │    no change │
│ QQuery 18    │ 439.84ms │ 440.61ms │    no change │
│ QQuery 19    │ 227.86ms │ 232.11ms │    no change │
│ QQuery 20    │ 191.79ms │ 192.04ms │    no change │
│ QQuery 21    │ 320.83ms │ 327.25ms │    no change │
│ QQuery 22    │  53.61ms │  54.35ms │    no change │
└──────────────┴──────────┴──────────┴──────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary      ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (81b0a01)   │ 4322.90ms │
│ Total Time (df3b9e4)   │ 4461.49ms │
│ Average Time (81b0a01) │  196.50ms │
│ Average Time (df3b9e4) │  202.79ms │
│ Queries Faster         │         0 │
│ Queries Slower         │         3 │
│ Queries with No Change │        19 │
└────────────────────────┴───────────┘

@gruuya
Copy link
Collaborator Author

gruuya commented Mar 15, 2024

/benchmark

Copy link

Benchmark results

Benchmarks comparing 8c98c0e (main) and df3b9e4 (PR)
Comparing 8c98c0e and df3b9e4
--------------------
Benchmark tpch.json
--------------------
┏━━━━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Query        ┃  8c98c0e ┃  df3b9e4 ┃       Change ┃
┡━━━━━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ QQuery 1     │ 441.78ms │ 444.58ms │    no change │
│ QQuery 2     │  58.94ms │  73.62ms │ 1.25x slower │
│ QQuery 3     │ 145.38ms │ 203.79ms │ 1.40x slower │
│ QQuery 4     │  88.50ms │ 124.15ms │ 1.40x slower │
│ QQuery 5     │ 198.34ms │ 200.73ms │    no change │
│ QQuery 6     │ 106.21ms │ 106.18ms │    no change │
│ QQuery 7     │ 278.39ms │ 287.54ms │    no change │
│ QQuery 8     │ 203.42ms │ 200.24ms │    no change │
│ QQuery 9     │ 305.02ms │ 307.84ms │    no change │
│ QQuery 10    │ 245.46ms │ 242.42ms │    no change │
│ QQuery 11    │  62.70ms │  63.35ms │    no change │
│ QQuery 12    │ 124.85ms │ 125.34ms │    no change │
│ QQuery 13    │ 183.79ms │ 193.07ms │ 1.05x slower │
│ QQuery 14    │ 132.27ms │ 130.51ms │    no change │
│ QQuery 15    │ 188.29ms │ 200.99ms │ 1.07x slower │
│ QQuery 16    │  51.40ms │  52.41ms │    no change │
│ QQuery 17    │ 313.43ms │ 333.16ms │ 1.06x slower │
│ QQuery 18    │ 453.80ms │ 456.20ms │    no change │
│ QQuery 19    │ 232.39ms │ 234.42ms │    no change │
│ QQuery 20    │ 204.01ms │ 198.49ms │    no change │
│ QQuery 21    │ 329.91ms │ 329.67ms │    no change │
│ QQuery 22    │  54.20ms │  56.21ms │    no change │
└──────────────┴──────────┴──────────┴──────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary      ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (8c98c0e)   │ 4402.51ms │
│ Total Time (df3b9e4)   │ 4564.90ms │
│ Average Time (8c98c0e) │  200.11ms │
│ Average Time (df3b9e4) │  207.50ms │
│ Queries Faster         │         0 │
│ Queries Slower         │         6 │
│ Queries with No Change │        16 │
└────────────────────────┴───────────┘

@gruuya
Copy link
Collaborator Author

gruuya commented Mar 15, 2024

/benchmark

Copy link

Benchmark results

Benchmarks comparing 71bdbff (main) and df3b9e4 (PR)
Comparing 71bdbff and df3b9e4
--------------------
Benchmark tpch.json
--------------------
┏━━━━━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Query        ┃  71bdbff ┃  df3b9e4 ┃       Change ┃
┡━━━━━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ QQuery 1     │ 438.93ms │ 444.18ms │    no change │
│ QQuery 2     │  59.38ms │  76.30ms │ 1.28x slower │
│ QQuery 3     │ 144.60ms │ 207.14ms │ 1.43x slower │
│ QQuery 4     │  85.16ms │  90.45ms │ 1.06x slower │
│ QQuery 5     │ 195.51ms │ 198.02ms │    no change │
│ QQuery 6     │ 105.64ms │ 105.13ms │    no change │
│ QQuery 7     │ 267.12ms │ 276.80ms │    no change │
│ QQuery 8     │ 196.23ms │ 197.97ms │    no change │
│ QQuery 9     │ 295.28ms │ 298.68ms │    no change │
│ QQuery 10    │ 238.23ms │ 241.99ms │    no change │
│ QQuery 11    │  62.19ms │  63.14ms │    no change │
│ QQuery 12    │ 125.58ms │ 125.03ms │    no change │
│ QQuery 13    │ 181.19ms │ 178.20ms │    no change │
│ QQuery 14    │ 129.41ms │ 128.22ms │    no change │
│ QQuery 15    │ 189.49ms │ 192.78ms │    no change │
│ QQuery 16    │  51.10ms │  51.06ms │    no change │
│ QQuery 17    │ 305.98ms │ 296.43ms │    no change │
│ QQuery 18    │ 430.65ms │ 424.84ms │    no change │
│ QQuery 19    │ 231.94ms │ 226.69ms │    no change │
│ QQuery 20    │ 187.00ms │ 188.89ms │    no change │
│ QQuery 21    │ 320.07ms │ 322.07ms │    no change │
│ QQuery 22    │  52.70ms │  52.85ms │    no change │
└──────────────┴──────────┴──────────┴──────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary      ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (71bdbff)   │ 4293.37ms │
│ Total Time (df3b9e4)   │ 4386.86ms │
│ Average Time (71bdbff) │  195.15ms │
│ Average Time (df3b9e4) │  199.40ms │
│ Queries Faster         │         0 │
│ Queries Slower         │         3 │
│ Queries with No Change │        19 │
└────────────────────────┴───────────┘

Copy link

Thank you for your contribution. Unfortunately, this pull request is stale because it has been open 60 days with no activity. Please remove the stale label or comment or this will be closed in 7 days.

@github-actions github-actions bot added the Stale label May 15, 2024
@gruuya gruuya closed this May 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant