8000 Add ci/cd benchmark by byawitz · Pull Request #8414 · appwrite/appwrite · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Add ci/cd benchmark #8414

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 18 commits into from
Jul 31, 2024
Merged

Add ci/cd benchmark #8414

merged 18 commits into from
Jul 31, 2024

Conversation

byawitz
Copy link
Member
@byawitz byawitz commented Jul 18, 2024

What does this PR do?

Adding CI/CD benchmark on PR

Copy link

✨ Benchmark results

  • Requests per second: 2459.51320466479
  • Total 200 requests: (jq -r '.statusCodeDistribution.200' benchmark.json)
  • 99 latency: 0.062312962

Copy link

✨ Benchmark results

  • ⚡ Requests per second: 2603
  • ✅ Total 200 requests:
  • 🔝 99 latency: 0.060357484

Copy link

✨ Benchmark results

  • Requests per second: 1204
  • Total 200 requests: 11994
  • 99 latency: 0.13283904

⚡ Benchmark results

Metric PR Latest version
RPS 1204 2138
200 11994 21345
P99 0.13283904 0.082391253

Copy link

✨ Benchmark results

  • Requests per second: 1723
  • Total 200 requests: 310204
  • 99 latency: 0.082712851

⚡ Benchmark Compering

Metric PR Latest version
RPS 1723 2237
200 310204 402617
P99 0.082712851 0.075572608

@byawitz byawitz requested a review from christyjacob4 July 18, 2024 21:31
Copy link

✨ Benchmark results

  • Requests per second: 1771
  • Total 200 requests: 318856
  • 99 latency: 0.082739085

⚡ Benchmark Compering

Metric PR Latest version
RPS 1771 2230
200 318856 401477
P99 0.082739085 0.072582799

Copy link

✨ Benchmark results

  • Requests per second: 1696
  • Requests with 200 status code: 305251
  • P99 latency: 0.080629043

⚡ Benchmark Comparison

Metric This PR Latest version
RPS 1696 2104
200 305251 378728
P99 0.080629043 0.073856637

Comment on lines 3 to 6
concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we make this a little more optimal and make the benchmark part of the existing tests here https://github.com/appwrite/appwrite/blob/main/.github/workflows/tests.yml#L41-L47

That way we already have the image built and saved in cache.

We can add a new job called benchmark that uses the cached image from the setup job.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Copy link

✨ Benchmark results

  • Requests per second: 1755
  • Requests with 200 status code: 315981
  • P99 latency: 0.077784953

⚡ Benchmark Comparison

Metric This PR Latest version
RPS 1755 2216
200 315981 398941
P99 0.077784953 0.0730288

Copy link

✨ Benchmark results

  • Requests per second: 1,745
  • Requests with 200 status code: 314,132
  • P99 latency: 0.,078,400,655

⚡ Benchmark Comparison

Metric This PR Latest version
RPS 1,745 2212
200 314,132 398225
P99 0.,078,400,655 0.07234523

Copy link

✨ Benchmark results

  • Requests per second: 1,755
  • Requests with 200 status code: 315,943
  • P99 latency: 0.077911213

⚡ Benchmark Comparison

Metric This PR Latest version
RPS 1,755 2,211
200 315,943 397,976
P99 0.077911213 0.073595476

Copy link

✨ Benchmark results

  • Requests per second: 1,644
  • Requests with 200 status code: 295,989
  • P99 latency: 0.079333671

⚡ Benchmark Comparison

Metric This PR Latest version
RPS 1,644 2,034
200 295,989 366,238
P99 0.079333671 0.076843401

@christyjacob4 christyjacob4 merged commit 733b654 into 1.6.x Jul 31, 2024
24 checks passed
@christyjacob4 christyjacob4 deleted the feat-adding-cicd-benchmarker branch July 31, 2024 20:51
@stnguyen90 stnguyen90 changed the title feat: Adding ci/cd benchmark Add ci/cd benchmark Sep 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants
0