8000 doc: Update benchmark result. by huacnlee · Pull Request #249 · huacnlee/autocorrect · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

doc: Update benchmark result. #249

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Mar 24, 2025
Merged

doc: Update benchmark result. #249

merged 3 commits into from
Mar 24, 2025

Conversation

huacnlee
Copy link
Owner
@huacnlee huacnlee commented Mar 24, 2025 •
edited
Loading

Recent changes, we get: 10% ~ 30% performance improvement, and halfwidth get 50% improvement.

format_050              time:   [5.0593 µs 5.0903 µs 5.1375 µs]
                        change: [-20.855% -20.397% -19.808%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  4 (4.00%) high mild
  2 (2.00%) high severe

format_100              time:   [8.6155 µs 8.6380 µs 8.6626 µs]
                        change: [-21.281% -20.865% -20.394%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) high mild
  2 (2.00%) high severe

format_400              time:   [23.488 µs 23.503 µs 23.520 µs]
                        change: [-23.933% -23.332% -22.808%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) high mild
  3 (3.00%) high severe

format_html             time:   [333.56 µs 334.31 µs 335.28 µs]
                        change: [-4.9896% -4.7014% -4.4106%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
  4 (4.00%) high mild
  4 (4.00%) high severe

halfwidth_english       time:   [989.11 ns 998.18 ns 1.0092 µs]
                        change: [-52.047% -51.654% -51.169%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
  12 (12.00%) high severe

format_json             time:   [53.582 µs 53.845 µs 54.249 µs]
                        change: [-12.689% -11.898% -11.134%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
  4 (4.00%) high mild
  7 (7.00%) high severe

format_javascript       time:   [173.77 µs 174.53 µs 175.48 µs]
                        change: [-3.9643% -3.3952% -2.5339%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
  6 (6.00%) high mild
  2 (2.00%) high severe

format_json_2k          time:   [8.8331 ms 8.8477 ms 8.8666 ms]
                        change: [-16.542% -16.064% -15.683%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  4 (4.00%) high mild
  3 (3.00%) high severe

format_jupyter          time:   [194.61 µs 194.80 µs 195.02 µs]
                        change: [-6.0811% -5.2462% -4.4798%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
  8 (8.00%) high mild
  4 (4.00%) high severe

format_markdown         time:   [1.2318 ms 1.2576 ms 1.2907 ms]
                        change: [-7.1730% -6.4374% -5.4945%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 18 outliers among 100 measurements (18.00%)
  3 (3.00%) high mild
  15 (15.00%) high severe

spellcheck_50           time:   [1.1976 µs 1.2004 µs 1.2037 µs]
                        change: [-11.644% -11.236% -10.855%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild

spellcheck_100          time:   [2.3332 µs 2.3822 µs 2.4342 µs]
                        change: [-10.841% -9.7377% -8.5275%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 13 outliers among 100 measurements (13.00%)
  7 (7.00%) high mild
  6 (6.00%) high severe

spellcheck_400          time:   [7.6525 µs 7.6892 µs 7.7337 µs]
                        change: [-6.7812% -6.1409% -5.4214%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
  4 (4.00%) high mild
  7 (7.00%) high severe

lint_markdown           time:   [1.3219 ms 1.3412 ms 1.3641 ms]
                        change: [-3.9642% -1.0184% +2.1326%] (p = 0.52 > 0.05)
                        No change in performance detected.
Found 12 outliers among 100 measurements (12.00%)
  6 (6.00%) high mild
  6 (6.00%) high severe

lint_json               time:   [58.524 µs 58.805 µs 59.145 µs]
                        change: [-8.9511% -8.4724% -7.9769%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
  5 (5.00%) high mild
  3 (3.00%) high severe

lint_html               time:   [353.92 µs 360.32 µs 371.64 µs]
                        change: [-6.3317% -5.6190% -4.5049%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  2 (2.00%) high mild
  4 (4.00%) high severe

lint_javascript         time:   [181.06 µs 183.88 µs 187.68 µs]
                        change: [-1.9953% -0.2524% +2.0506%] (p = 0.85 > 0.05)
                        No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
  1 (1.00%) high mild
  5 (5.00%) high severe

lint_yaml               time:   [375.97 µs 377.38 µs 379.46 µs]
                        change: [-12.032% -11.410% -10.886%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
  2 (2.00%) high mild
  3 (3.00%) high severe

lint_to_json            time:   [1.2790 ms 1.2891 ms 1.3037 ms]
                        change: [-4.0166% -2.4721% -0.4510%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 10 outliers among 100 measurements (10.00%)

8000
  5 (5.00%) high mild
  5 (5.00%) high severe

lint_to_diff            time:   [1.3725 ms 1.3984 ms 1.4333 ms]
                        change: [-5.0878% -2.5981% +0.3373%] (p = 0.06 > 0.05)
                        No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
  1 (1.00%) high mild
  6 (6.00%) high severe

NOTE: Value from af1dd59 vs d6ea7c1 at same computer, not only the README result diff.

@quake

@huacnlee huacnlee merged commit f0a2f9b into main Mar 24, 2025
11 checks passed
@huacnlee huacnlee deleted the update-benchmark branch March 24, 2025 02:25
huacnlee
huacnlee commented Mar 24, 2025
View reviewed changes
README.md
lint_javascript time: [177.00 µs 177.88 µs 178.69 µs]
lint_yaml time: [378.35 µs 382.30 µs 387.85 µs]
lint_to_json time: [1.2629 ms 1.2689 ms 1.2769 ms]
lint_to_diff time: [1.3255 ms 1.3288 ms 1.3327 ms]
Copy link
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The lint result diff is looks like performance down.

This is because the result is too old, I was added some features to lint but not update this result, so it is expected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@huacnlee
0