Skip to content

[Autoloop: perf-comparison] - #435

Draft
github-actions[bot] wants to merge 95 commits into
mainfrom
autoloop/perf-comparison
Draft

[Autoloop: perf-comparison]#435
github-actions[bot] wants to merge 95 commits into
mainfrom
autoloop/perf-comparison

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

🤖 This PR is maintained by Autoloop. Each accepted iteration adds a commit to this branch.

Autoloop: perf-comparison

Goal: Benchmark every tsb function vs pandas equivalent.

Current Best Metric: 756 benchmarked function pairs

Program Issue: #221


Latest Iteration (418)

Added firstValidIndex / lastValidIndex benchmarks:

  • TypeScript: benchmarks/tsb/bench_first_last_valid_index.ts — 100k-row Series with NaN at start, end, and scattered; 500 measured iterations
  • Python: benchmarks/pandas/bench_first_last_valid_index.py — matching dataset and loop structure using Series.first_valid_index() / Series.last_valid_index()

Metric: 755 → 756 (+1)

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • releaseassets.githubusercontent.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "releaseassets.githubusercontent.com"

See Network Configuration for more information.

Generated by Autoloop · 1.4K AIC · ⌖ 12.1 AIC · ⊞ 51.8K ·
Comment /autoloop to run again

…ndex benchmark

Run: https://github.com/githubnext/tsb/actions/runs/30010910150

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
github-actions Bot and others added 2 commits July 23, 2026 13:33
Benchmark BooleanArray extension array (100k elements, ~10% nulls, 50 iters):
from/any/all/sum/and/or/not/fillna. TS: arrays.BooleanArray from tsb;
Python: pd.array(dtype='boolean').

Run: https://github.com/githubnext/tsb/actions/runs/30058807058

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 402ebd6

Generated by Autoloop · 983.4 AIC · ⌖ 11.9 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 8d70dac

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

🤖 Iteration 420✅ Accepted

  • Change: Added StringArray extension array benchmarks (bench_string_array.ts / bench_string_array.py)
  • Metric: 758 (best: 758, delta: +1)
  • Commit: 8d70dac
  • Result: Benchmarks cover from/upper/lower/strip/contains/len/fillna on 100k-element arrays with ~10% nulls (50 measured iterations). Python uses pd.array(dtype="string") with equivalent .str accessor methods.

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K ·
Comment /autoloop to run again

Add bench_datetime_array.ts and bench_datetime_array.py benchmarking
nullable datetime extension array: from/year/month/day/isna/notna/fillna.
100k elements with ~10% nulls, 50 iterations.

Run: https://github.com/githubnext/tsb/actions/runs/30138360760

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 7500ea9

Generated by Autoloop · 669.6 AIC · ⌖ 11.8 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 25, 2026 01:30
Add bench_timedelta_array.ts and bench_timedelta_array.py benchmarks for
TimedeltaArray (100k elements, ~10% nulls, 50 iters): from/days/hours/
totalSeconds/isna/notna/sum/min/max/fillna.

Run: https://github.com/githubnext/tsb/actions/runs/30159549081

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 744e7b2

Generated by Autoloop · 845.1 AIC · ⌖ 11.9 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 25, 2026 13:32
Add matched TypeScript + Python benchmarks for Gaussian KDE (evaluate + integrate)
on a bimodal 10k-point dataset with 200 evaluation points, 20 iterations.

Run: https://github.com/githubnext/tsb/actions/runs/30182788398

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: dfda6b1

Generated by Autoloop · 1.8K AIC · ⌖ 12 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 66c5b82

Generated by Autoloop · 678.6 AIC · ⌖ 11.6 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 26, 2026 13:29
…tropy/jsDivergence/jsDistance/crossEntropy benchmark

Run: https://github.com/githubnext/tsb/actions/runs/30248425219

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 6fdb111

Generated by Autoloop · 1.1K AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 27, 2026 08:17
…alEntropy/variationOfInformation benchmark

1000-element paired observations, 10 categories, 50 iters each.
Python: pure-numpy implementations matching tsb semantics.

Run: https://github.com/githubnext/tsb/actions/runs/30297867311

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 320e47d

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K

Benchmarks fixed-bin cut and quantile-based qcut on 100k-row data.
Run: https://github.com/githubnext/tsb/actions/runs/31573572340

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 47467e8

Generated by Autoloop · 860 AIC · ⌖ 11.9 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 12, 2026 07:33
…ark — custom aggregation function (p75, range) via resample().agg(fn)

Run: https://github.com/githubnext/tsb/actions/runs/31631782373

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: ff2a1b7

Generated by Autoloop · 3.2K AIC · ⌖ 12.2 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 12, 2026 19:41
Add bench_style.ts and bench_style.py for DataFrame Styler API:
highlightMax, highlightMin, format, backgroundGradient → toHtml().
200-row DataFrame, 50 measured iterations.

Run: https://github.com/githubnext/tsb/actions/runs/31677401936

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 2fbbf0a

Generated by Autoloop · 1.1K AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 13, 2026 07:37
Add linregress + OLS regression benchmark (tsb vs pandas/numpy).
Benchmarks simple linear regression and multiple OLS on 10k-row dataset.

Run: https://github.com/githubnext/tsb/actions/runs/31734998176

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: b70653a

Generated by Autoloop · 1.1K AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 13, 2026 19:27
…ansform, transform, inverseTransform)

Add PCA transform benchmark pair:
- benchmarks/tsb/bench_pca_transform.ts: PCA.fitTransform, result.transform, result.inverseTransform
- benchmarks/pandas/bench_pca_transform.py: numpy SVD equivalent

Dataset: N=1000, P=10, n_components=5, WARMUP=5, ITERATIONS=30

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 9e0b94f

Generated by Autoloop · 7.3K AIC · ⌖ 11.9 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 14, 2026 07:46
Add benchmark pair for str.title() titlecase conversion on 100k strings.
tsb: Series.str.title() | pandas: Series.str.title()

Run: https://github.com/githubnext/tsb/actions/runs/31804160800

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 98dcf89

Generated by Autoloop · 2.3K AIC · ⌖ 11.8 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 14, 2026 13:42
…ction benchmark

Benchmark mergeAsof with direction="forward" (smallest right key >= left key).
Only the default backward direction was previously covered.

Run: https://github.com/githubnext/tsb/actions/runs/31856202878

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: d19f908

Generated by Autoloop · 7.3K AIC · ⌖ 11.9 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 80d2324

Generated by Autoloop · 1.7K AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 15, 2026 13:26
…arterEnd/Begin, BMonthEnd/Begin, BYearEnd/Begin apply/rollforward/rollback on 5k dates

Run: https://github.com/githubnext/tsb/actions/runs/31919325615

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 6b5ab0b

Generated by Autoloop · 2.1K AIC · ⌖ 12 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 16, 2026 01:36
…/dataFrameAbs/seriesRound/dataFrameRound on 100k-row dataset

Run: https://github.com/githubnext/tsb/actions/runs/31948913632

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: ed7dc53

Generated by Autoloop · 1.2K AIC · ⌖ 12.2 AIC · ⊞ 51.8K

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants