Skip to content

Added basic automated benchmarking #62

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Gitter499 wants to merge 64 commits into
base: main
Choose a base branch
from
Open

Added basic automated benchmarking #62

Gitter499 wants to merge 64 commits into from

Conversation

@Gitter499
Copy link
Contributor

@Gitter499 Gitter499 commented Sep 26, 2025 •
edited
Loading

Features

  • Switch between box plots, scatter plot, and time series
  • Toggle Miri with logarithmic scaling
  • Switch between different architectures and tests

Features currently in-progress

  • Add ASAN
  • Automatically pull and run on new programs from BorrowSanitizer/benches
  • Automatic diff table with different programs on every commit (see https://fast.vlang.io)
  • Show benchmark results (stdout) on every bench and highlight common violations in a table
    • Ex. BSAN and ASAN share memory out-of-bounds and use-after-free, so show results for both. BSAN and Miri share aliasing violations, etc.

icmccorm and others added 30 commits August 5, 2025 16:49
@icmccorm
Added pass v0.
4940314
@Gitter499 @icmccorm
fix(#49): Fixed tests
343b326
@Gitter499 @icmccorm
fix(#49): Removed redudant check
72ddddf
@Gitter499 @icmccorm
fix(#49): Fixed clippy warnings
bbb286c
@icmccorm
Added inst subcommand.
4c12026
@icmccorm
Eliminated 0-offsets.
6493c20
@icmccorm
Made xb inst compile by default.
eb59352
@icmccorm
Fixed pass to reflect new retag parameters.
0ec2882
@icmccorm
Ensured that assertion uses new borrow tag.
404580b
@icmccorm
Ensured that new location state is initialized.
43c5435
@icmccorm
Added back panic handler.
93aada7
@icmccorm
Refactored driver with Config and fixed bug report URL.
9acdba4
@icmccorm
Wipe TLS immediately after encountering a maybe-uninstrumented function.
5a734fc
@icmccorm
Added flag for trusting extern functions.
bf96298
@icmccorm
Fixed several bugs in allocation, permission encoding, and handling e…
ddffb33 
…xtern function calls.
@icmccorm
Fixed error where Rust allocation functions would not be instrumented.
bd54ea2
@icmccorm
Avoided unnecessary offsets when storing scalar provenance values.
3ef3322
@icmccorm
Updated toolchain, disabled retags temporarily, and reverted allocati…
9367934 
…on changes.
@icmccorm
Ensured that the sysroot is set for UI tests.
3a4b7c1
@icmccorm
Protected tags are stored in an array at the start of each frame.
ea80f86
@icmccorm @Gitter499
Added pass v0.
31d7d2c
@Gitter499
fix(#49): Fixed tests
6a65073
@icmccorm @Gitter499
Ensured that new location state is initialized.
c9d7db9
@icmccorm @Gitter499
Removed erroneous backtrace.
71c4406
@icmccorm @Gitter499
Fixed several bugs in allocation, permission encoding, and handling e…
09c0fce 
…xtern function calls.
@icmccorm @Gitter499
Updated toolchain, disabled retags temporarily, and reverted allocati…
e97d1d7 
…on changes.
@Gitter499
Added benchmarking scripts (disregard)
35892f7
@Gitter499
In progress snapshot (do not use)
913a4e0
@Gitter499
Added ./xb bench and CI trigger
0e11eac
@Gitter499
Updated CI
43043e4
Gitter499 and others added 23 commits August 6, 2025 15:03
@Gitter499
Added setup step
002e1b1
fix: Removed hard-coded path (duplicate commit, rebase later)
117a235
fix: Forgot to add sysroot var (duplicate, rebase later)
7d5e0f7
fix: Changed Miri's version from nightly to the one we have in the cu…
3b407c8 
…stom toolchain
fix: Changed name of results based on architecture
2ec7b4a
feat: Added basic visualizer based on previous visualizations
f3708cf
fix: Added back test branch trigger
0cf9d78
@Gitter499
fix: Changed to official action for github pages deployment
0ad61fc
@Gitter499
fix: Changed directory handling
872e752
@Gitter499
fix: Removed zip handling
1039172
@Gitter499
fix: Fixed relative path
e9226fd
@Gitter499
fix: Correct processing and displaying bench data (wip)
b1aec54
@Gitter499
fix: Added regex checking for command names (possible fix?)
92a354c
@Gitter499
fix: Upgraded to v6 schema
1736efe
@Gitter499
fix: Fixed chart issues and toggling Miri
c6eeab1
@Gitter499
fix: Fixed chart issues and toggling Miri
1872de8
@Gitter499
fix: Fixed scatterplot with Miri
a2ac57b
@Gitter499
fix: Updated CI version
3b5bf64
@Gitter499
fix: Added new bsan-pass from main
eb2affc
@Gitter499
fix: Added bsan-pass from upstream/main
14851cf
@Gitter499
fix: Added fix from bsan-driver
4b891fc
@Gitter499
fix: Added fix from bsan-rt
9844a9b
@Gitter499
fix: Changed bsan to BorrowSanitizer
d0e8b1c
@Gitter499 Gitter499 requested a review from icmccorm September 26, 2025 14:03
@Gitter499 Gitter499 self-assigned this Sep 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@icmccorm icmccorm Awaiting requested review from icmccorm

Assignees

@Gitter499 Gitter499

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@Gitter499 @icmccorm