-
Notifications
You must be signed in to change notification settings - Fork 14
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
18 changed files
with
385 additions
and
248 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,47 @@ | ||
name: Benchmark C | ||
|
||
on: | ||
workflow_dispatch: | ||
merge_group: | ||
|
||
concurrency: | ||
group: ${{ github.workflow }}-${{ github.ref }} | ||
cancel-in-progress: true | ||
|
||
jobs: | ||
benchmark: | ||
strategy: | ||
fail-fast: false | ||
matrix: | ||
os: | ||
- macos-latest | ||
- ubuntu-latest | ||
- windows-latest | ||
|
||
runs-on: ${{ matrix.os }} | ||
defaults: | ||
run: | ||
shell: bash | ||
working-directory: libcrux-ml-kem/c | ||
|
||
steps: | ||
- uses: actions/checkout@v4 | ||
|
||
- name: π¨ Build Release | ||
run: | | ||
cmake -B build -DCMAKE_BUILD_TYPE=Release | ||
cmake --build build --config Release | ||
# FIXME: Benchmarks on Windows CI are not working right now. | ||
# - name: ππ»ββοΈ Benchmark | ||
# run: ./build/Release/ml_kem_bench | ||
# if: ${{ matrix.os == 'windows-latest' }} | ||
|
||
- name: ππ»ββοΈ Benchmark (c) | ||
run: ./build/ml_kem_bench | ||
if: ${{ matrix.os != 'windows-latest' && (github.event_name == 'merge_group' || github.event_name == 'workflow_dispatch') }} | ||
|
||
- name: ππ»ββοΈ Benchmark (cg) | ||
working-directory: libcrux-ml-kem/cg | ||
run: ./build/ml_kem_bench | ||
if: ${{ matrix.os != 'windows-latest' && (github.event_name == 'merge_group' || github.event_name == 'workflow_dispatch') }} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -11,6 +11,7 @@ on: | |
- cron: "0 0 * * *" | ||
|
||
workflow_dispatch: | ||
merge_group: | ||
|
||
env: | ||
CARGO_TERM_COLOR: always | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,103 @@ | ||
name: Benchmark ML-KEM | ||
|
||
on: | ||
workflow_dispatch: | ||
merge_group: | ||
|
||
env: | ||
CARGO_TERM_COLOR: always | ||
|
||
concurrency: | ||
group: ${{ github.workflow }}-${{ github.ref }} | ||
cancel-in-progress: true | ||
|
||
jobs: | ||
benchmark: | ||
strategy: | ||
fail-fast: true | ||
matrix: | ||
bits: [32, 64] | ||
os: | ||
- macos-13 | ||
- macos-latest | ||
- ubuntu-latest | ||
- windows-latest | ||
exclude: | ||
# There's no such thing as 32-bit macOS | ||
- bits: 32 | ||
os: "macos-latest" | ||
- bits: 32 | ||
os: "macos-13" | ||
|
||
runs-on: ${{ matrix.os }} | ||
defaults: | ||
run: | ||
shell: bash | ||
working-directory: libcrux-ml-kem | ||
|
||
steps: | ||
- uses: actions/checkout@v4 | ||
|
||
- name: Update dependencies | ||
run: cargo update | ||
|
||
- run: echo "RUST_TARGET_FLAG=" > $GITHUB_ENV | ||
if: ${{ matrix.bits == 64 }} | ||
|
||
- name: π οΈ Setup Ubuntu x86 | ||
if: ${{ matrix.bits == 32 && matrix.os == 'ubuntu-latest' }} | ||
run: | | ||
rustup target add i686-unknown-linux-gnu | ||
sudo apt-get update | ||
sudo apt-get install -y gcc-multilib g++-multilib | ||
- name: π οΈ Setup Ubuntu x64 | ||
if: ${{ matrix.bits == 64 && matrix.os == 'ubuntu-latest' }} | ||
run: | | ||
rustup target add aarch64-unknown-linux-gnu | ||
- name: π οΈ Setup macOS | ||
if: ${{ matrix.os == 'macos-latest' }} | ||
run: | | ||
rustup target add aarch64-apple-darwin | ||
# Set up 32 bit systems | ||
|
||
- name: π οΈ Config Windows x86 | ||
run: echo "RUST_TARGET_FLAG=--target=i686-pc-windows-msvc" > $GITHUB_ENV | ||
if: ${{ matrix.bits == 32 && matrix.os == 'windows-latest' }} | ||
|
||
- name: π οΈ Config Linux x86 | ||
run: | | ||
echo "RUST_TARGET_FLAG=--target=i686-unknown-linux-gnu" > $GITHUB_ENV | ||
if: ${{ matrix.bits == 32 && matrix.os == 'ubuntu-latest' }} | ||
|
||
# - name: π¨ Build | ||
# run: cargo build --benches | ||
|
||
# - name: β¬ Upload build | ||
# uses: ./.github/actions/upload_artifacts | ||
# with: | ||
# name: benchmarks_${{ matrix.os }}_${{ matrix.bits }} | ||
|
||
# Benchmarks ... | ||
|
||
- name: ππ»ββοΈ Benchmarks | ||
run: cargo bench --verbose $RUST_TARGET_FLAG -- --output-format bencher | tee bench.txt | ||
|
||
- name: ππ»ββοΈ Benchmarks Portable | ||
run: | | ||
cargo clean | ||
LIBCRUX_DISABLE_SIMD128=1 LIBCRUX_DISABLE_SIMD256=1 cargo bench --verbose $RUST_TARGET_FLAG -- --output-format bencher | sed 's/^test \(.*\) \.\.\. bench/test portable \1 ... bench/' | tee -a bench.txt | ||
- name: Store benchmarks | ||
uses: benchmark-action/github-action-benchmark@v1 | ||
with: | ||
name: ML-KEM Benchmark | ||
tool: 'cargo' | ||
output-file-path: libcrux-ml-kem/bench.txt | ||
benchmark-data-dir-path: dev/bench/mlkem | ||
github-token: ${{ secrets.GITHUB_TOKEN }} | ||
auto-push: true | ||
|
||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.