v0.4.4

• Fix resource contention during large Perf queries
• Remove public query param from /v0/projects endpoint
• BREAKING CHANGE Move all CLI commands using --org, --project, and --user over to positional arguments, except bencher run and bencher threshold create
• Add a bencher report create CLI subcommand
• bencher run now tries to auto-fill the git commit hash for the report
• BREAKING CHANGE Rename statistic to model and remove API endpoint
• Add "Click to view Threshold" for all boundary limits and add a public view Threshold page
• Add PATCH endpoint for user account settings
• BREAKING CHANGE Remove /v0/server/ping endpoint
• Deprecate /v0/server/endpoint in favor of /v0/server/config/console and BREAKING CHANGE remove bencher server endpoint CLI command

v0.4.3

• BREAKING CHANGE Limit branch names to 256 characters and all slug lengths to 64 characters. Any existing values greater than these new limits are set to their respective UUID.
• Add shortcut URLs for user pages:
  • /console/users/tokens -> /console/users/USER-SLUG/tokens
  • /console/users/tokens/add -> /console/users/USER-SLUG/tokens/add
  • /console/users/settings -> /console/users/USER-SLUG/settings
• Improve bencher run error messages to include the command being run (idea credit to dholroyd: #335)
• Prevent pwn requests when using bencher run
• Add an API version check to all Bencher CLI commands that use the backend

v0.4.2

• Fix Perf Plot view reduce bug
• Add a View button to Perf Plot for Reports, Branches, Testbeds, and Benchmarks
• Add search query param to GET list endpoints for all named resources
• Add search for a named resources in Console UI and Perf Plot dimensions
• Add date based search for Reports in Console UI and Perf Plot
• Add search for public projects
• Move Bencher API server to "distroless" Docker image, bencher-api that is 10x smaller
• Move Bencher Console UI to "distroless" Docker image, bencher-console that is 1/3 smaller
• Fix Console server side rendering bug when using local URLs inside of Docker
• First time contributor JonasWanke added the Iai-Callgrind benchmark harness adapter

v0.4.1

• Add a "Show all"/"Hide all" toggle for perf plot results (idea credit to jerome-benoit)
• Add an --exec flag to bencher run to run commands as executables (no shell) and by default when there is more than one argument
• Add new Thresholds: Static, Percentage, Log Normal, Interquartile Range, and Delta Interquartile Range
• Include Iteration number for Report results
• Redirect to newly created resources in Console UI

v0.4.0

• BREAKING CHANGES Remove backwards compatibility for renames:
  • Metric (lower_bound => lower_value and upper_bound => upper_value)
  • Measure (metric_kind => measure in Report and Threshold; metric_kinds => measures in Perf)
  • Boundary (average => baseline)
• Add bencher up, bencher down, and bencher logs commands to CLI to easily run Bencher Self-Hosted
• Branches and Testbeds are now created if they do not exit for bencher run if the value passed is a slug or name (UUIDs are still required to already exist)

v0.3.26

• Add OAuth2 based login for GitHub
• Allow users to accept invitations while logged in
• Run smoke tests on Linux, MacOS, and Windows
• Release Linux, MacOS, and Windows CLI builds for both x86_64 and ARM64
• Add convenience script to install bencher CLI on Linux, MacOS, and Windows

v0.3.26-rc1

• Add OAuth2 based login for GitHub
• Allow users to accept invitations while logged in
• Run smoke tests on Linux, MacOS, and Windows
• Release Linux, MacOS, and Windows CLI builds for both x86_64 and ARM64

v0.3.25

• Allow custom CI ID to be an unbounded length

v0.3.24

• Add URL fragment links to all headings 🔗
• Fix browser navigation to replace history for automatic query args, like pagination
• Scroll to top of page when changing paginated pages
• Allow Branch, Testbed, and Measure names to be used in addition to slugs and UUIDs for Report (GET list & POST), Threshold (GET list & POST), and Branch (POST start point) endpoints
• Validate Branch and Testbed exist before running benchmarks with bencher run

v0.3.23

• Move CLI over to relaxed response parsing and add --strict flag to enable strict response parsing
• Add --quiet flag to bencher run to enable quite mode and only output the final Report JSON