Bump onnxruntime from 1.17.1 to 1.18.0 in /genai-quickstart-pocs-python/amazon-bedrock-amazon-rds-poc

[dependabot]

Bumps onnxruntime from 1.17.1 to 1.18.0.

Release notes

Sourced from onnxruntime's releases.

ONNX Runtime v1.18.0

Announcements

• Windows ARM32 support has been dropped at the source code level.
• Python version >=3.8 is now required for build.bat/build.sh (previously >=3.7). Note: If you have Python version <3.8, you can bypass the tools and use CMake directly.
• The onnxruntime-mobile Android package and onnxruntime-mobile-c/onnxruntime-mobile-objc iOS cocoapods are being deprecated. Please use the onnxruntime-android Android package, and onnxruntime-c/onnxruntime-objc cocoapods, which support ONNX and ORT format models and all operators and data types. Note: If you require a smaller binary size, a custom build is required. See details on creating a custom Android or iOS package on Custom build | onnxruntime.

Build System & Packages

• CoreML execution provider now depends on coremltools.
• Flatbuffers has been upgraded from 1.12.0 → 23.5.26.
• ONNX has been upgraded from 1.15 → 1.16.
• EMSDK has been upgraded from 3.1.51 → 3.1.57.
• Intel neural_speed library has been upgraded from v0.1.1 → v0.3 with several important bug fixes.
• There is a new onnxruntime_CUDA_MINIMAL CMake option for building ONNX Runtime CUDA execution provider without any operations apart from memcpy ops.
• Added support for Catalyst for macOS build support.
• Added initial support for RISC-V and three new build options for it: --rv64, --riscv_toolchain_root, and --riscv_qemu_path.
• Now you can build TensorRT EP with protobuf-lite instead of the full version of protobuf.
• Some security-related compile/link flags have been moved from the default setting → new build option: --use_binskim_compliant_compile_flags. Note: All our release binaries are built with this flag, but when building ONNX Runtime from source, this flag is default OFF.
• Windows ARM64 build now depends on PyTorch CPUINFO library.
• Windows OneCore build now uses “Reverse forwarding” apisets instead of “Direct forwarding”, so onnxruntime.dll in our Nuget packages will depend on kernel32.dll. Note: Windows systems without kernel32.dll need to have reverse forwarders (see API set loader operation - Win32 apps | Microsoft Learn for more information).

Core

• Added ONNX 1.16 support.
• Added additional optimizations related to Dynamo-exported models.
• Improved testing infrastructure for EPs developed as shared libraries.
• Exposed Reserve() in OrtAllocator to allow custom allocators to work when session.use_device_allocator_for_initializers is specified.
• Improved lock contention due to memory allocations.
• Improved session creation time (graph and graph transformer optimizations).
• Added new SessionOptions config entry to disable specific transformers and rules.
• [C# API] Exposed SessionOptions.DisablePerSessionThreads to allow sharing of threadpool between sessions.
• [Java API] Added CUDA 12 Java support.

Performance

• Improved 4bit quant support:
  • Added HQQ quantization support to improve accuracy.
  • Implemented general GEMM kernel and improved GEMV kernel performance on GPU.
  • Improved GEMM kernel quality and performance on x64.
  • Implemented general GEMM kernel and improved GEMV performance on ARM64.
• Improved MultiheadAttention performance on CPU.

Execution Providers

• TensorRT

  • Added support for TensorRT 10.
  • Finalized support for DDS ops.
  • Added Python support for user provided CUDA stream.
  • Fixed various bugs.

• CUDA

  • Added support of multiple CUDA graphs.
  • Added a provider option to disable TF32.
  • Added Python support for user provided CUDA stream.

... (truncated)

Commits

• 4573740 [ORT 1.18.0 Release] Cherry pick 3rd/Final round (#20677)
• ed349b9 Mark end of version 17 and 18 C API (#20671)
• d72b476 [ORT 1.18.0 Release] Cherry pick 2nd round (#20620)
• 65f3fbf [ORT 1.18.0 Release] Cherry pick 1st round (#20585)
• 204f1f5 Run fuzz testing before the CG task cleans up the build directory (#20500) (#...
• 21b3cbc [WIP][JS/WebGPU] Inputs Key and Value could be 4-dims. (#20470)
• 2c19db0 Put x64 specific benchmark code into ifdefs. (#20456)
• 227c441 add bf16 support for few ops (#20385)
• 464f199 Extend mac package jobs time out limit (#20459)
• edffa2a Optimize MlasComputeSoftmax with prefetch (#20393)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)