fix(llms): tolerate provider-specific service_tier values #117

Open
peersky wants to merge 3 commits from fix/unknown-service-tier into dev
Owner
  • Fixed bug where Groq's "service_tier": "on_demand" failed the whole completion (async-openai's enum knows only scale/default/flex/priority)
  • Fixed bug where a streamed chunk with an unknown service_tier was skipped, dropping the stream's content
  • Improved redundancy by sharing one drop_unknown_service_tier across native, xml_regex and streaming parses
- Fixed bug where Groq's "service_tier": "on_demand" failed the whole completion (async-openai's enum knows only scale/default/flex/priority) - Fixed bug where a streamed chunk with an unknown service_tier was skipped, dropping the stream's content - Improved redundancy by sharing one drop_unknown_service_tier across native, xml_regex and streaming parses
fix(llms): tolerate provider-specific service_tier values
Some checks failed
Commit Lint / Validate PR Title (pull_request) Successful in 5s
CI / Dependency Age Check (pull_request) Successful in 6s
CI / Spell Check (pull_request) Successful in 8s
CI / Lint & Audit (pull_request) Failing after 1m34s
CI / Test (pull_request) Successful in 7m36s
e4aa100d6e
- Fixed bug where Groq's "service_tier": "on_demand" failed the whole completion (async-openai's enum knows only scale/default/flex/priority)
- Fixed bug where a streamed chunk with an unknown service_tier was skipped, dropping the stream's content
- Improved redundancy by sharing one drop_unknown_service_tier across native, xml_regex and streaming parses
ci(release): cut and publish releases from any branch, not only dev
Some checks failed
CI / Dependency Age Check (pull_request) Successful in 7s
CI / Spell Check (pull_request) Successful in 7s
Commit Lint / Validate PR Title (pull_request) Successful in 5s
CI / Lint & Audit (pull_request) Failing after 2m32s
CI / Test (pull_request) Successful in 5m52s
0106584cb2
- Added ability to prepare a release from a named `base` branch (default dev) and open its release PR against that branch
- Added ability to override the computed bump (auto/patch/minor/major), so a maintenance line can ship a patch over inherited feats
- Fixed bug where the previous tag was the newest one in the repo rather than the newest on the release branch's history, and where pin tags counted as releases
- Fixed bug where a version already released from another line would be reused; the next free patch is taken
- Fixed bug where publish fired only for release PRs into dev, and a manual publish of a missing tag always tagged the default branch; it now takes an explicit `ref`
fix(deps): patch rustls, webpki and tokio advisories; record the unpatchable ones
All checks were successful
CI / Dependency Age Check (pull_request) Successful in 10s
CI / Spell Check (pull_request) Successful in 8s
Commit Lint / Validate PR Title (pull_request) Successful in 6s
CI / Lint & Audit (pull_request) Successful in 2m12s
CI / Test (pull_request) Successful in 5m52s
051f2c848c
- Fixed bug where rustls, rustls-webpki, webpki-roots, webpki-root-certs and tokio advisories (RUSTSEC-2026-0346..0349, -0381..0383, -0386) failed the audit; locked to patched releases
- Documented documentation of the advisories with no lockfile-sized fix in deny.toml, each with its removal condition (crypto-bigint 0.5.5 needs the k256 0.14 migration)
All checks were successful
CI / Dependency Age Check (pull_request) Successful in 10s
CI / Spell Check (pull_request) Successful in 8s
Commit Lint / Validate PR Title (pull_request) Successful in 6s
CI / Lint & Audit (pull_request) Successful in 2m12s
CI / Test (pull_request) Successful in 5m52s
This pull request has changes conflicting with the target branch.
  • Cargo.lock
  • crates/quorum-rs/src/llms/strategies/native.rs
  • deny.toml
View command line instructions

Manual merge helper

Use this merge commit message when completing the merge manually.

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin fix/unknown-service-tier:fix/unknown-service-tier
git switch fix/unknown-service-tier
Sign in to join this conversation.
No reviewers
No labels
release
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
peeramid-labs/quorum-rs!117
No description provided.