Skip to content

Bedrock rejects 'temperature' params on newer models #6581

Description

@gpereira-acc

Bug Description

When using 'livekit.pluging.aws.LLm' with newer Antropic Models on AWS Bedrock, returns a 'ValidationException'.

Bedrock discontinued the temperature parameter for some models

Expected Behavior

To treat validation. The AWS Bedrock plugin should not send the temperature parameter for models that reject them

Reproduction Steps

1. 
2.
3.
...
- Sample code snippet, or a GitHub Gist link -

Operating System

Windows 11

Models Used

No response

Package Versions

livekit-agents==1.6.6
livekit-plugins-aws==1.6.6

Session/Room/Call IDs

No response

Proposed Solution

Additional Context

No response

Screenshots and Recordings

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions