Bedrock Token Counting

[TimPansino]

Overview

• Add token counting to Bedrock via botocore and aiobotocore for all LLM invocations.

[github-actions]

✅MegaLinter analysis: Success

Descriptor	Linter	Files	Fixed	Errors	Warnings	Elapsed time
✅ ACTION	actionlint	9		0	0	1.02s
✅ MARKDOWN	markdownlint	7	0	0	0	1.34s
✅ PYTHON	ruff	1039	0	0	0	1.11s
✅ PYTHON	ruff-format	1039	0	0	0	0.42s
✅ YAML	prettier	23	0	0	0	1.61s
✅ YAML	v8r	23		0	0	7.62s
✅ YAML	yamllint	23		0	0	0.71s

Notices

📣 MegaLinter 9.5.0 is out! Discover the new features and security recommendations in the release announcement. (Skip this info by defining SECURITY_SUGGESTIONS: false)

See detailed reports in MegaLinter artifacts

Show us your support by starring ⭐ the repository

[codecov-commenter]

Codecov Report

❌ Patch coverage is 87.40157% with 16 lines in your changes missing coverage. Please review.
✅ Project coverage is 82.07%. Comparing base (8e0d575) to head (569283c).

Files with missing lines	Patch %	Lines
newrelic/hooks/external_botocore.py	87.40%	0 Missing and 16 partials ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1752      +/-   ##
==========================================
- Coverage   82.07%   82.07%   -0.01%     
==========================================
  Files         215      215              
  Lines       26496    26589      +93     
  Branches     4190     4213      +23     
==========================================
+ Hits        21747    21823      +76     
- Misses       3314     3315       +1     
- Partials     1435     1451      +16     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.