Notes
Features
- Added instrumentation for
openai
.- This feature is in limited preview and will be off by default.
- Aside from creating spans for chat completions and embeddings, it will create custom events that drive the New Relic AI Monitoring.
- Added instrumentation for chat completion streams (#1884) (404e317)
- Added instrumentation for openai chat completion creation (#1862) (34dcd70)
- Added instrumentation for openai embedding creation (#1872) (1c62321)
- Added
ai_monitoring.enabled
configuration.(#1873) (52bf9f3) - Added
Nodejs/ML/OpenAI/<version>
metric every time a chat completion or embedding occurs.(#1886) (d11d100) - Added
setLlmMetadata
API to allow users to specify metadata for LLM events (#1863) (85979d7) - Ensure API errors are tracked (#1880) (289c2a2)
- Added
getLlmMessageIds
andrecordLlmFeedbackEvent
API methods for tracking LLM feedback (#1868) (1681e4b) - Added openai LLM events. (#1857) (a7786f3)
- Added pkgVersion to shim instances to facilitate semver checking without having to re-parse the package.json (#1883) (4ddfd81)
Bug fixes
Security improvements
Code refactoring
Miscellaneous chores
- dep: Updated @newrelic/security-agent to v0.5.0 (#1877) (2882236)
- dev-deps: bump axios and @slack/bolt (#1871) (2d00b02)
- docs: Updated links in documentation to https (#1888) (f1913ea)
- Fixed bool -> boolean in jsdoc (#1853) (3c00e55)
Tests
- Added streaming responses to mock OpenAI sever (#1881) (86d83f2)
- Added unit tests for LLM API methods (#1878) (3d8b987)
- Added a mock server for openai testing (#1858) (3b1f5e6)
- Fixed shadowed variable lint error in pino versioned tests (#1859) (e1b21eb)
- Updated openai versioned tests to properly work with the legacy context manager (#1876) (a879700)
Continuous integration
- Made release note date always in pacific time (#1855) (6d7dc69)
- Remove updating staging with newly release agent version (#1887) (9d38faa)
Support statement:
We recommend updating to the latest agent version as soon as it's available. If you can't upgrade to the latest version, update your agents to a version no more than 90 days old. Read more about keeping agents up to date. (https://docs.newrelic.com/docs/new-relic-solutions/new-relic-one/install-configure/update-new-relic-agent/)
See the New Relic Node.js agent EOL policy for information about agent releases and support dates. (https://docs.newrelic.com/docs/apm/agents/nodejs-agent/getting-started/nodejs-agent-eol-policy/)