Skip to content

Add OpenAI provider tools#1582

Merged
toubatbrian merged 5 commits into
brian/provider-tool-basefrom
openai-provider-tools
May 26, 2026
Merged

Add OpenAI provider tools#1582
toubatbrian merged 5 commits into
brian/provider-tool-basefrom
openai-provider-tools

Conversation

@rosetta-livekit-bot
Copy link
Copy Markdown
Contributor

Summary

  • Add OpenAI provider tool classes for Responses API web search, file search, and code interpreter
  • Serialize OpenAI provider tools alongside function tools in HTTP and WebSocket Responses streams
  • Add an OpenAI plugin changeset

Stacked on #1576 for the ProviderTool base abstraction.

Test plan

  • pnpm exec prettier --check .changeset/openai-provider-tools.md plugins/openai/src/index.ts plugins/openai/src/responses/llm.ts plugins/openai/src/ws/llm.ts plugins/openai/src/tools.ts plugins/openai/src/tool_utils.ts
  • pnpm --filter @livekit/agents-plugins-test build
  • pnpm --filter @livekit/agents-plugin-silero build
  • pnpm --filter @livekit/agents-plugin-openai build
  • pnpm --filter @livekit/agents-plugin-openai lint (warnings only, pre-existing)

Note: pnpm --filter @livekit/agents-plugin-openai api:check currently fails on existing export * as ___ declarations in dist/index.d.ts, before reaching this change.

@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented May 22, 2026

🦋 Changeset detected

Latest commit: 812f4cd

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 31 packages
Name Type
@livekit/agents-plugin-openai Major
@livekit/agents-plugin-anam Major
@livekit/agents-plugin-cartesia Major
@livekit/agents-plugin-cerebras Major
@livekit/agents-plugin-elevenlabs Major
@livekit/agents-plugin-fishaudio Major
@livekit/agents-plugin-google Major
@livekit/agents-plugin-hume Major
@livekit/agents-plugin-inworld Major
@livekit/agents-plugin-neuphonic Major
@livekit/agents-plugin-rime Major
@livekit/agents-plugin-sarvam Major
@livekit/agents-plugin-xai Major
@livekit/agents Major
@livekit/agents-plugin-assemblyai Major
@livekit/agents-plugin-baseten Major
@livekit/agents-plugin-bey Major
@livekit/agents-plugin-deepgram Major
@livekit/agents-plugin-hedra Major
@livekit/agents-plugin-lemonslice Major
@livekit/agents-plugin-liveavatar Major
@livekit/agents-plugin-livekit Major
@livekit/agents-plugin-minimax Major
@livekit/agents-plugin-mistral Major
@livekit/agents-plugin-mistralai Major
@livekit/agents-plugin-phonic Major
@livekit/agents-plugin-resemble Major
@livekit/agents-plugin-runway Major
@livekit/agents-plugin-silero Major
@livekit/agents-plugin-trugen Major
@livekit/agents-plugins-test Major

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 4 additional findings.

Open in Devin Review

Comment thread plugins/openai/src/tool_utils.ts
@rosetta-livekit-bot
Copy link
Copy Markdown
Contributor Author

Added focused unit coverage for toResponsesTools: function tool serialization, OpenAI provider tool serialization, and skipping non-OpenAI provider tools.

devin-ai-integration[bot]

This comment was marked as resolved.

@rosetta-livekit-bot
Copy link
Copy Markdown
Contributor Author

Checked Devin’s finding and it was valid: CodeInterpreter now omits container when unset, with a focused test covering the default serialization case.

Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 1 new potential issue.

View 8 additional findings in Devin Review.

Open in Devin Review

Comment thread plugins/openai/src/tools.ts
Copy link
Copy Markdown
Contributor

@toubatbrian toubatbrian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Verified using agents-cli. Everything works good.

@toubatbrian toubatbrian merged commit cf22d9b into brian/provider-tool-base May 26, 2026
2 checks passed
@toubatbrian toubatbrian deleted the openai-provider-tools branch May 26, 2026 21:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant