anthropics/knowledge-work-plugins15 files

Zoom Rtms

Reference skill for Zoom RTMS. Use after routing to a live-media workflow when processing real-time audio, video, chat, transcripts, screen share, or contact-center voice streams.

Specification
Skill ID
anthropics/knowledge-work-plugins/zoom-rtms
Publisher
anthropics
Repository
knowledge-work-plugins
Installs
0
Files
15
Synced
Sep 23, 2026
How to use it

Open any RiverX project, open the Skills panel in the chat, and search for this identifier. The files are fetched from the source repository at install time.

anthropics/knowledge-work-plugins/zoom-rtmsInstalls these files
  • RUNBOOK.md
  • SKILL.md
  • concepts/connection-architecture.md
  • concepts/lifecycle-flow.md
  • examples/ai-integration.md
  • examples/manual-websocket.md
  • examples/rtms-bot.md
  • examples/sdk-quickstart.md
  • references/connection.md
  • references/data-types.md
  • references/environment-variables.md
  • references/media-types.md
  • references/quickstart.md
  • references/webhooks.md
  • troubleshooting/common-issues.md

What this skill tells the agent

Zoom Realtime Media Streams (RTMS)

Background reference for live Zoom media pipelines. Prefer build-zoom-bot first, then use this skill for stream types, capabilities, and RTMS-specific implementation constraints.

Zoom Realtime Media Streams (RTMS)

Expert guidance for accessing live audio, video, transcript, chat, and screen share data from Zoom meetings, webinars, Video SDK sessions, and Zoom Contact Center Voice in real-time. RTMS uses a WebSocket-based protocol with open standards and does not require a meeting bot to capture the media plane.

Read This First (Critical)

RTMS is primarily a backend media ingestion service.

  • Your backend receives and processes live media: audio, video, screen share, chat, transcript.
  • RTMS is not a frontend UI SDK by itself.
  • Processing is event-triggered: backend waits for RTMS start webhook events before stream handling begins.

Optional architecture (common):

  • Add a Zoom App SDK frontend for in-client UI/controls.
  • Stream backend RTMS outputs to frontend via WebSocket (or SSE, gRPC, queue workers, etc.).

Use RTMS for media/data plane, and use frontend frameworks/Zoom Apps for presentation + user interactions.

Official Documentation: https://developers.zoom.us/docs/rtms/ SDK Reference (JS): https://zoom.github.io/rtms/js/ SDK Reference (Python): https://zoom.github.io/rtms/py/ Sample Repository: https://github.com/zoom/rtms-samples

Quick Links

New to RTMS? Follow this path:

  1. [Connection Architecture](concepts/connection-architecture.md) - Two-phase WebSocket design
  2. [SDK Quickstart](examples/sdk-quickstart.md) - Fastest way to receive media (recommended)
  3. [Manual WebSocket](examples/manual-websocket.md) - Full protocol control without SDK
  4. [Media Types](references/media-types.md) - Audio, video, transcript, chat, screen share

Complete Implementation:

  • [RTMS Bot](examples/rtms-bot.md) - End-to-end bot implementation guide

Reference:

  • [Lifecycle Flow](concepts/lifecycle-flow.md) - Complete webhook-to-streaming flow
  • [Data Types](references/data-types.md) - All enums and constants
  • [Webhooks](references/webhooks.md) - Event subscription details
  • [Environment Variables](references/environment-variables.md) - credential modes and runtime knobs
  • [Quickstart Notes](references/quickstart.md) - Secondary quickstart guide
  • Integrated Index - see the section below in this file

Having issues?

  • Connection fails -> Common Issues
  • Duplicate connections -> Webhook Gotchas
  • No audio/video -> Media Configuration
  • Start with preflight checks -> 5-Minute Runbook

Supported Products

ProductWebhook EventPayload IDApp Type
Meetingsmeeting.rtms_started / meeting.rtms_stoppedmeeting_uuidGeneral App
Webinarswebinar.rtms_started / webinar.rtms_stoppedmeeting_uuid (same!)General App
Video SDKsession.rtms_started / session.rtms_stoppedsession_idVideo SDK App
Zoom Contact Center VoiceProduct-specific RTMS/ZCC Voice eventsProduct-specific stream/session identifiersContact Center / approved RTMS integration

Once connected, the core signaling/media socket model is shared across products. Meetings, webinars, and Video SDK sessions use the familiar start/stop webhooks. Zoom Contact Center Voice adds its own RTMS/ZCC Voice event family and should be treated as the same transport model with product-specific event payloads.

RTMS Overview

RTMS is a data pipeline that gives your app access to live media from Zoom meetings, webinars, and Video SDK sessions without participant bots. Instead of having automated clients join meetings, use RTMS to collect media data directly from Zoom's infrastructure.

What RTMS Provides

Media TypeFormatUse Cases
AudioPCM (L16), G.711, G.722, OpusTranscription, voice analysis, recording
VideoH.264, JPG, PNGRecording, AI vision, thumbnails, active participant selection
Screen ShareH.264, JPG, PNGContent capture, slide extraction
TranscriptJSON textMeeting notes, search, compliance
ChatJSON textArchive, sentiment analysis

March 2026 Protocol Changes

  • Zoom Contact Center Voice support: RTMS now covers Contact Center Voice audio and transcript scenarios.
  • Transcript Language Identification control: transcript media handshakes now support src_language and enable_lid. Default behavior is LID enabled. Set enable_lid: false to force a fixed language.
  • Single individual video stream subscription: RTMS can now stream one participant's camera feed at a time when data_opt is set to VIDEO_SINGLE_INDIVIDUAL_STREAM.
  • Graceful client-initiated shutdown: backends can send STREAM_CLOSE_REQ over the signaling socket and wait for STREAM_CLOSE_RESP.
  • Media keep-alive tolerance increased: media socket keep-alive timeout is now 65 seconds, not 35.

Two Approaches

ApproachBest ForComplexity
SDK (@zoom/rtms)Most use casesLow - handles WebSocket complexity
Manual WebSocketCustom protocols, other languagesHigh - full protocol implementation

Prerequisites

  • Node.js 20.3.0+ (24 LTS recommended) for JavaScript SDK
  • Python 3.10+ for Python SDK
  • Zoom General App (for meetings/webinars) or Video SDK App (for Video SDK) with RTMS feature enabled
  • Webhook endpoint for RTMS events
  • Server to receive WebSocket streams
Need RTMS access? Post in Zoom Developer Forum requesting RTMS access with your use case.

Quick Start (SDK - Recommended)

import rtms from "@zoom/rtms";

// All RTMS start/stop events across products
const RTMS_EVENTS = ["meeting.rtms_started", "webinar.rtms_started", "session.rtms_started"];

// Handle webhook events
rtms.onWebhookEvent(({ event, payload }) => {
  if (!RTMS_EVENTS.includes(event)) return;

  const client = new rtms.Client();

  client.onAudioData((data, timestamp, metadata) => {
    console.log(`Audio from ${metadata.userName}: ${data.length} bytes`);
  });

  client.onTranscriptData((data, timestamp, metadata) => {
    const text = data.toString('utf8');
    console.log(`${metadata.userName}: ${text}`);
  });

  client.onJoinConfirm((reason) => {
    console.log(`Joined session: ${reason}`);
  });

  // SDK handles all WebSocket connections automatically
  // Accepts both meeting_uuid and session_id transparently
  client.join(payload);
});

Quick Start (Manual WebSocket)

For full control or non-SDK languages, implement the two-phase WebSocket protocol:

const WebSocket = require('ws');
const crypto = require('crypto');

const RTMS_EVENTS = ['meeting.rtms_started', 'webinar.rtms_started', 'session.rtms_started'];

// 1. Generate signature
// For meetings/webinars: uses meeting_uuid. For Video SDK: uses session_id.
function generateSignature(clientId, idValue, streamId, clientSecret) {
  const message = `${clientId},${idValue},${streamId}`;
  return crypto.createHmac('sha256', clientSecret).update(message).digest('hex');
}

// 2. Handle webhook
app.post('/webhook', (req, res) => {
  res.status(200).send();  // CRITICAL: Respond immediately!
  
  const { event, payload } = req.body;
  if (RTMS_EVENTS.includes(event)) {
    connectToRTMS(payload);
  }
});

// 3. Connect to signaling WebSocket
function connectToRTMS(payload) {
  const { server_urls, rtms_stream_id } = payload;
  // meeting_uuid for meetings/webinars, session_id for Video SDK
  const idValue = payload.meeting_uuid || payload.session_id;

Use this skill in a project

Open any RiverX project, search the Skills panel for anthropics/knowledge-work-plugins/zoom-rtms, and install it in one click.

Use this skill