Screencast MCP

Mark a labelled moment on a recording, live or at a second. Kept in the session and a sidecar; chapters and pipeline turn markers into chapters.

Stitch clips (including title cards) into one video with cuts or xfade transitions; they need not match in size, fps, or audio.

Frame a video or screenshot on a gradient, color, or wallpaper with padding, rounded corners, and a drop shadow, optionally on a 16:9/1:1/9:16/4:5 canvas.

Package a recording as a paste-ready repro folder: secret-scanned, redacted clip and GIF, contact sheet, steps from the event log, OCR'd errors, environment, report.md for gh issue create --body-file.

Burn SRT/ASS subtitles (e.g. from transcribe) into a video in the bundled font.

Annotate a video with timed boxes, text labels, and arrows. Fallback fonts used are listed in fallbackFonts; characters no font covers are reported in warnings.

Write chapters (markers, scene changes, transcript, or a list) into an mp4/mkv/mov copy without re-encoding; returns YouTube chapter text. Can mux an SRT as soft subtitles.

Extract several frame-exact segments, each to its own file. For one segment, trim does the same.

Re-encode a video smaller (H.264 CRF ladder, optional width cap). For a platform target use export_preset.

Join videos end to end with hard cuts: stream copy when they match, else a re-encode (`mode` says which). For transitions use xfade_transition or assemble_highlights.

Tile timestamped frames of a video into one image to see a whole recording at a glance (the cheapest first look).

Convert media to mp4, webm, or gif. For a size-bounded GIF/WebP prefer export_gif; for a smaller mp4, compress or export_preset.

Crop a video to a pixel rectangle; one running off the frame is rejected.

Draw a smoothed, scaled cursor that hides when idle from the event log of a start_recording cursor: "events" recording (no OS cursor in the video), with click ripples and an optional spotlight.

Edit a video by its transcript: cut quoted text, cue numbers, or fillers. Also writes the re-timed .srt.

Remove dead air: cut stretches where the screen is frozen (and silent), keeping a short pad. Returns the time saved.

Reduce steady background noise (fan, hum, hiss) in a recording's audio with an adaptive FFT denoiser. Video is copied untouched. Returns the output path.

Check the setup: ffmpeg/ffprobe (FFmpeg 8+?), optional filters, capture devices, Windows OCR, settings, and enabled toolsets; `problems` says what is missing and how to fix it. Call on first use or when a tool reports a missing feature.

Export an animated GIF or WebP that fits a size budget (for PRs, issues, READMEs), stepping fps, width, and quality down until it fits.

Encode a platform-ready H.264 file (aspect, fps, bitrate, faststart) for a named platform.

Extract the audio track of a media file to its own file (mp3, aac, wav, or copy). Returns the output path.

OCR (built into Windows) on the screen, an image, or video frames, with line and match boxes in image pixels (add `origin` for desktop coordinates). Locate UI text or secrets (e.g. regex 'sk-|ghp_|api.?key') to redact. Best-effort: review results.

Probe a media file with ffprobe and return duration, resolution, frame rate, codecs, container format, and size.

Inspect a single recording session by id, including live status and whether its output file exists on disk.

Build a recording's text timeline (<video>.index.json: OCR per scene, events, markers, transcript) for search_recording.

Burn keycast-style badges for shortcuts, clicks, and typing from the recording's input event log (start_recording events: true). Never shows typed text: the log has none.

List DirectShow audio devices and flag a likely loopback (Stereo Mix or a virtual-audio driver), for start_recording's audio.device.

List all recording sessions (active and finished) with their status, target, output path, and whether the process is still alive.

List the desktop, monitors, and visible windows (topmost first, with capturability per backend). Each entry has a `target` string to pass as-is to capture tools; use it instead of guessing a title.

List DirectShow cameras for start_recording's webcam.device.

Lay music under a video: looped or trimmed to length, faded, leveled, and mixed with any existing audio. Video is stream-copied.

Offline voiceover with the built-in Windows voices: speaks each line at its time or marker over the audio, plus an SRT.

Normalize loudness to a delivery target (two-pass EBU R128 loudnorm); video is copied. Reports loudness before and after.

Composite an image or video (logo, watermark, picture-in-picture) onto a video at a pixel position, optionally scaled and time-limited; keeps the base's audio and length.

Pause a recording; until resume_recording nothing is captured, and the gap is left out of the file, events, and markers.

Run several edits (trim, crop, scale, speed, cut_idle, redact, callout, keystroke_overlay, cursor, reframe, zoom, backdrop, audio, burn_subtitles, then optionally export_preset or export_gif) in one ffmpeg pass: one re-encode, no intermediate files. Prefer it over chaining edit tools; a recipe does the usual polish in one call.

Read the input events (clicks, scroll, cursor, shortcuts, typing bursts) of a recording made with events: true, in video seconds and pixels; e.g. types: ['down'], then sample_frames there.

Cover given rectangles in a video (e.g. secrets on screen). Not automatic detection: find them with find_text redact: true. Off-frame regions are rejected.

Re-aspect a video to 16:9, 9:16, 1:1, or 4:5 by padding or cropping.

Resume a paused recording (same target and settings).

Open a recording for a person to review: in MCP Apps clients an inline player to scrub, trim, and redact, then export; elsewhere just the video's details.

Sample PNG frames from a video (by fps, timestamps, or scene changes) and return the first few inline so the model can see what happened.

Save the last N seconds of a replay buffer (start_recording replayBufferSec) to an mp4; the buffer keeps running.

Resize a video to a target width and/or height and re-encode. Provide one side to keep the aspect ratio, or both to set an exact size.

Compare two screenshots or frames: SSIM score, changed share, and changed boxes in b's pixels, to check a UI change happened only where expected.

Capture one PNG of the screen, a monitor, a window, or a region, returned inline and by path.