Skip to content

Add GStreamer audio capture and manual tester - #319

Draft
alan-george-lk wants to merge 4 commits into
mainfrom
alan/feature-capture-audio
Draft

alan-george-lk wants to merge 4 commits into
mainfrom
alan/feature-capture-audio

Conversation

@alan-george-lk

@alan-george-lk alan-george-lk commented Nov 19, 2026 •

Copy link
Copy Markdown
Collaborator

Add GStreamer PCM audio capture to the C++ capture API, backed by the Rust implementation in livekit/rust-sdks#1702. Pin the Rust submodule to 1387ff328cc9eaf579e6b4aa99c8111f8a3e695a.

Split the public capture API into audio, video, and shared-type headers while preserving capture_source.h as the compatibility umbrella. Audio uses fixed 10 ms frames, and terminal capture results report accepted frames and the exit reason for both media types.

Add a macOS capture_audio manual tester to capture-enabled test builds. It supports the default microphone, custom GStreamer pipelines, optional room publication, and bounded or Ctrl+C shutdown. Update documentation and add stereo buffer rechunking coverage.

Validation on macOS arm64:

  • Rust: 56 capture tests and 3 FFI capture lifecycle tests passed; the standard FFI configuration also passed cargo check.
  • ./build.sh release-tests --capture=all passed using the locally rebuilt, unstripped Rust FFI library to avoid the existing Apple linker LINKEDIT issue.
  • All 411 C++ unit tests passed.
  • Integration suite: 75 passed; the token-server endpoint test skipped because LIVEKIT_CREATE_TOKEN_URL is unset.
  • Installed-SDK capture consumer passed.
  • Doxygen validation passed; the manual tester passed a synthetic capture smoke test after removing playback.
  • Scarlett microphone capture, publication smoke testing, and PCM-to-WAV recording were exercised during local testing. The microphone recording was listened to successfully.

Known follow-ups: finite audio capture rejects a final partial 10 ms frame; direct WAV encoding in a capture pipeline may not finalize its header during teardown. Recording PCM and converting afterward works with the current tester. Other platforms have not been exercised locally.

@alan-george-lk alan-george-lk changed the title Add GStreamer audio capture and playout Add GStreamer audio capture and manual tester Nov 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant