shawn cdf04bd8eb
Lint & Validate / lint (push) Has been cancelled
P6-R1: Audio/video streaming pipeline
- src/streaming/ module: camera detection (USB webcam + Pi Camera Module via
  v4l2/libcamera), GStreamer pipeline builder with V4L2/OMX/x264 h264 encoders,
  platform presets (YouTube, Twitch, Facebook, custom RTMP), streamer lifecycle
  manager with auto-reconnect, scene management, stream statistics
- Keyboard shortcut controller (evdev + pynput fallback) for stream control:
  Ctrl+Shift+S (start/stop), Ctrl+Shift+1-9 (scene switch), Ctrl+Shift+R (reconnect)
- REST API: /api/v1/stream/* endpoints for start/stop/status, scenes, cameras,
  platforms, and hotkey listing — integrated into NetworkServer
- StreamStateProvider bridging layer connects REST routes to Streamer instance
- GStreamer pipeline supports ALSA/JACK/PulseAudio audio capture and
  V4L2/libcamera video capture with H.264 hardware encoding on RPi4B
- Low-latency streaming settings for live performance (zerolatency, no B-frames)
- 89 streaming tests (709 total project tests pass)
2026-05-19 22:13:51 -04:00
2026-05-19 22:13:51 -04:00
2026-05-19 22:13:51 -04:00

Raspberry Pi Real-Time Audio Mixer

RPi4B-based multi-channel real-time audio mixer with custom PREEMPT_RT kernel.

Architecture

  • Platform: Raspberry Pi 4 Model B (8GB RAM)
  • OS: Raspberry Pi OS Lite (64-bit, Bookworm) + custom PREEMPT_RT kernel
  • Audio: USB audio interface with multi-channel I/O
  • Goal: Low-latency (<10ms round-trip) multi-channel audio mixing

Project Structure

├── docs/           Research, architecture decisions, manuals
│   ├── research/   Technical research reports
│   ├── decisions/  Architecture Decision Records (ADRs)
│   └── manuals/    Hardware/software manuals and references
├── src/            Source code (audio engine, DSP, UI)
├── build/          Build scripts and cross-compilation tooling
├── recipes/        Buildroot/Yocto recipes (if applicable)
├── scripts/        Utility and deployment scripts
└── wiki/           Local wiki pages

Status

Phase 1-4: Core audio stack + MIDI controller support (in progress)

  • P1-R1: System Research — USB audio, PREEMPT_RT kernel analysis
  • P1-R2: Base OS Selection — RPiOS Lite 64-bit + custom PREEMPT_RT
  • P2-R1: ALSA + JACK2 Low-Latency Config
  • P4-R1: MIDI Controller Support — Binding + Learn Mode
  • P3: Audio Engine — DSP pipeline, mixing engine
  • P4: Hardware Integration — GPIO control surface

Getting Started

Documentation coming in Phase 2+

License

TBD

S
Description
RPi4B Real-Time Multi-Channel Audio Mixer
Readme 651 KiB
Languages
Python 86.9%
Shell 5.7%
JavaScript 4.4%
CSS 2.1%
HTML 0.9%