GeezerVison

Summary

• Add simulator and Android emulator audio to the WebRTC live stream alongside H.264 video.
• Capture per-simulator host audio with Core Audio process taps scoped to the selected iOS simulator or Android emulator process tree.
• Encode captured tap samples as browser-native Opus at 48 kHz stereo instead of telephone-grade PCMU/G.711.
• Keep the WebRTC audio packet clock independent from Core Audio tap refreshes, so slow process discovery or tap rebuilds cannot starve browser playback into tiny snippets.
• Drop stale encoded audio packets when the sender falls behind under host CPU pressure, so the live stream resumes at the newest audio instead of replaying a delayed crackly backlog.
• Suppress direct simulator/emulator hardware output while the tap is active, so audible playback comes through the browser WebRTC audio element only when Sound is unmuted.
• Keep the web Sound toggle muted by default, harden simulator/runtime/accessibility metadata rendering against non-string payloads, and recover a blank browser boot with a one-shot root watchdog reload.

Notes

• macOS 14.2+ is required for Core Audio process taps.
• Android emulators launched by SimDeck keep host audio enabled so there is audio for the process tap to capture; the active tap mutes direct hardware output and routes encoded Opus packets into WebRTC.
• The legacy H.264 WebSocket fallback remains video-only.

Testing

• npm run lint
• npm test
• npm run build:cli
• npm run build:client
• cargo test --manifest-path packages/server/Cargo.toml transport::webrtc::tests:: -- --nocapture
• Headless WebRTC audio check against http://127.0.0.1:4313/?device=817F1550-0970-42A3-8643-30B896495DBD&stream=webrtc for 10s with SIMDECK_E2E_ENABLE_AUDIO=1 SIMDECK_E2E_MIN_AUDIO_PACKETS=300: passed with directAudioPacketsDelta=658, audioPacketsLost=0, audioConcealedSamples=0, and audioSilentConcealedSamples=0.
• Reloaded the in-app browser on 4313 after rebuilding/restarting the service; fixed bundle index-B3KzZIJW.js rendered video and accessibility overlay nodes with no fresh console errors, and metrics reported WebRTC connected.