WebRTC Streaming Client shows black screen despite successful simulator initialization

[Seyeon321]

Hi I'm trying to set up WebRTC streaming from a remote GPU server to view OmniGibson simulations locally, and wanted to ask others who succeeded in doing this.

I'm experiencing a black screen in the WebRTC Streaming Client.

My Setup:

• Remote GPU server (accessed via SSH tunnel)
• Isaac Sim 4.5 / OmniGibson with WebRTC streaming
• SSH tunnel forwarding ports 8211 and 49100 to localhost
• Isaaac Sim WebRTC Streaming Client (macOS)

Steps I'm taking:

• SSH tunnel with port forwarding
  • ssh -L 8211:localhost:8211 -L 49100:localhost:49100 user@server
• Run the simulator
  • export CUDA_VISIBLE__DEVICES=x
  • export OMNIGIBSON_REMOTE_STREAMING=webrtc
  • python -m omnigibson.examples.scenes.scene_selector
• Connect WebRTC Streaming Client to localhost(127.0.0.1)

What happens:

• Simulator starts successfully and scene loads
• Terminal shows: ```
  Streaming server started. Now streaming on: http://10.2.11.11:8211/streaming/webrtc-client?server=10.2.11.11
• Scene loads: [INFO] [omnigibson.simulator] Imported scene 0.

- Camera controls appear in terminal
- **But the WebRTC Streaming Client shows only a black screen**

I'm wondering if this issue might be related to the server, of the gpu setting, or anything else like the GLFW init warnings.


Any insights would be greatly appreciated. Thank you!