Skip to content
Bastian Noel
FR

Case studies 05 / 05

DepthVistaXR

Shows whatever is on a PC screen in 3D, inside a virtual reality headset.

Role
Design and development
Period
2026
Status
On hold
Context
Personal project
Tools
Python, PyTorch, OpenXR, OpenGL
Links
See the code

The problem

A virtual reality headset only shows content made for it in 3D. I wanted to see any Windows window in 3D, in real time.

What I did

Every building block already existed: screen capture, depth-estimation models, OpenXR rendering. But no tool offered the whole chain. I assembled it on top of the open-source project nunif / IW3, and worked with AI to write the connectors between modules as close as possible to memory and GPU memory, to keep it real time. Around it: three performance profiles, four capture methods with automatic fallback, a flat or curved virtual screen, virtual rooms and an installer.

  1. Screen capture Four methods, with automatic fallback
  2. Depth estimation Existing AI models
  3. One image per eye
  4. Shown in the headset Through OpenXR
Source Every frame of the screen is turned into 3D, in real time.
The depth map under the image: the lighter, the closer. Drag the bar to switch between them.

The result

Version 1.0.2 released with its installer, 16 stars on GitHub. The project is on hold.

Another room, in a forest.
The app icon.
Esc
Ctrl K or /
Open this panel
J K
Next or previous case study
↑ ↓ Enter
Pick from the list