Skip to the content ForoHackers
Log inJoin

AR, VR and XR: start here

AR, VR and XR
#2987 · · Quote · Report

Extended reality covers virtual reality, which replaces the world with a rendered one, and augmented reality, which adds rendered things to the real one. Both must track where your head and hands are and redraw fast enough that your body believes it. Comfort is a hard technical limit, not a detail.

Key concepts

  • Tracking: finding the pose of the head and controllers from inertial sensors, cameras and markers.
  • Stereo rendering: one image per eye, with lens distortion corrected, at a high and steady frame rate.
  • Latency: the delay between a movement and the image that answers it; too much causes discomfort.
  • Spatial mapping: understanding surfaces and depth in the real room so virtual objects sit on them and hide behind them.
  • Interaction: hands, gaze, controllers and voice, in three dimensions, with real scale.

Vocabulary

  • 6DoF: six degrees of freedom, three of position and three of rotation.
  • SLAM: building a map while tracking position inside it.
  • Reprojection: warping the last frame to the newest head pose to hide small delays.
  • OpenXR: the open standard API between XR applications and devices.

What to study, in order

  1. Rotations: Euler angles, rotation matrices and quaternions, and why gimbal lock happens.
  2. Render a scene in stereo on a screen, with a camera that follows the mouse.
  3. Build a small app through OpenXR or a game engine's XR support, and read the frame timing.
  4. Measure frame time and learn what dropped frames feel like; budget for it.
  5. Design an interaction in 3D and test it on people for comfort, not just for function.

Related tags

#computer-graphics #game-engines #slam #human-factors

You are not logged in, so this goes up anonymously: no account, no name and no address is stored with it, and it may carry no link and no image. Log in or join to post under your name. Our web server's logs keep the address and time of every request for up to 14 days; to keep yours out of them, use Tor. To reach the staff in confidence, use the drop. Sign as a returning source (a key kept only in this browser)

Sending takes a few seconds here: your browser first works out a proof of work against spam.

Reply