Definition: Foveated rendering is a rendering method for VR and MR headsets that calculates in full resolution only the area of the image that the eye looks at. The edge of the field of view is shown with less detail. This saves GPU power without a clear loss of quality that users notice.
English: Foveated Rendering
German: Foveales Rendering, blickabhängiges Rendering
How It Works
The name comes from the fovea, the small area of the retina with which we see sharply. It covers only a few degrees of the field of view. In peripheral vision, the eye mainly detects movement and contrast, but almost no details. Foveated rendering uses this: the GPU divides the image into zones and calculates the outer zones with fewer pixels, for example with variable rate shading.
There are two variants:
- Fixed foveated rendering (FFR): The sharp zone stays fixed in the center of the image. The method needs no additional hardware and is common on standalone headsets without eye tracking, for example the Meta Quest 3. When the user looks to the side, they see the coarser area.
- Eye-tracked or dynamic foveated rendering: Eye tracking measures the direction of view, and the sharp zone moves with it. Meta offers this for the Quest Pro, and the Apple Vision Pro uses it system-wide. Low tracking latency is essential. Otherwise, the eye notices the change.
You can use the power you gain for higher resolution, more geometry or a stable refresh rate. How much it helps in practice depends on the scene, the engine and the device.
Importance in Mechanical Engineering
- Detailed models: Machines derived from CAD have many components and fine structures. Foveated rendering creates reserves for real-time rendering without strong polygon reduction.
- Training on standalone headsets: Without a PC, the mobile GPU must be sufficient. FFR helps to keep the frame rate, which prevents nausea.
- Design review: When you check weld seams, labels or cable routing, you benefit from full sharpness at the point you look at, especially with the eye-tracked variant.
- Limits: On the desktop, in the browser or on a kiosk screen, the method is hardly relevant, because several people look at the same image there.
Frequently Asked Questions (FAQ)
Can you see the difference?
With fixed foveated rendering at a high level, the edges are sometimes visibly blurred or flicker. With eye tracking and low latency, the reduction is usually not noticeable.
Must an application be adapted for it?
Usually you activate it in the engine or in the XR runtime, for example through extensions of the OpenXR standard. The manufacturers describe the setup, for example Meta in its developer documentation on eye-tracked foveated rendering. You should still test text and fine lines on the target device.
