Definition: Eye tracking (gaze tracking) is a technology that captures and analyzes the movements and positions of the eyes in real time. In VR and AR headsets, infrared sensors measure the gaze direction. This enables more natural interaction, performance optimization and usage analysis.
In B2B mechanical engineering, eye tracking is used for: foveated rendering (smooth display of highly detailed 3D models), attention analytics (what does the customer look at during a presentation?), hands-free interaction (gaze instead of a controller), VR training (attention measurement) and design reviews (gaze heatmaps for ergonomics validation).
Advantage: More natural VR/AR experiences, better performance, measurable attention.
English: Eye Tracking, Gaze Tracking German: Blickverfolgung, Augentracking
How It Works
Infrared-based capture
Modern VR/AR headsets use infrared cameras:
- IR LEDs illuminate the eyes: infrared light (invisible to humans)
- Cameras capture reflections: corneal reflection + pupil position
- Software calculates the gaze direction: 3D gaze ray (where does the user look?)
- Real-time tracking: 120-200 Hz (faster than the refresh rate)
Result: The system knows exactly where the user looks in the virtual scene.
Pupil Center Corneal Reflection (PCCR)
The most common method in XR headsets:
Principle: Measure the distance between the center of the pupil and the corneal reflection.
Advantage: High accuracy (0.5-1° angular accuracy), robust during head movements, works with glasses.
Use: HoloLens 2, Meta Quest Pro, HTC Vive Pro Eye.
Video oculography (VOG)
Camera-based tracking:
How it works: Cameras in the headset capture the eyes. Image processing algorithms analyze the pupil position.
Advantage: Low cost, easy integration.
Use: Standard in modern VR/AR headsets.
Eye Tracking Technologies
Foveated rendering
Performance optimization through selective rendering:
Problem: Detailed machine models (millions of polygons) put a high load on the GPU.
Solution: Render only the center of the gaze in high resolution and reduce the periphery.
How it works: 1. Eye tracking finds the gaze point 2. The GPU renders the center of the gaze in full quality 3. The periphery (outside 10-20° of the field of view) is rendered in low resolution 4. The user does not notice the difference (human peripheral vision is blurred)
Performance gain: 30-50% less GPU load.
B2B use: Show complex CAD models smoothly in VR (for example, a CNC milling machine with all details).
Gaze-based interaction
Gaze as an input method:
Use: The user looks at an object → the object is highlighted. The user looks + gives a voice command → the action is done. Menu navigation by gaze (dwell time: fixate for 1 s = click).
Advantage: Hands-free interaction (important when the user holds a tool or gives a presentation).
B2B scenario: A service technician wears a HoloLens and looks at a machine part → the maintenance instructions appear.
Attention analytics
Measurement of what users look at:
Data capture: heatmaps (where did the user look?), dwell time (how long did the user fixate on an object?), scan path (gaze path over time), first fixation (what did the user notice first?).
Evaluation: Which machine details interest customers? Which configuration options do they ignore? Where do questions come up (long fixation = uncertainty)?
B2B use: Optimization of VR product presentations based on attention data.
B2B Applications
VR design reviews
Eye tracking for ergonomics validation:
Scenario: A new packaging machine in a VR review with stakeholders.
Benefit of eye tracking: - The heatmap shows: where do operators look (display, control panel)? - Line-of-sight analysis: does the operator see critical areas? - Attention distribution: do people notice the safety notes?
Result: Optimization of the machine based on gaze data (for example, put the display higher when users often look down).
VR training with attention measurement
Eye tracking validates the effectiveness of training:
Use: Training for machine operation in VR.
Eye tracking metrics: - Does the trainee look at the correct controls? - Is distraction detected (the gaze wanders)? - Did the trainee notice safety-relevant elements?
Feedback: The system gives a warning when the trainee misses an important element.
B2B advantage: Objective training validation (not only "I understood", but "Did the trainee look?").
Product presentations with attention analytics
Eye tracking optimizes the sales strategy:
Workflow: 1. The customer wears a VR headset and explores the machine 2. Eye tracking captures the gaze path 3. After the presentation: analysis 4. Sales sees: the customer looked at the tool changer 40% of the time → this feature is of interest!
Benefit for sales: Targeted follow-up on features with high attention, identification of unclear points (long fixation without interaction).
Hands-free AR maintenance
Gaze interaction during service tasks:
Scenario: A technician wears a HoloLens and repairs a machine (both hands hold tools).
Eye tracking function: - The technician looks at a component → information appears - A look at "Next step" → the instructions change automatically - Voice command + gaze = action (for example, "Photo" + a look at the defect = the photo is saved)
Advantage: No hand is necessary for menu navigation.
Eye Tracking in B2B Headsets
Microsoft HoloLens 2
Enterprise AR headset with eye tracking:
Eye tracking features: - Automatic user authentication (iris recognition) - Gaze-based cursor (the gaze moves the cursor) - Foveated rendering (for complex holograms) - Attention-based UI (menus appear where the user looks)
B2B use: Field service, remote assistance, design reviews.
Price: ~€3,500-4,500
Meta Quest Pro
High-end VR with eye + face tracking:
Eye tracking features: - Foveated rendering (for detailed scenes) - Social presence (virtual avatars with realistic eye contact) - Gaze-based UI - Attention tracking
B2B use: VR collaboration, design reviews, training.
Price: ~€1,200 (lower cost than HoloLens 2)
HTC Vive Pro Eye
Enterprise VR with Tobii eye tracking:
Eye tracking features: - Tobii Eye Tracking SDK (market leader) - Foveated rendering - Attention analytics - Gaze-based interaction
B2B use: High-end VR applications, CAD reviews, simulations.
Price: ~€1,500 (headset + base stations + controllers)
Pico 4 Enterprise
Standalone VR with eye tracking:
Advantage: Lower cost than Quest Pro (~€800), eye tracking is optional (Pico 4 Pro).
B2B use: Budget-friendly VR training with eye tracking.
Challenges
People who wear glasses
Eye tracking works less well with glasses: - Reflections on the lenses disturb the IR cameras - Reduced accuracy
Solution: A headset with a glasses spacer (correct positioning), prescription lenses (for example from VR Optiker), calibration (the software compensates for the glasses).
Calibration is necessary
Eye tracking needs an initial setup: - The user follows calibration points (30-60 seconds) - With several users: a new calibration for each user
B2B challenge: This takes much time at demos with many customers (trade show).
Solution: Fast calibration (modern headsets: <30 s), saved profiles (for returning users).
Data privacy
Eye tracking captures biometric data: - Gaze data can reveal personal interests - Data processing that is relevant under the GDPR
B2B compliance: - Get consent before eye tracking - Anonymize attention data - Use the data only for the stated purpose (for example, presentation optimization, not profiling)
Frequently Asked Questions (FAQ)
Does eye tracking work for every user?
For most users, yes, with limitations. Good: normal vision, with or without contact lenses. Limited: glasses (reflections reduce the accuracy), eye diseases (cataract, nystagmus), very small or large pupils. Solution: Calibration compensates for much of this. Modern systems work for >95% of users. Rule of thumb: Test with the target audience before the rollout (for example, machine operators, not only office employees).
Is eye tracking in VR tiring for the eyes?
No, eye tracking itself is passive (it only measures). Tiring factors are: VR use in general (vergence-accommodation conflict), long sessions (>30 min without a break), a badly calibrated headset. Eye tracking even improves this: foveated rendering reduces motion sickness (smoother frame rate). Best practice: Take breaks every 20-30 min, and adjust the headset correctly (IPD - interpupillary distance).
Can eye tracking data be misused?
Yes, in theory. Risks: attention profiling (deriving interests), emotion recognition (pupil dilation = interest/stress), identification (eye patterns are unique). Protection: GDPR compliance (consent, purpose limitation, deletion), anonymization (no link to a person), transparency (what is captured, and for what purpose?). B2B recommendation: Store only aggregated data (heatmaps without personal reference).
Does every VR/AR headset need eye tracking?
No, this depends on the application. Eye tracking is necessary for: foveated rendering (for very detailed scenes), attention analytics (presentation optimization), gaze interaction (hands-free control). Eye tracking is optional for: simple VR applications (static scenes), controller-based interaction, budget constraints. Rule of thumb: High-end VR (CAD reviews) → eye tracking is valuable. Standard VR (basic training) → you can do without it.
How accurate is eye tracking in VR/AR headsets?
Angular accuracy: 0.5-1° (typical for modern headsets). In practice: at a distance of 2 m = 2-4 cm deviation. Sufficient for: gaze-based UI (buttons are >5 cm), foveated rendering (the area is large enough), attention heatmaps (approximate areas). Not sufficient for: precise pointing (<1 cm), medical diagnostics. B2B context: The accuracy is sufficient for all typical applications (design reviews, training, presentations).
Industry Standards and Technologies
Eye tracking providers: - Tobii – market leader for eye tracking hardware/software - Pupil Labs – open source eye tracking for research - Apple Vision Pro – eye tracking as the main input method
VR/AR platforms with eye tracking: - HoloLens 2 – Microsoft AR headset - Meta Quest Pro – high-end VR with eye + face tracking - HTC Vive Pro Eye – enterprise VR with Tobii - PlayStation VR2 – consumer VR with eye tracking - Pico 4 Pro – standalone VR with eye tracking
Software frameworks: - OpenXR Eye Gaze Interaction – open standard - Tobii XR SDK – eye tracking for Unity/Unreal - ARKit eye tracking – iOS eye tracking API
Related Topics
VR/AR technologies: - Virtual reality – VR basics - Augmented reality – AR technology - HoloLens – Microsoft MR headset - Immersive experience – immersive presentation - Foveated rendering – performance optimization
Tracking technologies: - Motion tracking – tracking of movements - Hand tracking – capture of the hands - Face tracking – capture of the face - SLAM – spatial tracking - Inside-out tracking – headset-based tracking
Interaction: - Gaze-based UI – control by gaze - Hands-free interaction – operation without hands - Voice control – control by voice - Controller input – input with controllers - Gesture recognition – recognition of gestures
Analytics and optimization: - Attention analytics – analysis of attention - Heatmaps – gaze heatmaps - User behavior analysis – behavior of users - A/B testing – presentation optimization - Usability testing – tests of usability
B2B applications: - VR training – virtual training - Design reviews – CAD reviews in VR - Remote collaboration – distributed teams - Product presentations – presentation of products - Field service – service tasks with AR
