Skip to content

Line of Sight (LOS)

Overview

Maverick AI LOS enables you to place content in world space - anchored to real-world positions that stay fixed as the user moves their head. This is the foundation for augmented reality experiences on Maverick AI glasses.

Unlike HUD drawables (which are fixed to the display), LOS content is positioned using the ENU (East-North-Up) coordinate system and projected onto the display based on the user's head orientation.

HUD and AR Content

M2ArScreen supports two types of content simultaneously:

Content Type Description Coordinate System
HUD 2D screen-fixed elements (text, shapes, images) Display pixels (0–640, 0–400)
AR World-anchored elements that stay fixed in real-world positions ENU world space

When you call screen.add(drawable), the SDK automatically determines whether the drawable is HUD or AR based on its type - no manual management is needed.

AR Drawable Types

Class Description
M2ArPanel A 2D billboard panel positioned in 3D world space. Contains standard HUD drawables (text, shapes, images) rendered as a flat panel facing the user.
M2ArMesh Triangle mesh with optional UV texture mapping for 3D objects.
M2ArLines Line segments in 3D world space.
M2ArPoints Point cloud in 3D world space.
M2ArLight Directional light source for Lambert shading on meshes.

HUD vs AR Comparison

Aspect HUD Drawables AR Drawables
Coordinate system Screen pixels (0–640, 0–400) World space ENU
Positioning setX() / setY() in pixels setWorldPosition(east, north, up)
Orientation Fixed to display Billboard (M2ArPanel) or freely transformable (M2ArGeometry)
Transforms 3x3 matrix (IM2Transformable3x3) 4x4 matrix (IM2Transformable4x4)
Depth ordering Z-order by add order Sorted by distance (farthest first)
Hit testing 2D bounding box 3D ray intersection
Sensor dependency None Requires IMU quaternion

Getting Started

  1. Extend M2ArScreen to get automatic sensor subscriptions - see ArScreen
  2. Learn the coordinate systems - see Coordinate Systems
  3. Add AR panels for HUD-style content in world space - see AR Panels
  4. Add 3D geometry for meshes and wireframes - see 3D Geometry

See Also