What iPhones Have LiDAR

The integration of LiDAR (Light Detection and Ranging) technology into iPhones represents a significant leap forward in mobile sensing capabilities. While often associated with professional surveying, autonomous vehicles, and advanced robotics, this sophisticated sensor is now accessible in the palm of your hand. For tech enthusiasts, developers, and everyday users alike, understanding which iPhones are equipped with LiDAR and what it enables is crucial for unlocking new dimensions of augmented reality, photography, and spatial understanding. This article delves into the iPhones that feature LiDAR, explores the technology itself, and illuminates the practical and innovative applications it unlocks.

The Evolution of iPhone Sensing Technology

Apple has consistently pushed the boundaries of smartphone innovation, and the inclusion of LiDAR is a testament to their commitment to integrating advanced sensing into consumer devices. Before LiDAR, iPhones relied on a suite of sensors like accelerometers, gyroscopes, and GPS to understand their environment and the user’s movement. Cameras provided visual data, and depth-sensing technologies like the TrueDepth camera system on the front of many iPhones enabled features like Face ID and portrait mode selfies.

The TrueDepth system, while impressive, is primarily focused on the front-facing camera and specific facial recognition tasks. It uses a dot projector and infrared camera to create a depth map of the user’s face. However, LiDAR offers a fundamentally different and more robust approach to depth sensing. Instead of projecting structured light or relying solely on stereoscopic vision, LiDAR emits laser pulses and measures the time it takes for these pulses to return after reflecting off surfaces. This allows for the creation of highly accurate, real-time 3D maps of an environment, regardless of ambient light conditions.

The introduction of LiDAR on the rear of the iPhone was a strategic move, aiming to enhance the phone’s ability to interact with and understand the physical world around it. This capability is particularly impactful for augmented reality (AR) experiences, which require precise mapping of surfaces and objects to anchor virtual content realistically. Beyond AR, LiDAR opens up possibilities for enhanced photography, 3D scanning, and even more sophisticated applications in fields like architectural planning and interior design.

TrueDepth vs. LiDAR: A Comparative Overview

While both the TrueDepth camera and LiDAR contribute to depth perception on iPhones, their methodologies and applications differ significantly.

TrueDepth Camera System

• Mechanism: Employs a dot projector, infrared camera, and flood illuminator to map facial geometry.
• Primary Focus: Facial recognition (Face ID), animoji, portrait mode selfies.
• Depth Range: Optimized for close-range facial scanning.
• Performance in Varying Light: Can be affected by very bright or very dark conditions for facial recognition.

LiDAR Scanner

• Mechanism: Emits laser pulses and measures the time-of-flight for reflected light to determine distances to objects.
• Primary Focus: Creating detailed 3D maps of environments, enhancing AR experiences, improving autofocus in low light.
• Depth Range: Capable of scanning larger areas and objects at greater distances.
• Performance in Varying Light: Largely unaffected by ambient light conditions due to its active laser emission.

The complementary nature of these sensors allows iPhones to possess a comprehensive understanding of their surroundings, from the fine details of a user’s face to the broader spatial context of a room.

iPhones Featuring LiDAR Technology

Apple has strategically equipped its higher-end iPhone models with LiDAR scanners, recognizing its potential to power advanced features. As of the latest releases, LiDAR is a standard feature on iPhone Pro models, signifying its role as a premium sensor for cutting-edge applications.

iPhone Pro Models

The journey of LiDAR on iPhones began with the iPhone 12 Pro and iPhone 12 Pro Max. Since then, every subsequent Pro model has retained and refined this technology.

• iPhone 12 Pro: This was the first iPhone to introduce the LiDAR scanner. It enabled faster and more accurate autofocus in low-light conditions for photos and videos, along with enhanced AR experiences.
• iPhone 12 Pro Max: Featuring the same LiDAR capabilities as the 12 Pro, it further benefited from the larger sensor and lens advancements of the Pro Max model for its photographic prowess.
• iPhone 13 Pro: Building upon the foundation of the 12 Pro series, the iPhone 13 Pro and iPhone 13 Pro Max integrated LiDAR with improved performance. This generation saw further enhancements in ARKit applications and low-light photography.
• iPhone 14 Pro: The iPhone 14 Pro and iPhone 14 Pro Max continued to feature the LiDAR scanner, benefiting from Apple’s ongoing advancements in sensor technology and computational photography. The LiDAR scanner plays a crucial role in the ProRAW photo capture and cinematic video modes of these devices.
• iPhone 15 Pro: The latest iteration, the iPhone 15 Pro and iPhone 15 Pro Max, boast an even more advanced LiDAR scanner. This generation’s LiDAR system is designed for enhanced accuracy and speed, contributing to features like spatial video recording for the Apple Vision Pro.

Identifying a LiDAR-Equipped iPhone

Distinguishing between an iPhone with and without LiDAR is straightforward. If you own an iPhone 12 Pro, 12 Pro Max, 13 Pro, 13 Pro Max, 14 Pro, 14 Pro Max, 15 Pro, or 15 Pro Max, your device is equipped with a LiDAR scanner. Visually, the LiDAR scanner is a small, circular module located on the rear camera array, typically positioned near the flash and other sensors.

While the sensor is present, its functionality is primarily accessed through specific applications and features designed to leverage its capabilities, particularly within ARKit-enabled apps.

Unlocking the Power of LiDAR: Applications and Capabilities

The LiDAR scanner is not merely a piece of hardware; it’s an enabler of a new class of iPhone experiences. Its ability to rapidly and accurately measure depth and dimension transforms how users interact with digital content and capture their physical surroundings.

Enhanced Augmented Reality (AR)

This is perhaps the most significant and widely discussed application of LiDAR on iPhones. AR experiences rely on precise understanding of the environment to anchor virtual objects realistically.

• Realistic Anchoring: LiDAR allows virtual objects to appear as if they are truly part of the physical environment. Instead of floating awkwardly, furniture can be placed with accurate perspective, and characters can interact with real-world surfaces.
• Occlusion: LiDAR enables virtual objects to be correctly occluded by real-world objects. For example, if a virtual character walks behind a real table, it will disappear behind it, creating a much more immersive and believable AR scene.
• Surface Detection: The scanner can detect horizontal, vertical, and even sloped surfaces, making it easier for AR apps to place content accurately. This is crucial for placing virtual decorations on walls or floors.
• Faster AR Setup: AR experiences that require environment scanning can often be initiated more quickly with LiDAR, as it provides a detailed depth map almost instantaneously.

ARKit, Apple’s framework for building AR experiences, is optimized to take full advantage of the LiDAR scanner. Developers can create increasingly sophisticated and interactive AR applications for gaming, education, design, and more.

Advanced Photography and Videography

LiDAR’s impact extends to how iPhones capture still images and video, particularly in challenging lighting conditions.

• Low-Light Autofocus: The LiDAR scanner significantly improves autofocus performance in low-light situations. By measuring depth precisely, the camera can lock onto subjects faster and more accurately, reducing blurry shots in dimly lit environments. This is particularly beneficial for portrait photography at night or in indoor settings.
• Night Mode Portraits: On supported iPhone models, LiDAR enables the Portrait mode effect to be applied even in low-light conditions, creating beautifully rendered portraits with a shallow depth of field.
• Spatial Video Recording: With the iPhone 15 Pro, LiDAR is instrumental in capturing spatial video. This 3D video format is designed to be viewed on the Apple Vision Pro, offering a sense of depth and immersion that traditional video cannot replicate. The LiDAR scanner captures depth information that is then encoded into the video, allowing for a more lifelike viewing experience.

3D Scanning and Measurement

The ability to create accurate 3D representations of real-world objects and spaces opens up a wealth of possibilities for professionals and hobbyists.

• Interior Design and Renovation: Apps like the Measure app (enhanced by LiDAR) allow users to take accurate measurements of rooms and objects. This is invaluable for planning furniture placement, calculating paint quantities, or even for professional interior design and architectural work.
• 3D Model Creation: Developers and users can create 3D models of objects or environments for use in 3D printing, game development, or virtual walkthroughs. LiDAR provides the raw data for these models, significantly speeding up the scanning process.
• Accessibility: For individuals with visual impairments, LiDAR-powered apps can help describe the spatial layout of a room, providing crucial information about the environment.

Future Potential and Developer Innovations

The integration of LiDAR into iPhones is still a relatively young endeavor, and its full potential is yet to be realized. As developers continue to explore the capabilities of the LiDAR scanner through ARKit and other frameworks, we can anticipate even more innovative applications emerging.

• Robotics and Automation: While consumer iPhones are not robotic platforms, the underlying technology mirrors that used in autonomous systems. Future iterations might see more direct integration with smart home devices or personal robotics.
• Enhanced Navigation and Spatial Awareness: Beyond AR, LiDAR could contribute to more sophisticated indoor navigation systems or provide richer context for location-based services.
• Medical and Scientific Applications: In specialized fields, the precision of LiDAR could be leveraged for applications ranging from physical therapy assessments to educational simulations.

The presence of LiDAR on a growing number of iPhones signifies a commitment from Apple to making advanced spatial sensing technology a mainstream feature, empowering users and developers to create and experience the world in entirely new ways.