WildDet3D

3D detection App by Ai2: Detect 3D bounding boxes in real-time using LiDAR or from uploaded photos. Visualize object size, distance, and orientation in AR.

WildDet3D brings open-vocabulary 3D object detection to your iPhone — powered by AI research from the Allen Institute for AI (Ai2).

Point your camera at any scene and instantly detect objects with full 3D bounding boxes rendered in
augmented reality. Simply type what you're looking for — chairs, monitors, cups, or any object — and
WildDet3D will find and measure them in 3D space.

CAMERA MODE
Leverage your iPhone's LiDAR sensor and ARKit to detect objects in real time. 3D bounding boxes are
anchored to the real world, showing each object's label, confidence score, distance, dimensions, and
volume. Supports meters, feet, and centimeters.

UPLOAD MODE
Run 3D detection on any photo from your library. No camera or LiDAR required — works on all iPhones.

DETECTION MODES

• Classes: Enter any object categories and detect all instances at once
• 2D Box: Draw a box around a specific object to get its 3D bounding box

ADVANCED FEATURES

• RGB and RGBD depth-aligned detection for improved accuracy
• Interactive 3D boxes — tap to inspect, compare, or delete
• Multi-frame and multi-view capture for challenging scenes
• Save annotated captures to your photo library

REQUIREMENTS

• iPhone with LiDAR sensor recommended for camera mode (iPhone 12 Pro and later)
• Upload mode works on all iPhones
• Internet connection required