Apple Immersive Video Gets Live Formats, iPhone Playback, and Static Foveation Streaming at WWDC26

Immersive Filmmaking

by Nino LeitnerJune 9^th, 2026

Subscribe to News - Software

At WWDC26, Apple has rolled out its most significant batch of Apple Immersive Video (AIV) updates since the format launched, headlined by Apple Immersive Live formats for real-time events, an Immersive Media Support framework that now reaches iPhone and iPad, and a static foveation distribution function that finally makes 8K-per-eye content streamable at a 4K frame size. Together they push AIV from a capture-and-post curiosity toward a complete, broadcastable production pipeline for Apple Vision Pro.

Apple Immersive Video is the company’s stereoscopic, large field-of-view format built specifically for Apple Vision Pro, captured at 90 frames per second and greater than 50MP per eye, with a target field of view of up to 230 degrees. Since its debut alongside the 16-minute short film “Submerged” and the Blackmagic URSA Cine Immersive camera, the format has steadily gained tooling across DaVinci Resolve, Colorfront, and SpatialGen. The WWDC26 updates, gathered on a new dedicated Apple Immersive Video home on the Apple Developer site, are the clearest signal yet that Apple wants the format used for more than first-party demos. If you have been following our ongoing coverage of immersive filmmaking for Vision Pro, this is the moment the workflow story matures.

Apple Immersive Live formats bring AIV into broadcast infrastructure

The most consequential addition is Apple Immersive Live, a set of formats and tools aimed at livestreaming events directly to Vision Pro. According to Apple, the live pipeline is designed to slot into professional broadcast infrastructure built on SMPTE ST 2110, transporting ProRes video, Spatial Audio, and calibrated lens metadata together before encoding to MV-HEVC. The pitch is presence in real time: live sports and events delivered at lifelike acuity and scale rather than as flat coverage.

This builds directly on Apple’s earlier roadmap. We reported in December on the company’s plan to launch live AIV streaming with LA Lakers games in early 2026, and the WWDC26 toolset is the developer-facing foundation for exactly that kind of production. The use of SMPTE ST 2110 matters because it means immersive feeds can ride the same IP-based plumbing that already moves conventional broadcast signals, lowering the integration barrier for facilities that already run ST 2110 routing.

Immersive Media Support framework extends to iPhone and iPad

The Immersive Media Support (IMS) framework, which handles reading, writing, and authoring AIV metadata, was previously limited to visionOS and macOS. With this release, IMS extends to iPadOS and iOS, bringing processing, control, and playback of immersive content to iPhone and iPad through the same cross-platform API. That is a meaningful reach extension: it means AIV content can be inspected and played back on the devices most people already carry, not only inside the headset or on a Mac.

IMS also gains new camera override capabilities for live and complex shoots. Apple says these let you define a camera inline, extending or replacing static metadata as a production evolves, referencing an existing camera or introducing a new one and specifying rotation, the calibration model, and an optional mask derived from AIME data. Overrides are honored at render time on a per-frame basis, which Apple frames as frame-accurate control over how immersive content is captured and presented.

There is a practical rigging win too. With visionOS 27, IMS adds Y-axis flipping alongside the existing X-axis flipping, applied with full stereo awareness so both eyes are handled correctly as a stereo pair. For anyone mounting cameras in inverted or unusual orientations, that means footage from those rigs integrates without the stereo mismatch that would otherwise break the immersive effect.

Static foveation makes 8K-per-eye content streamable

Streaming has always been AIV’s hardest problem. The format is captured at 8K per eye at 90 frames per second, which Apple notes generates over 10 billion pixels per second, a volume no practical network can carry. Scaling the whole frame down to 4K solves the bandwidth issue but sacrifices the pixel density that creates the sense of presence in the first place.

The answer Apple is shipping is a static foveation distribution function. Rather than scaling uniformly, it dedicates most of a smaller frame to the pixels of primary importance, typically the central area of the fisheye lens, and progressively reduces detail toward the periphery. The result, per Apple, is a streamable 4K frame that preserves most of the perceptual resolution at the original 90 fps. We covered the underlying technique in detail when Apple first lifted the veil on it: the URSA Cine Immersive captures 8160 by 7200 pixels per eye, and naive downscaling to 4320 by 4320 would drop pixel density from 40 pixels per degree to around 24 PPD, whereas foveation preserves roughly 40 PPD where viewers actually look. A new sample project demonstrates how the technique pairs with IMS to deliver high-acuity immersive video at a manageable frame size.

Unique-sized portal views fix the cropping problem

There are moments when full immersion is not what you want, such as multitasking or building an interactive app, and AIV’s portal view is the reduced-immersion answer. The catch was its default 16:9 aspect ratio, which could crop important content out of frame. Playback apps can now define a custom wide aspect ratio for the portal viewing mode. Developers set this through AVPlayerViewController’s viewport portal aspect ratio property in AVKit-based apps, or through VideoPlayerComponent’s portal size property in RealityKit-based apps, giving content the room it needs without forcing full immersion.

Apple Spatial Audio Format updates target Pro Tools mixers

Audio gets attention as well. The Apple Spatial Audio Format (ASAF) Production Suite of AAX plug-ins for Pro Tools picks up several improvements aimed at giving sound teams more creative control. Apple says creators can now position objects relative to reference video, and that ambisonics work benefits from a new scene compressor plug-in, enhanced heat map drawing, and a refined spatial filtering algorithm. Richer object orientation controls and support for additional channel bed layouts, including standalone LFE and center, widen the mixing options. The ASAF Video Player app state now saves with the DAW session, so a mix picks up where it was left off.

ASAF remains the backbone of AIV sound, unifying object-based, channel-based, and Higher Order Ambisonics audio in a single container with head-tracked binaural rendering, transported by the Apple Positional Audio Codec (APAC). The Pro Tools-side refinements are the kind of unglamorous workflow polish that tends to matter most to the mixers actually shipping immersive projects.

Where this leaves immersive production

Taken together, the WWDC26 release reads less like a feature list and more like Apple closing gaps across the full capture-to-delivery chain: live production via ST 2110, broader playback through IMS on iPhone and iPad, streamable distribution through static foveation, flexible reduced-immersion viewing through custom portals, and finishing-stage audio control through ASAF. Whether immersive video finds a durable commercial audience is still an open question we have raised before, but the toolchain argument is getting harder to dismiss. The new Apple Immersive Video developer site is the place to dig into the full pipeline, and Apple’s earlier Blackmagic-based capture and post workflow remains the best starting point if you are mapping a real production. You can explore Apple’s documentation on the Apple Immersive Video developer page and the What’s New overview.

The updates were detailed at WWDC26, which runs until June 12, with the Immersive Media Support changes and Y-axis flipping tied to visionOS 27. Apple has not attached pricing to these developer tools, which arrive as part of the platform’s frameworks and the free ASAF Production Suite plug-ins for Pro Tools.

Does live immersive sports on Vision Pro change your view of where AIV is headed, or is streaming bandwidth still the dealbreaker? Have you shot or finished an Apple Immersive Video project yet? Let us know in the comments below!