Watch: Google Project Starline could be the future of video calls

Google is focused on advancing AI, and at Google I/O, they unveiled several futuristic technologies. One of their long-teased projects is Project Starline, which has the potential to revolutionize video calling. It aims to make virtual interactions feel lifelike, even on a flat screen, without the need for 3D glasses or VR headsets. Recently, YouTuber Marques Brownlee had the opportunity to experience Starline firsthand.

Read: Twitter now allows Blue subscribers to upload two-hour videos

Conventional cameras struggle to capture depth perception, and their placement on devices like phones and laptops makes it challenging to maintain eye contact during video calls. Previous attempts at stereoscopic imaging with multiple camera lenses have not become mainstream.

Project Starline reimagines stereoscopic imaging for one-on-one video interactions using computer vision, machine learning, body tracking, and spatial audio. The result is a convincing illusion of sharing the same space with another person through a screen and the internet, without the need for glasses or headsets.

Marques Brownlee, known as MKBHD, filmed a hands-on experience with Project Starline. Initially, it required a dedicated room with computers, cameras, depth sensors, and a large display. However, Google recently introduced a compact unit featuring a 65-inch display, which Marques and his team tested.

The new design utilizes AI to generate depth maps from regular camera data, eliminating the need for depth sensors. Combined with head tracking, it creates a parallax effect, allowing users to look around the on-screen person by moving their heads. The real-time rendering of a plain white background with virtual shadows adds to the immersive experience. Spatial audio enhances the lifelike feel of the interaction.

However, Project Starline has some limitations. Certain segments in Marques’ video were shot using a single camera, resulting in a flat image without depth. Additionally, glitchy artifacts were visible around the subject, similar to virtual backgrounds on Google Meet calls.

For now, Project Starline only supports one-on-one interactions. While it may not be viable for daily use in its current form, there is hope that regular users will be able to experience this technology soon. Project Starline represents Google’s commitment to pushing the boundaries of AI and video calling, holding the potential to transform remote communication.