Sunday, June 1, 2025
  • Login
Anonymous Wire
  • Home
  • Top News
  • Entertainment
  • Technology
  • World Sport
  • Uncategorized
  • Privacy Policy
  • Website Terms of Use
  • Contact Us
No Result
View All Result
  • Home
  • Top News
  • Entertainment
  • Technology
  • World Sport
  • Uncategorized
  • Privacy Policy
  • Website Terms of Use
  • Contact Us
No Result
View All Result
Anonymous Wire
No Result
View All Result
Home News

Researchers reconstruct 3D environments from eye reflections

June 28, 2023
in News
0
Researchers reconstruct 3D environments from eye reflections
0
SHARES
0
VIEWS
Share on FacebookShare on Twitter

Researchers reconstruct 3D environments from eye reflections

Researchers at the University of Maryland have turned eye reflections into (somewhat discernible) 3D scenes. The work builds on Neural Radiance Fields (NeRF), an AI technology that can reconstruct environments from 2D photos. Although the eye-reflection approach has a long way to go before it spawns any practical applications, the study (first reported by Tech Xplore) provides a fascinating glimpse into a technology that could eventually reveal an environment from a series of simple portrait photos.

The team used subtle reflections of light captured in human eyes (using consecutive images shot from a single sensor) to try to discern the person’s immediate environment. They began with several high-resolution images from a fixed camera position, capturing a moving individual looking toward the camera. They then zoomed in on the reflections, isolating them and calculating where the eyes were looking in the photos.

The results (here’s the entire set animated) show a decently discernible environmental reconstruction from human eyes in a controlled setting. A scene captured using a synthetic eye (below) produced a more impressive dreamlike scene. However, an attempt to model eye reflections from Miley Cyrus and Lady Gaga music videos only produced vague blobs that the researchers could only guess were an LED grid and a camera on a tripod — illustrating how far the tech is from real-world use.

A dream-like scene of a room with a wall covered with various hanging frames. A broom leans against the wall, and two shirts hang nearby. A dresser sits farther to the left. We see the wall at a slight angle.
Reconstructions using a synthetic eye were much more vivid and lifelike — with a dreamlike quality.

University of Maryland

The team overcame significant obstacles to reconstruct even crude and fuzzy scenes. For example, the cornea introduces “inherent noise” that makes it difficult to separate the reflected light from humans’ complex iris textures. To address that, they introduced cornea pose optimization (estimating the position and orientation of the cornea) and iris texture decomposition (extracting features unique to an individual’s iris) during training. Finally, radial texture regularization loss (a machine-learning technique that simulates smoother textures than the source material) helped further isolate and enhance the reflected scenery.

Despite the progress and clever workarounds, significant barriers remain. “Our current real-world results are from a ‘laboratory setup,’ such as a zoom-in capture of a person’s face, area lights to illuminate the scene, and deliberate person’s movement,” the authors wrote. “We believe more unconstrained settings remain challenging (e.g., video conferencing with natural head movement) due to lower sensor resolution, dynamic range, and motion blur.” Additionally, the team notes that its universal assumptions about iris texture may be too simplistic to apply broadly, especially when eyes typically rotate more widely than in this kind of controlled setting. 

Still, the team sees their progress as a milestone that can spur future breakthroughs. “With this work, we hope to inspire future explorations that leverage unexpected, accidental visual signals to reveal information about the world around us, broadening the horizons of 3D scene reconstruction.” Although more mature versions of this work could spawn some creepy and unwanted privacy intrusions, at least you can rest easy knowing that today’s version can only vaguely make out a Kirby doll even under the most ideal of conditions.

Published at Wed, 28 Jun 2023 20:39:49 +0000

ShareTweetPinSendShareShareShareShareSend
Previous Post

Canucks draft picks 2023: When does Vancouver pick? Full list of NHL Draft selections

Next Post

Pieces of Shattered Titanic Submersible Brought Ashore in Canada

Next Post
Pieces of Shattered Titanic Submersible Brought Ashore in Canada

Pieces of Shattered Titanic Submersible Brought Ashore in Canada

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

ABOUT US

Anonymous Wire is the best news website to get every updates you need.

Follow Us

Browse by Category

  • Adventure (144)
  • An Adventure (1)
  • Business (3)
  • Entertainment (393)
  • Games (5)
  • Health (56)
  • News (425)
  • Science & Space (2)
  • Technology (224)
  • Top News (167)
  • Uncategorized (41)
  • Web Stories (1)
  • World Sport (316)
    • News Story (3)
    • Video (3)

Recent News

GAA Football Championship Betting Preview – Saturday & Sunday , May 31st & 1st of June

GAA Football Championship Betting Preview – Saturday & Sunday , May 31st & 1st of June

June 1, 2025
URC Quarter-Final Betting Preview: Leinster to Run Riot, Sharks to Sink Munster

URC Quarter-Final Betting Preview: Leinster to Run Riot, Sharks to Sink Munster

June 1, 2025
  • Home
  • Top News
  • Entertainment
  • Technology
  • World Sport
  • Uncategorized
  • Privacy Policy
  • Website Terms of Use
  • Contact Us

© 2022 Anonymous Wire - Design & Developed by IndeedFeed Media.

No Result
View All Result
  • Home
  • Top News
  • Entertainment
  • Technology
  • World Sport
  • Uncategorized
  • Privacy Policy
  • Website Terms of Use
  • Contact Us

© 2022 Anonymous Wire - Design & Developed by IndeedFeed Media.

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
<