Researchers reconstruct a person's surroundings using just the reflections in their eyes.
In the case of reconstructing a 3D scene using eye reflections, the researchers had to overcome numerous challenges, including finding a way to compensate for iris texture and cornea poses. To do so, the team developed an estimated eye texture and designed a way to translate the shape of a reflection on a typical cornea into a typical, natural perspective. To that end, the researchers also relied upon previous extensive research about human eye geometry.
In real-world experimentation, the team successfully reconstructed a room in 3D using eye reflections. While the results are not exceedingly high resolution, they are fascinating. The team explains that standard NeRF techniques are insufficient because of noise inherent in cornea localization, complex iris textures, and the low-resolution nature of small reflections. To overcome these obstacles, the team introduced novel cornea pose optimization and iris texture decomposition methods during its training process.
“With this work, we hope to inspire future explorations that leverage unexpected, accidental visual signals to reveal information about the world around us, broadening the horizons of 3D scene reconstruction,” the research concludes.“Seeing the World through Your Eyes” by Hadi Alzayer, Kevin Zhang, Brandon Feng, Christopher Metzler, and Jia-Bin Huang / University of Maryland, College Park
South Africa Latest News, South Africa Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Dolphin moms use baby talk to call their young, researchers findA new study has found that dolphin mothers also use a kind of high-pitched baby talk with their kids.
Read more »
Some Dutch people seeking euthanasia cite autism or intellectual disabilities, researchers saySeveral people with autism and intellectual disabilities have been legally euthanized in the Netherlands in recent years because they said they could not lead normal lives, researchers have found.
Read more »
Researchers reconstruct 3D environments from eye reflections | EngadgetResearchers at the University of Maryland have turned eye reflections into (somewhat discernible) 3D scenes.
Read more »
Some Dutch people seeking euthanasia cite autism or intellectual disabilities, researchers saySeveral people with autism and intellectual disabilities have been legally euthanized in the Netherlands in recent years because they said they could not lead normal lives.
Read more »
Researchers working on new ways to detect Alzheimer'sResearchers are working on new ways to detect Alzheimer’s before you or anyone else knows you have it.
Read more »
Some Dutch people seeking euthanasia cite autism or intellectual disabilities, researchers saySeveral people with autism and intellectual disabilities have been legally euthanized in the Netherlands in recent years because they said they could not lead normal lives, researchers have found.
Read more »