
To ring in the new year, former Apple engineer Bob Burrough uploaded a new video to his fledgling YouTube channel to show off a new idea he has for a smartphone interface.
Burrough’s “Project Erasmus” is a user interface (UI) implementation that renders the lighting in your immediate environment to light, shade, and reflect on the software elements in the device. The result is an incredible, immersive visual effect that will make you want to use your phone even more (as if that’s possible).
Take a look.
Burrough created a small screen application to show how Project Erasmus works.
When he moves the phone around in the air, the buttons and elements on the screen react to the lighting of the room he’s in, complete with shading and highlights.
“It looks like the user interface elements are physical objects that reside just beneath the surface of the screen, like you could reach in and touch them,” Burrough says in the video.
YouTube/Bob Burrough
Take a look.
Burrough created a small screen application to show how Project Erasmus works.
When he moves the phone around in the air, the buttons and elements on the screen react to the lighting of the room he’s in, complete with shading and highlights.
“It looks like the user interface elements are physical objects that reside just beneath the surface of the screen, like you could reach in and touch them,” Burrough says in the video.
YouTube/Bob Burrough
To make it work, Burrough attached an Olloclip fish-eye lens camera to the top of his phone, which captures a wide-angle shot of the environment.
YouTube/Bob Burrough
The software projects that environment map into a scene, which is used to construct lighting and reflections that affect the UI elements on the device.
In the video, Burrough walks through different rooms in his house to demonstrate how lighting can change the interface.


YouTube/Bob Burrough
When Burrough walks into a dark room, or is covered by shadow, the device and the UI are also both in the shadow, which means there are no lighting effects on the phone. The UI elements, like the buttons up top and the shading on the square toward the bottom, completely disappear.
YouTube/Bob Burrough
Burrough says what happens to the user interface in the dark is completely up to the programmer, but his design allows for many interesting variations. He says you could, for example, create a backlight effect for the UI elements when your device is in a dark room, like how Mac keyboards can light up in the dark.
Leo Leung/Flickr
As soon as Burrough walks out of the shadows, the interface begins to react to the light.
YouTube/Bob Burrough
In brighter scenes, the UI takes on the shadows and highlights from the lighting in the room.
YouTube/Bob Burrough
When you move around, the shadows change, and the highlights come from the other direction. It creates a very nifty 3D effect.
YouTube/Bob Burrough
Burrough’s concept, which he says “provides an unprecedented level of immersion,” is something we would love to see in a real smartphone.
YouTube/Bob Burrough
One of everyone’s favorite features in iOS 7 was the parallax effect, a simple visual tweak that creates an illusion of depth on your phone. It has no real function besides looking cool. Burrough’s idea, if implemented on a phone correctly, could produce a similar “wow” effect among customers