How LED Lighting and a Smartphone Can Create 3D Imaging

Lighting

Feb 22, 2021

As LEDs replace traditional lighting systems, they bring more smart capabilities to everyday lighting. While you might use your smartphone to dim LED lighting at home, researchers have taken this further by tapping into dynamically controlled LEDs to create a simple illumination system for 3D imaging. For example, simple yet smart LED illumination could provide 3D images for surveillance and robotic applications.

“Current video surveillance systems such as the ones used for public transport rely on cameras that provide only 2D information,” says Emma Le Francois, a doctoral student in the research group led by Martin Dawson, Johannes Herrnsdorf and Michael Strain at the University of Strathclyde in the UK. “Our new approach could be used to illuminate different indoor areas to allow better surveillance with 3D images, create a smart work area in a factory, or to give robots a more complete sense of their environment.”

In The Optical Society (OSA) journal Optics Express, the researchers demonstrate that 3D optical imaging can be performed with a cell phone and LEDs without requiring any complex manual processes to synchronize the camera with the lighting.

“Deploying a smart-illumination system in an indoor area allows any camera in the room to use the light and retrieve the 3D information from the surrounding environment,” says Le Francois. “LEDs are being explored for a variety of different applications, such as optical communication, visible light positioning and imaging. One day the LED smart-lighting system used for lighting an indoor area might be used for all of these applications at the same time.”

The science behind the system

It starts with our brains. Human vision relies on the brain to reconstruct depth information when we view a scene from two slightly different directions with our two eyes. This depth information can also be acquired using a method called photometric stereo imaging, which combines one detector, or camera, with illumination that comes from multiple directions. This lighting setup allows images to be recorded with different shadowing, which can then be used to reconstruct a 3D image.

Photometric stereo imaging traditionally requires four light sources, such as LEDs, which are deployed symmetrically around the viewing axis of a camera. In the new work, the researchers show that 3D images can also be reconstructed when objects are illuminated from the top down but imaged from the side. This setup allows overhead room lighting to be used for illumination.

To construct a 3D image, the researchers developed algorithms that help the camera to determine which LED generated which image. The algorithms modulate each LED differently and have their own clock signal. The camera acquires an image after detecting a signal.

“We wanted to make photometric stereo imaging more easily deployable by removing the link between the light sources and the camera,” says Le Francois. “To our knowledge, we are the first to demonstrate a top-down illumination system with a side image acquisition where the modulation of the light is self-synchronized with the camera.”

3D imaging with a smartphone

To demonstrate this new approach, the researchers used their modulation scheme with a photometric stereo setup based on commercially available LEDs. A simple Arduino board provided the electronic control for the LEDs. Images were captured using the high-speed video mode of a smartphone. They imaged a 48-millimeter-tall figurine that they 3D printed with a matte material to avoid any shiny surfaces that might complicate imaging.

After identifying the best position for the LEDs and the smartphone, the researchers achieved a reconstruction error of just 2.6 millimeters for the figurine when imaged from 42 centimeters away. This error rate shows that the quality of the reconstruction was comparable to that of other photometric stereo imaging approaches. They were also able to reconstruct images of a moving object and showed that the method is not affected by ambient light.

In the current system, reconstructing the image takes a few minutes on a laptop. To make the system practical, the researchers are working to decrease the computational time to just a few seconds by incorporating a deep-learning neural network that would learn to reconstruct the shape of the object from the raw image data.

Source: The Optical Society. “Researchers acquire 3D images with LED room lighting and a smartphone: Simple, yet smart LED illumination could provide 3D images for surveillance and robotic applications.” ScienceDaily, 11 January 2021; www.sciencedaily.com/releases/2021/01/210111125549.htm.

Journal Reference: Emma Le Francois, Johannes Herrnsdorf, Jonathan J. D. McKendry, Laurence Broadbent, Glynn Wright, Martin D. Dawson, Michael J. Strain. “Synchronization-free top-down illumination photometric stereo imaging using light-emitting diodes and a mobile device.” Optics Express, 2021; 29 (2): 1502 DOI: 10.1364/OE.408658

Photo credit: Emma Le Francois, University of Strathclyde

Related Articles


Latest Articles

  • Industrial Wiring Devices: A Brief Intro and How to Choose Them

    Industrial Wiring Devices: A Brief Intro and How to Choose Them

    June 9, 2025 Introduction: With the multitude of options on the market, it can be difficult to decide whether you need a pin and sleeve wiring device or a plug and connector in your industrial plant or facility. You might find your head swirling with thoughts about which option is best. Or you may not… Read More…

  • Industry Leaders Head to Quebec to Strengthen Energy and Supply Chain Resilience

    Industry Leaders Head to Quebec to Strengthen Energy and Supply Chain Resilience

    June 9, 2025 By Electro-Federation Canada On June 3 and 4, a high-level delegation from Canada’s electrical and automation sector travelled to Montreal and Quebec City for a series of strategic meetings with Quebec government officials and key stakeholders. Organized by Electro-Federation Canada (EFC), this mission underscores the critical role the industry plays in advancing… Read More…

  • Electrifying Connections: A Celebration of Legacy, A Vision for the Future

    Electrifying Connections: A Celebration of Legacy, A Vision for the Future

    June 9, 2025 By Electro-Federation Canada This year’s Annual Industry Conference, held against the breathtaking backdrop of Niagara Falls, Ontario, was a landmark event with more than 710 Electro-Federation Canada community members. More than just a celebration of our shared history, it was a launchpad for new ideas, future-based dialogue, and deeper connections.   The energy and… Read More…

  • Code Quiz: Canadian Electrical Code, Part 1, 26th Edition Section 28 – Motors and Generators

    Code Quiz: Canadian Electrical Code, Part 1, 26th Edition Section 28 – Motors and Generators

    by William (Bill) Burr Question:  Adam is working in his garage cutting wood on his table saw. Suddenly the lights go out and the sump pump and the table saw stop running. There is obviously a power outage. After a short time, the lights and the sump pump come back on, but thetable saw stays off. Adam needs to restart it.  Can you explain why the lights and sump pump come back on… Read More…


Changing Scene

  • Andrey Goreev Joins Mersen Electrical Power as Regional Sales Manager

    Andrey Goreev Joins Mersen Electrical Power as Regional Sales Manager

    June 9, 2025 MERSEN CANADA TORONTO INC. is pleased to announce effective June 2nd, 2025, Andrey Goreev has joined Mersen Electrical Power as Regional Sales Manager for the Western Canada Region. He will report to Tom Arbanas, Vice President of Distribution Sales and Customer Care, Canada. Andrey has over 18 years of experience in industrial… Read More…

  • Electric Avenue Powers Ahead with Major Win and New Flagship Product: Watti Pro Echo

    Electric Avenue Powers Ahead with Major Win and New Flagship Product: Watti Pro Echo

    June 9, 2025 In an industry dominated by global giants, a startup from Canada’s East Coast is quickly becoming one of the most compelling cleantech success stories in the country. Electric Avenue, a Nova Scotia–based EV charging manufacturer, is making waves in the North American market with the official launch of its Watti Pro Echo… Read More…

  • Manitoba and BC Establish Free Trade Agreements

    June 9, 2025 The Manitoba government will sign a new memorandum of understanding with British Columbia to advance free trade between the two provinces and cabinet will pass regulations by July 1 to ensure mutual recognition of other provinces by Canada Day, Premier Wab Kinew announced today at the MBiz Breakfast Series hosted by the… Read More…

  • Nova Scotia Removing Trade Barriers With Other Provinces, Federal Government

    Nova Scotia Removing Trade Barriers With Other Provinces, Federal Government

    June 9, 2025 Trade barriers between Nova Scotia, several provinces and the federal government will soon be removed. Nova Scotia, along with Alberta, British Columbia, Manitoba, Ontario and Prince Edward Island have taken action to remove barriers and red tape that will open up new trade and investment opportunities. It is also anticipated that the… Read More…