How LED Lighting and a Smartphone Can Create 3D Imaging

Lighting

Feb 22, 2021

As LEDs replace traditional lighting systems, they bring more smart capabilities to everyday lighting. While you might use your smartphone to dim LED lighting at home, researchers have taken this further by tapping into dynamically controlled LEDs to create a simple illumination system for 3D imaging. For example, simple yet smart LED illumination could provide 3D images for surveillance and robotic applications.

“Current video surveillance systems such as the ones used for public transport rely on cameras that provide only 2D information,” says Emma Le Francois, a doctoral student in the research group led by Martin Dawson, Johannes Herrnsdorf and Michael Strain at the University of Strathclyde in the UK. “Our new approach could be used to illuminate different indoor areas to allow better surveillance with 3D images, create a smart work area in a factory, or to give robots a more complete sense of their environment.”

In The Optical Society (OSA) journal Optics Express, the researchers demonstrate that 3D optical imaging can be performed with a cell phone and LEDs without requiring any complex manual processes to synchronize the camera with the lighting.

“Deploying a smart-illumination system in an indoor area allows any camera in the room to use the light and retrieve the 3D information from the surrounding environment,” says Le Francois. “LEDs are being explored for a variety of different applications, such as optical communication, visible light positioning and imaging. One day the LED smart-lighting system used for lighting an indoor area might be used for all of these applications at the same time.”

The science behind the system

It starts with our brains. Human vision relies on the brain to reconstruct depth information when we view a scene from two slightly different directions with our two eyes. This depth information can also be acquired using a method called photometric stereo imaging, which combines one detector, or camera, with illumination that comes from multiple directions. This lighting setup allows images to be recorded with different shadowing, which can then be used to reconstruct a 3D image.

Photometric stereo imaging traditionally requires four light sources, such as LEDs, which are deployed symmetrically around the viewing axis of a camera. In the new work, the researchers show that 3D images can also be reconstructed when objects are illuminated from the top down but imaged from the side. This setup allows overhead room lighting to be used for illumination.

To construct a 3D image, the researchers developed algorithms that help the camera to determine which LED generated which image. The algorithms modulate each LED differently and have their own clock signal. The camera acquires an image after detecting a signal.

“We wanted to make photometric stereo imaging more easily deployable by removing the link between the light sources and the camera,” says Le Francois. “To our knowledge, we are the first to demonstrate a top-down illumination system with a side image acquisition where the modulation of the light is self-synchronized with the camera.”

3D imaging with a smartphone

To demonstrate this new approach, the researchers used their modulation scheme with a photometric stereo setup based on commercially available LEDs. A simple Arduino board provided the electronic control for the LEDs. Images were captured using the high-speed video mode of a smartphone. They imaged a 48-millimeter-tall figurine that they 3D printed with a matte material to avoid any shiny surfaces that might complicate imaging.

After identifying the best position for the LEDs and the smartphone, the researchers achieved a reconstruction error of just 2.6 millimeters for the figurine when imaged from 42 centimeters away. This error rate shows that the quality of the reconstruction was comparable to that of other photometric stereo imaging approaches. They were also able to reconstruct images of a moving object and showed that the method is not affected by ambient light.

In the current system, reconstructing the image takes a few minutes on a laptop. To make the system practical, the researchers are working to decrease the computational time to just a few seconds by incorporating a deep-learning neural network that would learn to reconstruct the shape of the object from the raw image data.

Source: The Optical Society. “Researchers acquire 3D images with LED room lighting and a smartphone: Simple, yet smart LED illumination could provide 3D images for surveillance and robotic applications.” ScienceDaily, 11 January 2021; www.sciencedaily.com/releases/2021/01/210111125549.htm.

Journal Reference: Emma Le Francois, Johannes Herrnsdorf, Jonathan J. D. McKendry, Laurence Broadbent, Glynn Wright, Martin D. Dawson, Michael J. Strain. “Synchronization-free top-down illumination photometric stereo imaging using light-emitting diodes and a mobile device.” Optics Express, 2021; 29 (2): 1502 DOI: 10.1364/OE.408658

Photo credit: Emma Le Francois, University of Strathclyde

Related Articles


Latest Articles

  • ABB Wins New Product Award at MCEE Show

    ABB Wins New Product Award at MCEE Show

    April 28, 2025 ReliaHome™ Smart Panel won Best New Product Award in the Software, Controls and Related Components category. Iberville® Gangable boxes with low-voltage cables support bracket was recognized as a finalist in the Commercial, Institutional and Industrial Electrical Products category. ABB was honored with a Best New Product Award in the Software, Controls and… Read More…

  • Weidmuller Celebrating a Legacy: 175 Years Globally, 50 Years in Canada

    Weidmuller Celebrating a Legacy: 175 Years Globally, 50 Years in Canada

    April 28, 2025 The year 2025 is truly special for Weidmüller. The company proudly celebrates not just 50 remarkable years in Canada but also its 175th anniversary globally—an extraordinary achievement few companies can claim. This legacy is a testament to the company’s relentless pursuit of innovation and commitment to refining its offerings. But the journey… Read More…

  • Canada Stands Tall at Hannover Messe 2025

    Canada Stands Tall at Hannover Messe 2025

    April 28, 2025 By Owen Hurst At Hannover Messe earlier this month Canada had a strong presence as the host country with a wide variety of companies and programs focusing on the development of advance technology. The presence was accentuated by numerous halls hosting Canada pavilions. Partner Country Canada presented itself impressively at HANNOVER MESSE…. Read More…

  • BC Prompt Payment Legislation Progressing

    BC Prompt Payment Legislation Progressing

    April 28, 2025 Consistent with its mandate of growing the economy, the government wants to ensure that businesses are paid promptly for work performed on (or material provided to) construction projects. British Columbia’s Ministry of Attorney General staff have been tracking the issue of payment delay in the construction industry, including legislative responses in other… Read More…


Changing Scene

  • Schneider Electric Advances in Product Environmental Data Transparency

    Schneider Electric Advances in Product Environmental Data Transparency

    April 28, 2025 Schneider Electric has launched its Environmental Data Program. This initiative, which builds on the legacy Green Premium label, provides customers with unique access to information on the environmental impact of its products, enabling them to make better informed, data-based decisions and meet evolving regulatory requirements with confidence. Schneider Electric has frequently been recognized… Read More…

  • nVent Sustainability Report Highlights Progress and Focus on Electrification

    nVent Sustainability Report Highlights Progress and Focus on Electrification

    April 15, 2025 nVent Electric plc announced the release of its 2024 Sustainability Report. The new report highlights nVent’s achievements in each of its sustainability focus areas: People, Products, Planet and Governance. The report also highlights how nVent solutions support electrification, digitalization and sustainability efforts around the world. “nVent is becoming a more focused electrical… Read More…

  • Ontario Introduces Legistlation to Unlock Trade and Labour Mobility Within Canada

    Ontario Introduces Legistlation to Unlock Trade and Labour Mobility Within Canada

    April 18, 2025 As a next step in its plan to protect Ontario by unleashing the province’s economy, the Ontario government is introducing the Protect Ontario through Free Trade within Canada Act to unlock free trade and labour mobility within Canada. This legislation will, if passed, create new opportunities for job creation and investment attraction, supporting economic… Read More…

  • Ontario, P.E.I. Join Nova Scotia With Legislation to Remove Internal Trade Barriers

    Ontario, P.E.I. Join Nova Scotia With Legislation to Remove Internal Trade Barriers

    April 18, 2025 Prince Edward Island and Ontario have joined the Nova Scotia by introducing reciprocal legislation that will help foster an environment of mutual recognition of goods, services and labour mobility between these provinces. “Leaders across the country are expressing interest in removing trade barriers, and I’m very pleased that P.E.I. and Ontario have… Read More…