Since the first photograph was taken nearly 200 years ago, it has been a centuries-long challenge to conquer low-light conditions and capture the perfect image at any time of day.
And it’s not just amateur smartphone photographers who grapple with this challenge. Today, achieving clear, detailed digital images is vital for professionals in the media, the security industry, and the emergency services.
Pictures have been beset with many issues that corrupt and degrade the image for decades. Photos can be grainy as the sensors struggle to pick up enough light.
For the same reason, the difference between colors can be difficult to determine, and the picture itself can have what is known as ‘image noise,’ which makes it hard to determine the depth and various shapes.
The tech that now makes smartphone photos possible would have blown the minds of the original photographic pioneers.
The work of electrical engineer Kush Desai, a highly respected expert in his field, would have left them even more stunned and incredulous.
Desai is at the forefront of developing ways to enhance pictures taken as day turns to night, using the cameras in our pockets and those used by amateurs and professionals.
The award-winner has been the lead architect in building the latest iPhone Pro and Pro Max, specifically the primary camera, Sensor-Shift wide-angle with AF/OIS.
He has also pioneered Apple’s 5x zoom telephoto camera (zooming in an object or point to five times its normal size).
Desai is committed to innovation. He continuously seeks new ways to enhance camera technology, stays updated with industry trends and technological advancements, and integrates new ideas and techniques into design processes. His proactive approach to innovation drives continuous improvement in products.
Among Desai’s many achievements is the development of tools and automation aiding Electrical design verification, which are being deployed and used across the Apple Hardware Engineering community.
He has also led the efforts to make the Camera Hardware Design Life Cycle mature and robust, which includes iPads, Vision Pro, MacBook, and iPhone
Desai has also solved image quality, signal, and power integrity-related issues through Electrical Design/simulations.
His skills have helped him be recognized by CEO magazine, which honored him with an award for outstanding project performance.
Gujarat Technological University and San Jose State University graduate Kush, who has worked for Apple in Cupertino, CA since 2021 when he joined as an intern and is now with the company as its camera electrical engineer, said:
“Traditionally, night vision in cameras has been fraught with issues such as high noise levels, grainy images, and poor color differentiation.
“In technical terms, the challenge for me is to enhance the camera’s sensitivity to light, minimizing the noise and making the picture quality the best it can be.
“We want the cameras on the iPhone to be to the standard of a professional DSLR camera. That’s the ultimate goal.
“The fundamental challenge is still the same as it has always been. The same challenge that bedeviled the earliest photographers. Getting the balance right between the camera’s sensitivity and the quality of the image.”
The key to improving low-light photography has been the development of sensors and enabling those sensors, the tech that creates the image, to turn the data it picks up into the best picture.
The electronics and science behind these sensors have fascinated Kush since he was a schoolboy in India. As his education continued, he threw himself into science, gaining a Master’s in the US, which led him to a prestigious appointment at Apple.
Kush pinpoints a key development in this process: “The development of back-illuminated sensors was the real game changer,” he said.
“These sensors allow more photons to hit the light-catching part of the sensor, which significantly improves the camera’s low-light performance without increasing that enemy of good photography, the so-called noise.”
Another step forward has been using computers to add level of quality to the finished image. Algorithms and data-crunching power reduce noise and enhance sharpness using techniques such as ‘image stacking.’
Kush explains: “Computational photography allows us to use techniques like image stacking, which is literally what it says. It’s a way of stacking multiple images of the same thing on top of each other to build up the best image possible.”
Right now, the cutting edge of photographic improvement inevitably involves Artificial Intelligence, especially when it comes to improving images taken in low light. Kush is also at the forefront of this area.
He said, “We’re now seeing AI being used in cameras to adjust settings to ever-more accurate levels automatically. But not only that, AI can also enhance individual pixels, the tiny dots that make up an image, to reduce the noise.
“It’s a step beyond what has gone before as it can improve individual photographs, depending on available data. Each photograph can be constructed in the most efficient way possible.”
While the tech has increased in ways the earliest photographers would find incomprehensible, they would recognize other far more practical challenges Kush faces.
For example, the larger the sensor, the more information it can absorb but large sensors are themselves an issue, particularly in our ever-more compact smartphones.
Another issue involving size is the size of the aperture, the part of the camera that sits behind the lens and allows light to fall onto the sensor. The wider the aperture, the more light is allowed in, which is crucial in low-light conditions.
Kush explained: “This is why cameras on the back of phones are looking wider than before, not necessarily deeper. We are now building wider sensors to draw in more light and apertures as wide as a smartphone or camera, which will allow.”
The improvement in low-light images has also helped make cameras used in the security industry way more effective, dramatically improving the power of surveillance in recent decades.
But with that progress also comes responsibility. Ethical and privacy issues come to the fore when such cameras involve AI. Another application is in driving. As cars edge ever closer to becoming able to self-driving, nighttime vision is the game changer.
Kush emphasizes: “It’s a cliche but one we must remember. With great power comes great responsibility. This kind of tech has all sorts of implications, and as we build these cameras, we must keep that in mind.
“The ability to capture clear images in the dark must be balanced with respect for privacy.
“Having rules, regulations and guidelines to safeguard this will be crucial in the years ahead. Technology will always improve; that’s what I will make happen. But it must be done in a way society can handle.”
Going forward, new camera materials, such as graphene, a lightweight, thin material of pure carbon made of graphite, may lead to ever-better images. Graphene may also be used to design and build new, more powerful, and compact sensors.
“Graphene sensors are on the cutting edge of the development of making new sensors, while AI is the cutting edge of the tech used in processing the data. They offer the potential for even greater sensitivity and lower levels of noise. Ultimately, it will open the way for cameras to see far more than the human eye can and show it in far more clarity than has ever been achieved in the past 200 years.
“Working at the cutting edge of this technology is a dream come true. The
advances in the years ahead will be exciting and dramatic. Everyone with a smartphone is a photographer, and everyone’s photos will benefit.”
Deep Patel, an electrical engineer at Apple Inc., is one man who has witnessed first-hand the extent of Desai’s expertise.
Having worked with the highly sought-after expert for nearly three years, he cites Desai’s meticulous attention to detail, his ability to propose innovative solutions, and his thorough understanding of the technical complexities involved in camera design.
Patel says: “Kush brings a fresh perspective to our team’s projects through his creative thinking. He consistently explores new ideas and approaches to improve camera technology, leveraging his creativity and technical knowledge.
“Working with Kush encourages a team innovation culture, fostering an environment where novel concepts are welcomed and explored.”
Citing Desai’s attention to detail, Patel says: “His commitment to excellence has resulted in camera systems that meet stringent quality standards and deliver reliable performance.
‘And his thorough reviews of hardware designs, grounding topologies, and image quality-related issues ensure that our products consistently exceed customer expectations for reliability and functionality.”
Patel also reveals Desai’s expertise has led to significant advancements in Pro/Pro Max Wide Camera technology: “His deep understanding of sensor integration and image processing has enabled the development of camera systems that deliver superior image quality, enhanced low-light performance, and innovative features. These technical advancements have differentiated our products in the competitive market and contributed to Apple’s reputation for delivering cutting-edge technology.”
But Desai’s expertise doesn’t just stop there. His guidance, technical mentorship, and hands-on training have also empowered team members at Apple Inc to expand their skills, tackle complex challenges, and contribute meaningfully to our projects: “By nurturing talent within the organization, Kush has contributed to a robust pipeline of skilled engineers who continue to drive innovation and excellence in iPhone camera design,” says Patel.