The four most influential image sensor technologies into 2013

5 Feb

As Panasonic once again proved with its introduction of the micro colour splitter that it is the less established companies that are more innovative in the photography world, I thought I’d take a look at what I believe may be the four most influential sensor technologies for the first half of this decade. I’m going to focus here on technologies that have actually made an impact in the consumer space, or are being promised to do so shortly – in no particular order (you are assumed to have heard of moire and the Bayer filter):

  • Foveon X3 or “stacked RGB”: This is the first of two proposed solutions for the avoidance of moire in digital photographs. The idea is to sense red, green and blue at the same site, rather than at sites next to each other. Similarly to sea water, differential colour absorption in silicon means that blue penetrates the least and red the most deeply (in sea water, colours are the other way around). Therefore blue can only be “harvested” close to the surface of a piece of silicon, whereas any deep absorption is sure to stem from red. If the photosite is vertically divided into three zones whose excitement can be read independently, the relative amounts of each colour coming in can be determined by subtraction among the three measured values. As moire results from the lateral displacement of photosites relative to each other (as in the Bayer array used on other sensors), moire is prevented in Foveon sensors. However, they can still suffer from aliasing. Foveon-type sensors are currently the sole domain of Foveon, Inc., and used in Sigma cameras. However, Sony has submitted patent applications for Foveon-like technologies and may eventually develop a similar sensor.
  • X-Trans: This is a simple modification of the Bayer array, such that the placement of red, green and blue photosites within any square containing four photosites, is different from the arrangement in any adjacent such square. Instead of a 2×2 repeating unit, the X-Trans sensor has a 6×6 repeating unit (or a 3×6, repeating with a lateral displacement of 3, or a 3×3 unit with rotation through 90 degrees in either direction, depending on your point of view), thus decreasing the regularity in arrangement that causes moire. Fujifilm started using the X-Trans technology in its “boutique” or enthusiast camera models, starting with the X-Pro1. Because this requires new demosaicing strategies, Fujifilm’s own in-camera JPEG engine has so far produced better output than desktop RAW processing software. Remember also that Fujifilm had previously established itself as an innovator in sensor technology when creating the EXR sensor and associated innovations, which also featured a modified array of red, green and blue sites. In this sensor, photosites are diagonally arranged in subdivided groups of one colour, so that they can either be combined to give greater sensitivity at stable noise ratios, exposed at different sensitivites to give a within-exposure HDR image, or give a standard exposure using the full resolution the sensor is capable of. Even then, RAW support for the altered array was challenging for third party software, and created a lag in support for the cameras. This seems to now be resolved, but note also that with in-camera HDR generation, the need for external RAW processing is somewhat reduced. It may be part of Fuji’s story that due to the diagonal arrangement of square photosites, the EXR sensor would tend to show less moire on horizontal and vertically repeating patterns, which may occur more commonly in typical subjects and compositions than do diagonal ones.
  • Light field cameras: The Lytro has been the first consumer-oriented camera using a light field sensor that can simultaneously record pixels at different focal depths. This means that different depths of the image can be independently explored in a 2D viewer. However, the camera has low 2D resolution, and is strongly tied to Lytro’s desktop and web offerings. German light field specialist Raytrix is growing its portfolio of cameras, with models ranging from 1 to 7 megapixels. Internally, Lytro has a standard flat CMOS sensor situated behind micro lenses that split incoming beams depending on the direction of incoming light. The different planes of focus are then “triangulated” using software.
  • Colour splitting: While Panasonic’s patent application is not the first use of beam splitting with a prism to harvest the full amount of light, it does reduce such splitting to a micro-level that some are anticipating will lead to revolutions in compact and low-light photography. This is in contrast to earlier ideas from Foveon, wherein three different sensors were used, each dedicated to one colour, and positioned relative to one central beam splitting prism.

Given the fact that especially the smaller camera manufacturers such as Panasonic, Pentax Ricoh, Fujifilm, Olympus and Sony*, are struggling to be profitable, it would be interesting to see new consortia for technology-sharing spring up – perhaps between Fujifilm and Panasonic.

* Sony may be a big corporation and supplying nearly everyone else with sensors, but they don’t ship a lot of cameras compared to the “big two”.


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: