Image Sensors 2009 - Shri Sundaram
Download as PPT, PDF0 likes486 views
The document discusses trends in the imaging industry, noting that key markets like digital still cameras, notebooks, and mobile phones are flattening, making growth difficult. However, new opportunities exist in niche emerging markets like automotive, medical, and industrial applications. These applications require image processing capabilities closer to the camera, rather than just capturing images. The document outlines some processor solutions from Toshiba that can perform functions like image processing and video analysis directly on the camera module.
Image Sensors 2009 - Shri Sundaram
- 1. Moving Towards the Next Generation of Imaging Applications A Perspective Shri Sundaram, Toshiba America Electronic Components, Inc.
- 2. Markets are Flattening for DSC, NBPC & Mobile Making it Hard to Sustain Growth… Three primary markets are flattening Revenue growth opportunities exist only outside these three markets But, the key players in the market will sustain profits…but… Source: My estimates based on info from iSuppli, Gartner, In-Stat etc.
- 3. Consolidation and Maturing of an industry will reduce the number of players *HBR Dec 2002; M/S. Deans, Kroeger, Zeisel Players that are likely to survive will have clear strategy based on core strengths The product/technology offering by the survivors will likely look similar CMOS Area Sensor Business (~ 10 years)
- 4. How Does a Player Defend the Position in a Mature Market? Toshiba’s strategies to grow its core business in this rapidly maturing industry Sensitivity, SNR, Crosstalk, Smaller Pixels DSC Quality, Wide Dynamic Range Smallest form factor z, x & y Easy Manufacturing High Reliability Pixel Technology Image Pipeline Module Packaging Advanced Fabrication Technologies & Highly Integrated Manufacturing Facilities
- 5. Pixel Technology Advancements in geometry and sensitivity
- 6. Image Pipeline advancements in image processing and interfaces
- 7. Packaging technologies are evolving for both high performance and manufacturability Toshiba estimates
- 8. While the Imaging Industry Moves Toward Consolidation and Slowed Growth, New Niche Opportunities will Provide New Growth Opportunities
- 9. Niche / Emerging Markets How do the opportunities manifest?
- 10. Revenue Upsides are possible from new applications Most of the emerging applications – camera is used for data gathering ! An Image is NOT the end product… Source: My estimates based on info from iSuppli, Gartner, In-Stat etc. Gaming Surveillance and Security Machine Vision Industrial Cameras High Speed Cameras Telepresence, Video Telephony Medical Automotive Others…
- 11. Future Applications May Not Need High-Res Images for Image Identification Source: http://www.youtube.com/watch?v=6VTrb2gl-14 Google Tech Talks by Bob Fischer of Optics1 Inc. “ Motion is the cue that’s extremely important… probably would be able to tell what it is if you saw the car (PT Cruiser) driving across the 8x16…” - Bob Fischer Video is Important, Resolution Not so …
- 12. It Will Come Down to Architecture Definition Source: http://electronicdesign.com/files/29/21483/fig_03.gif Cover Feature on Video Analysis by Richard Quinnell in Electronic Design (7/23/09) Traditional architectures place video analysis in a central location such as on a server or a digital video recorder, but analysis is now moving toward the edge with IP cameras offering built-in processing … Image is no longer the end product. ..
- 13. Another View of the System Partition Image sensor from a leading supplier or from a specialty supplier Traditionally a remote location, these functional blocks are moving closer to camera. Functions include Hough Space Transformation and instant pattern matching… Remote Image is the raw material for further analysis.
- 14. An Example of a Processor Residing Close to the Camera - TX4961 System from Toshiba MOST M-LB TX49 RISC CPU Core Graphic Display Ctrl. & Accelerators ADC Mem Ctr DMA Ctrl DDR- S D RAM Flash FG SEI, UART AC Link I2C CAN 3ch Timer PWM GPIO With CAN interface, GPIO, ADC, Timers, and PWMs , the TX4961 can do the job of an MCU Auxiliary audio output for sound effects and reinforcement In-Vehicle Communications CAN /MOST/Serial Live video input from rearview / sideview cameras or DVD/Navi system Full-size TFT Software-Reconfigurable Instrument Cluster NAND Ctr
- 15. Transformation Engine – One of the Functions Performed by a Processor Close to Camera A mapping LookUp Table (LUT) is loaded with coefficients that describe the transformation For each destination pixel, the LUT determines where the source pixel will come from (sub-pixel is supported) Simple and effective way to implement programmable non-linear coordinate transformations
- 16. Rotation Engine – Another function!
- 17. Scaling and Transformations in Action! Once a frame is captured, it becomes graphics data that can be processed further by the graphics engines for real-time processing of video input CROP SCALE TRANSFORM
- 18. Here’s Another Toshiba Processor (ARM® Core) That Can Reside Next to a Camera – TMPA900CM TX09 Series - ARM926EJ-S TM Core - Embedded USB Device and USB Host function ARM is a registered trademark and ARM926EJ-S is a trademark of ARM Limited in the EU and other countries. SSP/UART (2/3ch) I/O Port (91pins) I2C/I2S (1/1ch) 10bitA/D (8ch) NANDF (2ch) / CLCDC 16bit WATCH DOG TIMER RTC 16bit Timer (6ch) USB (Device) Memory Controller SRAM SDR SDRAM DDR SDRAM USB (Host) CLCDC 24bit / CMOS IF LCDDA Scale Rotation Blend OFD ARM926EJ-S TM CORE Boot ROM RAM CG DMAC Touch Screen SD Host Controller (1ch)
- 19. Summary Imaging industry revenue growth is likely to slow – driven by the semiconductor industry fundamentals Volumes up; costs down; prices down Immutable Laws of Consolidation will guide the industry towards 3 to 4 leading image sensor suppliers with many smaller niche suppliers! Incremental technology trends – predictable Niche emerging markets will be dominated by applications such as medical, automotive, industrial/machine vision, surveillance, robotics… Image Processing a key function – architectural shift from remote location to co-location with camera There are emerging processor architectures to address these requirements! Go beyond image sensors – look for specialized processors that can process images and video feeds (perhaps real-time) @ a cost point you desire