Enables Understandable and Improved Visibility for Surround View Systems with Unique Viewpoint Conversion and Brightness Compensation
Renesas Electronics, a premier provider of advanced semiconductor solutions, and its subsidiary, Renesas Mobile Corporation, an innovative supplier of advanced cellular semiconductor solutions and platforms, today announced the availability of their new image recognition system-on-chip (SoC), the SH7766. This solution integrates on a single chip all the functions required for the implementation of camera-based surround view systems together with the display of crucial information such as lanes, signs and markings, pedestrians, vehicles, etc.
The new SH7766 SoC retains compatibility with Renesas’ existing SH77650 image recognition SoC while delivering improved performance. In particular, the display functions such as viewpoint conversion and dynamic range control (brightness compensation, etc.) have been enhanced. These new functions make it possible to develop applications with clear top-view virtual camera visualization. These can use different viewpoints to display the changing surroundings in real time and provide monitoring functionalities such as advanced driver assistance systems (ADAS).
ADAS applications, such as lane deviation warning systems (see Note 2), are becoming more widespread. Related trends include display applications that enable drivers to monitor their vehicle’s surroundings while parking. These applications include rear-view monitor and top view systems which are gaining in popularity. Advances have been made in seamless safety support systems that provide uninterrupted coverage of the area in front of the vehicle as well as its surroundings. For this reason, there is growing demand for improved image recognition technology, to underpin sensing and extended functions that provide a clear and easily understandable display to the driver.
At the same time, image recognition systems are diversifying beyond lane recognition to include simultaneous recognition of multiple objects such as signs and markings, pedestrians, and vehicles. This has led to a demand for increased performance in image recognition engines, which must perform multiple processing tasks in parallel. An efficient architecture using a combination of CPU and specialized IP is necessary to handle the different recognition algorithms in order to distinguish objects of different shapes and sizes as well as people.
In response to these demands, Renesas' next-generation SH7766 image recognition SoC improves on the performance of its predecessor, the SH77650, and delivers enhanced view functions and higher image recognition engine performance.
Key features of the SH7766 SoC:
- Viewpoint conversion engine and dynamic range control for improved view functions
The SH7766 SoC integrates a hardware engine that enables new view functions such as a viewpoint conversion engine and dynamic range control. For each video input, the image renderer (IMR) viewpoint conversion engine generates in real time top view images in which the viewpoint changes with the surroundings. The dynamic range control (DRC) function adjusts the composite video brightness to compensate for indistinctness in both very bright and very dark portions, even when handling multiple video feeds with large brightness differences due to sunlight and shade. As a result, the driver with a display that is easy to see in all lighting conditions.
The SH7766 SoC also implements 2-D graphics capabilities (optionally a 3-D graphics engine, see Note 3), making it possible to develop an exceptionally high-level user interface by overlaying sophisticated graphical elements onto the video from the cameras.
- IMP-X2 next-generation image recognition engine
The SH7766 SoC features the IMP-X2 next-generation image recognition engine. The IMP-X2 retains library compatibility with Renesas’ existing image processing engine (IMP) while boosting processing performance more than fourfold. This enables it to perform multiple processing tasks in parallel, such as tracking lanes, signs and markings, pedestrians, and vehicles. It adds new functions such as integral image generation, which makes extensive use of image recognition algorithms for distinguishing pedestrians, vehicles, etc. It shares determination processing with the CPU on the same chip, making possible a high level of image recognition performance while keeping power consumption low.
- Six video input channels, including four channels with integrated NTSC ADCs, for reduced system coste
The SH7766 SoC has six video input channels. Of these, four channels incorporate NTSC analogue -to-digital converters (ADCs). This means that the capabilities necessary for an NTSC camera system are provided on a single chip. It is also possible to make use of the six video input channels to implement multiple applications using the capabilities provided on a single chip. For example, two digital channels could be used during normal driving, switching as necessary to four NTSC channels at intersections, when parking, etc.
The new SH7766 SoC shares its architecture, IP, and software with the Renesas R-Car series of SoCs for vehicle information terminals. It can be extended to applications such as navigation systems and vehicle information terminals equipped with image recognition and viewpoint conversion functions.
(Note 1) Next-generation top view monitoring:
This is a type of application that displays the vehicle surroundings to the driver in an easy-to-follow format, employing image recognition technology to prevent important information from being overlooked
(Note 2) Lane deviation warning system:
This is a typical ADAS system that monitors the lanes as the vehicle proceeds and warns the driver of upcoming deviations.
(Note 3) 3-D graphics engine: Imagination Technologies’ advanced 3D graphics IP core, the POWERVR SGX530, can be implemented in the 3D graphics engine as an option.
Availability
Samples of the SH7766 SoC will be available in November 2011. Mass production is scheduled to begin in September 2013 and is expected to reach a production volume of 100,000 units per month by September 2014. (Availability is subject to change without notice.).
