JSAE Exposition 2018: HMI and Camera Monitoring Systems

Gesture Control, Curved Display, Electronic Mirror, and Driver Monitoring



Kyocera's latest device equipped in GLM's EV sports car " Tommykaira ZZ "
(JSAE Exposition 2018)

At the JSAE Automotive Engineering Exhibition 2018 (Period: May 23 to 25, 2018, Venue: Pacifico Yokohama exhibition center) there were numerous exhibits of Human Machine Interface (HMI) and Camera Monitoring System (CMS) solutions to support the advances being made in autonomous driving and advanced driver-assistance system (ADAS) technologies.

Center Information Display (CID) solutions exhibited included features such as haptic feedback and gesture control technologies that operated intuitively, and curved touch displays that enhanced interior design freedom. Displays included an interior cockpit module equipped with a driver monitoring system, a CMS with cameras embedded in the rearview and door mirrors, image recognition technology utilizing cameras, the improved detection accuracy of LiDAR, and deep learning technology.

Products and solutions such as those mentioned above are being designed and developed with the aim of improving driving safety. Furthermore, these are being adopted as elements to enhance the interior comfort of vehicles that in the future are expected to be driverless automated vehicles.


Related reports:
JSAE Exposition 2018: CASE Technologies of System Suppliers (Jun. 2018)
WCX18: SAE World Congress Experience - Autonomous Technology (Apr. 2018)
CES 2018: Autonomous and HMI technology applications and examples (Jan. 2018)
Automotive World 2018: Autonomous driving solutions exhibition (Feb. 2018)


Center Information Displays and Input Devices: Murakami, Mitsubishi Electric, and Alps Electric

For center information displays (CIDs), suppliers introduced features such as haptic feedback and gesture control technology that can be operated intuitively without having to look at the display when adjusting functions to control systems such as the audio, air conditioning, and car navigation. Components exhibited realized new functionality by adopting the features of electronic devices and gaming equipment for automotive applications, including the use of curved touch displays that enhance the design freedom of the vehicle's interior.


Murakami: Multi Display

Murakami introduced a next-generation display with increased visibility and improved ease-of-operation by combining three technologies developed in house.
1) Curved cover glass: Made using bending technology to create a concave mirror for head-up display (HUD) applications
2) Special optical device: Used to vehicle control operating guide functions by means of a floating virtual concierge screen that interacts with highly sensitive mid-air, non-contact haptic feedback switch technology.
3) Door mirror mechanism technology: The door mirror surfaces can be rotated using mid-air haptic switch technology.


Mitsubishi Electric: Knob-on-display

Mitsubishi Electric exhibited its knob-on display technology that is used to operate various functions on the center console using both a touch panel and rotary knob. Search results are selected by moving a sliding knob left or right. The technology is incorporated in the design of Mitsubishi Electric's EMIRAI4 concept car as a center display that offers the multi-functionality of touch operation as well as the secure feel of knob manipulation.

Murakami - Multi Display 
Operation Demo Video / Display Panel
S shape glass / Display Panel
Mitsubishi Electric - Knob-on-display 
Operation Demo Video / Display Panel
EMIRAI4 concept car Display Panel


Alps Electric: Input Devices, HAPTIC Reactor, and Touch Panels

Input devices for vehicles

Alps Electric displayed demo units of touch input devices with highly sensitive touch performance, even when users are wearing a glove, and compatiblity with gesture control technology. The input device solutions are realized by combining high sensitivity electrostatic sensors, touch control ASIC*, and unique algorithms. The display used examples of the devices combined with natural materials (leather, wood, fabric) used for vehicle interiors. The product is targeted to provide a safe and comfortable user experience in the interior of an autonomous vehicle.
*ASIC (Application Specific Integrated Circuit)

HAPTIC Reactor

This vibration feedback device enables the recreation of diverse and realistic vibration sensations from a wide range of frequencies. This technology is widely used in gaming devices. Complex waveforms can be realistically reproduced by the overlapping of low and high frequency vibrations. The demo unit on display was used to show how the system transmits a vibrating touch sensation to the driver's hand, warning the driver that the vehicle is deviating from its lane or being approached by another vehicle from the rear.

Input devices for vehicles
Operation Demo Video / Display Panel
HAPTIC Reactor
Operation Demo Video
 / Display Panel
Curved transparent touch panel (Display Panel)
Zero border touch panel (Display Panel)


Curved transparent touch panel

The product is compatible with intuitive operation and curved surface designs. It uses film sensors suited to lamination on curved surfaces. It can provide multi-touch functionality using a single film sensor.

Zero border touch panel

The product is suitable for touch panels without frames as well as head-up display (HUD) units. Alps fine wire patterning technology makes it possible to provide large display sizes of up to 7 inches.


Cockpit System and Electronic Mirror: Toshiba, Murakami, and Ichikoh Industries

The cockpit is equipped with a driver monitoring system, which in the event of any interference to the safe operation on the vehicle, alerts the driver by providing a visual, auditory, or vibration warning. Also, a camera monitoring system (CMS) embedded in the rearview and door mirrors can be used to eliminate blind spots and provide clear visibility even in poor environmental conditions such as driving at night or in rainy weather.


Driver monitoring integrated with next generation cockpit solution
Operation Demo Video

Toshiba: Driver monitoring integrated with next generation cockpit solution

Toshiba demonstrated its next-generation cockpit solution that combines the group's unique image recognition processor "Visconti" with electronic mirror display technology. In addition to front and peripheral monitoring of the vehicle, the cockpit is also equipped with a driver monitoring system.

The Visconti image recognition processor realizes high-precision image recognition (such as nighttime pedestrian detection) required for advanced driver-assistance systems (ADAS) with high performance and low power consumption. The Toshiba Group is applying its technologies developed for consumer electronics to automotive applications, with the Visconti processor used to run the algorithms for image recognition systems.


Murakami: Hybrid Inner Mirror, and Multi Mirror System

Hybrid Inner Mirror

The hybrid inner mirror is capable of switching between monitor display and mirror display. It is also equipped with an automatic anti-glare function. As a result, the mirror can ensure clear visibility of traffic conditions behind the vehicle under various adverse conditions such as nighttime driving.

Multi Mirror System

The interior rearview mirror of the system displays high-resolution field of view information of the rear and sides of the vehicle. Each side mirror is equipped with a camera to compensate for the blind spots of the mirror.

Hybrid inner Mirror
Operation Demo Video / Display Panel
Multi mirror system
Display Panel


Ichikoh Industries: Camera Monitor System (CMS)

Ichikoh Industries exhibited a next-generation rear-facing vision system that replaces conventional rearview and door mirrors with cameras and displays. The CMS specifications feature a liquid crystal shutter that switches between monitor mode and mirror mode, as well as an anti-glare function. By replacing the door mirrors with downsized cameras, the vehicle's aerodynamic performance and design performance can be improved. The CMS can provide driver assistance by image analysis that detects the vehicle's surrounding situation to alert the driver if necessary when a vehicle close by is going to change lanes. The CMS automatically changes the angle of view of the images displayed according to the driving conditions.

The prototype of the camera monitor system (CMS) exhibited at this event used a camera only with no mirror design for the right side of the vehicle, but on the left side of the vehicle used the hybrid mirror design that combines a conventional door mirror with camera for those countries that mandate vehicles be equipped with conventional door mirrors. Cameras are equipped with the Sensor Cleaning System displayed by Valeo.

Camera Monitor System
Left mirror / Right camera
Presentation Movie / Display Panel
3D Surround Multi View
Enlarged image of ECU / Display Panel


3D Surround Multi View

Images are captured by four high-resolution cameras (approximately 1 million pixels), synthesized in real time as a three-dimensional model, and displayed as a high-quality 360 degree seamless image on the monitor. It also supports driving safety by automatically changing the view when turning right or left and when parking because the system interfaces with the turn signal and reverse gear. Also, good visibility is secured using a 190-degree wide angle camera that switches to the front view of the vehicle at intersections with poor visibility.


Camera Monitoring System: Valeo, Kyocera, Nippon Chemi-Con, and Mitsuba

Camera monitoring system (CMS) solutions exhibited reflect the advances being made in the development of image recognition technology as a result of the improved detection accuracy of cameras and LiDAR and the application of deep learning technology.


Valeo: Laser scanner SCALA 2

Valeo unveiled the new SCALA 2, the new generation of its SCALA laser scanner. The first generation SCALA debuted in 2017 equipped on an Audi A8 in 2017 and it was a 2018 PACE award winner. The SCALA 2 is equipped with Valeo's proprietary detection and recognition algorithms to detect stationary and moving objects, open spaces, and perform accurate self-positioning estimates, even in bad weather conditions. The SCALA 2 features a vertical field of view that is 3 times wider, up to 10 degrees from the 3.2 degrees in the first generation SCALA, making it possible to determine road inclines and detect lane markings. The demo unit at the front of Valeo's booth highlighted the product's ability to accurately perceive the clothes of its visitors.

Laser scanner SCALA 2
Enlarged image of SCALA 2 / Display Panel
Operation Demo Video
AI 3D Object Perception
Operation Demo Video / Display Panel
Technologies for Autonomous Car
3D Gesture Steering Wheel Switches / Display Panel
Sensors Cleaning Systems / Display Panel


AI 3D Object Perception

Valeo's AI 3D Object Perception is a full set of deep learning solutions for the various image recognition tasks required for autonomous driving. The system realizes high resolution object detection and accurate pose estimation by 360 degree detection using high dynamic range (HDR) megapixel fisheye cameras with a viewing angle of 190 degrees. Valeo's booth included a display demonstrating the system's ability to perceive details of the vehicle's environment such as the position and size of objects and driving direction.


3D Gesture Steering Wheel Switches

The 3D gesture user interface is Valeo's proposal to enhance safety and revolutionize the design around the steering wheel. The technology uses a 3D ToF (time-of-flight) camera to detect the driver's finger and hand movements when operating the virtual switches on the steering wheel, interpreting these movements as gesturing instructions. The technology allows a driver to more safely operate the vehicle controls without having to look for switches around the steering wheel.


Sensors Cleaning Systems

These are electronically-controlled systems to clean the cameras, LiDAR, and the various sensors used in automated driving and ADAS technologies. The Valeo systems are designed to clean automatically under all circumstances and use less cleaning fluid.


Kyocera: eMirror Camera, and Fused Sensor of Camera and LiDAR

At the center of its booth, Kyocera displayed the " Tommykaira ZZ " sports car of GLM (an EV venture manufacturer launched by members of Kyoto University) as a concept car equipped with the Kyocera Group's advanced devices and systems. The concept car was equipped with 12 Kyocera proprietary technologies such as side and rearview e-mirrors embedded with cameras, a 12.3-inch instrument cluster with built-in camera, and a 10.25-inch center display (with its HAPTIVITY tactile feedback technology).

In addition, the Kyocera Group's booth contained a demo unit and displays demonstrating products and technologies for automated driving and advanced driver-assistance system (ADAS) applications such as its LiDAR sensor module and a rear view mirror equipped with an AI-based object recognition feature.

Kyocera's devices equipped in "Tommykaira ZZ"
Side eMirror Camera / Cutaway model
The concept car equipped devices / Kyocera automotive devices
Fused Sensor of Camera and LiDAR
Presentation Movie / Display Panel
View camera with recognition function


Nippon Chemi-Con: CMOS Camera Modules

The CMOS camera module is one of the main products in a growth business field of Nippon Chemi-Con. The modules can be customized to meet various applications, examples of which were displayed such as an in-vehicle camera module and drive recorder.

Nippon Chemi-Con CMOS Camera Modules
Exhibit products materials
Non-contact gesture control system with pinch protection

Enlarged image of camera system
Operation Demo Video / Display Panel


Mitsuba: Non-contact gesture control system with pinch protection

Mitsuba unveiled the prototype of a gesture-controlled system used to open and close the power windows of a vehicle. The system utilizes a camera to detect the position and shape of hand gestures to open and close windows in a contactless manner. The system also includes a feature to detect when an object may enter a vehicle while in motion as well as a feature to prevent finger pinching.


Murakami, Mitsubishi Electric, Alps Electric, Toshiba, Ichikoh Industries, Valeo, Kyocera, Nippon Chemi-Con, Mitsuba, HMI, CMS, camera monitoring system, electronic mirror, camera, LiDAR, display, touch panel, driver monitoring, gesture control, haptics, image recognition, deep learning, AI

<Automotive Industry Portal MarkLines>