Home › General › NEW FEATURES [2015/08 Update] › NEW FEATURES › from 2015.08
NM2660E _V1 General _054961 NEW FEATURES [2015/08 Update] _0267699 NEW FEATURES UN GENERAL/CONTROL/DETAILS F

NEW FEATURES [2015/08 Update]  NEW FEATURES  GENERAL/CONTROL/DETAILS  ROAD SIGN ASSIST SYSTEM  


DESCRIPTION


a.

General

i.

The Road Sign Assist (RSA) system has been adopted. The system recognizes traffic signs using the forward recognition camera and provides information to the driver via the multi-information display.


ii.

The RSA system can recognize various traffic signs* of different countries. By informing the driver of the speed limit as it changes while driving within or across borders, it makes it easier for the driver to be aware of different speed limits, assisting safe driving.

*: Signs that comply with the Vienna Convention on Road Signs and Signals (including electronic signs and blinking signs)

Y199987C01
3.458,2.042 3.948,1.438 true 5.792,1.833 5.698,1.208 true 1.396,0.448 1.646,0.823 true 5.635,1.021 5.948,1.219 0.313,0.198 10 false *a 3.938,1.25 4.25,1.448 0.313,0.198 10 false *1 1.323,0.271 1.635,0.469 0.313,0.198 10 false *b 1.667,1.5 1.979,1.698 0.313,0.198 10 false *2 0.354,2.49 0.667,2.688 0.313,0.198 10 false *c
*1 Forward Recognition Camera (Camera Sensor) *2 Multi-information Display
*a Traffic Sign *b Traffic Sign Display
*c The illustration shown is an example only. - -




b.

Precaution of Road Sign Assist System

i.

General Headline Precautions

·

RSA is a system which supports the driver by providing information from traffic signs to the driver. The RSA system does not serve as a replacement for a driver's vision or awareness. It is necessary for the driver to always pay attention to the traffic conditions and applicable rules while driving.

·

The RSA system may not detect or correctly recognize speed limit signs if they are dirty, bent or blocked by an object. It is necessary for the driver to confirm all speed limit signs while driving.

·

When the unit of speed being used or the direction of traffic changes, it may take some time for the system to learn of the changes. Until the learning is complete, the system may not detect the correct unit of speed or the direction of traffic and may subsequently display incorrect information. It is necessary for the driver to always pay attention to the traffic conditions and applicable rules while driving.

·

The system may not detect traffic signs under the following conditions:

Y199988E01
4.802,1.906 5.26,2.104 0.458,0.198 10 false (2) 1.646,2.073 2.104,2.271 0.458,0.198 10 false (1) 1.823,3.719 2.281,3.917 0.458,0.198 10 false (3) 4.896,3.677 5.354,3.875 0.458,0.198 10 false (4) 1.854,5.542 2.313,5.74 0.458,0.198 10 false (5) 5.135,5.531 5.594,5.729 0.458,0.198 10 false (6) 3.083,7.594 3.542,7.792 0.458,0.198 10 false (7)

Number Condition
(1) The orientation of the forward recognition camera is deviate.
(2) The vehicle passes the sign too quickly after the sign comes into view.
(3) Dirt, snow, ice or a sticker is on the windshield glass in front of the forward recognition camera.
(4) Driving in bad weather (heavy rain or snow, or dense fog).
(5) The headlights of an oncoming vehicle or sunlight are shining directly on the forward recognition camera.
(6) The sign is dirty, faded or tilted, or the contrast of an electronic sign is poor.
(7) Whole or part of the sign is blocked by an object such as a pole, tree or a tall truck passing the sign.

·

The system may incorrectly recognize traffic signs under the following conditions:

Y199989E01
1.823,2.75 2.281,2.948 0.458,0.198 10 false (1) 1.844,5.583 2.302,5.781 0.458,0.198 10 false (3) 5.177,5.583 5.635,5.781 0.458,0.198 10 false (4) 4.958,2.729 5.417,2.927 0.458,0.198 10 false (2)

Number Condition

*: When the unit of speed or the direction of traffic changes, the system may not display the correct speed or overtaking lane.

(1) A sticker or graphic is on the rear of a preceding vehicle.
(2) A sign is on an adjacent lane or side road, or immediately after traffic lanes merge or diverge.
(3) An object which is not a traffic sign is similar in appearance.
(4)
·

The system has not completed learning after entering a different country*.

·

As the navigation system provides information on the navigation display based on map information, the speed information displayed on the multi-information display and navigation display may differ.





ii.

Precautions for Forward Recognition Camera

·

Keep the windshield glass clean. If dirt, snow or ice is on the windshield glass, the forward recognition camera may not operate correctly.

·

Do not apply a sticker, etc. to the area of the windshield glass around the forward recognition camera.

·

Do not splash liquid on the forward recognition camera.

·

Do not flash a strong light source, such as an LED flashlight, on the forward recognition camera.

·

Do not apply film to the windshield glass.

·

Do not install an antenna in front of the forward recognition camera.

·

If the windshield glass fogs up, turn on the defogger to clear condensation. The windshield glass easily fogs up when the heater is set to foot mode and this may affect the performance of the forward recognition camera.

·

Do not damage the monocular camera lens or allow it become dirty. When cleaning the inner surface of the windshield glass, do not allow cleaning agent to contact the camera lens. Do not touch the camera lens.

·

The orientation of the forward recognition camera is precisely adjusted. Do not remove, or change the position or orientation of the forward recognition camera.

·

Do not subject the forward recognition camera to a strong impact, and do not disassemble it.

·

Only replace the windshield glass with a genuine part.

·

Do not place reflective items on the dashboard.





SYSTEM DIAGRAM


Y199990E01
0.823,0.635 2.25,1.094 1.427,0.458 10 false Millimeter Wave Radar Sensor Assembly 4.854,3.844 6.531,4.281 1.677,0.438 10 false Air Conditioning Amplifier Assembly 4.76,4.927 6.594,5.365 1.833,0.438 10 false Ambient Temperature Sensor (Thermistor Assembly) 4.854,6.708 6.531,7.146 1.677,0.438 10 false Main Body ECU (Multiplex Network Body ECU) 0.51,1.573 2.354,2.031 1.844,0.458 10 false Forward Recognition Camera (Camera Sensor) 0.49,2.323 2.427,2.531 1.938,0.208 10 false - Monocular Camera 0.479,2.896 2.417,3.104 1.938,0.208 10 false Combination Meter Assembly 0.49,3.26 2.427,3.469 1.938,0.208 10 false - Multi-information Display 0.49,3.635 2.427,3.844 1.938,0.208 10 false - Multi Buzzer 0.531,4.365 2.469,4.573 1.938,0.208 10 false Steering Pad Switch Assembly 0.531,4.719 2.469,4.927 1.938,0.208 10 false - Meter Control Switches 4.719,0.698 6.656,0.906 1.938,0.208 10 false Driving Support ECU Assembly 4.688,2.385 6.625,2.594 1.938,0.208 10 false Central Gateway ECU 4.667,5.781 6.604,5.99 1.938,0.208 10 false Airbag Sensor Assembly 4.688,6.135 6.625,6.344 1.938,0.208 10 false - Yaw Rate Sensor 5.458,7.698 5.927,7.927 0.469,0.229 10 false ECM 3.208,8.021 4.156,8.208 0.948,0.188 10 false CAN (Bus 2) 3.281,2.375 4.229,2.563 0.948,0.188 10 false CAN (Bus 5) 2.958,0.552 4.25,0.74 1.292,0.188 10 false CAN (Local Bus) 0.917,5.323 2.208,5.51 1.292,0.188 10 false Skid Control ECU 0.969,6.344 2.083,6.563 1.115,0.219 10 false Speed Sensors 0.979,7.438 2.115,7.646 1.135,0.208 10 false Steering Sensor


LAYOUT OF MAIN COMPONENTS


Y199991C01
4.219,2.219 4.656,0.344 true 2.083,0.552 2.813,1.542 true 1.01,1.333 1.844,2.219 true 0.979,2.781 0.26,2.167 true 0.375,3.656 1.094,2.885 true 0.854,4.188 1.208,3.042 true 2.938,4.313 2.427,3.688 true 4.156,3.813 2.594,2.729 true 5.427,2.896 6.031,3.49 true 3.969,5.688 3.792,4.813 true 4.625,5.823 5.573,5.406 true 4.896,8.313 3.625,7.052 true 3.479,8.188 2.969,6.542 true 2.229,8.042 2.885,6.792 true 1,7.156 1.677,6.854 true 1.375,5.75 2.396,6.24 true 3.635,6.042 2.646,5.125 true 1.948,0.344 2.156,0.573 0.208,0.229 11 false *1 0.844,1.135 1.052,1.365 0.208,0.229 11 false *2 0.094,1.969 0.302,2.198 0.208,0.229 11 false *3 0.229,3.688 0.438,3.917 0.208,0.229 11 false *4 0.75,4.229 0.958,4.458 0.208,0.229 11 false *5 4.188,3.813 4.396,4.042 0.208,0.229 11 false *7 6.021,3.51 6.229,3.74 0.208,0.229 11 false *8 4.625,0.167 4.833,0.396 0.208,0.229 11 false *9 2.49,4.917 2.802,5.146 0.313,0.229 11 false *11 3.677,4.604 4.042,4.833 0.365,0.229 11 false *10 2.948,4.333 3.156,4.563 0.208,0.229 11 false *6 1.115,5.615 1.406,5.844 0.292,0.229 11 false *12 0.719,7.115 1,7.354 0.281,0.24 11 false *13 2.021,8.073 2.302,8.302 0.281,0.229 11 false *14 3.385,8.219 3.667,8.448 0.281,0.229 11 false *15 4.875,8.344 5.156,8.573 0.281,0.229 11 false *16 5.615,5.292 5.896,5.521 0.281,0.229 11 false *17
*1 Forward Recognition Camera (Camera Sensor) *2 ECM
*3 Millimeter Wave Radar Sensor Assembly *4 Ambient Temperature Sensor (Thermistor Assembly)
*5 Front Speed Sensor RH *6 Front Speed Sensor LH
*7 Skid Control ECU *8 Rear Speed Sensor LH
*9 Rear Speed Sensor RH *10 Driving Support ECU Assembly
*11 Air Conditioning Amplifier Assembly *12 Combination Meter Assembly
*13 Main Body ECU (Multiplex Network Body ECU) *14 Steering Pad Switch Assembly
*15 Steering Sensor *16 Airbag Sensor Assembly
*17 Central Gateway ECU - -



FUNCTION OF MAIN COMPONENTS


Component Function

*: The threshold can be adjusted to 1 of 3 levels through the customization function

Forward Recognition Camera (Camera Sensor) Monocular Camera Captures road signs.
Forward Recognition Camera ECU Performs RSA system control based on information of road signs captured by the monocular camera.
Millimeter Wave Radar Sensor Radiates millimeter radar waves forward, uses the reflected waves to detect the presence of an object, and then transmits this information to the driving support ECU assembly.
Driving Support ECU Assembly Sends an object signal from the millimeter wave radar sensor assembly to the forward recognition camera.
ECM Transmits the reverse signal to the forward recognition camera.
Skid Control ECU Sends a vehicle speed signal from the speed sensor to the forward recognition camera.
Steering Pad Switch Assembly Meter Control Switches Sends a multi-information operating signal to the forward recognition camera.
Combination Meter Assembly Buzzer Sounds for speed limit exceeded and no overtaking notifications.*
Multi-information Display
·

Displays road signs recognized by the forward recognition camera.

·

The RSA system can be turned on and off through the settings tab.


Main Body ECU (Multiplex Network Body ECU) Outputs turn signal commands, which are sent from the headlight dimmer switch assembly, to the forward recognition camera.
Air Conditioning Amplifier Assembly Sends an ambient temperature signal to the forward recognition camera.
ECM Sends a shift position signal to the forward recognition camera.
Steering Sensor Detects the steering angle position and sends it to the forward recognition camera.
Airbag Sensor Assembly Detects the yaw rate and sends it to the forward recognition camera.
Ambient Temperature Sensor (Thermistor Assembly) Detects ambient temperature and sends it to the air conditioning amplifier assembly.
Central Gateway ECU Relays the data between the each CAN buses.
Speed Sensors Detect the wheel speed of each of the 4 wheels and sends it to the skid control ECU.


CONSTRUCTION AND OPERATION


a.

Function

·

The RSA system recognizes the following traffic signals using the forward recognition camera.

Category Sign Type Example of recognizable traffic sign
Speed Limit Round maximum speed limit/End of speed limit
Y180848

No Overtaking No overtaking/End of no overtaking
Y180849

Supplemental Signs Road condition signs Ramp Way
Y180850

Rain
Y180851

Ice
Y180852

Wet
Y189642

End of Prohibition
Y180854


·

The RSA system recognizes the following traffic signals using the forward recognition camera.

Category Display Example Details
Speed Limit Related
Y180855

·

Informs the driver of the maximum speed limit of the currently driven road.

·

The displayed sign reflects the speed limit on the recognized sign.


No Overtaking Related
Y180856

Informs the driver when they are in a no overtaking zone on the currently driven road.
All Canceled (All restrictions canceled. Return to default road regulations.)
Y180854

Informs the driver when all applicable prohibitions, such as speed limit and no overtaking, have ended.
Speed Limit with Supplemental Sign Related Ramp Way
Y180858

Informs the driver of the ramp way direction. However, this item is not displayed when making a lane change without operating the turn signal light.
Rain
Y194214

Informs the driver of the maximum speed limit on the currently driven road when it is raining or the road surface is wet.
Ice
Y188514

Informs the driver of the maximum speed limit on the currently driven road when there is accumulated snow or ice.
Blank
Y188515

The display is blank when the system is unable to recognize a supplemental sign.

·

Notification functions are used in the RSA system which inverts the colors of displayed signs, flash signs, etc. to notify the driver.


i.

Speed Limit Exceeded Notification

·

While a speed limit sign is displayed, if the actual vehicle speed exceeds the speed limit plus a designated threshold*, the colors of the displayed sign are inverted. For example, if the threshold is set to 5 km/h and the speed limit sign is 60 km/h, the colors of the displayed sign are inverted when the actual vehicle speed exceeds 65 km/h. Furthermore, the system also inverts a speed limit sign with supplemental sign in the same way. However, the system does not invert the colors of the supplemental sign.

·

The buzzer may be set to sound during notifications through the customization function. However, if a speed limit recognized from a speed limit with supplemental sign is exceeded, the buzzer does not sound.

·

This notification is judged according to the speed units estimated by the forward recognition camera. When moving to a region with different speed units, notifications may be incorrectly issued until learning is complete. (The user can change speed units of the meter for the given region, therefore displays and notifications can be correctly issued directly after moving to a region with different speed units.)

*: The threshold can be adjusted to 1 of 3 levels through the customization function.


Notification Method Display Example
Inverted Display
Y180861



ii.

No Overtaking Notification

·

While a no overtaking sign is displayed, if the system detects that the vehicle is attempting to overtake another vehicle, the system flashes the displayed sign.

·

The buzzer may be set to sound during notifications through the customization function.

Notification Method Display Example
Inverted Display
Y180862





b.

System Control

·

The RSA can be turned on or off through the settings tab of the multi-information display.

·

A customization function is used for the RSA, which allows settings such as the notification method and level for exceeding the speed limit to be changed. Setting changes are made through the customization tab of the multi-information display. Refer to the Repair Manual for details.


i.

RSA Control Pattern 1

·

After a road sign is recognized by the forward recognition camera and the vehicle passes by, the sign is displayed on the multi-information display.

·

While a sign is displayed on the multi-information display, if a new road sign is not recognized within a specified distance, display of the current sign is turned off.

Y199992E01
2.24,0.948 2.625,1.281 true 1.094,0.76 2.625,0.979 1.531,0.219 10 false Road Sign Recognized 3.958,0.542 5.688,0.76 1.729,0.219 10 false Specified Distance Driven 1.073,2.521 2.604,2.74 1.531,0.219 10 false : Sign display off 1.073,3.083 2.604,3.302 1.531,0.219 10 false : Sign display on



ii.

RSA Control Pattern 2

·

When the engine switch is turned off while a sign is displayed on the multi-information display, the same sign is displayed when the engine switch is turned on (IG) again.

Y199993E01
2.198,0.604 3.75,0.781 1.552,0.177 10 false Engine Switch is Off 1.083,2.875 2.635,3.052 1.552,0.177 10 false : Sign display on 5.49,0.521 6.635,0.938 1.146,0.417 10 false Engine Switch is Turned On (IG)



iii.

RSA Control Pattern 3

·

While a sign is displayed on the multi-information display, the sign is turned off when turning left or right onto a new road.

Y199994E01
1.292,4.969 3.896,5.167 2.604,0.198 10 false : Sign display on 1.292,4.271 3.896,4.469 2.604,0.198 10 false : Sign display off 1.677,3.906 3.115,4.125 1.438,0.219 10 false Road Sign Recognized




c.

Construction

i.

Forward Recognition Camera

·

The forward recognition camera (camera sensor) is composed of a monocular camera and camera sensor ECU.

·

The RSA is controlled by the monocular camera and camera sensor ECU.

Y199995C01
3.063,2.542 3.885,1.635 true 4.51,2.094 4.813,2.76 true 1.146,3.323 1.635,3.906 true 2.125,0.625 2.438,0.781 0.313,0.156 10 false *1 2.938,2.521 3.25,2.677 0.313,0.156 10 false *a 4.802,2.781 5.115,2.938 0.313,0.156 10 false *b 1.021,3.146 1.333,3.302 0.313,0.156 10 false *c 2.844,5.208 3.156,5.365 0.313,0.156 10 false *d 0.042,5.625 0.354,5.781 0.313,0.156 10 false *e
*1 Forward Recognition Camera (Camera Sensor) - -
*a Monocular Camera *b Camera Sensor ECU
*c Camera Sensor Recognition Area *d Camera Sensor Recognition Range:
*e The illustration shown is an example only. - -


·

Road signs captured by the monocular camera are output to the camera sensor ECU.

·

The camera sensor ECU judges road signs recognized by the monocular camera and displays information based on these judgments on the multi-information display.

Y199996E01
1.854,0.833 2.271,0.417 true 0.927,1.99 1.958,1.688 true 4.729,1.719 5.229,0.729 true 0.188,1.99 1.344,2.667 1.156,0.677 10 false Image Recognition Range 2.302,0.281 3.052,0.563 0.75,0.281 10 false Road Sign 4.688,0.333 6.531,1.063 1.844,0.729 10 false Forward Recognition Camera (Camera Sensor) 0.521,5.25 2.927,5.708 2.406,0.458 10 false Image Captured by Monocular Camera 3.469,3.917 4.656,4.948 1.188,1.031 10 false Judgment of Road Sign Captured by Monocular Camera 3.438,5.24 4.792,5.615 1.354,0.375 10 false Camera Sensor ECU 5.031,5.083 6.594,5.427 1.563,0.344 10 false Multi-information Display 1.375,6.042 4.302,6.417 2.927,0.375 10 false Forward Recognition Camera (Camera Sensor)

·

When one of the following operations is conducted, the forward recognition camera angle must be adjusted. For details, refer to the Repair Manual.

-

The forward recognition camera is removed and reinstalled or replaced.

-

Parts relating to the tire or suspension are replaced or adjusted.

-

Strong force is applied onto the forward recognition camera.





d.

Operation

i.

Combination Meter

·

The combination meter assembly displays recognized signs on the multi-information display based on information of road signs recognized by the forward recognition camera.

·

The RSA system display mode can be selected by switching the display mode of the multi-information display through operation of the multi-information switch in the steering pad switch assembly.

·

When the driving assist system information tab is selected for display on the multi-information display, road signs recognized by the forward recognition camera are displayed on the upper portion of the multi-information display.

·

A maximum of 3 signs can be displayed simultaneously. When 3 signs are displayed, the signs are displayed in the following order from left to right: speed limit related, speed limit with supplemental sign related and no overtaking related.

Y199997C01
2.563,1.302 1.896,1 true 3.406,1.25 3.396,0.563 true 4.198,1.313 4.844,0.969 true 1.719,0.854 2.031,1.01 0.313,0.156 10 false *a 3.313,0.385 3.625,0.542 0.313,0.156 10 false *b 4.875,0.833 5.188,0.99 0.313,0.156 10 false *c 0.042,2.583 0.354,2.74 0.313,0.156 10 false *d
*a Speed Limit Related *b Speed Limit with Supplemental Sign Related
*c No Overtaking Related *d The illustration shown is an example only. The illustration may differ from the actual vehicle screen.


·

When an information tab other than the driving assist system information tab is selected for display on the multi-information display, road signs recognized by the forward recognition camera are displayed as pop-ups on the lower center portion of the multi-information display. Furthermore, the pop-up display is only for speed limit signs. It is not displayed for any overtaking signs and speed limit with supplemental signs.

Y199998C01
2.448,1.26 2.625,0.594 true 2.583,0.406 2.896,0.563 0.313,0.156 10 false *a 4.552,1.99 4.865,2.146 0.313,0.156 10 false *b 0.052,2.573 0.365,2.729 0.313,0.156 10 false *c
*a Speed Limit Related *b Multiple Road Sign Recognized
*c The illustration shown is an example only. The illustration may differ from the actual vehicle screen. - -


·

When there is a malfunction in the RSA system or the system is temporarily unusable, a warning message is displayed on the multi-information display, the master warning light illuminates and the multi buzzer sounds.

Condition Multi-information Display Master Warning Light Buzzer
System Malfunction Check RSA system Illuminates Sounds
Forward Recognition Camera Temperature High Front Camera Systems Unavailable Wait a Moment - -
Windshield Glass Dirty Front Camera Systems Unavailable Clean Windshield. - -





DIAGNOSIS


·

If a malfunction is detected in the RSA the forward recognition camera cancels the RSA, sounds the multi buzzer in the combination meter assembly, and displays a message on the multi-information display to inform the driver of the malfunction.

·

At the same time, the malfunction is stored in memory as a Diagnostic Trouble Code (DTC). For details, refer to the Repair Manual.