Autonomous cars that can navigate winter roads? ‘Snow problem!

A look at what happens when you equip a Ford Fusion with sensor fusion.

Paul Leroux

Let’s face it, cars and snow don’t mix. A heavy snowfall can tax the abilities of even the best driver — not to mention the best automated driving algorithm. As I discussed a few months ago, snow can mask lane markers, obscure street signs, and block light-detection sensors, making it difficult for an autonomous car to determine where it should go and what it should do. Snow can even trick the car into “seeing” phantom objects.

Automakers, of course, are working on the problem. Case in point: Ford’s autonomous research vehicles. These experimental Ford Fusion sedans create 3D maps of roads and surrounding infrastructure when the weather is good and visibility clear. They then use the maps to position themselves when the road subsequently disappears under a blanket of the white stuff.

How accurate are the maps? According to Ford, the vehicles can position themselves to within a centimeter of their actual location. Compare that to GPS, which is accurate to about 10 yards (9 meters).

To create the maps, the cars use LiDAR scanners. These devices collect a ginormous volume of data about the road and surrounding landmarks, including signs, buildings, and trees. Did I say ginormous? Sorry, I meant gimongous: 600 gigabytes per hour. The scanners generate so many laser points — 2.8 million per second — that some can bounce off falling snowflakes or raindrops, creating the false impression that an object is in the way. To eliminate these false positives, Ford worked with U of Michigan researchers to create an algorithm that filters out snow and rain.

The cars don’t rely solely on LiDAR. They also use cameras and radar, and blend the data from all three sensor types in a process known as sensor fusion. This “fused” approach compensates for the shortcomings of any particular sensor technology, allowing the car to interpret its environment with greater certainty. (To learn more about sensor fusion for autonomous cars, check out this recent EE Times Automotive article from Hannes Estl of TI.)

Ford claims to be the first automaker to demonstrate robot cars driving in the snow. But it certainly won’t be the last. To gain worldwide acceptance, robot cars will have to prove themselves on winter roads, so we are sure to see more innovation on this (cold) front. ;-)

In the meantime, dim the lights and watch this short video of Ford’s “snowtonomy” technology:



Did you know? In January, QNX announced a new software platform for ADAS and automated driving systems, including sensor fusion solutions that combine data from multiple sources such as cameras and radar processors. Learn more about the platform here and here.

Award season

Patryk Fournier

The first two months of the calendar year are often referred to as award season by the entertainment industry. Although we don’t compete with the likes of Leonardo DiCaprio and Jennifer Lawrence, we still feel honored with the recent accolades and awards being bestowed upon us.

In the category of Best Backhaul Software or Development Platform for Automakers, the winner is… QNX Software Systems.

Thank you so much to Auto Connected Car News and all the people and companies who voted for us in the Tech CARS Awards. We pride ourselves on offering flexible development platforms that enable automakers to deliver unique, branded experiences. Working with leading-edge automakers and Tier 1 suppliers drives us (pardon the pun) to continue upping our game in advanced platforms for infotainment, digital instrument clusters, advanced driver assistance systems (ADAS), and acoustics — including, of course, the recently announced QNX Platform for ADAS and QNX Acoustics Management Platform.

We would also like to congratulate our fellow award winners, Ford and Harman. Ford won for Overall Best Car Infotainment Software by Automaker for their QNX-powered SYNC 3 connectivity system.

And speaking of Ford, the GSMA Global Mobile Awards recently announced their shortlist of finalists. And we just happen to be a finalist in the category of Best Mobile Innovation for Automotive for our work in Ford SYNC 3.

QNX-powered Ford SYNC 3: Shortlisted for a 2016 Glomo Award. Source: Ford

The Global Mobile Awards, newly rebranded as the Glomo Awards, will take place on February 23 at the Mobile World Congress event in Barcelona, Spain.

Ford ports SmartDeviceLink to QNX CAR Platform

QNX joins Ford, Toyota, and other industry leaders to help drive new standard for app integration.

Paul Leroux

For as long as I can remember, QNX Software Systems has been at the forefront of integrating cars and smartphones. Through our flexible OS architecture and large automotive ecosystem, we provide automakers and Tier 1 suppliers with the ultimate choice in connectivity options for smartphones and other smart devices. And now, QNX customers will have even greater choice, with the availability of Ford’s SmartDeviceLink (SDL) technology for the QNX CAR Platform for Infotainment.

If you’ve never heard of SDL, it’s the open source version of Ford AppLink, the software that allows Ford SYNC users to access smartphone apps through voice commands and dashboard controls. Ford donated AppLink to the open source community to create a standard way for consumers to interact with smartphone apps, regardless of which phone they use or vehicle they drive.

SDL is quickly gaining industry advocates, including Toyota, UI Evolution, and, of course QNX. What’s more, companies like PSA, Honda, Subaru, Mazda are evaluating it for use in next-generation vehicles.

Why the interest in SDL? Because it’s a flexible, vendor-neutral standard that can benefit drivers, automakers, and developers alike. With SDL:

• Drivers can interact with apps by using voice commands, steering-wheel buttons, and other in-car controls, so they can keep their eyes on the road and hands on the wheel.
• Automakers can deliver a consistent app experience across vehicles, while retaining the flexibility to customize that experience for each vehicle brand or model.
• Developers can create apps that can work across multiple smart devices and multiple automotive brands — which means they have greater incentive to create automotive apps.

SDL for QNX builds on a history of successful collaborations between Ford and QNX, including the QNX-powered Ford SYNC 3 infotainment system. According to Paul Elsila, CEO of Livio, the Ford subsidiary that maintains the SDL open source project, “With its large market share, QNX can play a key role in driving the adoption of auto industry standards, and we are excited to work with them in building vendor-neutral technology that can simplify the integration of smartphone apps in any brand or type of vehicle.”

SDL works with multiple smartphone platforms. Moreover, it is highly flexible: it can work across a full range of vehicles, from entry-level to premium, and across a wide range of displays. It can even be used in systems without displays — for instance, in systems that use a voice interface.

To learn more about SDL, check out the announcements that Ford, Toyota, and QNX issued this morning.

The A to Z of QNX in cars

Over 26 fast facts, brought to you by the English alphabet

Paul Leroux

A is for Audi, one of the first automakers to use QNX technology in its vehicles. For more than 15 years, Audi has put its trust in QNX, in state-of-the-art systems like the Audi virtual cockpit and the MIB II modular infotainment system. A is also for QNX acoustics software, which enhances hands-free voice communications, eliminates “boom noise” created by fuel-saving techniques, and even helps automakers create signature sounds for their engines.

B is for Bentley, BMW, and Buick, and for their QNX-powered infotainment systems, which include BMW ConnectedDrive and Buick Intellilink.

C is for concept vehicles, including the latest QNX technology concept car, a modded Maserati Quattroporte GTS. The car integrates an array of technologies — including cameras, LiDAR, ultrasonic sensors, and specialized navigation engines — to show how QNX-based ADAS systems can simplify driving tasks, warn of possible collisions, and enhance driver awareness.

D is for the digital instrument clusters in vehicles from Alpha Romeo, Audi, GM, Jaguar, Mercedes-Benz, and Land Rover. These QNX-powered displays can reconfigure themselves on the fly, providing quick, convenient access to turn-by-turn directions, back-up video, incoming phone calls, and a host of other information.

E is for experience. QNX has served the automotive market since the late 1990s, working with car makers and tier one suppliers to create infotainment systems for tens of millions of vehicles. QNX has been at work in safety-critical industrial applications even longer — since the 1980s. This unique pedigree makes QNX perfectly suited for the next generation of in-vehicle systems, which will consolidate infotainment and safety-related functions on a single, cost-effective platform.

F is for Ford, which has chosen the QNX Neutrino OS for its new SYNC 3 infotainment system. The system will debut this summer in the 2016 Ford Escape and Ford Fiesta and will be one of the first infotainment systems to support both Apple CarPlay and Android Auto.

G is for GM and its QNX-based OnStar system, which is now available in almost all of the company’s vehicles. GM also uses QNX OS and acoustics technology in several infotainment systems, including the award-winning Chevy MyLink.

H is for hypervisor. By using the QNX Hypervisor, automotive developers can consolidate multiple OSs onto a single system-on-chip to reduce the cost, size, weight, and power consumption of their designs. The hypervisor can also simplify safety certification efforts by keeping safety-related and non-safety-related software components isolated from each other.

I is for the ISO 26262 standard for functional safety in road vehicles. The QNX OS for Automotive Safety has been certified to this standard, at Automotive Safety Integrity Level D — the highest level achievable. This certification makes the OS suitable for a wide variety of digital clusters, heads-up displays, and ADAS applications, from adaptive cruise control to pedestrian detection.

J is for Jeep. The QNX reference vehicle, based on a Jeep Wrangler, showcases what the QNX CAR Platform for Infotainment can do out of the box. In its latest iteration, the reference vehicle ups the ante with traffic sign detection, lane departure warnings, curve speed warnings, collision avoidance alerts, backup displays, and other ADAS features for enhancing driver awareness.

K is for Kia, which uses QNX technology in the infotainment and connectivity systems for several of its vehicles.

L is for LG, a long-time QNX customer that is using several QNX technologies to develop a new generation of infotainment systems, digital clusters, and ADAS systems for the global automotive market.

M is for Mercedes-Benz, which offers QNX-based infotainment systems in several of its vehicles, including the head unit and digital instrument cluster in the S Class Coupe. M is also for market share: according to IHS Automotive, QNX commands more than 50% of the infotainment software market.

N is for navigation. Thanks to the navigation framework in the QNX CAR Platform, automakers can integrate a rich variety of navigation solutions into their cars.

O is for the over-the-air update solution of the BlackBerry IoT Platform, which will help automakers cut maintenance costs, reduce expensive recalls, improve customer satisfaction, and keep vehicles up to date with compelling new features long after they have rolled off the assembly line.

P is for partnerships. When automotive companies choose QNX, they also tap into an incredibly rich partner ecosystem that provides infotainment apps, smartphone connectivity solutions, navigation engines, automotive processors, voice recognition engines, user interface tools, and other pre-integrated technologies. P is also for Porsche, which uses the QNX Neutrino OS in its head units, and for Porsche 911, which formed the basis of one of the first QNX concept cars.

Q is for the QNX CAR Platform for Infotainment, a comprehensive solution that pre-integrates partner technologies with road-proven QNX software to jump-start customer projects.

R is for the reliability that QNX OS technology brings to advanced driver assistance systems and other safety-related components in the vehicle — the same technology proven in space shuttles, nuclear plants, and medical devices.

S is for the security expertise and solutions that Certicom and QNX bring to automotive systems. S is also for the advanced smartphone integration of the QNX CAR Platform, which allows infotainment systems to support the latest brought-in solutions, such as Apple CarPlay and Android Auto. S is also for the scalability of QNX technology, which allows customers to use a single software platform across all of their product lines, from high-volume economy vehicles to luxury models. And last, but not least, S is for the more than sixty million vehicles worldwide that use QNX technology. (S sure is a busy letter!)

T is for Toyota, which uses QNX technology in infotainment systems like Entune and Touch ‘n’ Go. T is also for tools: using the QNX Momentics Tool Suite, automotive developers can root out subtle bugs and optimize the performance of their sophisticated, multi-core systems.

U is for unified user interface. With QNX, automotive developers can choose from a rich set of user interface technologies, including Qt, HTML5, OpenGL ES, and third-party toolkits. Better yet, they can blend these various technologies on the same display, at the same time, for the ultimate in design flexibility.

V is for the Volkswagen vehicles, including the Touareg, Passat, Polo, Golf, and Golf GTI, that use the QNX Neutrino OS and QNX middleware technology in their infotainment systems.

W is for the QNX Wireless Framework, which brings smartphone-caliber connectivity to infotainment systems, telematics units, and a variety of other embedded devices. The framework abstracts the complexity of modem control, enabling developers to upgrade cellular and Wi-Fi hardware without having to rewrite their applications.

X, Y, and Z are for the 3D navigation solutions and the 3D APIs and partner toolkits supported by the QNX CAR Platform. I could show you many examples of these solutions in action, but my personal favorite is the QNX technology concept car based on a Bentley Continental GT. Because awesome.

Before you go... This post mentions a number of automotive customers, but please don’t consider it a complete list. I would have gotten them all in, but I ran out of letters!

In Memoriam Carroll Shelby

I should have had my camera with me. Because if I had photos to show you, you’d understand. Too late now!

It happened in Wilno, a small town in rural Ontario. I had just stepped out of the local tavern when I saw the thing, only meters away.

I stopped dead in my tracks.

It lay close to the ground, absolutely still. Its striped, muscular frame suggested immense power, and its skin reflected the blood-red rays of the setting sun. I stood frozen, refusing to believe what my eyes were telling me.

Moments passed, and I decided I had nothing to lose. I began to walk towards it. Closer… closer… closer.

Finally, I was standing over it. No response. So I reached down and, ever so gently, stroked it. And then it happened. A voice behind me, yelling a question. I mustn’t have responded, because the question was repeated.

“So would you like a peek under the hood?”

"Yes", I said.

Beneath the thing’s hood was a gleaming and oh-so-potent 427 V8. And the thing itself was an AC Cobra, immaculately restored to its mid-60s glory. For the next 30 minutes, the Cobra's owner treated me to a bumper-to-bumper inspection of the car, inside and out. I must have exclaimed “Cool!” about 100 times. Because it was.

The best part? When the owner started it up. The car's engine and side-mounted exhaust pipes erupted into sonic mayhem, right off the decibel scale. Pure rock ‘n’ roll.

Ever since then, I have had the comfort knowing that, on the highways of Ontario, there can be found an unalloyed embodiment of one man’s automotive vision and imagination. A man whom I've never met, but whose work I've admired for more than 45 years. An man who, just recently, left us. The car, an AC Cobra. The man, Carroll Shelby.

RIP Carroll.
 

QNX-based nav system helps Ford SUVs stay on course down under

Paul Leroux

This just in: SWSA, a leading electronics supplier to the Australian automotive industry, and NNG, the developer of the award-winning iGO navigation software, have created a QNX-based navigation system for Ford Australia. The new system has been deployed in Ford Territory SUVs since June of this year.

To reduce driver distraction, the system offers a simplified user interface and feature set. And, to provide accurate route guidance, the system uses data from an internal gyroscope and an external traffic message channel, as well as standard GPS signals. Taking the conditions of local roads into account, the software provides a variety of alerts and speed-camera warnings; it also offers route guidance in Australian English.

The navigation system is based on the iGO My way Engine, which runs in millions of navigation devices worldwide. To read NNG's press release, click here.


SWSA's new nav system for the Ford Territory is based on the Freescale
i.MX31L processor, QNX Neutrino RTOS, and iGO My way Engine.