Home
Tesla
News
Tesla Bet On 'Pure Vision' For Self-Driving. That's Why It's In Hot Water
Tesla was recently hit with a new probe prompted by an incident when a Tesla on Autopilot killed a pedestrian in low visibility.

Photo by: Tesla
Andrei Nedelea 
By: Andrei Nedelea
Oct 22, 2024 at 10:00am ET
Add InsideEVs as a preferred source in Google
- (https://twitter.com/intent/tweet?url=https%3A%2F%2Finsideevs.com%2Fnews%2F738204%2Ftesla-pure-vision-camera-only%2F&text=Tesla%20Bet%20On%20%27Pure%20Vision%27%20For%20Self-Driving.%20That%27s%20Why%20It%27s%20In%20Hot%20Water&via=InsideEVs)
- copy
Share
Comment
- Tesla has been hit with a new federal investigation, this time into how its automated driving assistance tech works in low visibility.
- It's the only automaker that has abandoned radar and lidar in favor of a camera-only approach.
- Cameras don't do a great job of depth perception, so perhaps having the extra safety net of radar may have been a good idea for now.
A fan of Tesla might think that the automaker just can't catch a break when it comes to its autonomous driving tech. It’s already subject to several federal investigations over its marketing and deployment of technologies like Autopilot and Full Self-Driving (FSD), and as of last week, we can add another to the list involving around 2.4 million Tesla vehicles. This time, regulators are assessing the cars' performance in low-visibility conditions after four documented accidents, one of which resulted in a fatality.
The National Highway Traffic Safety Administration (NHTSA) says this new probe is looking at instances when FSD was engaged when it was foggy or a lot of dust was in the air, or even when glare from the sun blinded the car’s cameras and this caused a problem.
What the car can "see" is the big issue here. It's also what Tesla bet its future on.

Tesla Cybertruck Vision
Unlike the vast majority of its competitors that are giving their cars with autonomous driving capabilities more ways to “see” their surroundings, Tesla removed ultrasonic and other types of sensors in favor of a camera-only approach in 2022.
This means there isn’t really any redundancy in the system, so if a Tesla with FSD enabled drives through dense fog, it may not have an easy time keeping track of where the road is and staying on it. Vehicles that not only have cameras but also radar and lidar will make more sense of their environment even through dense fog, although these systems are also affected by the elements. Inclement weather seems to sometimes make FSD go rogue.
Tesla Bet Big On Self-Driving. Now It Faces Another Federal Investigation
'Full Self-Driving' Teslas Still Can't Reverse. That May Change Soon
Police Determine Tesla Driver Had FSD Enabled In Fatal Motorcycle Crash
Tesla Will Have 'Unsupervised' Self Driving Soon, Like Musk Said In 2016
When you enable FSD in your Tesla, the car is hardcoded to follow traffic rules and obey all road signs, but it also knows when not to do those things in certain situations. It tracks its position via satellite and it uses artificial intelligence linked to neural networks to make sense of where it is and what other vehicles are doing around it. It relies on its camera-only ADAS array to help it see in all directions. A separate neural network handles route planning and the AI plays a crucial role in making everything work together. Other neural networks are used for different tasks and all of this requires some serious processing power to run.
Tesla uses data from both autonomous driving and other driver behavior, feeding both into its AI models. It relies on a supercomputer of its own making called Dojo to process the vast amount of video data that it receives from its cars. It’s also used to train the various machine learning models that Tesla uses to develop its autonomous driving and it’s what makes the camera-only system work and get better over time.

Tesla FSD V12.4.1
This is all very cool stuff, in theory. But it’s actually behind on the project whose success could have silenced the critics: the Cybercab. Several companies are closer to launching their own fully autonomous and driverless taxi and they’ll probably beat Tesla to it.
Cybercab production is only slated to start in 2026, although even CEO Elon Musk will admit that his timelines are "optimistic", so it may be even later than that. But this is happening while there are already companies in the U.S. that are operating small fleets of autonomous cabs without even a safety driver on board. However, Tesla will make up a lot of the difference because it will tap into autonomous driving tech that it’s been perfecting for years.
Moreover, Tesla is the only manufacturer whose vehicles don’t even have ultrasonic sensors for parking. That’s right: they use cameras for that and, as we discovered during my own refreshed Model 3 drive, I found it to be an inferior solution sometimes leaving you wondering if the car is seeing an actual obstacle or just a low curbstone or a surface change.
Get the best news, reviews, columns, and more delivered straight to your inbox.
back
Subscribe For more info, read our Privacy Policy & Terms of Use.
Older Teslas had a combination of radar and cameras for Autopilot and driver assistance systems. With newer software versions launched after Tesla went down the "Pure Vision" route, it disabled the sensors in the older cars that had them from the factory. So even if you have FSD enabled in an older Tesla that has more than just cameras, only the cameras will be used when the car is driving itself.

Screenshot from allegedly staged 2016 Tesla video promoting Autopilot
The incident that prompted the new NHTSA investigation occurred in November 2023, when a 2021 Model Y with FSD enabled slammed into a Toyota SUV parked on the side of the highway, which then struck and killed one of the people who were in front of the vehicle.
We don’t know if the driver of the Tesla was paying attention to the road at the time of the crash and simply didn’t see the other car or if their eyes were not on the road—people bypassing the safety systems meant to keep drivers’ attention on the road while the car drivers itself is the topic of another investigation.
NHTSA will now look at this system’s ability to "detect and respond appropriately to reduced roadway visibility conditions." We are very curious about the results of this particular investigation since it will reveal whether having just cameras is enough or if the support of radar and lidar makes self-driving cars safer.

Waymo Hyundai Ioniq 5
Waymo
What do you think?
View
Comments
Musk has vehemently opposed the notion that relying only on cameras for autonomous driving is unsafe, but the entire automotive industry (which has all but unanimously embraced the marriage of cameras, radar and sometimes lidar as the go-to solution for cars that can drive themselves) says otherwise. The Tesla boss argues that if humans can navigate solely through a combination of vision and intelligence, cars should be able to do it too.
But cameras don’t perceive depth the way the human eye does, so having the redundancy of radar or lidar is an extra safety net you want in a driverless vehicle that will take you up to highway speeds and can potentially cause harm to you or others. Elon’s argument behind going camera-only is valid, but it doesn’t seem applicable yet and the slew of investigations doesn’t help. Autonomous car tech still needs to evolve more before just cameras will be enough. Those other self-driving players with their spinning sensor-laden cars can’t all be wrong, right?
More Autopilot Stories
Tesla Just Released Autopilot Crash Data. We Have Doubts
Tesla Autopilot Trainers Were Told To Ignore ‘No Turn On Red’ Signs: Report
Police Stop A Sleeping Driver In A Tesla Full Of Drugs
Tesla Reports Fewer Crashes, Incidents With Full Self-Driving In 2023 Vs. 2022
Tesla Autopilot Data Shows Improved Q1 2024: 7.63 Million Miles Per Crash
Tesla Autopilot Linked To 13 Deaths, Hundreds Of Crashes In New Investigation
We want your opinion!
What would you like to see on Insideevs.com?
Take our 3 minute survey.
- The InsideEVs team
Share this Story
- (https://twitter.com/intent/tweet?url=https%3A%2F%2Finsideevs.com%2Fnews%2F738204%2Ftesla-pure-vision-camera-only%2F&text=Tesla%20Bet%20On%20%27Pure%20Vision%27%20For%20Self-Driving.%20That%27s%20Why%20It%27s%20In%20Hot%20Water&via=InsideEVs)
- copy
GO TO COMMENTS
(
)
Got a tip for us? Email: tips@insideevs.com
View all comments ( )
Trending

Diesel Prices Are Surging. This Electric Trucking Company Is Seeing More Interest

I Tried Mercedes MB.Drive Assist Pro. It's Like Tesla FSD, But With One Catch

Tesla Opens Self-Driving Cybercab Orders To 'Select Customers' At $29,990

Tesla Model 3 Maintenance Guide: What Needs Servicing And What Doesn't
Latest Stories
- Tesla Model 3 Maintenance Guide: What Needs Servicing And What Doesn't Nov 16 - Repair / Maintenance -
- Audi A2 e-tron First Drive: Does The Iconic Nameplate Live Up To The Hype? Nov 16 - First Drives -
- I Tried Mercedes' Answer To Tesla FSD. Here's How It Went Nov 16 - Tech Review -
- BMW Just Started Making EV Batteries In America. The New iX5 Will Be First In Line Nov 16 - Manufacturing / Production -
- BMW’s iX5 Beat The Lucid Gravity On Highway Range. Not On Efficiency Nov 16 - Range / Efficiency -
- Tesla Just Bumped The Cheapest Model Y’s Range, But The Price Stays The Same Nov 16 - Range / Efficiency -
- Tesla Drivers Can Now Plug In And Charge Automatically at Ionna Stations Nov 16 - Charging -
RECOMMENDED FOR YOU

Tesla Model 3 Maintenance Guide: What Needs Servicing And What Doesn't

Audi A2 e-tron First Drive: Does The Iconic Nameplate Live Up To The Hype?

Tesla Just Bumped The Cheapest Model Y’s Range, But The Price Stays The Same

I Tried Mercedes' Answer To Tesla FSD. Here's How It Went

Tesla Drivers Can Now Plug In And Charge Automatically at Ionna Stations

BMW Just Started Making EV Batteries In America. The New iX5 Will Be First In Line

Diesel Prices Are Surging. This Electric Trucking Company Is Seeing More Interest