Here's what Tesla Autopilot "sees" during a drive in the Paris city limits.
We've shared videos with you before about what users learned that Tesla Autopilot is "seeing." However, a drive around downtown Paris is quite a bit more interesting than just any random road. Of course, this data doesn't come from Tesla, nor did anyone at the automaker help to reconstruct it. Instead, the owner has taken the time to use internal data about what Autopilot sees and then reconstructed the video to paint a picture for us.
This footage only applies to the front-facing camera. Being that it "sees" a lot, it would be very telling to learn what all the other cameras are taking in and processing. While this gives us a good idea of how Full Self-Driving could eventually come to fruition, it also reveals the ultimate complexities of the situation. Nevertheless, it's pretty neat to see it in this setting.
Video Description via greentheonly on YouTube:
Paris streets in the eyes of Tesla Autopilot
This is what Tesla autopilot "sees" via the 'main' camera when driving on the streets of Paris. Objects, lanes, drivable space (green fill at the bottom), ....
Footage is reconstructed from the autopilot videofeed and a stream of internal data. This footage was created without any help from Tesla.
Timing highlights: 01:17 – traffic cones shape driveable space 01:31 – construction equipment recognized as a truck (shows they have quite a deep library of objects they train against? Though it’s not perfect, we saw some common objects not detected too. Notably a pedestrian pushing a cart (not present in this video) 02:23 – false positive, a container mistaken for a vehicle 03:31 – a pedestrian in red(dish?) jacket is not detected at all. (note to self, don’t wear red jackets) 04:12 – one example of lines showing right turn while there are no road markings of it 05:52 – another false positive – poster mistaken for a pedestrian 08:10 – another more prominent example of showing left turn lane with no actual road markings. 09:25 – close up cyclist 11:44 – roller skater 14:00 – we nearly got into accident with that car on the left. AP did not warn
19:48 – 20 pedestrians at once (not that there was shortage of them before of course)