YouTuber Mark Rober has kicked the hornet's nest with his latest video. But are Tesla fanboys right mistakes were made?
In the piece — titled "Can You Fool a Self Driving Car?" — Rober found that a Tesla car on Autopilot was fooled by a Wile E. Coyote-style wall painted to look like the road ahead of it, with the electric vehicle plowing right through it instead of stopping.
The footage was damning enough, with slow-motion clips showing the car not only crashing through the styrofoam wall but also a mannequin of a child. The Tesla was also fooled by simulated rain and fog.
As Electrek points out, Autopilot has a well-documented tendency to disengage right before a crash. Regulators have previously found that the advanced driver assistance software shuts off a fraction of a second before making impact.
This has been known.
They do it so they can evade liability for the crash.
If the disengage to avoid legal consequences feature does exist, then you would think there would be some false positive incidences where it turns off for no apparent reason.
I found some with a search, which are attributed to bad software. Owners are discussing new patches fixing some problems and introducing new ones. None of the incidences caused an accident, so maybe the owners never hit the malicious code.
Every Tesla driver would need super human reaction speeds to respond in 17 frames, 680ms(I didn't check the recording framerate, but 25fps is the slowest reasonable), less than a second.
They're talking about avoiding legal liability, not about actually doing the right thing. And of course you can see how it would help them avoid legal liability. The lawyers will walk into court and honestly say that at the time of the accident the human driver was in control of the vehicle.
And then that creates a discussion about how much time the human driver has to have in order to actually solve the problem, or gray areas about who exactly controls what when, and it complicates the situation enough where maybe Tesla can pay less money for the deaths that they are obviously responsible for.
It costs too much. It's also why you have to worry about panels falling off the swastitruck if you park next to them. They also apparently lack any sort of rollover frame.
He doesn't want to pay for anything, including NHTSB crash tests.
It's literally what Drumpf would have created if he owned a car company. Cut all costs, disregard all regulations, and make the public the alpha testers.
The guy bankrupted a casino, not by playing against it and being super lucky, but by owning it. Virtually everything he has ever touched in business has turned to shit. How do you ever in the living fuck screwup stakes at Costco? My cousin with my be good eye and a working elbow could do it.
And now its the country's second try. This time unhinged, with all the training wheels off. The guy is stepping on the pedal while stripping the car for parts and giving away the fuel. The guy doesn't even drive, he just fired the chauffeur and is dismantling the car from the inside with a shot gun...full steam ahead on to a nice brick wall and an infinity cliff ready to take us all with him. And Canada and Mexico and Gina. Three and three quarters of a year more of daily atrocities and law breakage. At least Hitler boy brought back the astronauts.
Cost cutting. Lidar is cheaper now but was relative expensive and increased tech debt and maintenance. Also he legit thought that "human see good - then car see good too". Tesla is being led by a literal idiot.
There was a comedy channel on Youtube aeons ago that would do "if x were honest" videos. Their slogan for Valve was "We used to make games. Now we make money."
Read about this somewhere. Iirc, Elon felt cameras were better than LiDAR at a time when that was kinda true, but the technology improved considerably in the interim and he pridefully refuses to admit he needs to adapt. [Edit: I had hastily read the referenced article and am incorrect here; link to accurate statements is linked in a reply below.]
I don't even understand that logic. Use both. Even if one is significantly better than the other, they each have different weaknesses and can mitigate for each other.
He didn't think they were better. He thought Tesla could get away without the more expensive lidar. Basically "humans can drive with just vision, that should be enough for an autonomous vehicle also." Basically he did it because lidar is more expensive.
Notice how they're mad at the video and not the car, manufacturer, or the CEO. It's a huge safety issue yet they'd rather defend a brand that obviously doesn't even care about their safety. Like, nobody is gonna give you a medal for being loyal to a brand.
These people haven't found any individual self identity.
An attack on the brand is an attack on them. Reminds me of the people who made Stars Wars their meaning and crumbled when a certain trilogy didn't hold up.
Thus it ever is with Conservatives. They make $whatever their whole identity, and so take any critique of $whatever as a personal attack against themselves.
I blame evangelical religions' need for martyrdom for this.
So literally every single above average sports fan?
The pathological need to be part of a group so bad it overwhelmes all reason is a feature I have yet to understand. And I say that as someone who can recognize in myself those moments when I feel the pull to be part of an in group.
The styrofoam wall had a pre-cut hole to weaken it, and some people are using it as a gotcha proving the video was faked. It would be funny if it wasn't so pathetic.
For more background, Rober gave an interview and admitted that they ran the test twice. On the first run, the wall was just fabric, which did not tear away in a manner that was visually striking. They went back three weeks later and built a styrofoam wall knowing that the Tesla would fail, and pre-cut the wall to create a more interesting impact.
Yeah, but it's styrofoam. You could literally run through it. And I'm sure they did that more as a safety measure so that it was guaranteed to collapse so nobody would be injured.
But at the same time it still drove through a fucking wall. The integrity doesn't mean shit because it drove through a literal fucking wall.
I wondered how the hell it managed to fool LIDAR, well...
The stunt was meant to demonstrate the shortcomings of relying entirely on cameras — rather than the LIDAR and radar systems used by brands and autonomous vehicle makers other than Tesla.
If I could pass one law, requiring multiple redundant scanning tech on anything autonomous large enough to hurt me might be it.
I occasionally go to our warehouses which have robotic arms, autonomous fork lifts, etc. All of those have far more saftey features than a self driving Tesla, and they aren't in public.
The tl;dr here is that Elon said that humans have eyes and they work, and eyes are like cameras, so use cameras instead of expensive LIDAR. Dick fully inside car door for the slam.
In theory he's not wrong, except for that part where neither the optics nor (especially) the software come anywhere close to matching the performance of human eyes and brains and won't for the foreseeable future.
The entire premise of the joke is that we could mistake a sufficiently detailed image of a road for an actual road. That humans are susceptible to such a failure does not mean it is reasonable for a robot to share the same flaw.
To be clear, Elon Musk removed radar from Tesla vehicles and not Lidar, but a) he had it removed even from vehicles that had the hardware for radar and b) radar would have been enough to pass all the tests in the video anyway.
I got a Tesla from my work before Elon went full Reich 3, and try this:
break on bridge shadows on the highway
start wipers on shadows, but not on rain
break on cars parked on the roadside if there's a bend in the road
disengage autopilot and break when driving towards the sun
change set speed at highway crossings because fuck the guy behind me, right?
engage emergency break if a bike waits to cross at the side of the road
To which I'll add:
moldy frunk (short for fucking trunk, I guess?), no ventilation whatsoever, water comes in, water stays in
pay attention noises for fuck-all reasons masking my podcasts and forcing me to rewind
the fucking cabin camera nanny - which I admittedly disabled with some chewing gum
the worst mp3 player known to man, the original Winamp was light years ahead - won't index, won't search, will reload USB and lose its place with almost every car start
bonkers UI with no integration with Android or Apple - I'm playing podcasts via low rate Bluetooth codecs, at least it doesn't matter much for voice
unusable airco in auto mode, insists on blowing cold air in your face
Say what you want about European cars, at least they got usability and integration right. As did most of the auto industry. Fuck Tesla, never again. Bunch of Steve Jobs wannabes.
This, if the so called Tesla fans even drive the car, they know all of the above is more or less true. Newer cars have fewer of these issues, but the camera based Auto Pilot system is still in place. The car doesn't even allow you to use cruise control under certain circumstances, because the car deems visibility too poor. The camera also only detects rain when its pouring, every other situation it will just randomly engage/disengage.
I drive a Tesla Model 3 (2024) daily and I wouldn't trust the car driving itself towards a picture like that. It would be an interesting experiment to have these "Tesla Fans" do the same experiment and use a concrete wall for some additional fun. I bet they won't even conduct the experiment, because they know the car won't detect the wall.
Frunk is short for front trunk. The mp3 issues mostly goes away if you pay for LTE on the car. The rest of the issues I can attest to. Especially randomly changing the cruise control speed on a highway because Google maps says so, I guess? Just hard breaking at high speeds for no fucking reason.
Tesla cars are stupid tech. As the cars that use lidar demonstrated, this is a solved problem. There don’t have to be self driving cars that run over kids. They just refuse to integrate the solution for no discernible reason, which I’m assuming is really just “Elon said so.”
Yeah, it's infuriating! Elon said something along the lines of Humans drive all the time just using their eyes, so we can replicate that with just cameras. Leaving out the fact that one of the benefits of a self driving system should surely be that it's in many ways BETTER than humans which are often terrible at driving in fog, torrential rain, low light/night time etc!? It was almost a point of pride that his cars would be every bit as shitty as a human driver to a fault!
I guess his robots are going to be just as weak and frail as humans and need sick days and simulate getting tired and dropping things too?? I can just imagine one of his robots entering a room and saying What did I come in here for again?? I think I need a nap!?
It's even worse than that. Not only is it a solved problem, but Tesla had it solved (or closer to solved, anyway) and then intentionally regressed on the technology as a cost cutting measure. All the while making a limp-wristed attempt to spin the removal of key sensor hardware -- first the radar and later the ultrasonic proximity sensors -- as a "safety" initiative.
There isn't a shovel anywhere in the world big enough for that pile of bullshit.
What would definitely help with the discussion is if Mark Rober the scientist left a fucking crumb of scientific approach in his video. He didn’t really explain how he was testing it just slam car into things for views. This and a collaboration with a company that makes lidar made the video open to every possible criticism and it’s a shame.
Did he enable the autopilot? When? What his inputs to the car were? Is if fsd? What car is that?
You can make every car hit a wall, that is the obvious part, but by claiming (truthfully, I have no doubt) that the car hit it on its own I would like to know what made it do it.
But I do feel there is something strange about the car disengaging the auto pilot (cruise control) just before the crash. How can the car know it's crashing while simultaneously not knowing it's crashing?
I drive a model 3 myself, and there is so much bad shit about the auto pilot and rain sensors. But I have never experienced, or heard anyone else experiencing a false positive were the car disengage the auto pilot under any conditions the way shown in the video with o sound or visual cue. Considering how bad the sensors on the car is, its strange they're state of the art every time an accident happens. There is dissonance between the claims.
Mark shouldn't have made so many cuts in the upload. He locks the car on 39mph on the video, but crashes at 42mph. He should have kept it clean and honest.
I want to see more of these experiments in the future. But Marks video is pretty much a commercial for the Lidar manufacturer. And commercials shouldn't be trusted.
For the record, I do want the bar for self-driving safety to be high. I also want human drivers to be better... Because even not-entirely-safe self-driving cars may still be safer than humans at a certain point.
Right, those were the failures that really matter, and Rober included the looney tunes wall to get people sharing and talking about it. A scene painted on wall is a contrived edge case, but pedestrians/obstacles in weather involving precipitation is common.
props to the LiDAR car for trying to drive through that heavy rain - does it just have enough resolution to see through the droplets to determine that there isn't a solid object within braking distance?