Unfortunately he'll still have hundreds of billions of dollars, even without Tesla, so his influence will never go away. He could lose 99% of his wealth and still be a billionaire.
That's because billionaire means nothing. e.g. Jordan Belfort was almost a billionaire, but still went to jail like small fry.The untouchable ones are oligarchs, that is what people are implying and it is much scarier to have a 6-year-old messing around as one.
Madoff made the mistake of stealing from people more powerful than him. Billionaires always steal from poor people, and thus incur no wrath from people who could punish them.