Connect with us

Hi, what are you looking for?


Autonomous Vehicles

Tesla Is Migrating From Programming Logic To Neural Nets For FSD Decision Making — What That Means (Video)

Tesla firmware hacker and researcher who goes by the name of “green” recently revealed that Tesla is migrating towards neural nets (NNs) for Full Self-Driving (FSD) decision making.

Tesla firmware hacker and researcher who goes by the name of “green” recently revealed that Tesla is migrating towards neural nets (NNs) for Full Self-Driving (FSD) decision making. Currently, Tesla vehicles are making decisions such as “right of way” with programming logic built in C++.

Tesla’s Autopilot is constantly improving. (Image: Tesla)

Green tweeted, “Looked into 2020.48 NNs (yay for holiday break free time!) Interesting to see they are migrating right of way guessing from C++ as seen in the early FSD betas in October to NNs now. The quantum leap is being implement bit by bit I guess.”

Green thinks that the Silicon Valley based automaker is implementing this migration bit-by-bit, probably starting with the “right of way guessing” function to other more complex decisions that the car needs to make while driving.

Tesla FSD visualizations.Tesla FSD Beta driving visualizations (Source: What’s Inside Family/YouTube)

At this stage, Tesla is iterating and improving on its FSD Beta decision-making with each firmware update that it’s pushing to a select few cars in the United States. With NNs in the loop, the cars will be able to instantly get feedback from the Tesla Mothership, which will have a plethora of machine learning data to help make a better decision.

To simplify this, Tesla Autopilot engineer Kate Park explains how computer vision works in a recent video produced for kids. Check out the graphic from the video below that explains how decision making or object detection is limited to the use of traditional programming. With the use of Machine Learning + AI + Neural Nets, the whole process provides limitless possibilities.

Tesla Autopilot engineer explains how computers recognize objects via Traditional Programming vs. Machine Learning + AI. (Source:

For example, traditional programming cannot recognize “X” if it is not exactly drawn with the defined parameters (see image above). But the combination of machine learning, AI, and Neural Networks enable the computer to learn multiple patterns and possibilities an “X” can appear in front.

To make computer vision work perfectly, it requires thousands (sometimes millions) of images to correctly define an object. In Tesla’s case, virtually every car in the fleet sends back video data from all 8 cameras to train the company’s neural net. Tesla has billions of miles of real-world driving data gathered from its worldwide fleet. This gives Tesla a substantial advantage over other companies working on self-driving cars.

How Tesla Autopilot Vision works.How Tesla Neural Net vision works, explained by Tesla AI director, Andrej Karpathy on Tesla Autonomy Day 2019 (Source: Tesla)

Earlier this year, Tesla CEO Elon Musk said that the company’s powerful next-gen neural net (coined Dojo) is being built and its version 1.0 should be up and running next year.

Autopilot driving decisions migrating towards NNs represents a substantial leap forward for Tesla’s FSD efforts. In turn, 2020 could yield some notable advances.

Video: How computer vision works by Tesla Autopilot engineer Kate Park (Source: / YouTube)

An earlier version of this article was originally published on Tesla Oracle.

Appreciate CleanTechnica’s originality and cleantech news coverage? Consider becoming a CleanTechnica Member, Supporter, Technician, or Ambassador — or a patron on Patreon.

Don't want to miss a cleantech story? Sign up for daily news updates from CleanTechnica on email. Or follow us on Google News!

Have a tip for CleanTechnica, want to advertise, or want to suggest a guest for our CleanTech Talk podcast? Contact us here.
Written By

Iqtidar Ali writes for X Auto about Tesla and electric vehicles. A true car enthusiast since his childhood, he covers his stories with an utmost passion, which is now guided by the mission towards sustainability. With over 1 decade of website development experience, he’s also our IT resource at hand. He also writes about tech stuff at occasionally. Iqtidar can easily be reached on Twitter @IqtidarAlii (DM open for tips, feedback or a friendly message) or via email:


You May Also Like


Amidst the bouts of laughter and Musk-centered adoration were several references to Tesla's future planning, leading to more speculation about the company's direction with...

Autonomous Vehicles

Using the terms Autopilot and Full Self Driving is deceptive, the California DMV alleges in a new administrative filing.


Tesla held its annual meeting of stockholders at its Austin, Texas factory on Thursday. The meeting invited shareholders to join in person, in addition to over...


“Interpretability methods” seek to shed light on how machine-learning models make predictions, but researchers say to proceed with caution.

Copyright © 2021 CleanTechnica. The content produced by this site is for entertainment purposes only. Opinions and comments published on this site may not be sanctioned by and do not necessarily represent the views of CleanTechnica, its owners, sponsors, affiliates, or subsidiaries.