Tesla’s Director of AI Shares A New Project That Tesla Is Hiring For
Tesla’s Director of Artificial Intelligence (AI), Andrej Karpathy, shared a thread this week about a new project that his team is working on. He also shared some video footage from it. The thread, in a nutshell, is an invitation for those interested in helping Tesla solve this particular problem. They want you to apply for a job.
1/3 Some panoptic segmentation eye candy 🌈🤩 from a new project we are bringing up. These are too raw to run in the car, but feed into auto labelers. Collaboration of data labeling a large (100K+), clean, diverse, multicam+video dataset and engineers who train the models pic.twitter.com/RTERAxyRO0
— Andrej Karpathy (@karpathy) November 30, 2021
Karpathy noted that the videos were panoptic segmentation from the new project and were too raw to run in the car. So, instead, they are feeding it into auto labelers.
In AI, panoptic segmentation is the task of clustering parts of an image together that belong to the same object class. Another term for this is pixel-level classification. It partitions images or video frames into multiple segments or objects. An auto labeler simply labels raw, unlabeled data. Labeling helps an AI understand the implications of a pattern. PatternEx has an in-depth article about this term and uses the Pandora app as an example. As you hear a song and click the thumbs up, you are basically telling it that you like the song. This is labeling. Another example is a parent reading a book to a baby, tapping an image of a dog, and saying the word “dog.”
So, explaining Andrej’s tweet in layman’s terms, he is simply saying that the videos are from a new project where they are clustering parts of an image/video that belong to the same object class and then getting it labeled via AI. After that, the aim is to improve the system more and more so that the AI gets better and better at seeing the world in a complete, comprehensive, human (but actually superhuman) way.
3/3 It's still early for this task; Help us make these panoptic segmentation predictions perfect and realize the downstream impact: https://t.co/miz7u0twtN pic.twitter.com/glBePUuWda
— Andrej Karpathy (@karpathy) November 30, 2021
Karpathy pointed out that it is still early for this task and that Tesla needs help perfecting these panoptic segmentation predictions and realizing the downstream impact.
Who’s gonna help Tesla? Anyone who wants to can apply to join the team here.
Have a tip for CleanTechnica? Want to advertise? Want to suggest a guest for our CleanTech Talk podcast? Contact us here.
CleanTechnica Holiday Wish Book

Our Latest EVObsession Video
CleanTechnica uses affiliate links. See our policy here.