Machine Learning at Scale with Spark MLlib

Big Data with Apache Spark Intermediate 3 min read Published
In this lesson

When the training data is hundreds of millions of rows (every click, every transaction), scikit-learn on one machine runs out of memory. MLlib is Spark’s machine-learning library: the same ideas, distributed across a cluster.

🎬 Training on a billion clicks

🔒 This is a premium lesson

It is part of the Data Scientist career track.

🎬 Live animations · 🧪 Tested code · 💼 Projects · 🎓 Certificate

See the track

Already a member? Sign in

Progress is saved in this browser. Create a free account to keep it on every device.