Learners will build, analyze, and implement real-time data pipelines; produce and consume streaming data; and apply aggregation logic to identify top trending songs using Apache Kafka and Apache Spark. This hands-on course equips learners with practical skills in streaming architecture, data ingestion, transformation logic, and end-to-end pipeline execution.

Gain next-level skills with Coursera Plus for $199 (regularly $399). Save now.

Recommended experience
What you'll learn
Build real-time data pipelines using Apache Kafka and Apache Spark for streaming ingestion and processing.
Implement aggregation and transformation logic to analyze continuous event streams in Scala.
Design and execute end-to-end streaming projects that mirror real-world data engineering workflows.
Skills you'll gain
Details to know

Add to your LinkedIn profile
January 2026
7 assignments
See how employees at top companies are mastering in-demand skills

There are 2 modules in this course
This module introduces learners to the fundamentals of real-time data streaming using Apache Kafka and Apache Spark. It covers project setup, environment configuration, IDE preparation, and the foundational Scala structures needed to build a streaming analytics pipeline. Learners gain clarity on how data flows through the system and begin constructing the core components required for identifying top trending songs.
What's included
5 videos4 assignments
This module guides learners through implementing, testing, and executing the complete Kafka–Spark streaming workflow. It covers producing real-time data, validating streaming output, writing processed results back to Kafka, and applying practical execution tips to ensure pipeline reliability. By the end, learners will be able to operationalize a fully functional data-streaming solution for ranking top trending songs.
What's included
5 videos3 assignments
Explore more from Software Development
Status: Free Trial
Status: Free Trial
Status: Free
Status: Free Trial
Why people choose Coursera for their career





Open new doors with Coursera Plus
Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 3,400 global companies that choose Coursera for Business
Upskill your employees to excel in the digital economy
Frequently asked questions
To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.
When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.
Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.
More questions
Financial aid available,


