EthicsComputerCourses
Join training

Web Development Build websites and web apps, from your first HTML page to React and Next.js.

Backend Development Server-side apps and APIs with Node.js, PHP, Django, Spring Boot and ASP.NET Core.

Programming Languages Core languages for college, coding interviews and real projects.

Mobile Development Build Android and iOS apps with Flutter and Swift.

Computer Science Core Operating systems, networks, DBMS and system design for college, GATE and interviews.

Databases Store, query and design data with SQL, PostgreSQL and MongoDB.

Data Science & AI Statistics, data analysis, dashboards and machine learning.

Cloud, DevOps & Testing Containers, Kubernetes, the cloud and software testing.

Security & Systems Protect systems and work confidently on Linux servers.

IoT & Electronics Build smart devices with Arduino, sensors and Raspberry Pi.

Office, Accounts & Career Computer basics, Excel, Tally with GST and digital marketing for jobs and business.

New to coding? Start with Intro to Programming Browse all 68 tutorials
EthicsComputerCourses
Join training +91 90532 10052
  1. Tutorials
  2. Big Data & Apache Spark Tutorial

Big Data & Apache Spark Tutorial

Learn how Hadoop and Apache Spark process data too big for one computer, with small runnable Python versions of every idea.

28 free lessons Intermediate to Advanced Covers Apache Spark 4.3 with PySpark; Hadoop as background

Start the first lesson

Big Data Foundations Intermediate

  1. 1Big Data Introduction
  2. 2Distributed Computing Basics
  3. 3Hadoop Overview & HDFS
  4. 4MapReduce & YARN

Getting Started with Spark Intermediate

  1. 5Spark Architecture
  2. 6Installing PySpark Locally
  3. 7SparkSession & Your First DataFrame
  4. 8RDDs vs DataFrames
  5. 9Transformations, Actions & Lazy Evaluation

Working with DataFrames Intermediate

  1. 10Reading & Writing CSV, JSON & Parquet
  2. 11DataFrame Operations
  3. 12Grouping & Aggregations
  4. 13Nulls, Dates & Complex Types
  5. 14Spark SQL
  6. 15Joins & Shuffles
  7. 16Window Functions
  8. 17UDFs & Their Cost

Performance Advanced

  1. 18Partitioning & Bucketing
  2. 19Caching & Persistence
  3. 20Performance Tuning: Skew & Broadcast Joins
  4. 21Reading the Spark UI

Streaming & Storage Advanced

  1. 22Structured Streaming Basics
  2. 23File Formats: Parquet, ORC & Avro
  3. 24Data Lakes & Lakehouses

Production & Project Project

  1. 25Orchestration with Airflow
  2. 26Big Data Services in the Cloud
  3. 27Data Quality for Pipelines
  4. 28Project: E-commerce Clickstream Pipeline

Learn Big Data (Spark) with a mentor

Free lessons get you started. Our Data Science & Machine Learning training adds real projects and code reviews from working developers.

  • Project-based learning
  • Mentor code reviews
  • Free counselling call
Get course details +91 90532 10052