Apache Hadoop and Spark Developer

In stock
  • Big Data & Spark Overview

    • Overview of Big data and its challenges

    • Spark Architecture Overview

    • Installing and Configuring Spark

  • Quick Overview of SCALA Language

  • Spark Architecture Deep Dive

    • Using Spark Shell

    • Understanding Resilient Distributed Datasets (RDDs), Types of RDDs

    • Working with RDD Actions & Transformations

    • Complete Flow of a spark program

    • Deploying to Spark Standalone & Hadoop Cluster

    • Using Web UI for monitoring & managing Spark Applications

    • Hands On

  • Spark APIs & Usages

    • Working with Key-value pairs using Spark APIs

    • Overview of RDD lineage, Caching and Persistence

    • Share Variables: Accumulators and Broadcast Variables

    • Integrating with different data sources including HDFS

    • Logging & Unit Testing

    • Track Spark jobs stages for Investigation and Troubleshooting

    • Hands On

  • Working with Advanced Spark Features

    • Working with DataFrames & Spark SQLs

    • Hive & RDD Integrations

    • Working with different data formats: Structured and Unstructured

    • Hands On

  • Writing Spark Streaming Applications

    • Spark Streaming Overview

    • Understanding Streaming Operations

    • Sliding Window Operations

    • Developing Spark Streaming Applications 

Write Your Own Review
You're reviewing:Apache Hadoop and Spark Developer
Your Rating
Copyright © 2017 Agilitics. All rights reserved.