Description

You will design, build, and maintain big data solutions using Hadoop, Azure, and GCP ecosystems.

This role is hybrid.

Responsibilities

• Design data solutions leveraging Hadoop-based technologies, Azure, and HDInsight for cloud-based data latency using Scala.
• Build and deliver data solutions utilizing GCP products including BigQuery, Dataflow, DataProc, Looker, and Cloud Data Fusion.
• Ingest data from files, streams, and databases, processing it with Hadoop, Spark, and SQL Database.
• Develop distributed, high-volume, high-velocity multi-threaded event processing systems.
• Implement scalable solutions to meet increasing data volumes using PySpark and Kafka.

Required Skills

• 4+ years of experience in Big Data technologies.
• Proficiency in Python, Scala, or Java.
• In-depth experience with Hadoop, Hive, Pig, Spark, and Python/Scala.
• Hands-on experience with Google Data Products (BigQuery, Dataflow, DataProc, Looker, Cloud Data Fusion).
• Experience building and delivering data solutions using GCP.
• Strong experience in Spark, Scala, Python, or Java.
• Solid experience across the entire Software Development Lifecycle.
• Experience with Distributed Versioning Control environments such as GIT.

Key Skills

Education

Any Graduate