Description

You will design and build distributed data solutions using Hadoop-based technologies and cloud platforms.

This role is on-site.

Responsibilities

• Design and develop distributed, high-volume, multi-threaded event processing systems.
• Ingest data from files, streams, and databases for processing.
• Build and deliver data solutions using GCP products and offerings.
• Develop scalable solutions to handle increasing data volumes using big data and cloud technologies.
• Ensure operational excellence, platform stability, and high availability.

Required Skills

• 5+ years of experience in Big Data technologies.
• Proficiency in Python, Scala, or Java.
• Hands-on experience with Spark, Hadoop, Hive, and Pig.
• Experience with GCP data products including BigQuery, Dataflow, Dataproc, Looker, and Cloud Data Fusion.
• Experience with Kafka and distributed version control using Git.
• Knowledge of modern API platform design and service consumption.
• Experience with the full Software Development Lifecycle (SDLC).
• Familiarity with build tools like Maven and IDEs such as IntelliJ, Eclipse, or VSCode.

Preferred Skills

• Experience with Azure services including Data Factory, Databricks, and Data Lake Storage.
• Background in AWS or Azure Data Engineering.

Key Skills

Education

Any Graduate