Description

Design and operate enterprise-scale big data infrastructure on AWS EMR and the Hadoop ecosystem.

This role is on-site.

Responsibilities

• Design, build, and manage cloud-based infrastructure services supporting platform operations.
• Develop high-performance data pipelines using Spark, PySpark, and Scala.
• Implement data engineering workflows using Airflow and manage streaming with Kafka.
• Administer and optimize Hadoop ecosystem components including HDFS, Hive, HBase, and Delta Tables.
• Ensure system reliability and observability using Splunk and Dynatrace.

Required Skills

• 9+ years of hands-on experience designing and developing enterprise-scale applications.
• 7+ years of expertise in Big Data technologies on AWS EMR and Hadoop ecosystem.
• Mandatory proficiency in Scala and Python.
• Strong command of Spark and PySpark for data processing.
• Experience with AWS cloud ecosystem services.
• Working knowledge of Linux, Bash, and shell scripting.
• Bachelor’s degree in Computer Science, Engineering, Math, or related field.

Preferred Skills

• Experience with MongoDB.
• Knowledge of AI/Machine Learning using Python, Keras, or TensorFlow.
• Familiarity with Iceberg and MapReduce.

Key Skills

Education

Any Graduate