Description

You will build and maintain data pipelines using big data technologies and distributed systems.

Responsibilities

• Develop data processing applications using Java 8 or higher.
• Manage large-scale structured and unstructured datasets using SQL.
• Implement data workflows within big data ecosystems including Hadoop and Spark.
• Deploy and manage services across cloud platforms like AWS, Azure, or GCP.
• Integrate CI/CD practices into the data engineering lifecycle.

Required Skills

• 6+ years of professional experience in data engineering.
• Strong programming proficiency in Java (version 8 or higher).
• Hands-on experience with Apache Hadoop (HDFS, MapReduce, YARN).
• Proficiency with Apache Spark (RDD, DataFrames, Spark Streaming).
• Experience with Apache Kafka, Hive, and HBase.
• Advanced SQL skills for querying large-scale data.
• Working knowledge of distributed systems.
• Experience with cloud environments such as AWS, Azure, or GCP.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Familiarity with containerization and orchestration using Docker and Kubernetes.

Key Skills

Education

Any Graduate