Description

Key Skills: Data Engineer, AWS, Java, Apache, Python, MySQL, Spark, SCALA, GCP, FLink, Azure

Roles and Responsibilities:

• Lead and mentor a team of Data Engineers to deliver scalable and reliable data solutions.
• Design, develop, and optimize ETL/ELT pipelines for structured and unstructured data.
• Build scalable batch and real-time data processing workflows.
• Integrate data from multiple sources into centralized data platforms.
• Develop and maintain data lakes, data warehouses, and modern data architectures.
• Write clean, maintainable code using Python, Java, or Scala.
• Implement data quality checks, monitoring, and validation to ensure reliable data pipelines.
• Develop and maintain CI/CD pipelines for data engineering workflows.
• Collaborate with cross-functional teams to support analytics, reporting, and machine learning initiatives.
• Ensure data security, governance, and compliance with organizational standards.

Skills Required:

• Strong experience in Data Engineering and ETL/ELT pipeline development.
• Proficiency in Python, Java, or Scala programming.
• Hands-on experience with Apache Spark, Apache Flink, or similar distributed data processing frameworks.
• Strong knowledge of SQL, MySQL, and relational databases.
• Experience working with cloud platforms such as AWS, GCP, or Azure.
• Familiarity with data warehouse and data lake technologies.
• Experience with workflow orchestration tools such as Apache Airflow or similar.
• Understanding of CI/CD pipelines, version control, and software engineering best practices.
• Strong analytical, problem-solving, and leadership skills.

Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related field

Key Skills

Education

Any Graduate