Description

You will build and manage large-scale data processing pipelines within an AWS environment.

Responsibilities

• Design and implement ETL processes to extract, transform, and load data into data warehouses and data lakes.
• Orchestrate big data transformations using CI/CD pipelines in the cloud.
• Standardize interfaces for data mining and handling massive datasets.
• Collaborate with global customers to gather requirements and translate them into technical solutions.
• Create, test, and execute SQL code for data manipulation.

Required Skills

• 8+ years of experience in data engineering and big data processing.
• Proficiency in Spark and Scala.
• Extensive experience with AWS services, including EMR, Databricks, and Redshift.
• Hands-on experience with ETL development and data lake architecture.
• Strong knowledge of SQL and Oracle.
• Experience with GitHub, Jenkins CI/CD, JUnit, and Docker.
• Ability to manage data engineering workflows on the AWS cloud platform.

Key Skills

Education

Any Gradute