Description

Key Skills: AWS Databrics , ADF, Pyspark , Python , Terraform,Airflow

Roles and Responsibilities:

• Design and implement ETL processes for data integration.
• Develop and maintain data pipelines using Pyspark and Azure Databricks.
• Optimize data workflows for performance and scalability.
• Collaborate with data scientists and analysts to support data-driven decision-making.
• Ensure data quality and integrity throughout the data lifecycle.

Skills Required:

• 8 - 12 years of relevant experience in data engineering.
• Strong experience in ETL and data engineering.
• Proficiency in Pyspark and Azure Databricks.
• Expertise in AWS services related to data processing.
• Solid understanding of Python for data manipulation.

Good to Have:

• Experience with AWS Lambda and SparkSQL.
• Familiarity with Terraform and Apache technologies.
• Knowledge of MySQL and version control using Git.

Education: B. Sc., B.Com., B.Tech, B.Tech M.Tech (Dual), M.B.A.

Key Skills

Education

Any Graduate