Description

You will design and maintain data pipelines using PySpark and SQL on AWS and Databricks.

Responsibilities

• Build and optimize ETL processes using PySpark for large-scale data processing.
• Write efficient SQL queries and manage data models within Databricks.
• Deploy and manage cloud infrastructure and data services on AWS.
• Ensure data quality, reliability, and performance across the pipeline.

Required Skills

• 6+ years of experience as a Data Engineer.
• Strong proficiency in PySpark for distributed computing.
• Advanced SQL skills for complex data manipulation and analysis.
• Hands-on experience with AWS data services (S3, Redshift, EMR, Glue, or similar).
• Practical experience using Databricks for data engineering workflows.
• Ability to work independently and deliver results.

Preferred Skills

• Experience with CI/CD for data pipelines.
• Knowledge of data governance and security best practices.

Key Skills

Education

Any Graduate