Description

Build and maintain scalable data pipelines using AWS, Databricks, and PySpark.

This role is on-site.

Responsibilities

• Develop and maintain ETL/ELT processes using PySpark, Python, and SQL.
• Design, build, and deploy data solutions aligned with business needs.
• Ensure data quality and integrity through validation and monitoring.
• Optimize data models and schemas for high-performance retrieval.
• Troubleshoot and resolve data-related issues in a timely manner.

Required Skills

• Strong hands-on experience with PySpark for distributed data processing.
• Expertise in AWS services: S3, Glue, EMR, Redshift, Lambda.
• Experience with Databricks for large-scale data processing.
• Advanced proficiency in Python and SQL.
• 5+ years of experience in Data Engineering.
• Solid understanding of ETL/ELT, data warehousing, and data modeling.

Preferred Skills

• Familiarity with Amazon Bedrock or Generative AI data integrations.

Key Skills

Education

Any Graduate