Description

Role Summary
We are looking for a highly experienced Data Engineer with strong expertise in Python, SQL, PySpark, and AWS data services. The role involves building and optimizing scalable data pipelines, working with distributed systems, and ensuring high performance and reliability of data platforms.

Technical Skills Required
Programming & Frameworks
Python
SQL
PySpark
Spark SQL
AWS Data Services
EMR
AWS Glue
AWS Lambda
Amazon S3
Amazon RDS / MySQL
Amazon Redshift
CloudWatch
Secrets Manager

Key Responsibilities
Design, develop, and optimize scalable data pipelines
Work with distributed computing systems and large datasets
Perform data modeling, schema design, and management
Ensure performance tuning and cost optimization
Troubleshoot complex data and system issues
Collaborate with cross-functional teams to support analytics and business needs

Required Competencies

Strong experience in distributed data processing
Expertise in data modeling and schema evolution
Hands-on performance tuning and optimization
Excellent debugging and problem-solving skills
Ability to work in fast-paced, production-grade environments

Key Skills

Education

Any Graduate