Description

You will design, develop, and manage data integration processes to ensure seamless data flow across the organization.

Responsibilities

• Design and implement data integration workflows using AWS Glue, EMR, Lambda, and Redshift.
• Build and maintain ETL pipelines to extract, transform, and load data from diverse sources into data warehouses or lakes.
• Implement monitoring, validation, and error-handling mechanisms to ensure data quality and integrity.
• Optimize data workflows for performance, scalability, and cost-efficiency on AWS cloud infrastructure.
• Translate business requirements into technical specifications and documented data pipelines.

Required Skills

• 10+ years of experience in data engineering, database design, or ETL processes.
• 5+ years of experience with Python and PySpark/Apache Spark for large-scale data processing.
• 5+ years of experience with AWS tools including S3, EMR, Glue, Athena, Redshift, Postgres, RDS, and Lambda.
• 3+ years of experience working with databases, data marts, or data warehouses.
• Proven experience in ETL development, system integration, and CI/CD implementation.
• Experience managing complex database objects to move changed data across multiple environments.
• Strong understanding of data security, privacy, and compliance.
• Bachelor's degree in Computer Science, Information Technology, or a related field.

Preferred Skills

• Master's degree in a related technical field.
• Experience providing technical guidance and mentorship to junior developers.

Key Skills

Education

Bachelor's Degree