Description

You will design, build, and maintain scalable software applications and data pipelines within an AWS environment.

Responsibilities

• Build and maintain scalable data pipelines on AWS to ensure efficient data transfer to the warehouse.
• Manage third-party integrations using tools like Fivetran to streamline collection and transformation.
• Implement data quality checks and validation processes to ensure accuracy across the pipeline.
• Monitor and optimize pipelines for speed, efficiency, and cost-effectiveness.
• Document workflows, pipelines, and procedures to facilitate team knowledge sharing.

Required Skills

• 9+ years of experience in software engineering, data pipelines, data integration, and database management.
• Strong expertise in AWS services, specifically S3, Glue, and Redshift.
• Proficiency in Python, Java, or Scala.
• Hands-on experience with data integration tools such as Fivetran.
• Experience with orchestration services, preferably Airflow.
• Proficiency in database management systems including Amazon Aurora and Snowflake.
• Deep understanding of data modeling, ELT processes, and data warehousing concepts.
• Knowledge of data quality and data governance principles.

Preferred Skills

• AWS or other relevant technical certifications.

Key Skills

Education

Any Graduate