Description

You will lead the design and implementation of scalable data pipelines and architecture.

Responsibilities

• Design, implement, and expand ETL pipelines through extraction, transformation, and loading activities.
• Translate business requirements into data models geared toward end-user needs.
• Investigate ETL pipeline issues, notify stakeholders, and implement solutions.
• Manage data migration tasks, including DMS activity.
• Maintain technical documentation and ensure architecture is scalable and maintainable.

Required Skills

• 6+ years of experience in data engineering.
• Proficiency in Python and Flask API.
• Experience with AWS Glue, Step Functions, and Lambda.
• Strong SQL skills, including query performance tuning and index maintenance.
• Expertise in scripting languages such as Python, Bash, or Perl.
• Knowledge of API development and data modeling principles.
• Experience handling DMS activity for data migration.
• Ability to manage complex data structures and technical problem-solving.

Preferred Skills

• Strong organizational skills regarding time management and project planning.

Key Skills

Education

ANY GRADUATE