Description

You will own the design, development, and optimization of data pipelines.

Responsibilities

• Design, develop, and optimize data pipelines using AWS Data Analytics services like RDS, DMS, Glue, Lambda, Redshift, and Athena.
• Implement data migration and transformation processes using AWS DMS and Glue for efficient data movement.
• Work with SQL on Oracle and Postgres databases to query, manipulate, and analyse large datasets.
• Develop and maintain ETL/ELT workflows for comprehensive data ingestion and transformation.
• Write clean and efficient Python scripts for automation and data processing tasks.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency with AWS services (S3, IAM, CloudWatch, VPC).
• Expertise in SQL, Python, ETL, and Data Pipelines.
• Experience with AWS Lambda, RDS, and Oracle databases.
• Familiarity with DevOps practices and Terraform.
• Experience with data warehousing concepts and data lake implementations.
• Ability to collaborate on CI/CD pipelines.

Key Skills

Education

Any Graduate