Description

You will engineer data infrastructure and pipelines to support extraction, transformation, and loading from various sources.

This role is remote.

Responsibilities

• Build and maintain data infrastructure for optimal ETL/ELT using SQL and AWS cloud-native technologies.
• Develop and maintain data pipeline architecture for large datasets using AWS Glue and Apache Airflow.
• Write complex SQL for data extraction and manipulation, and develop reports for dashboards in collaboration with stakeholders.
• Identify process improvements, automating manual tasks and optimizing data delivery.
• Participate in rotating 24x7 production support.

Required Skills

• 4+ years of experience with Python.
• 4+ years of experience with Shell Scripting.
• 4+ years working with relational databases and data warehouses.
• Experience with AWS services: EC2, RDS, S3, Athena, Redshift, and DynamoDB.
• Experience with Gitlab/Github CI/CD.
• Experience with PySpark, Storm, or Spark-Streaming.
• Strong proficiency in writing complex SQL.

Preferred Skills

• 5+ years of overall working experience.

Key Skills

Education

Any Graduate