Description

You will design and implement data pipelines and infrastructure on AWS.

This role is on-site.

Responsibilities

• Build and manage data pipelines using AWS services.
• Design and implement CI/CD pipelines using Terraform and Jenkins.
• Manage data processing workflows with Spark, Hive, and Airflow.
• Develop data solutions using AWS Lake Formation, Glue Data Catalog, and EMR.
• Conduct design reviews alongside Architects and Development Leads.

Required Skills

• 8 to 10 years of experience in Data Engineering.
• Strong proficiency in Python and SQL.
• Hands-on experience with AWS S3, Athena, and Lambda.
• Experience with big data technologies: HDFS, Hadoop, Spark, and PySpark.
• Practical knowledge of Trino and Airflow.
• Infrastructure as Code experience using Terraform.
• Experience with Jenkins for CI/CD.
• Familiarity with front-end technologies like Angular.

Preferred Skills

• Bachelor's degree in a related field.

Key Skills

Education

Bachelor's degree