Description

You will design and maintain scalable data architectures and pipelines within an AWS cloud environment.

Responsibilities

• Design and implement data processing architectures using big data technologies to solve complex data challenges.
• Develop scalable data pipelines, perform data modeling, and optimize performance in AWS.
• Collaborate with data scientists and analysts to support data features, reports, and analyses.
• Mentor junior data engineers on best practices and continuous learning.
• Evaluate and integrate new technologies to improve data system efficiency and performance.

Required Skills

• 5+ years of professional experience in data engineering or related fields.
• 3+ years of experience working with Big Data technologies.
• 3+ years of experience with PostgreSQL.
• Strong proficiency in Python scripting and SQL.
• Hands-on experience with Amazon Web Services (AWS) and its data ecosystems.
• Experience building data pipelines with AWS Glue.
• Experience with workflow orchestration using Apache Airflow.
• Solid understanding of relational databases and Microsoft SQL Server.

Preferred Skills

• Familiarity with AWS Lake Formation.
• Experience with stream-processing systems like Apache Kafka.

Key Skills

Education

Any Graduate