Description

You will design, build, and maintain data systems and storage solutions using Amazon Web Services.

Responsibilities

• Build and maintain ETL pipelines, workflows, and data orchestration processes.
• Design data models and implement data storage solutions for structured and unstructured datasets.
• Manage data life cycles and implement processes to ensure data quality.
• Document data pipelines, architectural processes, and engineering best practices.
• Ingest and transform data by applying core programming concepts.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python, Spark, and Scala.
• Advanced SQL skills and experience with data warehousing.
• Hands-on experience with AWS Glue, AWS Lambda, and Amazon Kinesis.
• Experience using Amazon EMR, Amazon Athena, and AWS Step Functions.
• Working knowledge of Amazon DynamoDB, Amazon CloudWatch, and Amazon SNS.
• Practical experience with AWS Redshift, AWS RDS, and Hadoop.
• Proven experience building data lakes on AWS S3.
• Bachelor of Computer Science degree.

Key Skills

Education

BACHELOR OF COMPUTER SCIENCE