Description

You will design, build, and maintain data systems using Amazon Web Services.

Responsibilities

• Design and build ETL pipelines, workflows, and data storage solutions.
• Orchestrate data pipelines while applying core programming concepts.
• Develop data models and manage data life cycles.
• Ensure data quality and create documentation for pipelines and best practices.
• Ingest and transform structured and unstructured data sets.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python, PySpark, and Scala.
• Strong SQL skills and experience with data warehousing.
• Hands-on experience with AWS Glue, AWS Lambda, and AWS Step Functions.
• Experience with Amazon Kinesis, Amazon EMR, and Amazon Athena.
• Working knowledge of Amazon DynamoDB, Amazon CloudWatch, and Amazon SNS.
• Expertise in AWS Redshift, AWS RDS, and Hadoop.
• Experience building data lakes using AWS S3.
• Solid understanding of data modeling and the Big Data ecosystem.

Key Skills

Education

Any Gradute