Description

You design, build, and maintain data pipelines and warehousing solutions on AWS.

This role is on-site.

Responsibilities

• Design and implement data pipelines using AWS Glue, Amazon Redshift, Amazon S3, and AWS Lambda.
• Collaborate with data scientists and analysts to translate requirements into high-quality data solutions.
• Optimize data storage and retrieval processes for efficient access and processing.
• Monitor pipeline performance, troubleshoot issues, and ensure data integrity and availability.
• Implement data governance, security best practices, and document data architecture for compliance.

Required Skills

• 15+ years of experience in data engineering or related roles.
• Strong expertise in AWS services: AWS Glue, Amazon Redshift, Amazon S3, and AWS Lambda.
• Proficiency in Python, Java, or Scala.
• Hands-on experience with ETL processes and data warehousing solutions.
• Solid understanding of SQL and NoSQL databases.
• Familiarity with data modeling and data architecture principles.
• Experience with CI/CD pipelines.

Preferred Skills

• Experience with big data technologies such as Apache Spark or Hadoop.
• Knowledge of data visualization tools like Tableau or Power BI.

Key Skills

Education

Bachelor's or Master's degrees