Description

Responsibilities:

• Design and implement robust data pipelines using AWS services such as AWS Glue, Amazon Redshift, and Amazon S3.
• Collaborate with data scientists and analysts to understand data requirements and deliver high quality data solutions.
• Optimize data storage and retrieval processes to ensure efficient data access and processing.
• Monitor and troubleshoot data pipeline performance, ensuring data integrity and availability.
• Implement data governance and security best practices to protect sensitive information.
• Document data architecture, processes, and workflows for future reference and compliance.
• Stay updated with the latest AWS services and data engineering trends to continuously improve our data solutions.

Mandatory Skills:

• Proven experience as an AWS Data Engineer with a strong portfolio of data engineering projects.
• Expertise in AWS services, particularly AWS Glue, Amazon Redshift, Amazon S3, and AWS Lambda.
• Strong programming skills in languages such as Python, Java, or Scala.
• Experience with ETL processes and data warehousing solutions.
• Solid understanding of SQL and NoSQL databases.
• Familiarity with data modeling and data architecture principles.
• Excellent problem solving skills and attention to detail.

Preferred Skills:

• Experience with big data technologies such as Apache Spark or Hadoop.
• Knowledge of data visualization tools like Tableau or Power BI.
• Familiarity with machine learning concepts and tools.
• Experience with DevOps practices and CI/CD pipelines.
• Strong communication and collaboration skills.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 10 15 years of experience in data engineering or related roles.
• AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified Solutions Architect) are a plus

Key Skills

Education

Bachelor's or Master's degrees