Description

Lead the implementation and optimization of data pipelines within an AWS data lake and warehouse environment.

Responsibilities

• Translate business requirements into technical specifications for data pipeline implementation.
• Design and implement data ingestion, transformation, and processing workflows.
• Document data mapping, transformation rules, and data quality requirements.
• Collaborate with technical teams to integrate data from various sources while ensuring integrity and consistency.
• Conduct testing and validation of pipelines to ensure performance, functionality, and reliability.

Required Skills

• 5+ years of experience as a Business Analyst implementing data pipelines in AWS environments.
• Hands-on experience with AWS Glue, AWS Data Pipeline, Amazon Redshift, and AWS Lambda.
• Deep understanding of ETL processes, data ingestion, and data transformation.
• Proficiency in SQL and data modeling.
• Experience with scripting languages including Python or PySpark.
• Knowledge of data governance, security, and privacy principles within AWS.
• Ability to use data visualization tools and project management methodologies.
• Strong analytical skills to translate complex business needs into technical solutions.

Key Skills

Education

Any Graduate