Description

You will design, build, and maintain scalable ETL pipelines and data workflows within AWS Cloud environments.

Responsibilities

• Design and implement ETL pipelines using AWS services including S3, Glue, Lambda, and Redshift.
• Develop and maintain data models and workflows integrated with Cassandra for high-availability storage.
• Optimize Cassandra configurations and queries for performance and scalability.
• Optimize ETL workflows for performance, reliability, and cost efficiency.
• Troubleshoot ETL-related issues and document architectures and best practices.

Required Skills

• 8+ years of experience in ETL development and data engineering.
• Strong expertise in AWS Cloud services (S3, Glue, Lambda, Redshift).
• Hands-on experience with Cassandra, including data modeling and query optimization.
• Proficiency with ETL tools such as Informatica or Talend.
• Advanced SQL skills for data manipulation and querying.
• Understanding of data warehousing, schema design, and performance optimization.
• Experience with job orchestration and scheduling tools.
• Any Graduate degree.

Preferred Skills

• Programming experience with Python or Scala for ETL scripting.
• Knowledge of CI/CD pipelines and Git version control.
• Familiarity with real-time data processing tools like Kafka or Kinesis.
• AWS certifications such as Data Analytics or Solutions Architect.

Key Skills

Education

Any Graduate