Description

You will design and maintain scalable big data pipelines and analytics solutions on AWS.

This role is on-site.

Responsibilities

• Build and optimize data processing pipelines using Spark, Hadoop, and Hive.
• Develop serverless architectures and workflows using Lambda, EventBridge, and Step Functions.
• Implement CI/CD pipelines and manage infrastructure with Terraform and GitLab.
• Perform complex data manipulation, SQL queries, and API integrations.
• Analyze large datasets to extract insights and support visualization efforts.

Required Skills

• 10+ years of Python development experience for big data applications.
• 5+ years of hands-on experience with AWS services (EMR, Lambda, EventBridge, Step Functions, Redshift, S3, Glue).
• Strong proficiency in Spark, Hive, and Hadoop ecosystems.
• Experience with CI/CD tools, specifically GitLab and Terraform.
• Solid understanding of API development and SQL query optimization.
• Bachelor's degree in Computer Science or related field.

Preferred Skills

• Experience with data mining and advanced data analysis techniques.
• Strong analytical and problem-solving skills in matrixed organizations.

Key Skills

Education

Bachelor's degree