Description

You will build and maintain data processing pipelines using Python and AWS services.

Responsibilities

• Develop ETL workflows leveraging PySpark and AWS Glue Jobs.
• Automate infrastructure provisioning and configuration using Terraform.
• Manage and maintain CI/CD pipelines using Git Actions.
• Design and implement serverless solutions using AWS Lambda and Step Functions.
• Apply R for data analysis, specifically topic modeling.

Required Skills

• 8+ years of professional experience in software development.
• Expert proficiency in Python.
• Strong experience with PySpark for large-scale data processing.
• Hands-on experience with Terraform for IaC.
• Familiarity with AWS services: Airflow, DynamoDB, Step Functions, Glue Jobs, Lambda.
• Proficiency in Git Actions for CI/CD orchestration.
• Experience using R, particularly for Topic Modeling.

Key Skills

Education

Any Graduate