Description

You will build and maintain large-scale data pipelines and infrastructure.

This role is on-site.

Responsibilities

• Develop ETL processes using PySpark and Spark SQL/Streaming.
• Design and implement data storage solutions on AWS, specifically DynamoDB and Snowflake.
• Automate infrastructure provisioning using Terraform.
• Build and maintain REST APIs for data access.

Required Skills

• 5+ years of experience in Data Engineering.
• Expertise in Databricks and PySpark.
• Proficiency with Spark SQL and Spark Streaming.
• Hands-on experience with AWS Lambda and DynamoDB.
• Experience working with Snowflake.
• Proficiency in Terraform.
• Experience developing and consuming REST APIs.
• Familiarity with CI/CD practices.

Preferred Skills

• Any Graduate education.

Key Skills

Education

Any Graduate