Description

You will build and maintain data pipelines for large-scale data processing.

Responsibilities

• Develop ETL processes using PySpark and Spark SQL/Streaming.
• Design and implement data storage solutions on AWS (DynamoDB, Snowflake).
• Automate infrastructure provisioning using Terraform.
• Build and maintain REST APIs for data access.

Required Skills

• 5+ years of experience in Data Engineering.
• Expertise in Databricks and PySpark.
• Proficiency with Spark SQL and Spark Streaming.
• Hands-on experience with AWS Lambda and DynamoDB.
• Experience working with Snowflake.
• Familiarity with CI/CD practices.
• Proficiency in Terraform.
• Experience developing and consuming REST APIs.

Key Skills

Education

Any Graduate