Description

You will build and maintain large-scale data processing pipelines.

Responsibilities

• Develop and implement data engineering solutions using Python and PySpark.
• Manage and optimize data workflows within Databricks environments.
• Containerize applications using Docker and orchestrate deployments.
• Implement automated testing strategies across data systems.

Required Skills

• 7+ years of Data/Software Engineering experience.
• 5+ years hands-on development experience in Python and PySpark for large-scale data processing.
• 4+ years experience with Containers (Docker and orchestration, e.g., Kubernetes or EKS or Redhat).
• 4+ years experience with test automation.
• 5+ years experience working with SQL & NoSql databases.
• Experience with version control systems, such as Git.
• Experience in a complex enterprise application delivery using Agile methodology.
• Proficiency in Cloud environments.

Preferred Skills

• Java Spring Boot
• Kafka
• Cassandra

Key Skills

Education

Any Graduate