Description

You will design and implement end-to-end cloud environments and large-scale data processing pipelines.

This role is remote.

Responsibilities

• Design, develop, and optimize data processing pipelines using Databricks and Spark.
• Translate business requirements into scalable and reliable technical architectures.
• Oversee cloud migrations and end-to-end environment setups on Azure or AWS.
• Lead onsite and offshore teams through the full project lifecycle from planning to delivery.
• Manage stakeholder expectations and coordinate deliverables across multiple time zones.

Required Skills

• 5+ years of hands-on experience with Databricks, PySpark, and Apache Spark.
• Proven track record in cloud migration and environment setup using Azure or AWS.
• Expertise in Databricks platform architecture, performance tuning, and security best practices.
• Experience with CI/CD implementation, monitoring, and infrastructure.
• Background in cloud-native tools and services.
• Ability to manage technical delivery and project closure.
• Any Graduate degree.

Key Skills

Education

Any Graduate