Description

What's the Job?

• Design, develop, and optimize scalable cloud data pipelines and platforms.
• Support large-scale cloud migration initiatives, primarily AWS to GCP.
• Collaborate with cross-functional teams to deliver data solutions that meet business needs.
• Troubleshoot and resolve performance issues in data workflows and pipelines.
• Implement infrastructure automation using Terraform and support CI/CD pipelines.

What's Needed?

• Hands-on experience with Databricks, Spark, and SQL for data engineering tasks.
• Proficiency in cloud platforms, especially GCP and AWS, with cloud migration experience.
• Strong programming skills in Python, Spark, and SQL.
• Experience with Airflow orchestration and infrastructure automation using Terraform.
• Knowledge of DevOps practices, CI/CD pipelines, and deployment automation

Key Skills

Education

Any Graduate