Description

You will architect and manage cloud data solutions, leading the migration from on-premises Cloudera to Azure.

This role is on-site.

Responsibilities

• Design scalable data lake solutions using Snowflake and Databricks.
• Develop and optimize data pipelines for ingestion, transformation, and storage.
• Implement performance tuning, automation, and CI/CD practices for data workflows.
• Migrate Hadoop, Hive, and Spark workloads to Azure Synapse Analytics or Azure Databricks.
• Manage data governance, quality, and security standards.

Required Skills

• 5+ years of experience in data architecture and cloud migration.
• Expertise with Snowflake and Databricks.
• Strong proficiency in CI/CD implementation for data workflows.
• Hands-on experience managing and tuning Hadoop, Hive, and Spark jobs.
• Scripting ability using Shell, Ansible, and Python for automation.
• Experience implementing data security using Kerberos, Apache Ranger, and HashiCorp Vault.
• Familiarity with Azure Databricks.
• Ability to troubleshoot Linux servers, network issues, and cluster bottlenecks.

Preferred Skills

• Experience migrating large-scale on-premises clusters to Azure services.

Key Skills

Education

Any Gradute