Description

Lead the design, modernization, and migration of enterprise data platforms from on-prem Cloudera to Azure cloud-based data lake architectures.

Responsibilities

• Lead migration of on-prem Cloudera Hadoop to Azure, designing scalable data lake architectures using Databricks, Snowflake, and Synapse.
• Install, configure, and manage Cloudera clusters, ensuring high availability, performance, and security of HDFS, YARN, Hive, and Spark.
• Tune Hadoop, Hive, and Spark jobs for optimal resource utilization and resolve Linux, network, and cluster health issues.
• Implement enterprise security using Kerberos, Ranger, Atlas, HashiCorp Vault, and CyberArk for governance and access control.
• Develop automation scripts using Shell, Python, and Ansible to support CI/CD pipelines and platform operations.

Required Skills

• 10+ years of experience with Cloudera Data Platform (CDP), Hadoop, HDFS, YARN, Hive, and Spark.
• Strong hands-on experience with Microsoft Azure, specifically Azure Databricks, Snowflake, and Azure Synapse.
• Proven track record of cloud migration strategies and large-scale data lake design.
• Proficiency in Linux system administration, networking, and troubleshooting.
• Experience with security and governance tools: Kerberos, Apache Ranger, Apache Atlas.
• Hands-on experience with secrets management (HashiCorp Vault) and privileged access management (CyberArk).
• Automation skills using Shell, Python, and Ansible.
• Excellent communication and stakeholder collaboration skills.

Preferred Skills

• Azure certifications (Data Engineer or Solutions Architect).
• Experience with CI/CD tools for data platforms.

Key Skills

Education

Any Graduate