You will architect and manage data solutions leveraging Snowflake in a cloud environment.
Responsibilities
Guide migration from on-prem Cloudera to Azure cloud environment, designing scalable data lake solutions using Snowflake and Databricks.
Develop and optimize data pipelines for ingestion, transformation, and storage, while managing data governance, quality, and security.
Implement performance tuning, automation, and CI/CD practices for data workflows.
Migrate Hadoop, Hive, and Spark data and applications to Azure services like Azure Synapse Analytics, Azure Databricks, or Snowflake, ensuring data integrity.
Required Skills
5+ years of experience in data architecture and cloud migration.
Expertise with Snowflake and Databricks.
Strong proficiency in CI/CD implementation for data workflows.
Hands-on experience managing and tuning Hadoop, Hive, and Spark jobs.
Scripting ability using Shell, Ansible, and Python for automation.
Experience implementing data security using Kerberos, Apache Ranger, and HashiCorp Vault.
Familiarity with Azure Databricks.
Ability to troubleshoot Linux servers, network issues, and cluster bottlenecks.