Description

Design and implement data architectures across multi-cloud environments. Own the full lifecycle of data pipelines and warehousing solutions.

Responsibilities

• Design and manage data pipelines using Azure Data Factory and Databricks.
• Optimize data warehouse performance within Snowflake and other SQL-based systems.
• Develop ETL processes using Matillion, Qlik, or DataStage.
• Implement large-scale data processing using Spark SQL and Spark Streaming.
• Tune and optimize data workflows for performance and efficiency.

Required Skills

• 5+ years of experience in data architecture or engineering.
• Hands-on experience with Azure, specifically Azure Data Factory and Databricks.
• Proficiency in PySpark, Spark SQL, and Spark Streaming.
• Strong expertise in SQL and Snowflake.
• Practical experience with Hadoop ecosystems.
• Working knowledge of AWS and GCP cloud environments.
• Strong Python programming skills.
• Experience with ETL tools like Matillion, Qlik, or DataStage.
• Degree in any graduate field.

Preferred Skills

• Experience with Java, Elasticsearch, or Cassandra.

Key Skills

Education

Any Graduate