Description

You will model and structure data for BI/DW initiatives.

Responsibilities

• Design and create data structures optimized for storage and query patterns, utilizing formats like Parquet and Delta Lake.
• Analyze and transform data across structured, semi-structured, and unstructured sources, identifying linkages between disparate datasets.
• Implement data solutions using Azure modern data platform components, including Data Factory, Databricks, Synapse (Azure SQL DW), and Azure Data Lake.
• Manage data lifecycle while adhering to Information Security principles for compliant data handling.
• Collaborate using Agile methodologies (SCRUM, XP, Kanban) within a team environment.

Required Skills

• 6+ years of IT experience, with at least 2 years hands-on with Azure modern data platform (Data Factory, Databricks, Synapse, Azure Data Lake).
• Meaningful experience in data analysis and transformation using Python, R, or Scala on Azure Databricks or Apache Spark.
• Expertise in creating data models and ETL processes, including experience with traditional tools like Informatica or IBM Datasage.
• Experience with multiple database types: Traditional RDMS (MS SQL Server, Oracle), MPP (Teradata, Netezza), and NoSQL (MongoDB, Cassandra, CosmosDB).
• Proficiency in working with large and complex code bases using Github and Gitflow.
• Understanding of distributed processing concepts using Databricks or Apache Spark.
• Familiarity with REST API and Django development practices.
• Experience with Kanban methodology.

Key Skills

Education

Highschool, Undergraduate, Associate Degree, Bachelors Degree, Masters Degree, PHD