Description

You will model and structure data for BI and data warehouse initiatives.

This role is hybrid.

Responsibilities

• Design and create data structures optimized for storage and query patterns using Parquet and Delta Lake.
• Analyze and transform data across structured, semi-structured, and unstructured sources to identify linkages between disparate datasets.
• Implement data solutions using Azure modern data platform components including Data Factory, Databricks, Synapse, and Azure Data Lake.
• Manage data lifecycle and adhere to Information Security principles for compliant data handling.
• Collaborate using Agile methodologies (SCRUM, XP, Kanban) within a team environment.

Required Skills

• 6+ years of IT experience with at least 2 years hands-on with Azure modern data platform (Data Factory, Databricks, Synapse, Azure Data Lake).
• Experience in data analysis and transformation using Python, R, or Scala on Azure Databricks or Apache Spark.
• Expertise in creating data models and ETL processes, including experience with Informatica or IBM Datasage.
• Experience with multiple database types: Traditional RDBMS (MS SQL Server, Oracle), MPP (Teradata, Netezza), and NoSQL (MongoDB, Cassandra, CosmosDB).
• Proficiency in working with large and complex code bases using Github and Gitflow.
• Understanding of distributed processing concepts using Databricks or Apache Spark.
• Familiarity with REST API and Django development practices.
• Experience with Kanban methodology.

Preferred Skills

• Experience with Pytest for data quality assurance.

Key Skills

Education

Highschool, Undergraduate, Associate Degree, Bachelors Degree, Masters Degree, PHD