Description

You will architect and implement data pipelines for a large-scale modernization initiative, owning the full lifecycle from ingestion to BI-ready models.

Responsibilities

• Develop and maintain scalable data pipelines and new API integrations to handle increasing data volume and complexity.
• Design efficient data structures, database schemas, and distributed system architectures, including non-relational databases.
• Define data assets and models, specifying the jobs required to populate them and ensuring long-term platform architecture.
• Implement monitoring processes and systems to ensure data quality and availability for stakeholders.
• Collaborate with engineering and business teams to improve data models for BI tools and handle regulated data.

Required Skills

• 3+ years of experience with SQL and Python, specifically building reusable frameworks.
• 3+ years of experience with integration technologies and protocols including SOAP, REST, JSON, and APIs, including streaming data.
• 3+ years of experience working with large sets of regulated data, distributed systems, and CosmosDB.
• 5+ years of experience with BI reporting tools such as Power BI or Tableau.
• Hands-on experience with Azure Data Factory, Databricks, Azure Storage, SQL Pools, and CI/CD pipeline design.
• Experience with Azure services including Functions and Logic Apps.
• Experience planning and implementing data warehouses, data lakes, or other data repositories.
• Bachelor's degree in Computer Science, Information Technology, Business, or equivalent experience.

Key Skills

Education

Bachelor's degree