Description
You will design and implement data architectures, warehouses, and lakes to manage large sets of regulated data.
Responsibilities
- Design efficient data structures, database schemas, and distributed systems architecture using Cosmos DB.
- Build reusable frameworks using SQL and Python.
- Implement and manage data pipelines using Azure Data Factory, Databricks, and Azure Storage.
- Integrate data via SOAP, REST, JSON, and APIs while handling streaming data.
- Deploy and manage services including SQL Pools, Azure Functions, and Logic Apps within CI/CD pipelines.
- Collaborate with cross-functional teams in an Agile/Scrum environment to deliver data products.
Required Skills
- 5+ years of experience with BI reporting tools such as Power BI or Tableau.
- 3+ years of experience with SQL and Python focused on framework development.
- 3+ years of experience with distributed systems, Cosmos DB, and regulated data sets.
- 3+ years of experience with integration protocols including SOAP, REST, JSON, and APIs.
- Hands-on experience with Azure Data Factory, Databricks, Azure Storage, and SQL Pools.
- Proven experience planning and implementing data lakes or data warehouses.
- Experience with CI/CD pipeline design and Azure services like Functions and Logic Apps.
- Practical experience working within Agile/Scrum methodologies.
- Bachelor’s degree in Computer Science, Information Technology, Business, or equivalent experience.