Description
You will design and implement enterprise data architectures that align with business strategy and modernization goals.
Responsibilities
- Define the organizational data strategy and formulate plans to address data-driven challenges.
- Lead the implementation and integration of data solutions by working with IT teams and vendors.
- Build and implement data ingestion and curation processes using cloud-native tools.
- Develop near real-time data processes and handle ETL transformations on streaming data.
- Create reusable, metadata-driven frameworks for complex transformations, data quality, and profiling.
- Optimize performance for Azure SQL Synapse dedicated/serverless pools and Cosmos DB APIs.
Required Skills
- 5+ years of experience in data architecture and strategy.
- Hands-on expertise with Spark (Scala and Python) and Spark streaming.
- Proficiency in Azure SQL Synapse, Cosmos DB, Data Factory, and Event Hub.
- Extensive experience with Databricks, Delta Lake, and Azure Cosmos Search.
- Strong SQL skills for data analysis, anomaly detection, and quality assurance.
- Experience with NoSQL databases and Cosmos SQL API optimization for API consumption.
- Proven ability to lead data modernization from legacy platforms to the cloud.
- Knowledge of data governance, privacy regulations, and data security.
- Competency in Python, R, or similar data analysis tools.
Preferred Skills
- Experience executing automation across data management functions.
- Experience building data consumption layers for digital API, predictive, and prescriptive needs.