Description

Design and deliver an enterprise-scale big-data ecosystem while evolving the data technology stack.

Responsibilities

• Define and document data mesh architecture and developmental recommendations.
• Maintain the framework, cookbook, and bootstrap code for data infrastructure-as-a-platform.
• Develop architectural strategies and plans for onboarding data products.
• Ensure non-functional requirements like security, performance, scalability, and compliance are designed and documented.
• Conduct independent POC projects to evaluate and prototype emerging cloud data technologies.

Required Skills

• 10+ years of experience developing data and services in enterprise or cloud environments.
• Deep understanding of data warehouse, data lake architecture, and data management processes.
• Hands-on expertise with cloud storage and services including Snowflake, Azure SQL, ADLS2, Azure Cosmos DB, MongoDB, CockroachDB, DataStax, or Redis.
• Experience with ETL and analytics tools such as Talend, NiFi, dbt, Databricks, or ADF.
• Knowledge of data virtualization tools like Tibco DV, Denodo, Starburst, or Dremio.
• Proficiency in Java or Python.
• Ability to write scripts for Linux shell and Windows PowerShell.

Preferred Skills

• Experience with DevOps, DataOps, or MLOps using ADO.
• Knowledge of IaC and automation tools such as Terraform or Ansible.

Key Skills

Education

Bachelor's degree in Computer Science