Description

You will own the end-to-end lifecycle of data collection, transformation, storage, governance, and consumption.

Responsibilities

• Design and implement virtual warehouses for new and existing use cases.
• Manage external and internal data integration processes.
• Collaborate with software engineers and DevOps to optimize APIs, data models, and microservices.
• Build self-service data access capabilities and smart APIs.
• Drive cost optimization efforts for data and virtual warehouse environments.

Required Skills

• 5+ years of experience developing enterprise data solutions using AWS services.
• Hands-on expertise with EMR, Athena, Scala, Databricks, Snowflake, Spark, RDS, Glue, Redshift, and Apache Airflow.
• Extensive experience with Data Lake, Data Warehouse, and API environments.
• Strong understanding of Kafka fundamentals and Kafka streams for near real-time reporting.
• Experience leading solutions in data engineering, machine learning, and data governance.
• Proven ability to manage regulatory compliance and technical deliverables.
• Ability to communicate technical concepts to both technical and non-technical stakeholders.

Key Skills

Education

Any Graduate