Description

Build transformation and load processes using Kafka streamed data into Snowflake databases.

This role is on-site.

Responsibilities

• Build ETL processes to ingest Kafka streamed data into Snowflake.
• Analyze SQL design requirements and define metadata for source file ingestion.
• Create source-to-target mapping lineage, transformation rules, and data definitions.
• Design and implement transformation rules within the existing framework.
• Coordinate data integration, quality, integrity, and consolidation efforts.

Required Skills

• 4+ years of experience in metadata modeling, data transformation, and data profiling.
• 4+ years of experience in data quality, integrity, and data consolidation.
• 4+ years working with Snowflake, Oracle, MS SQL, SparkSQL, Hive, or Impala.
• 3+ years designing and optimizing data transformation processes.
• 3+ years of experience with SDLC and Agile methodologies.
• 3+ years working with technical teams, stakeholders, and architects.
• 2+ years of project management and documentation using GitHub, Jira, and Confluence.
• Proficiency in Python, Spark, Databricks, and Azure.
• Strong SQL and Big Data expertise with CI/CD pipeline experience.

Key Skills

Education

Any Graduate