Description

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and data warehouse solutions using Snowflake, AWS, and Python.
• Develop and optimize complex SQL queries for high-performance data processing and reporting.
• Create and manage Snowflake Streams, Tasks, Views, and Stored Procedures.
• Build robust ELT/ETL pipelines to ingest, transform, and process large-scale datasets.
• Work extensively with different file formats including:
  • CSV
  • JSON
  • Parquet
• Implement data ingestion and transformation frameworks for structured and semi-structured data.
• Participate in GCP migration initiatives, including data migration, validation, and optimization.
• Collaborate with cross-functional teams to gather requirements and deliver scalable data solutions.
• Utilize GitHub for version control, code reviews, and CI/CD integration.
• Monitor data quality, performance, and security across cloud environments.
• Troubleshoot and resolve data pipeline and Snowflake performance issues.

Mandatory Technical Skills

Snowflake

• Strong hands-on experience with:
  • Snowflake Streams
  • Snowflake Tasks
  • Snowflake Views
  • Snowflake Stored Procedures
  • Snowflake Performance Optimization
  • Data Modeling and ELT Development

Cloud & Data Engineering

• Strong experience with AWS services (S3, Glue, Lambda, IAM, etc.).
• Hands-on experience with GCP and data migration projects.
• Expertise in building cloud-native data solutions.

Programming & Database

• Strong proficiency in Python.
• Strong experience in SQL query writing, tuning, and optimization.
• Experience with ETL/ELT frameworks and orchestration tools.

Data Formats

• Extensive experience handling and processing:
  • CSV files
  • JSON files
  • Parquet files
  • Semi-structured and structured data

Version Control

• GitHub (Mandatory)

Good to Have

• Power BI experience for data visualization and business analytics.
• Exposure to ServiceNow.
• Knowledge of CI/CD and DevOps practices.
• Experience with Agile/Scrum delivery methodologies.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• Snowflake, AWS, or GCP certifications will be an added advantage.

Preferred Candidate Profile

• 6-9 years of Data Engineering experience.
• Strong problem-solving and analytical skills.
• Experience working with large-scale cloud data platforms.
• Excellent communication and stakeholder management skills.
• Ability to work independently in a fast-paced environment

Key Skills

Education

Bachelor's or Master's degrees