Description

Lead the design and optimization of scalable data platforms and pipelines.

Responsibilities

• Design, develop, and optimize multi-layered data models and pipelines in Snowflake.
• Build and manage scalable data solutions using AWS services including S3, EMR, EC2, Redshift, Athena, Lambda, and Glue.
• Develop end-to-end ETL/ELT pipelines using Apache Airflow, Apache NiFi, or dbt.
• Implement real-time and batch processing solutions using Apache Spark and Kafka.
• Optimize query performance and manage cost efficiency within Snowflake environments.

Required Skills

• Strong experience in Snowflake data modeling, performance tuning, and query optimization.
• Solid understanding of AWS cloud services (S3, EMR, EC2, Redshift, Athena, Lambda, Glue).
• Hands-on experience with Apache Spark and Kafka for big data processing.
• Experience with data orchestration tools such as Apache Airflow, Apache NiFi, or dbt.
• Proficiency in Python and Scala for data engineering tasks.
• Strong expertise in SQL and relational databases including MySQL, PostgreSQL, and SQL Server.
• Experience building scalable ETL/ELT pipelines and real-time data processing systems.

Preferred Skills

• Familiarity with CI/CD tools like Jenkins and infrastructure as code tools such as Terraform.
• Understanding of Azure and Google Cloud platforms.
• Relevant certifications in Snowflake, AWS, or data engineering technologies.

Key Skills

Education

Any Graduate