Description

Own the end-to-end management of big data programs, focusing on ETL pipelines, data modeling, and platform stability across Hadoop and Snowflake ecosystems.

Responsibilities

• Design and maintain scalable ETL workflows using Hadoop, Spark, and Hive for large-scale data processing.
• Manage Snowflake platform operations, ensuring efficient data warehousing and query performance.
• Develop and optimize SQL queries and data models to support business intelligence and analytics needs.
• Build and maintain API services using Java or Scala, integrating data flows with external systems.
• Implement CI/CD pipelines and Infrastructure-as-Code practices to automate deployment and improve developer proficiency.

Required Skills

• 5+ years of experience with big data technologies, specifically Hadoop, Spark, and Hive.
• Deep proficiency with the Snowflake platform and cloud data warehousing concepts.
• Strong SQL skills with a solid understanding of data modeling principles.
• Programming experience in Java or Scala, including API development.
• Hands-on experience with ETL tools such as Informatica, Talend, or Apache Airflow.
• Familiarity with cloud platforms, preferably AWS.
• Knowledge of SCM, Infrastructure-as-Code, and CI/CD pipeline management.
• Excellent problem-solving and communication skills.

Preferred Skills

• Experience using Gen AI tools to generate code and improve developer productivity.
• Proficiency in Python or other scripting languages.

Key Skills

Education

Any Graduate