Description

You will own the design and implementation of large-scale data infrastructure, focusing on ETL pipelines and data modeling.

This role is hybrid.

Responsibilities

• Architect and maintain ETL pipelines using Apache Spark, Hadoop, and Hive for high-volume data processing.
• Design efficient data models and optimize SQL queries for performance and scalability.
• Develop and manage data warehousing solutions, primarily leveraging Snowflake and Hadoop ecosystems.
• Build APIs and automate workflows using Java, Scala, or Python, integrating tools like Airflow or Informatica.
• Apply Gen AI techniques to enhance developer proficiency and streamline code generation.

Required Skills

• 8+ years of experience with Big Data technologies, specifically Apache Spark, Hadoop, and Hive.
• Strong proficiency in Snowflake and Hadoop platforms for data warehousing and processing.
• Expert-level SQL skills with deep knowledge of data modeling principles.
• Hands-on programming experience in Java or Scala, including API development.
• Practical experience with ETL tools such as Informatica, Talend, or Apache Airflow.
• Familiarity with cloud platforms, preferably AWS.
• Understanding of SCM, Infrastructure-as-code, and CI/CD pipelines.

Preferred Skills

• Knowledge of Generative AI tools for code generation and developer support.
• Proficiency in Python or other scripting languages for automation.

Key Skills

Education

Any Graduate