Description

You will design, build, and maintain data pipelines and infrastructure for our Analytical Data Warehouse.

Responsibilities

• Develop and maintain Python scripts to automate data ingestion and processing tasks.
• Design database schemas and contribute to the architecture of the data warehouse infrastructure.
• Implement ETL processes to load data into Snowflake and Databricks while ensuring data integrity.
• Write efficient SQL queries to perform data manipulation and optimize database performance.
• Troubleshoot and resolve issues related to data pipelines, ETL processes, and database performance.
• Monitor and optimize pipelines for efficiency and scalability.
• Provide technical guidance to junior team members and participate in Agile ceremonies.

Required Skills

• 12+ years of professional experience in data engineering roles.
• Proficiency in writing and maintaining Python scripts.
• Strong SQL skills for complex data manipulation and query optimization.
• Hands-on experience with Snowflake and Databricks.
• At least 1 year of hands-on experience with Scala.
• Proven experience implementing ETL processes.
• Ability to prioritize tasks and meet deadlines.
• Strong verbal and written communication skills for cross-team collaboration.
• Any Graduate degree.

Preferred Skills

• Knowledge of DevOps practices.
• Experience with Drive automation.

Key Skills

Education

Any Gradute