Description

Build and maintain batch data pipelines across an advanced analytics platform.

Responsibilities

• Design, develop, and orchestrate scalable ETL/ELT pipelines using Databricks and Snowflake.
• Develop optimal codebases and perform Spark optimizations for Big Data use cases.
• Deploy monitoring and testing strategies to ensure the reliability of data products.
• Translate business requirements into scalable data engineering solutions through stakeholder collaboration.
• Prepare data for model development in partnership with data scientists and visualization developers.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency with Databricks, Snowflake, and DBT.
• Strong Python programming skills.
• Knowledge of AWS environments.
• Experience with SQL.
• Familiarity with GitHub, VS Code, and Linux CLI.
• Experience handling file formats such as CSV and Parquet.
• Any Graduate degree.

Preferred Skills

• AWS Certification.
• Experience with Tableau or Power BI.

Key Skills

Education

Any Graduate