Description

You will build and maintain large-scale data processing systems and analytical warehouses.

Responsibilities

• Develop modular, maintainable code for big data processing tasks.
• Design and implement dimensional models within analytical warehouses.
• Manage ETL workflows using orchestration tools.
• Analyze complex datasets using notebook-based environments.
• Make technical decisions regarding data architecture and processing logic.

Required Skills

• 7+ years of industry experience in big data systems and SQL databases.
• 3+ years of experience using Spark SQL, Spark DataFrames, and PySpark.
• Strong proficiency in Python and SQL.
• Experience with Hive and Snowflake.
• Knowledge of ETL workflow management tools like Airflow.
• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.

Preferred Skills

• Experience with version control and CI/CD tools including Git and Jenkins.
• Proficiency with notebook solutions such as Jupyter, EMR Notebooks, or Apache Zeppelin.

Key Skills

Education

Bachelor’s degree in computer science