Description

You will design, develop, and optimize ETL processes to support data engineering requirements.

Responsibilities

• Design and develop scalable ETL processes and data workflows.
• Optimize data pipelines to ensure integrity and efficiency.
• Set up and manage JupyterHub environments.
• Collaborate with cross-functional teams to deliver data solutions.

Required Skills

• 8 to 10 years of experience in data engineering and ETL development.
• Strong expertise in Hadoop, PySpark, Spark, and Dask.
• Proven experience managing JupyterHub environments.
• Bachelor's degree in Computer Science.

Preferred Skills

• Familiarity with cloud platforms for big data deployment.
• Experience with data visualization tools like Tableau or Power BI.

Key Skills

Education

Bachelor's degree in Computer Science