Description

You will build and maintain data pipelines using big data technologies.

Responsibilities

• Design and implement ETL/ELT processes.
• Develop and manage data workflows using PySpark and related frameworks.
• Automate data processes and scheduling tasks.
• Troubleshoot complex data, networking, and software issues.

Required Skills

• 5+ years of experience as a Big Data Engineer.
• In-depth knowledge of PySpark and Hadoop.
• Proficiency in Python and SQL.
• Experience with AWS Glue and Snowflake.
• Familiarity with ETL/ELT tools.
• Experience with DevOps practices, CI/CD, and automation.
• Ability to solve complex technical issues.

Key Skills

Education

Any Gradute