Description

You will own the design, development, and maintenance of data pipelines and ETL solutions.

This role is on-site.

Responsibilities

• Develop and optimize ETL processes using Talend and IBM DataStage.
• Build data ingestion and processing jobs using Python, PySpark, and API integrations.
• Design and implement solutions leveraging Big Data technologies like Spark, Hadoop, Hive, and Kafka.
• Apply data engineering design patterns and best practices across all projects.

Required Skills

• 10+ years of hands-on experience in data engineering or ETL development.
• Expert proficiency in Python, including pandas and PySpark.
• Strong experience with Big Data technologies: Spark, Hadoop, Hive, and Kafka.
• Deep knowledge of SQL and NoSQL databases.
• Hands-on experience with ETL tools, specifically Talend and IBM DataStage.
• Experience with orchestration tools such as Airflow, ControlM, or Talend scheduler.
• Demonstrable expertise in core Data Engineering principles.

Key Skills

Education

Bachelor's degree