Description

You will build and manage the data infrastructure required to integrate information across diverse systems.

Responsibilities

• Design and implement end-to-end data pipelines.
• Develop ETL processes for batch and stream workflows.
• Maintain data quality and implement security measures.
• Optimize pipeline performance and collaborate with data teams.

Required Skills

• 5+ years of experience in data integration and management.
• Proficiency with Databricks and Kafka.
• Experience with ETL tools and workflow orchestration including Streamsets and Prefect.
• Hands-on experience with Docker and Kubernetes for containerization and orchestration.
• Working knowledge of Google Cloud and Microsoft Azure services.
• Strong SQL skills with experience in MySQL and PostgreSQL.
• Experience with NoSQL databases including MongoDB and Cassandra.
• Bachelor of Computer Science or equivalent degree.

Key Skills

Education

Any Graduate