Description

You will own the architecture, development, and maintenance of big data solutions and data analysis processes.

Responsibilities

• Build and maintain data pipelines and processing workflows.
• Automate data management processes to improve efficiency and simplify operations.
• Define data security levels and maintain data integrity across systems.
• Support Data Scientists and the wider team with data collection and analysis.
• Monitor data management systems to ensure reliability and security.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency in Python, Java, Scala, and Ruby.
• Strong SQL skills with experience in relational databases (MySQL, PostgreSQL).
• Experience with non-relational databases (MongoDB, Cassandra).
• Hands-on experience with big data technologies including Hadoop, Spark, and Kafka.
• Knowledge of data modeling and designing scalable batch and streaming architectures.
• Experience with cloud computing platforms.
• Proficiency in DevOps tools: Docker, Kubernetes, CI/CD, and Git.
• Understanding of data security practices and GDPR governance regulations.

Preferred Skills

• Experience with data preparation frameworks and libraries.

Key Skills

Education

Any Graduate