Description

You will build and maintain data processing systems for large-scale data platforms.

This role is on-site.

Responsibilities

• Develop and maintain scalable data processing systems using Azure Databricks and Big Data technologies.
• Lead the design and implementation of distributed data solutions.
• Integrate data from diverse sources, including RDBMS and NoSQL databases.
• Implement stream-processing systems using Apache Storm or Spark-Streaming.
• Conduct performance tuning and optimization of data queries and processes.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python and Spark.
• Experience with Azure Databricks and Azure services.
• Knowledge of distributed data processing using Apache Spark.
• Experience with messaging systems like Kafka or RabbitMQ.
• Familiarity with data integration from RDBMS and NoSQL sources.
• Ability to apply Agile development practices.

Key Skills

Education

Any Graduate