Description

You will build and maintain data processing systems using Azure Databricks and big data technologies.

This role is on-site.

Responsibilities

• Design and implement scalable data solutions for high performance.
• Integrate data from various sources, including RDBMS and NoSQL databases.
• Utilize Apache Spark for data processing and tune Spark jobs.
• Implement stream-processing systems using technologies like Spark-Streaming or Storm.
• Manage messaging systems like Kafka or RabbitMQ for data flow.

Required Skills

• 5+ years of experience in data engineering.
• Expertise in Azure Data Engineering, specifically Azure Databricks (ADB).
• Proficiency with distributed data processing using Apache Spark.
• Experience with data integration from RDBMS and NoSQL sources.
• Familiarity with stream processing (Spark-Streaming, Storm).
• Knowledge of messaging systems (Kafka, RabbitMQ).
• Strong skills in Python and Azure services.
• Experience with performance tuning and query optimization.

Preferred Skills

• Bachelor's degree in Computer Science or related field.

Key Skills

Education

Any Graduate