Description

Senior Data Engineer based in Bengaluru.

Responsibilities

• Build and maintain scalable data pipelines using Apache Spark and Hadoop.
• Develop and optimize data models within Snowflake and Databricks environments.
• Implement streaming solutions using Kafka for real-time data processing.
• Deploy and manage data infrastructure on AWS and Azure cloud platforms.
• Collaborate with distributed teams to deliver robust data warehousing solutions.

Required Skills

• 8+ years of professional experience in data engineering.
• Proficiency in Python for data manipulation and pipeline scripting.
• Hands-on experience with Apache Spark and Hadoop ecosystems.
• Demonstrated expertise in Snowflake and Databricks.
• Strong understanding of AWS and Azure data services.
• Experience with message queues and streaming platforms like Kafka.
• Solid grasp of data warehousing concepts and technologies.
• Ability to work independently in a geographically distributed team.

Key Skills

Education

Any Gradute