Description

You will lead the development of real-time data pipelines and centralized reporting systems to provide visibility into B2B and B2C sales.

Responsibilities

• Build and maintain real-time Kafka pipelines using Spark Connector and Schema Registry.
• Develop centralized reporting systems and Power BI reports to support retail operations.
• Execute data analytics and ad-hoc querying using distributed query engines like Trino or Presto.
• Implement serverless architectures and data processing workflows on AWS.
• Collaborate with cross-functional teams to optimize processes and eliminate data bottlenecks.

Required Skills

• 8+ years of experience in data engineering roles.
• Hands-on experience with Kafka, Spark Connector, and Schema Registry.
• Proficiency with AWS, specifically implementing serverless architectures via AWS Lambda.
• Strong SQL skills and experience with both relational and NoSQL databases.
• Experience with distributed query engines such as Trino or Presto.
• Solid understanding of data warehousing concepts and data processing techniques.
• Expertise in data analytics and Power BI report generation.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Experience with containerization using Docker and orchestration via Kubernetes.
• Familiarity with Agile development methodologies.

Key Skills

Education

Bachelor's or Master's degrees