Description

Design and optimize large-scale data processing systems, pipelines, and architectures to handle petabyte-scale workloads.

This role is hybrid.

Responsibilities

• Design scalable, secure data pipelines, data warehouses, and data lakes capable of processing massive data volumes.
• Evaluate and implement big data technologies and cloud platforms to ensure performance and cost-efficiency.
• Ensure data quality, integrity, and security across the entire data lifecycle.
• Collaborate with cross-functional teams to gather requirements and deliver robust data solutions.
• Provide technical leadership and guidance to junior team members.

Required Skills

• 6+ years of experience with big data technologies including Hadoop, Spark, and Kafka.
• Proficiency in programming languages such as Java, Scala, or Python.
• Strong knowledge of data modeling, ETL processes, Medallion architecture, and data warehousing concepts.
• Hands-on experience with cloud platforms like AWS, Azure, or Google Cloud.
• Familiarity with database technologies including NoSQL and SQL.
• Bachelor's degree in Computer Science or related field.

Preferred Skills

• Relevant certifications in big data or cloud technologies.
• Experience optimizing existing data architectures for performance.

Key Skills

Education

Bachelor's degree