Description

Build and scale big data applications on distributed platforms, owning the architecture of data products, CI/CD pipelines, and warehousing standards.

This role is on-site.

Responsibilities

• Architect data products using streaming, serverless, and microservices patterns.
• Configure Jenkins pipelines for CI/CD processes involving Managed Spark jobs and Docker images.
• Implement data warehousing, modeling, governance, and architecture standards.
• Partner with product and engineering teams to solve complex problems and communicate technical solutions.

Required Skills

• 5+ years developing scalable Big Data applications on distributed platforms.
• 4+ years with Spark, Python, and Scala.
• 3+ years with AWS services: S3, Managed Airflow, EMR, EC2, and IAM.
• 3+ years with Databricks (Data Engineering, Delta Lake, Lakehouse Medallion architecture).
• Experience with data warehousing tools: SQL databases, Presto, and Snowflake.
• Experience building Docker images and managing CI/CD via Jenkins.
• Working knowledge of reporting tools like Tableau and QuickSight.
• Experience working within Agile and Scrum processes.

Preferred Skills

• Ability to quickly learn new programming languages, technologies, and frameworks.

Key Skills

Education

Any Gradute