Description

You own the data engineering scope and delivery from design through implementation.

This role is on-site.

Responsibilities

• Prepare functional and design specifications for stakeholder approval.
• Lead functional and architectural design for assigned areas, ensuring decisions meet project requirements.
• Provide estimations, agree on task duration, and contribute to the project plan.
• Address area-level risks, implement mitigation plans, and resolve crisis situations.
• Initiate and conduct code reviews, establishing code standards and conventions.

Required Skills

• 6-8 years of professional experience as a Data Engineer.
• Strong experience with Apache Spark, including workload optimization techniques.
• Strong experience with Spark Structured Streaming.
• Strong experience with Spark SQL and query performance optimization.
• Experience with Terraform and Databricks Asset Bundles.
• Ability to work independently, prioritize effectively, and proactively identify improvements.
• Comfort operating in loosely defined scopes, driving priorities when execution is expected.
• Excellent communication skills when working with technical and non-technical teams.
• Able to pass HackerRank code tests.

Preferred Skills

• Experience with application development and Deatrick Apps.
• Comfort working in Linux environments.

Key Skills

Education

Any Gradute