Description

You own the data engineering scope and delivery from design through implementation.

Responsibilities

• Obtain tasks from the project lead and prepare functional and design specifications for stakeholder approval.
• Lead functional and architectural design for assigned areas, ensuring decisions meet project requirements.
• Provide estimations and agree on task duration with management, contributing to the project plan.
• Address area-level risks and implement mitigation plans, resolving crisis situations within your Area of Responsibility.
• Initiate and conduct code reviews, establishing code standards and conventions.

Required Skills

• 6-8 years of professional experience as a Data Engineer.
• Strong experience with Apache Spark, including workload optimization techniques.
• Strong experience with Spark Structured Streaming.
• Strong experience with Spark SQL and query performance optimization.
• Experience with Terraform and Databricks Asset Bundles.
• Ability to work independently, prioritize effectively, and proactively identify improvements.
• Comfort operating in loosely defined scopes, driving priorities when execution is expected.
• Excellent communication skills when working with technical and non-technical teams.
• Able to pass HackerRank code tests.

Preferred Skills

• Experience with application development and Deatrick Apps.
• Comfort working in Linux environments.

Key Skills

Education

Any Gradute