Description

Design, build, test, deploy, and support batch and streaming data pipelines.

Integrate data from databases, files, APIs, event streams, and cloud platforms.

Develop scalable transformations and curated datasets using SQL, Spark, and cloud data services.

Collaborate with product owners, analysts, and business partners to translate requirements into technical solutions.

Implement data-quality checks, monitoring, alerting, security controls, and performance optimizations.

Participate in Agile ceremonies, provide delivery updates, and contribute to end-to-end feature ownership.

Use approved AI-assisted engineering tools in day-to-day development to accelerate coding, testing, documentation, troubleshooting, and process improvement, while validating outputs for accuracy, security, privacy, and maintainability.

Identify and implement practical AI-enabled automation opportunities that improve data-engineering productivity, quality, and delivery speed.

Troubleshoot production issues and improve pipeline reliability, maintainability, and cost efficiency.

Document data flows, technical designs, dependencies, and operational procedures

Key Skills

Education

Bachelor's degree