Description

You will lead the design, build, and execution of data lake ingestion and business transformation processes.

This role is remote.

Responsibilities

• Own end-to-end ETL and BI delivery, including work item allocation and team monitoring.
• Design high-level and low-level ETL mapping documentation and source-to-target mappings.
• Execute schema and historical data migrations, including initial configuration and setup.
• Document AS-IS and TO-BE system architectures and data flows.
• Coordinate with solution architects to resolve technical issues and facilitate complex design discussions.

Required Skills

• 5+ years of experience in data analysis or engineering roles.
• Proficiency in Python, Java, or Scala.
• Hands-on experience with Spark and PySpark.
• Advanced SQL skills for Hive, Spark, Postgres, or BigQuery.
• Expertise in ETL development and building data pipelines.
• Strong Unix/shell scripting skills.
• Direct experience with Azure cloud computing platforms.
• Experience in architecture design and implementation for cloud-based applications.

Preferred Skills

• Ability to review ETL/BI code and technical deliverables.

Key Skills

Education

Any Gradute