← Back to jobs

Select Jarvis LLC Logo
Lead Data Engineer

Select Jarvis LLC

 

Chicago, IL, USA

Posted On: 30+ days ago
Experience: 10+ years
Availability: Onsite
Openings: 1
Category: Lead Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will lead the design and implementation of large-scale data solutions.

This role is on-site.

Responsibilities

  • Develop architecture blueprints for batch, real-time, and micro-batch design patterns.
  • Design and implement scalable data solutions utilizing AWS services.
  • Optimize data pipelines and manage large-scale data processing using Databricks.
  • Enforce data governance policies to maintain data quality and compliance.

Required Skills

  • 10+ years of experience leading data engineering teams and architects in complex big data environments.
  • 7+ years of experience implementing scalable data solutions using AWS services (MWAA, Lambda, RDS, ECS, EKS).
  • 6+ years of proficiency in Databricks, including PySpark, Unity Catalog, and SQL Warehouse.
  • 5+ years of proficiency in Snowflake for query optimization, schema design, and security.
  • Expertise in developing architecture blueprints for various data patterns.
  • Deep knowledge of FinOps best practices across AWS, Databricks, and Snowflake.
  • Skilled in deployment patterns and CI/CD tools such as CDK, CloudFormation, and Terraform.
  • Familiarity with AppSecOps tools and practices.

Preferred Skills

  • Experience with Tableau for data visualization.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs