← Back to jobs

Arthur Lawrence Logo
Big Data Engineer

Arthur Lawrence

 

New York, NY, USA

Posted On: 1 day ago
Experience: 4+ years
Availability: Onsite
Openings: 1
Category: Big Data engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will build and maintain data pipelines and governance frameworks using AWS-based solutions.

This role is on-site.

Responsibilities

  • Manage data ingestion and governance processes.
  • Develop and optimize data processing workflows using PySpark and Snowpark.
  • Build and maintain CI/CD pipelines for data infrastructure.
  • Implement and manage AWS-based data solutions and storage.

Required Skills

  • 4+ years of experience as a Big Data Engineer.
  • Proficiency with AWS services including S3, Glue, Athena, and EMR.
  • Experience with Redshift and SnowSQL.
  • Hands-on expertise with PySpark and Snowpark.
  • Experience with Hadoop ecosystems.
  • Working knowledge of CI/CD pipelines.
  • Bachelor's degree in a relevant field.

Education

Bachelor's degree

Related Jobs

No related jobs found

← Back to jobs