Description

Big Data Engineer in Malvern, PA.

Responsibilities

• Build and maintain data pipelines using Python and PySpark.
• Manage data storage and querying on AWS S3, Athena, and Redshift.
• Implement Big Data solutions for scalable data engineering tasks.

Required Skills

• 5+ years of experience as a Data Engineer.
• Strong proficiency in Python.
• Hands-on experience with PySpark.
• Deep knowledge of AWS services, specifically S3, Athena, and Redshift.
• Proven track record in Big Data engineering.

Preferred Skills

• Experience with Apache Iceberg.
• Experience with Dremio.
• Experience with AWS SageMaker.

Key Skills

Education

Any Gradute