Description

You will build and maintain scalable data pipelines and ETL processes to support large-scale data analysis in Iselin, NJ.

Responsibilities

• Design and implement scalable data pipelines and ETL processes using Java, Python, and Spark.
• Manage and optimize Spark clusters to ensure high performance and reliability.
• Develop and maintain data models, schemas, and quality validation checks.
• Build and integrate REST API endpoints for data access and consumption.
• Monitor pipeline performance to identify and resolve bottlenecks.

Required Skills

• 5+ years of professional experience in data engineering.
• Expertise in Java and Python for building scalable code.
• Hands-on experience with Spark, including cluster management and performance tuning.
• Proficiency in SQL and working with relational databases or Delta Tables.
• Experience with Snowflake.
• Proven ability to design and develop REST APIs using Flask or Spring.
• Familiarity with Azure cloud-based platforms.
• Strong understanding of data science concepts and data warehousing.

Preferred Skills

• Experience with BigQuery.

Key Skills

Education

Any Graduate