Description

You will build and maintain data pipelines for large-scale data processing.

Responsibilities

• Develop data processing jobs using Scala or Java with Spark.
• Design and implement data models for structured and unstructured datasets.
• Manage and optimize data workflows using big data tools.
• Analyze data to identify business opportunities and resolve data gaps.

Required Skills

• 5+ years of professional experience in data engineering.
• Minimum 2-5+ years of development experience in Scala or Java.
• 2+ years of experience with SQL and NoSQL databases.
• 1+ years of extensive experience with the Spark Processing engine.
• 1+ years experience with Big Data tools/technologies/Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka).
• 1+ years experience with Data Modeling.
• Experience working with cloud or on-prem Big Data platforms (Netteza, TeraData, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar).
• Proficiency in Scala, Java, Spark, SQL, NoSQL.

Key Skills

Education

Any Graduate