Description

You will design and manage data solutions using Azure Databricks and Spark. You own the release pipeline, code quality, and offshore team workflows.

Responsibilities

• Design and implement ETL processes and data pipelines using Azure Databricks and Spark.
• Conduct design and code reviews to ensure quality and adherence to best practices.
• Perform requirement reviews and provide accurate work effort estimations.
• Manage offshore team workflows and oversee their code quality.
• Write technical documentation following application development standards.

Required Skills

• 3+ years of experience with Azure Databricks, Spark, and Python.
• Strong proficiency in SQL and MS SQL Server.
• Experience with relational databases and ETL concepts.
• Knowledge of unit testing and end-to-end testing methodologies.
• Bachelor's degree.
• Ability to work onsite in Branchville, NJ.
• Strong written and oral communication skills for stakeholder management.

Preferred Skills

• Experience with Azure Data Factory (ADF) platforms and frameworks.
• Familiarity with XML and JSON file formats.
• Experience in Agile environments using JIRA.

Key Skills

Education

Bachelor's degree