Description

You will design and implement data solutions using PySpark and Azure technologies. You own the full lifecycle from technical design through coding, testing, and debugging.

Responsibilities

• Design, develop, and implement data pipelines using PySpark and Azure Databricks.
• Create technical design documents and perform program coding and testing.
• Resolve technical issues through debugging, research, and investigation.
• Support the implementation and maintenance of Data Lake and Data Warehouse architectures.

Required Skills

• 5+ years of experience in computer programming or software development.
• 3+ years of experience with Python and Azure Databricks.
• 3+ years of experience in the design, implementation, and support of Data Lakes.
• Proficiency with PySpark and Structured Streaming.
• Experience using Azure Data Factory and general Azure services.
• Strong knowledge of SQL.
• Experience with UNIX environments.
• 3+ years of solid Java experience.

Education

• Bachelor’s degree in Computer Science, Information Technology, or a related field.

Key Skills

Education

Bachelor’s Degree