Description
You will develop and manage data pipelines using AWS Databricks.
Responsibilities
- Design and build data pipelines on AWS Cloud Platform, utilizing Spark-based processing.
- Develop AI solutions and data pipelines within an AWS cloud environment.
- Implement data engineering techniques and testing methodologies for data projects.
- Apply design skills within Agile data development projects.
Required Skills
- 5+ years of experience in a data software engineering role.
- 3+ years of hands-on experience with Databricks on AWS.
- 2+ years experience building AWS cloud-based data pipelines and AI solutions.
- 2+ years hands-on experience with Python and PySpark.
- Experience with Data Software Engineering and Cloud Platform technologies.
- Familiarity with DevOps delivery models.
- Proficiency in Agile methodologies.
Preferred Skills
- Databricks certification.
- Experience in a quality and compliance environment.