Description

You will design and implement scalable data processing solutions using Azure Databricks.

Responsibilities

• Build ETL processes to move data between RDBMS like Oracle, Databricks, and NoSQL databases.
• Optimize data pipelines and workflows for performance and scalability.
• Maintain data quality and integrity throughout transformation and load processes.
• Develop and maintain data architecture and best practices.
• Set up performance monitoring and alerting for pipelines and data integrity.
• Troubleshoot and resolve data-related issues.

Required Skills

• 10+ years of professional experience.
• Proficiency in Python.
• Experience with PySpark or Scala.
• Hands-on work with Databricks.
• Experience with Oracle RDBMS.
• Knowledge of NoSQL databases.
• Ability to collaborate with data scientists and analysts to meet data requirements.
• Degree in any graduate field.

Key Skills

Education

Any Graduate