Description

You will design, develop, and maintain scalable data pipelines for extracting, transforming, and loading data from various sources into data warehouses and data lakes.

Responsibilities

• Build and manage relational and non-relational databases, ensuring data integrity, security, and performance across all systems.
• Integrate data from multiple internal and external sources, ensuring consistency and quality across all platforms and systems.
• Automate data processing tasks and workflows to improve efficiency and reduce manual intervention in daily operations.
• Monitor data pipelines and systems for performance issues, troubleshoot problems, and implement effective solutions promptly.
• Proactively identify hidden problems and patterns in data and use insights to drive improvements to coding hygiene and system architecture.

Required Skills

• 5+ years of applied experience in software engineering concepts.
• Proficiency in Python, Java, and Scala for application development.
• Strong SQL skills with experience in MySQL and PostgreSQL.
• Hands-on experience with AWS and ETL processes.
• Practical experience with Databricks for data processing.
• Knowledge of Data Warehousing principles and architecture.
• Experience with system design, application development, testing, and operational stability.

Preferred Skills

• Master's degree or relevant certifications such as AWS Certified Data Analytics.
• Experience with data governance, data quality, and data security practices.

Key Skills

Education

Any Graduate