Description

• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Pentaho Data Integration (PDI).
• Extract, transform, and load data from multiple source systems including databases, APIs, flat files, and cloud applications.
• Develop and optimize data workflows, mappings, transformations, and orchestration processes.
• Collaborate with business analysts, architects, and stakeholders to understand data requirements and implement scalable solutions.
• Monitor, troubleshoot, and enhance data pipelines to ensure performance, reliability, and data quality.
• Perform data validation, reconciliation, and quality assurance checks.
• Support cloud migration and modernization projects involving Azure data services.
• Maintain technical documentation, ETL design specifications, and operational procedures.
• Implement data governance, security, and best practices across data integration processes.
• Participate in production support and issue resolution activities.

Qualifications:

• 4-6 years of experience in Data Engineering and ETL development.
• Hands-on experience with Azure Data Factory (ADF).
• Strong experience in Pentaho Data Integration (PDI/Kettle).
• Proficiency in SQL and database concepts.
• Experience with Azure SQL Database, SQL Server, Oracle, PostgreSQL, or similar databases.
• Knowledge of ETL/ELT design patterns and data warehousing concepts.
• Experience in developing and optimizing complex data transformation workflows.
• Familiarity with Azure ecosystem components and cloud-based data solutions.
• Experience with scheduling, monitoring, and troubleshooting ETL jobs.
• Understanding of data modeling and data quality frameworks.
• Knowledge of Git/version control practices.
• Experience with Azure Data Lake, Synapse Analytics, Databricks, or related Azure services.
• Exposure to Power BI or other reporting and analytics platforms.
• Experience in data migration and legacy modernization projects.
• Knowledge of Python, Shell Scripting, or automation tools.
• Familiarity with Agile delivery methodologies.
• Bachelor's or master’s degree in computer science, Information Technology, Engineering, or a related field.
• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management capabilities.
• Ability to work independently and as part of a collaborative team.
• Strong attention to detail and commitment to delivering high-quality solutions.
• Ability to manage multiple priorities in a fast-paced environment.
• Azure Data Factory (ADF)
• Pentaho Data Integration (PDI/Kettle)
• SQL
• ETL/ELT Development
• Data Warehousing Concepts
• Azure Data Platform Exposure

Key Skills

Education

Bachelor's degree