Description

You will develop and maintain data integration solutions across various environments.

Responsibilities

• Design, develop, and maintain ETL/ELT processes to extract, transform, and load data from disparate sources into target data warehouses.
• Collaborate with stakeholders to translate complex data integration needs into technical ETL requirements.
• Implement data pipelines utilizing both cloud platforms (AWS, Azure, Google Cloud) and local tools (Apache NiFi, Talend, Informatica).
• Optimize workflows for performance, scalability, and data integrity through validation and error handling.
• Monitor data jobs, troubleshoot pipeline failures, and perform performance tuning and debugging.

Required Skills

• 7+ years of proven experience in an ETL Developer or similar data integration role.
• Proficiency in SQL and strong experience with relational databases (MySQL, PostgreSQL, SQL Server, Oracle).
• Expertise in Python programming for scripting, automation, and data manipulation.
• Hands-on experience with cloud ETL/ELT tools (AWS Glue, Azure Data Factory, Google Cloud Dataflow) and local tools (Apache NiFi, Talend, Informatica).
• Familiarity with data warehousing concepts and dimensional modeling.
• Proficiency with spatial data concepts, including PostGIS, GeoPandas, and ArcGIS.
• Knowledge of GIS concepts and spatial data formats (shapefiles, GeoJSON).
• Understanding of cloud computing services (storage, compute, networking).

Key Skills

Education

Any Graduate