Description

You will design, implement, and manage ETL processes to ensure data consistency, quality, and availability across systems.

Responsibilities

• Design and develop scalable ETL workflows to manage and transform complex datasets.
• Collaborate with architects, scientists, and analysts to optimize data flows and meet requirements.
• Implement data validation, cleansing, and transformation processes to maintain integrity.
• Monitor and troubleshoot ETL jobs to resolve performance issues or inconsistencies.
• Maintain documentation for ETL processes and data flows to support governance and audit needs.

Required Skills

• 6-10 years of experience with end-to-end ETL processes, data modeling, and data integration.
• Proficiency with ETL tools including Informatica, Talend, or Apache NiFi.
• Advanced SQL skills for querying, performance tuning, and troubleshooting large datasets.
• Experience with Python for advanced data manipulation.
• Hands-on experience with Big Data technologies such as Hadoop and Spark.
• Strong knowledge of data warehousing concepts.
• Experience with job scheduling and monitoring tools like Apache Airflow or Control-M.
• Understanding of data governance, quality frameworks, and security protocols.

Preferred Skills

• Familiarity with cloud-based ETL environments like AWS Glue or Azure Data Factory.
• Experience with Amazon Redshift, Snowflake, or Google BigQuery.

Key Skills

Education

Any Graduate