Description

You will design and develop scalable ETL workflows to manage and transform complex datasets.

This role is on-site.

Responsibilities

• Design and develop scalable ETL workflows for complex datasets.
• Collaborate with architects, scientists, and analysts to optimize data flows.
• Implement data validation, cleansing, and transformation processes.
• Monitor and troubleshoot ETL jobs to resolve performance issues or inconsistencies.
• Maintain documentation for ETL processes to support data governance and audit requirements.

Required Skills

• 10+ years of experience in data engineering and ETL processes.
• Proficiency with ETL tools including Informatica, Talend, or Apache NiFi.
• Advanced SQL skills for querying, performance tuning, and troubleshooting.
• Strong Python skills for advanced data manipulation.
• Expertise in data modeling and data integration.
• Hands-on experience with Big Data technologies like Hadoop and Spark.
• Deep understanding of data warehousing, including Amazon Redshift, Snowflake, or Google BigQuery.
• Experience with job scheduling and monitoring tools such as Apache Airflow or Control-M.
• Knowledge of data governance, quality frameworks, and security protocols.

Preferred Skills

• Familiarity with cloud-based ETL environments like AWS Glue or Azure Data Factory.

Key Skills

Education

Bachelor's or Master's degrees