Description

You will build and maintain complex data integration pipelines and processing frameworks.

Responsibilities

• Design and implement generic, reusable, and dynamic Talend ETL processes.
• Develop data processing frameworks using Scala or Python.
• Load various data warehouses and data marts using Talend ETL technologies.
• Troubleshoot issues and implement logging and error handling at both job and project levels.
• Optimize Talend job performance and implement parallel execution.
• Collaborate with stakeholders to define and execute data integration requirements.

Required Skills

• 8-12 years of industry experience in application development.
• Hands-on experience with Talend Data Integration and API usage for data fetching and file loading.
• Proficiency with Apache Spark, Hive, and Oracle.
• Experience with Apache Kafka for real-time data streaming.
• Expertise in writing complex SQL and working with PL/SQL (packages, procedures, functions, triggers, views, partitions).
• Strong knowledge of Data Modelling and Warehousing (Star Schema, Snowflake Schema, OLAP, OLTP, Fact and Dimension tables).
• Experience handling structured files including JSON, XML, Excel, and CSV.
• Experience extracting data from Oracle and DB2 databases.
• Proficiency with Unix commands for file operations.
• Bachelor of Computer Science or any graduate degree.

Preferred Skills

• Knowledge of batch scheduling and JIL creation using Autosys.
• Experience with Git, Bitbucket, and Confluence.
• Knowledge of Java and Big Data concepts.

Key Skills

Education

Any Graduate