Description

You will design and maintain complex data pipelines and ETL/ELT processes across Azure and AWS environments.

Responsibilities

• Design and document data pipelines using AWS services (EMR, Step Functions, SNS, Event Scheduler) and Azure services (ADF, Databricks, Synapse, Logic Apps).
• Build and automate cloud deployments using Infrastructure as Code and CI/CD pipelines via Azure DevOps and AWS CodePipeline.
• Develop, debug, and modify Python, PySpark, and SSIS packages to meet business requirements.
• Extract and transform data from diverse sources including RDBMS, S3, ADLS Gen2, and Parquet files.
• Design web-based solutions using ReactJS, Redux, and NodeJS.

Required Skills

• 8+ years of ETL experience with star and snowflake schema design.
• 4+ years of data ingestion and transformation experience using AWS (EMR, Step Functions, SNS, Python) and SQL Server SSIS.
• 2+ years of experience with Azure Data platforms (ADF, Synapse, Databricks, Event Hub, Service Bus, Logic App, ADLS Gen2).
• 2+ years of experience with Snowflake platform.
• 2+ years of experience with object-oriented programming and web technologies including React.JS, Node.JS, HTML, and JavaScript.
• Proficiency in Python, PySpark, and complex SQL querying.
• Experience with AWS CodeCommit and AWS CodePipeline.
• Strong understanding of data security practices and change management processes.
• Proficiency in HTML, CSS, JavaScript/jQuery, and local storage.

Preferred Skills

• Experience working with Guidewire applications.
• Power BI report and dashboard development experience.

Key Skills

Education

ANY GRADUATE