Description

You will design and implement backend data processing workflows and automate complex pipelines to support data ingestion and analysis.

Responsibilities

• Design and implement backend data processing workflows using AWS Glue, AWS Crawler, and AWS Athena.
• Write efficient, maintainable code in Python, R, and SQL for data transformation and analysis.
• Orchestrate and automate complex data pipelines using Azure Data Factory.
• Leverage Databricks for big data processing using Medallion Architecture.
• Translate business requirements into technical solutions through cross-functional collaboration.

Required Skills

• 5+ years of professional experience.
• Proficiency in Python, R, and SQL.
• Hands-on experience with AWS services including Glue, Crawler, and Athena.
• Experience with Azure Data Factory and Azure environments.
• Knowledge of Data Warehousing principles.
• Experience with Databricks and Medallion Architecture.
• Bachelor's degree or equivalent graduate qualification.

Key Skills

Education

Any Gradute