Description

You will design and architect modern data solutions, migrating legacy ingestion and ETL/ELT processes to cloud platforms.

Responsibilities

• Provide technical leadership to modernize legacy data ingestion, ETL/ELT, and databases to cloud technologies.
• Implement data access, classification, and security patterns adhering to regulatory standards.
• Design and map ETL/ELT pipelines for new or modified data streams into cloud storage.
• Automate, validate, and maintain ETL/ELT processes using tools like Databricks, ADF, SSIS, Spark, Python, and Scala.
• Conduct unit, system, and integration testing for all ETL/ELT solutions and create detailed process documentation.

Required Skills

• 4+ years designing and implementing data warehouse and analytics solutions (on-premise and cloud).
• 3+ years of expertise in data warehousing concepts (ETL/ELT, data quality, security) using ADF, Data Factory, and SSIS.
• 3+ years working with cloud data and cloud-native data lakes/warehouses.
• Proficiency with Microsoft Azure services, including Fabric Lakehouse, ADF, Data Factory, and Synapse.
• 2+ years experience in Python, Scala, or Java for distributed processing (e.g., Spark).
• Familiarity with CI/CD practices and tools such as Azure DevOps, Git, or Jenkins.
• Experience integrating data from multiple sources into cloud-based architectures.

Key Skills

Education

Any Gradute