Description

You will design, develop, and maintain cloud-based data pipelines and solutions to drive analytics and business intelligence capabilities.

Responsibilities

• Provide technical leadership in modernizing legacy data ingestion, ETL/ELT, and databases to cloud technologies (AWS/Azure).
• Implement data access, classification, and security patterns compliant with regulatory standards (PII, locational data, etc.).
• Design and map ETL/ELT pipelines for new or modified data streams, integrating into on-prem or cloud storage.
• Automate, validate, and maintain ETL/ELT processes using Databricks, ADF, SSIS, Spark, Python, and Scala.
• Monitor and optimize the performance of data pipelines and databases.

Required Skills

• 4+ years designing and implementing data warehouse and analytics solutions (on-prem and cloud).
• 3+ years expertise in data warehousing concepts (ETL/ELT, data quality, security, MDM) using ADF, Data Factory, and SSIS.
• 3+ years experience with cloud data and cloud-native data lakes/warehouses.
• Proficiency with Microsoft Azure services (Fabric Lakehouse, ADF, Data Factory, Synapse).
• 2+ years experience in Python, Scala, or Java for distributed processing (Spark).
• Familiarity with CI/CD practices and tools like Azure DevOps or Git.

Key Skills

Education

Any Graduate