← Back to jobs

CareerNet Technologies Pvt Ltd Logo
Azure Data Engineer

CareerNet Technologies Pvt Ltd

 

Bangalore, Karnataka, India

Posted On: Just posted
Experience: 5+ years
Availability: Remote
Openings: 2
Category: Azure Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Build and optimize scalable data pipelines on the Azure platform.

This role is remote.

Responsibilities

  • Design and implement large-scale data pipelines using PySpark and Azure Databricks.
  • Develop and maintain Azure Data Factory (ADF) workflows for seamless data integration.
  • Create and manage Databricks notebooks in Python for complex data processing tasks.
  • Optimize data storage and processing efficiency within Azure Data Lake architecture.
  • Ensure data quality and integrity through rigorous testing, validation, and performance monitoring.

Required Skills

  • 5+ years of hands-on experience with PySpark for big data processing.
  • Proven expertise in Azure Databricks for engineering and transformation workflows.
  • Strong experience building and managing pipelines with Azure Data Factory (ADF).
  • Advanced SQL skills for querying and performance tuning.
  • Deep understanding of Azure Data Lake storage architecture and optimization techniques.
  • Experience handling both structured and unstructured data sources.
  • Knowledge of data quality frameworks and validation methodologies.

Preferred Skills

  • Experience troubleshooting and optimizing pipeline performance and reliability.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs