Description

You will design, develop, and maintain scalable data pipelines, ETL/ELT processes, and data architectures on Azure. You will build APIs, backend services, and interactive dashboards while ensuring data quality and security.

This role is on-site.

Responsibilities

• Design and manage scalable data architectures using Azure Data Services, including Data Factory, Synapse, and Data Lake.
• Build and maintain data pipelines and ETL/ELT processes for structured and unstructured data.
• Develop RESTful APIs and backend services to support data applications and microservices.
• Create interactive dashboards and visualization solutions using BI tools like Power BI or Tableau.
• Optimize data workflows for performance, scalability, and integrity across distributed systems.

Required Skills

• 5 to 8 years of experience in data engineering and full stack development.
• Strong proficiency in Python, SQL, and at least one other language (Java/Scala preferred).
• Hands-on experience with Apache Spark, Hadoop, or similar data processing frameworks.
• Experience building RESTful APIs and working with microservices architecture.
• Knowledge of data modeling, ETL/ELT processes, and data warehousing concepts.
• Familiarity with BI tools such as Power BI or Tableau.
• Experience with version control tools like Git.

Preferred Skills

• Experience with real-time data processing (Kafka, Spark Streaming).
• Experience with containerization tools like Docker and Kubernetes.
• Knowledge of CI/CD pipelines and DevOps practices.

Key Skills

Education

Bachelor's degree