← Back to jobs

DATAECONOMY Logo
Senior Data Engineer

DATAECONOMY

 

Hyderabad, Telangana, India

Posted On: 30+ days ago
Experience: 5+ years
Availability: Onsite
Openings: 1
Category: Senior Data Engineer
Tenure: Full-time Only
Related Jobs

No related jobs found

Description

You will lead the end-to-end development of complex compliance and supervision models for the financial domain.

This role is on-site.

Responsibilities

  • Lead the development of advanced models using AWS services including EMR, Glue, and Glue Notebooks.
  • Design, build, and optimize scalable cloud infrastructure solutions.
  • Create, manage, and optimize ETL pipelines using PySpark for large-scale data processing.
  • Build and maintain CI/CD pipelines for deploying cloud-based applications.
  • Enhance existing frameworks and capabilities to support evolving business needs.

Required Skills

  • 5+ years of experience with Python programming.
  • 5+ years of experience in cloud infrastructure, specifically AWS.
  • 3+ years of experience with PySpark, including EMR or Glue Notebooks.
  • 3+ years of experience with Apache Airflow for workflow orchestration.
  • Proficiency with CI/CD tools such as Jenkins, GitLab CI/CD, or AWS CodePipeline.
  • Deep understanding of capital markets, financial systems, or the financial domain.
  • Experience using notebooks like Jupyter or Glue Notebooks for interactive development.
  • Experience working in agile or hybrid agile environments.

Preferred Skills

  • Any Graduate degree.

Education

Any Gradute

Related Jobs

No related jobs found

← Back to jobs