Description

You will build and maintain scalable data pipelines for financial analytics and AI initiatives. This role is on-site.

Responsibilities

• Design and maintain data pipelines using Python, Spark, and SQL for large-scale financial datasets.
• Manage data ingestion and storage within Hadoop and Cloudera environments.
• Optimize Spark jobs and SQL queries for performance and low latency.
• Deploy and manage data engineering solutions on AWS and GCP.
• Implement data quality checks and provide production support for pipeline stability.

Required Skills

• Strong proficiency in Python and SQL.
• Hands-on experience with Apache Spark and the Hadoop ecosystem (HDFS, Hive).
• Knowledge of cloud platforms, specifically AWS and GCP.
• Experience with Cloudera and data management tools.
• Understanding of software engineering principles and problem-solving.
• Bachelor’s degree in Computer Science, Engineering, IT, or related field.
• 10+ years of relevant experience.

Preferred Skills

• Experience with BigQuery and workflow orchestration like Apache Airflow.
• Familiarity with containerization (Docker, Kubernetes) and CI/CD tools.
• Interest in financial services and capital markets.

Key Skills

Education

Any Graduate