← Back to jobs

Thoughtwave Software and Solutions Logo
Sr. Data Engineer
Posted On: Just posted
Experience: 5+ years
Availability: Onsite
Openings: 2
Category: Sr. Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will build and maintain a scalable data platform supporting the Operational Risk team's trading desk demands.

This role is on-site.

Responsibilities

  • Design, implement, and maintain scalable data architectures and data models, including schema design.
  • Build and orchestrate ETL data pipelines using AWS services.
  • Develop and manage APIs to support data workflows.
  • Write, maintain, and execute automated unit tests using Python.

Required Skills

  • 5+ years of professional engineering experience.
  • Strong proficiency in Python programming and SQL.
  • Extensive experience with AWS services: Lambda, Glue ETL, S3, ECS, RDS PostgreSQL, DynamoDB, and Athena.
  • Expertise in big data technologies, specifically Spark and developing distributed applications using PySpark.
  • Strong understanding of ETL processes and data warehousing concepts.
  • Experience with data manipulation libraries such as Pandas and Polars.
  • Familiarity with data visualization tools like Tableau.
  • Knowledge of both relational and NoSQL databases.

Preferred Skills

  • Experience with Presto and Hive.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs