← Back to jobs

E-Solutions Logo
Data Platform Engineer

E-Solutions

 

Brazil

Posted On: 30+ days ago
Experience: 5+ years
Availability: Remote
Openings: 1
Category: Data Platform Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

You will architect and maintain production-grade Python applications and data pipelines for enterprise-scale systems.

This role is remote.

Responsibilities

  • Design and implement cloud-native data solutions using AWS services including Lambda, Glue, Step Functions, S3, EventBridge, SQS/SNS, and Kinesis.
  • Build scalable ETL/ELT pipelines using Python frameworks such as Apache Airflow, Prefect, or AWS Step Functions for orchestration.
  • Develop and maintain RESTful APIs using FastAPI or Flask for data services, microservices, and system integrations.
  • Implement Infrastructure as Code using CloudFormation, CDK, or Terraform for reproducible and version-controlled deployments.
  • Apply comprehensive testing strategies including unit testing, integration testing, and data validation frameworks like pytest and Great Expectations.

Required Skills

  • 5+ years of software development experience with 4+ years of production Python development.
  • Expert-level Python skills including OOP, design patterns, async programming, and building maintainable code at enterprise scale.
  • 3+ years of hands-on AWS experience with data-focused services (Lambda, Glue, Step Functions, S3, Kinesis, EMR).
  • Strong experience with SQL and database technologies for data pipeline development and optimization.
  • Proficiency with Python data frameworks such as Pandas, NumPy, SQLAlchemy, and PySpark for data transformation and analysis.
  • Experience with containerization (Docker) and container orchestration (ECS, Kubernetes) for deploying Python services.
  • Knowledge of DataOps practices, CI/CD for data pipelines, automated testing, and monitoring.
  • Experience with Git, CI/CD pipelines, and collaborative development workflows.
  • Familiarity with Agile, Scrum, and Jira methodologies.

Preferred Skills

  • Experience with Snowflake, SQL Server, or other data warehouse platforms for pipeline target systems.
  • Financial Services and mortgage industry experience, particularly with regulatory reporting and risk management data requirements.

Education

Any Gradute

Related Jobs

No related jobs found

← Back to jobs