Description

You will build and maintain data pipelines to process large volumes of structured and unstructured data.

This role is on-site.

Responsibilities

• Develop and maintain data pipelines for ingestion, processing, and transformation.
• Design and implement data models to ensure optimal storage, retrieval, quality, and integrity.
• Build scalable data applications and optimize ETL processes using Python.
• Deploy and manage data solutions using AWS services.
• Monitor and troubleshoot pipeline issues to ensure data availability and reliability.

Required Skills

• 5+ years of experience in data engineering and pipeline maintenance.
• Proficiency in Python for scripting, programming, and data manipulation.
• Hands-on experience with AWS services including S3, Glue, Redshift, and Lambda.
• Strong SQL skills and experience with relational and NoSQL databases.
• Experience with version control systems such as Git.
• Knowledge of ETL processes and continuous integration/deployment.
• Practical understanding of data modeling concepts and best practices.
• Ability to implement data security, privacy, and compliance standards.

Preferred Skills

• Experience collaborating with data scientists and analysts to support infrastructure needs.

Key Skills

Education

Any Graduate