Description

You will build and manage scalable data integration pipelines and acquisition strategies within AWS environments.

Responsibilities

• Develop data acquisition strategies to ensure data quality, integrity, and security.
• Design and implement data cleansing and transformation processes to align vendor data with internal standards.
• Build and optimize data integration pipelines using internal tools and SDKs for scalability and performance.
• Manage agents for monitoring, logging, and automation within AWS.
• Integrate with the internal Archival Service Platform for data purging and lifecycle management.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency with AWS services including S3, Athena, and Glue.
• Experience using Amazon SNS for notification and communication workflows.
• Hands-on experience with SDKs for data integration and processing.
• Ability to establish connections with external vendors to meet data requirements.
• Experience implementing monitoring and logging automation.

Preferred Skills

• Degree in any field of study.

Key Skills

Education

Any Graduate