Description

You will build and document automated data pipelines designed for scale and high volume.

Responsibilities

• Build automated data pipelines from diverse sources with an emphasis on scale.
• Handle large streaming datasets and perform data pattern identification using AWS Kinesis.
• Develop highly available applications and REST APIs to support near-real-time integrations.
• Implement full-scale data solutions using AWS EventBridge, SQS, SNS, and Confluent Kafka.
• Contribute to architecture and design patterns for storing and processing high data volumes using S3, DynamoDB, and RDS.

Required Skills

• 3+ years of experience in a data engineering role.
• 2+ years of experience with AWS services including EC2, S3, SNS, Lambda, and IAM.
• Proficiency with Python and ANSI SQL.
• Experience with APIs and RESTful design.
• Hands-on experience with RDBMS platforms such as MS SQL Server, MySQL, or Postgres.
• Experience working with NoSQL databases.
• Experience with Snowflake.
• Bachelor's degree in Computer Science, Informatics, or a related field.

Preferred Skills

• Hands-on experience with ETL tools and techniques.

Key Skills

Education

Bachelors degree in Computer Science, Informatics