Description

You will design and maintain AWS data pipelines and environments to support business intelligence and decision-making.

Responsibilities

• Implement and manage AWS services including S3, Lambda, Kinesis, Glue, and CloudWatch.
• Manage Apache Kafka streams for real-time data processing.
• Build data connections using Python to ingest data from APIs, SQL databases, and S3 into Snowflake.
• Develop datasets in collaboration with stakeholders to ensure data consistency and accuracy.
• Drive projects with competing priorities and evolving technical requirements.

Required Skills

• 5+ years of experience in data engineering, ETL development, and pipeline construction.
• 3+ years of experience with AWS services (S3, Lambda, Kinesis, Glue, CloudWatch).
• 3+ years of experience managing Apache Kafka streams.
• Proficiency in Python scripting and SQL.
• Hands-on experience with Snowflake and cloud database systems.
• Experience ingesting data from REST and SOAP APIs.
• Strong understanding of relational databases, dimensional modeling, and data normalization.
• Bachelor's degree in Computer Science, Information Systems, or a related technical field.

Preferred Skills

• Experience with PySpark, DBT, Apache Airflow, or Fivetran.
• Knowledge of Docker, Kubernetes, Terraform, or Azure data products.
• Experience with MPP technologies, Tableau, Sigma, Salesforce, or SAP data.

Key Skills

Education

Bachelor's degree in Computer Science