Description

You will design and maintain data pipelines and AWS environments to support business intelligence.

Responsibilities

• Implement and manage AWS tools, environments, and Apache Kafka streams.
• Build and maintain data connections using Python to ingest data from APIs, SQL databases, and S3 into Snowflake.
• Develop datasets in collaboration with internal and external stakeholders to support business decision-making.
• Ensure data consistency, accuracy, and reliability as business requirements evolve.
• Drive and manage projects involving competing priorities and technical requirements.

Required Skills

• 5+ years of experience in data engineering, ETL development, and pipeline construction.
• 3+ years of experience with AWS services including S3, Lambda, Kinesis, Glue, and CloudWatch.
• 3+ years of experience managing Apache Kafka streams.
• Proficiency in Python scripting and SQL.
• Hands-on experience with Snowflake and cloud database systems.
• Experience requesting, transforming, and ingesting data from REST and SOAP APIs.
• Strong understanding of relational databases, dimensional modeling, and data normalization.
• Bachelor's degree in Computer Science, Information Systems, or a related technical field.

Preferred Skills

• Experience with PySpark, DBT, Apache Airflow, or Fivetran.
• Knowledge of Docker, Kubernetes, Terraform, or Azure data products.
• Experience with MPP technologies, Tableau, Sigma, Salesforce, or SAP data.

Key Skills

Education

Bachelor's degree in Computer Science