Description

You will design and build data pipelines and infrastructure for large-scale analytics.

This role is on-site.

Responsibilities

• Develop and optimize data processing workflows using Python and PySpark.
• Manage and query large datasets within Redshift or Snowflake data warehouses.
• Implement and maintain distributed computing solutions using Spark and Hadoop.
• Handle streaming data ingestion using Kafka.

Required Skills

• 6+ years of professional experience.
• Bachelor's degree in a relevant field.
• 4+ years using Python, PySpark, and SQL.
• 4+ years experience with data warehousing (Redshift or Snowflake).
• 4+ years experience on AWS.
• 2+ years experience with distributed computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark).
• 2+ years experience with NoSQL databases.
• 2+ years experience with Databricks.

Key Skills

Education

Bachelor's degree