Description

Lead the delivery and management of large-scale data solutions across warehousing, big data, and cloud platforms.

Responsibilities

• Build and maintain efficient, large-scale big data pipelines using distributed technologies.
• Implement SCD techniques including Type 1, Type 2, and Type 3 dimensions.
• Transform and integrate complex datasets from various sources into Snowflake and Redshift.
• Manage continuous data ingestion using Snowpipe and handle bulk loading/unloading processes.
• Write complex SQL scripts utilizing statistical aggregate and analytical functions to support ETL workflows.

Required Skills

• 12+ years of experience delivering data solutions on Big Data and Cloud Data Platforms.
• Proficiency in Spark, Python, or Scala.
• Hands-on experience with Spark and Kafka for distributed data processing.
• Expertise in Snowflake Cloud Architecture, SnowSQL, and Snowpipe.
• Experience managing data within AWS S3 and Snowflake cloud data warehouses.
• Ability to handle complex file formats including JSON, ORC, Parquet, and CSV.
• Strong software engineering background.
• Bachelor's degree.

Key Skills

Education

Bachelor's degree