Description

You will design and implement data pipelines using Python and SQL.

Responsibilities

• Develop and maintain ETL processes for data ingestion and transformation.
• Query and manipulate large datasets using SQL.
• Build and optimize data solutions within the Big Data ecosystem.
• Script data operations using Unix shell scripting.

Required Skills

• 4+ years of experience in Information Technology.
• 3+ years of project experience with Python and SQL.
• Solid understanding of ETL concepts.
• Experience with PySpark and Spark.
• Familiarity with Hadoop.
• Experience with Cloud Platforms, specifically AWS or Azure.
• Proficiency in Scala is beneficial.
• Experience with Snowflake is required.
• Bachelor's degree from an accredited institution.

Key Skills

Education

Bachelor's degree