Description

You will build and manage data pipelines within a Snowflake environment, moving data from Big Data sources to cloud warehouses.

Responsibilities

• Ingest data from Hadoop/IOP to Snowflake using industry best practices.
• Develop Snowpark features and build pipelines using Python.
• Manage Snowflake environments, including role-based access, virtual warehouses, tasks, streams, and Snowpipe.
• Perform performance tuning, query optimization, and monitoring within Snowflake.
• Develop ETL/ELT workflows using PySpark, Hive, Impala, and UNIX shell scripting.
• Maintain technical documentation, including Run Books and Deployment Plans.
• Conduct code reviews and develop reusable frameworks.

Required Skills

• 8+ years of experience in Big Data technologies including Hadoop, Sqoop, PySpark, Hive, Impala, and Kafka.
• 4–6 years of experience with Cloud Databases, Snowflake, and Data Warehousing.
• 2–3 years of hands-on Snowflake platform experience with Snowpipe and Snowpark.
• Expertise in SnowSQL, PL/SQL, and SQL/Python/Java-based procedures in Snowflake.
• Extensive experience with UNIX shell scripting, Oracle SQL, HDFS, and StreamSets.
• Strong ETL/ELT development background in data integration and transformation.
• Experience handling PHI/PII data and adhering to data governance policies.
• Knowledge of AWS platform services.
• Bachelor’s degree in Computer Science, Information Systems, or related field.

Preferred Skills

• Snowflake certification.
• Experience with data masking, SAML, OAuth, or Kerberos.
• Experience with System Disaster Recovery Plans for Snowflake.

Key Skills

Education

Any Gradute