Description

You will build and migrate complex ETL pipelines to support elastic data systems, owning the full project lifecycle from analysis to release.

Responsibilities

• Extract and combine data from various heterogeneous sources.
• Build and migrate complex ETL pipelines to S3, Redshift, or EMR.
• Manipulate, process, and extract value from large datasets using PySpark and Spectrum.
• Design and implement data models for warehousing platforms including Redshift, Athena, and Aurora.

Required Skills

• 5+ years of hands-on experience with AWS services including S3, Glue ETL, Glue Catalog, Athena, and EMR.
• Proficiency with PySpark and Spectrum for large-scale data processing.
• 2-3 years of experience with Hadoop Ecosystem components such as HDFS, Hive, Spark, Sqoop, MapReduce, and YARN.
• Strong experience with ETL tools like Talend and Amazon Glue.
• Deep SQL coding experience.
• Hands-on experience with Python functional programming.
• Experience with databases including MS SQL Server, Oracle, and MySQL.
• Proven ability in data modeling and data warehousing.

Preferred Skills

• Experience working with Life Sciences or Pharma data.

Key Skills

Education

Any Graduate