Description

You will build and maintain data pipelines to consolidate, cleanse, and structure complex datasets for analytical use.

Responsibilities

• Build and maintain data pipelines to gather, integrate, and structure data from multiple sources.
• Develop data quality models, tracking processes, and automated checks to troubleshoot anomalies.
• Design and implement moderately complex data models and optimize them for performance.
• Implement security best practices across all data pipelines and infrastructure.
• Mentor junior engineers through code reviews and guidance on dataset implementations.

Required Skills

• 5+ years of experience in a data engineering or related role.
• Proficiency in Python and SQL.
• Intermediate experience with scripting languages.
• Intermediate experience with Google Cloud Platform (GCP) and cloud computing concepts.
• Experience building and troubleshooting moderately complex data pipelines.
• Advanced Git usage and CI/CD integration skills.
• Experience designing and implementing data models.
• BS degree in a STEM major or equivalent discipline; Master's degree preferred.

Preferred Skills

• Experience with Google BigQuery, BigTable, Google DataFlow, Scala, Spark, or PySpark.
• Knowledge of data formats such as JSON, AVRO, or PARQUET.
• Experience with Entity Resolution concepts or commercial credit data products.

Key Skills

Education

Any Graduate