Description
You will design, build, and maintain data pipelines for ingestion and analytical purposes.
Responsibilities
- Build and maintain systems to prevent data quality issues in production.
- Develop monitoring tools for data quality and processing performance across the data value chain.
- Create analytics tools to provide insights into operational efficiency and business metrics.
- Support stakeholders with technical data issues and infrastructure needs.
- Provide feedback to the platform team to optimize queries and system performance.
Required Skills
- 2+ years of experience in a data engineering or related role.
- Bachelor's degree in Computer Science or a quantitative field.
- Proficiency in Python and SQL.
- Experience building and maintaining data pipelines and transforming data for usability.
- Experience supporting the design and implementation of basic data models.
- Proficient Git usage for contributing to team repositories.
- Foundational understanding of Google Cloud Platform and cloud computing concepts.
- Experience with NoSQL databases.
Preferred Skills
- Experience with big data tools including Hadoop, Spark, and Kafka.
- Experience with relational SQL and NoSQL databases such as Postgres and Cassandra.
- Experience with workflow management tools like Airflow or GCP Dataflow.