Description

You build and maintain the optimal data platform and pipeline architecture.

Responsibilities

• Assemble large, complex data sets meeting functional and non-functional business requirements.
• Identify, design, and implement internal process improvements, automating manual tasks and optimizing data delivery.
• Build infrastructure for optimal extraction, transformation, and loading of data from diverse sources using SQL and GCP big data technologies.
• Support data-related technical issues and infrastructure needs for Executive, Product, Data, and Design teams.
• Create data tools for analytics team members to optimize product functionality.

Required Skills

• 3 to 6 years of experience in a Data Engineer role.
• Advanced working knowledge of SQL and No-SQL databases.
• Experience building and optimizing big data data pipelines, architectures, and datasets.
• Strong analytic skills related to working with unstructured datasets.
• Experience with big data tools: Hadoop, Spark, Kafka.
• Experience with GCP cloud services: GCS, Dataproc, Dataplex.
• Working knowledge of message queuing and stream processing systems.
• Proficiency in object-oriented scripting languages: Python, Scala.
• Experience with workflow management tools like Airflow.

Key Skills

Education

Any Graduate