Description
Design, build, and maintain scalable data pipelines to support growth monetization initiatives. You will own the development of ETL/ELT workflows, complex SQL queries, and monitoring frameworks for data integrity.
This role is hybrid.
Responsibilities
- Design and optimize scalable data pipelines for large-scale structured and unstructured datasets.
- Write complex SQL queries to analyze A/B experiment results and support business insights.
- Develop and enhance ETL/ELT workflows using Big Data technologies like Hadoop, Hive, and Spark.
- Build automated monitoring, alerting, and validation frameworks to ensure pipeline health and data quality.
- Partner with Data Science, Product, and Engineering teams to deliver actionable data solutions.
Required Skills
- 5+ years of experience in data engineering.
- Strong SQL expertise with the ability to write and optimize complex queries on large datasets.
- Hands-on experience with distributed processing frameworks such as Hadoop, Hive, and Spark.
- Proficiency in building and optimizing scalable data pipelines in cloud and enterprise environments.
- Experience with ETL orchestration and workflow management tools.
- Knowledge of data quality, pipeline monitoring, and performance tuning.
- Bachelor's degree in Computer Science or related field.
Preferred Skills
- Experience collaborating with non-technical stakeholders in a fast-paced environment.
- Familiarity with data science workflows and A/B testing methodologies.