Data Engineer Job - San Jose, CA, USA (JPS Tech Solutions)Description
- Design, build, optimize, and maintain scalable data pipelines that support ****'s Growth Monetization initiatives.
- Write complex SQL queries to analyze A/B experiment results
- Develop and enhance ETL/ELT workflows for large-scale structured and unstructured datasets.
- Optimize pipeline performance, reliability, scalability, and data quality across distributed systems.
- Work with Big Data technologies and best practices to process high-volume datasets efficiently.
- Build automated monitoring, alerting, and validation frameworks for pipeline health and data integrity.
- Partner with Data Science, Product, Marketing, and Engineering teams to deliver actionable insights and scalable data solutions.
Skills:
- Strong SQL expertise with the ability to write and optimize complex queries on large datasets.
- Hands-on experience with Big Data technologies such as Hadoop, Hive, Spark, or similar distributed processing frameworks.
- Experience building and optimizing scalable data pipelines in cloud and enterprise environments.
- Proficiency in ETL orchestration and workflow management tools.
- Experience with data quality, pipeline monitoring, and performance tuning.
- Ability to collaborate effectively with technical and non-technical stakeholders in a fast-paced environment
Education
Bachelor's degree