Description
Key Skills: Python, Spark, PySpark, Databricks, ETL, Data Engineering, Git, CI/CD, Software Engineering, Data Validation
Good to Have Skills: Experience with distributed data platforms, schema management, transformation logic, unit testing, integration testing, monitoring, logging, alerting, operational support processes, code reviews, clean code principles, and troubleshooting production issues.
Roles & Responsibilities:
- Build multiple high-performance, stable, scalable systems that have been successfully shipped to customers in production.
- Drive best practices and set standards for the engineering team.
- Serve as a key influencer in the team's strategy and contribute significantly to team planning.
- Make good judgment trade-offs between immediate and long-term business needs.
- Drive innovation and produce delightful experiences for customers as a result-driven creative thinker.
- Advocate for data-driven decision-making with insatiable curiosity to invent and innovate solutions.
- Take ownership of work and consistently deliver results in a fast-paced environment.
- Make other engineers and team members more productive by sharing knowledge and helping with technical decisions.
- Play a leading role in designing and developing major functional changes to existing software systems.
- Troubleshoot production issues by reviewing source code, logs, operational metrics, and stack traces.
- Provide guidance on design, coding, and operational best practices to the team.
- Propose and create best practices proactively where none exist in the organization.
- Make high-impact decisions driving how and what software gets built for the platform.
- Mentor junior engineers, overseeing their designs, code quality, and integration into the team.
Experience Required: 3-5 years of experience in software engineering or data engineering
Education: Bachelor's degree in Computer Science, Engineering, or related field