Description
You will design and maintain large-scale data pipelines and lead technical deliveries for vulnerability data management projects.
This role is on-site.
Responsibilities
- Architect and optimize big data processing systems using Hadoop, Cloudera, Hive, and Spark.
- Develop modular Python applications and complex SQL queries for data engineering workflows.
- Manage CI/CD pipelines and code versioning via Bitbucket.
- Guide junior engineers through project completion and resolve technical challenges with business partners.
- Apply SDLC principles to ensure robust delivery of data solutions in the cyber security domain.
Required Skills
- 10+ years of hands-on experience in data engineering or software development.
- Deep expertise with Hadoop ecosystem components including Hive, Spark, and HBase.
- Proficient in Python (modular programming), SQL, and UNIX shell scripting.
- Experience with cloud services (AWS, Azure) and big data platforms like Cloudera.
- Strong understanding of CI/CD pipelines and code versioning tools.
- Proven track record in technology leadership and mentoring junior staff.
- Experience in the cyber security domain, specifically vulnerability data management.