Description

Job Description

What you will be doing

The Enterprise Data Engineer will be a member of the Global Cybersecurity Data Acquisition and Engineering team responsible for all aspects of data acquisition and onboarding to the cyber data lake and analytics platform. The team partners with IT Infrastructure teams in end-to-end deployment of security technologies across the firm and delivers normalised security data feeds to the Databricks cyber analytics platform.

The role involves the design and implementation of data ingestion patterns and pipelines to make feeds available for security analytics. It requires sustainable, reliable and performant solutions to be implemented on a repeatable basis.

The role requires an experienced systems engineer with strong technical leadership and collaboration skills. The ideal candidate will have significant experience in data pipeline and analytics technologies, Linux system administration and cloud infrastructure eg. Databricks, Data Factory, NiFi, Kafka, RHEL/Ubuntu, Azure Function Apps, Azure platform services etc.

Responsibilities will include But not limited to

• Engineering leadership and support for existing and future data analytics technology Databricks, Data Factory, NiFi, Kafka, Fluentd etc.
• Leading the continued technical enhancement of security platforms
• Supporting the identification, development and implementation of new detections and analytics use cases
• Leading the continued evolution of automation and orchestration across the platform
• Training and developing other members of the cyber analytics team as well as other members of the engineering function
• Supporting a culture of individual self-improvement whereby staff are expected to maintain subject matter expertise within their area of focus and within the realm of cybersecurity more broadly, for example remaining up to date on the tooling for strategically important platforms
• Taking a leading role in the engagement of Global Businesses and Functions driving global uplift in cybersecurity awareness
• Collaborating with various layers of management across Cybersecurity and other IT teams to develop solutions that protect the organisation
• Designing and driving the implementation of new service offerings, capability uplifts and process improvements to protect the bank for a continuously changing threat landscape

What you will bring to the role

To be successful in this role you should have proven experience within the technology sector with knowledge of the following skills

• Experience with cloud-based data pipelines, preferably Azure data transport and data cleaning
• Automation and optimisation of data engineering pipelines
• Deployment of real-time analytics for large datasets and application of data engineering in cybersecurity
• Expertise in one of more key areas of Google Site Reliability Engineering (SRE) principles for large-scale cloud infrastructure with a commitment to continuous learning and professional development
• Broad knowledge of Azure services Identity, Networking, Compute, Storage, Web, Containers, Databases, PowerBI
• Proficiency with Infrastructure-as-Code and automation tools Terraform, Chef, Ansible, CloudFormation/ARM
• Familiarity with streaming platforms Azure Event Hubs, Kafka and stream processing Spark streaming

Key Skills

Education

Any Graduate