Description

Lead data engineering efforts to build scalable solutions capable of processing millions of records with high velocity.

Responsibilities

• Develop and implement data masking solutions for on-prem PII data, targeting performance metrics such as masking 10 million records within 15 minutes.
• Build secure API calls and established secured channels to support data models and data science activities.
• Manage the movement of standard output data to lower environments for pre-production testing.
• Design scalable architectures to handle high-volume data processing requirements.

Required Skills

• 7+ years of software development experience.
• Proficiency in Java, Scala, and Python.
• Hands-on experience with Apache Spark.
• Experience with AWS services including S3, Glue, and Redshift.
• Strong SQL and NoSQL database expertise.
• Proven ability to implement secure data transfer protocols.
• Experience with agile methodologies and standard development tools.

Preferred Skills

• Bachelor's degree in Computer Science.

Key Skills

Education

Bachelor's degree in Computer Science