Description

You will design and implement complex data transformations and large-scale software applications.

Responsibilities

• Develop and modify computer applications, including Python connector creation for Vector pipeline transformations.
• Design end-to-end technical architectures for Data Lakes, reporting marts, and Elastic Search data marts.
• Manage large datasets using partitions, memory utilization, replication, and load balancing during ingestion.
• Build Elastic Search indices and expose them as RESTful web services for client consumption.
• Lead code reviews, evaluate new technologies through proof-of-concepts, and define system interfaces.

Required Skills

• 10+ years of software engineering experience.
• Expertise in Python for data transformation and connector development.
• Hands-on experience with Vector Flow.
• Proficiency in handling Bigdata environments and Data Lake architectures.
• Experience with Splunk for data visualization.
• Strong understanding of structured and semi-structured data management.
• Ability to manage data ingestion processes involving fault tolerance and load balancing.
• Experience supporting User Acceptance Testing (UAT) and complex data validation.

Preferred Skills

• Bachelor's degree or equivalent in Computer Science, IT, or a related field.

Key Skills

Education

Any Graduate