Description

You will design, develop, and deploy data integration solutions within an Apache Spark-based Enterprise Data Platform.

This role is on-site.

Responsibilities

• Design and maintain data and technical architectures to ensure data integrity and accuracy.
• Build and maintain business reporting and dashboards.
• Develop data integration solutions to connect enterprise systems to the data platform.
• Facilitate requirements gathering, process mapping workshops, and technical design documentation.
• Implement standard operating procedures and drive technical improvements through review sessions.

Required Skills

• 5+ years of experience in data integration and pipeline development using Python and PySpark.
• 2+ years of experience with AWS Cloud services including EMR, Glue, Kafka, Kinesis, and Lambda.
• Hands-on experience with S3, Redshift, RDS, MongoDB, and DynamoDB ecosystems.
• Proficiency in Core Python and common Python libraries.
• Strong experience with algorithms, data structures, and complex database query optimization.
• Experience developing data processing tasks specifically using PySpark.
• Proficiency with source control and CI/CD tools including Git, Bitbucket, and Jenkins.

Preferred Skills

• Knowledge of Artificial Intelligence and Machine Learning principles.

Key Skills

Education

Any Graduate