Description

You will build and maintain data ingestion, processing, and analytical pipelines across relational, NoSQL, and data warehouse environments.

Responsibilities

• Develop data ingestion and processing pipelines for big data and relational databases.
• Architect solutions using AWS native services and Hadoop ecosystems.
• Manage migrations between private and public cloud architectures.
• Implement streaming data workflows using technologies like Kafka, Kinesis, or NiFi.

Required Skills

• 8+ years of experience in big data, relational databases, and NoSQL development.
• 5+ years of hands-on experience with AWS services including EC2, S3, Glue, and Lambda.
• Proficiency in Java, Node.js, Python, and PySpark.
• Strong experience with Spark, SparkSQL, Hive/MR, and Pig.
• Expertise in SQL and Unix shell or Perl scripting.
• Experience with streaming technologies such as Kafka, Kinesis, or NiFi.
• Hands-on use of DevOps tools including GitLab, Jenkins, CodeBuild, and CodeDeploy.
• Must hold at least one AWS Certification: Developer Associate, DevOps Professional, or Big Data Specialty.

Key Skills

Education

Any Graduate