Description

What's the Job?

• Design, develop, and maintain scalable ETL pipelines using Hadoop and related big data technologies.
• Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.
• Implement data security practices within Hadoop environments to ensure compliance and data integrity.
• Test and validate data processing workflows, including UAT and regression testing.
• Achieve subject matter expertise quickly on new applications and tools to support ongoing projects.

What's Needed?

• 5+ years of experience working with Hadoop, Python, and its ecosystem.
• Proficiency with BitBucket, end-to-end ETL pipelines, and dedicated testing methodologies.
• Familiarity with big data frameworks like Apache Spark and Kafka.
• Strong understanding of Linux/Unix systems and shell scripting.
• Knowledge of data security practices in Hadoop environments

Key Skills

Education

Any Graduate