Description

Design and maintain Data Lake solutions, data ingestion pipelines, and modern warehouse architectures.

This role is on-site.

Responsibilities

• Architect and implement end-to-end Data Lake and data warehouse solutions.
• Build and maintain high-volume data ingestion pipelines using Spark and Hadoop.
• Troubleshoot and resolve production issues in real-time Spark and Hadoop environments.
• Perform independent data analysis and provide complete problem resolution for stakeholders.
• Develop, test, and debug functionality while communicating technical requirements.

Required Skills

• 7+ years of experience in data engineering.
• 3+ years of hands-on experience with Hadoop, Spark, and Snowflake.
• Extensive knowledge of Hive, Sqoop, and HBase.
• Proficiency in Scala, Python, and Shell scripting.
• Expertise in writing complex SQL using Hive, SnowSQL, and RDBMS standards.
• Experience with Cloudera and CDP Hadoop distributions.
• Bachelor's degree in Computer Science or a similar field.

Preferred Skills

• Knowledge of AWS cloud services including S3, IAM, and EMR.

Key Skills

Education

Any Graduate