Description

You will design and develop Hadoop and cloud-based data solutions, owning the full lifecycle from development to release.

Responsibilities

• Design and develop scalable Hadoop and cloud-based data solutions.
• Perform unit and integration testing for all data pipelines to ensure reliability.
• Collaborate with architecture and lead engineers to maintain consistent development practices.
• Mentor junior engineers and participate in retrospective reviews to improve team processes.
• Estimate effort for new work and releases while solving complex technical problems.

Required Skills

• 10+ years of professional data development experience.
• 7+ years developing with Hadoop/HDFS and SQL (Oracle, SQL Server).
• 5+ years of experience with PySpark and Spark.
• 5+ years of experience developing with Python, Java, or Scala.
• Deep understanding of ETL and Data Warehousing concepts.
• Experience with Version Control Systems such as Git or SVN.
• Strong understanding of Agile and Scrum principles.

Preferred Skills

• Experience with Azure, Databricks, or NoSQL databases like MongoDB and Cassandra.
• Knowledge of Service Oriented Architecture, CI/CD, or BI tooling (Tableau, Power BI, Cognos).

Key Skills

Education

Any Graduate