Description

Lead the design and implementation of technical solutions within data-intensive development environments.

Responsibilities

• Design, develop, and support technical solutions across Agile teams using distributed microservices and full-stack systems.
• Build real-time data transformations and consumption pipelines using Python and Spark.
• Conduct rigorous code reviews to ensure performance tuning and elegant design.
• Drive automated CI/CD release pipelines.

Required Skills

• Bachelor's Degree.
• 6+ years of experience in big data technologies.
• 5+ years of practical coding experience in Python.
• 4+ years of experience with PySpark, Spark, Hadoop, EMR, and cluster computing environments.
• 3+ years of experience with cloud computing (AWS, Microsoft Azure, or Google Cloud).
• Experience with Jenkins, unit testing, and CI/CD practices.

Preferred Skills

• 7+ years of application development using Python.
• 4+ years with distributed computing tools including EMR, Hadoop, Spark, MapReduce, or Kafka.
• 4+ years working on real-time streaming applications, specifically Spark Structured Streaming.

Key Skills

Education

Bachelor's Degree