← Back to jobs

Concord IT Systems Logo
Big Data Engineer

Concord IT Systems

 

Phoenix, AZ, USA

Posted On: 8 days ago
Experience: Not specified years
Availability: Onsite
Openings: 10
Category: Quality Assurance Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

Design and develop custom applications to transition legacy batch-based platforms to event-driven, microservices-based architectures while owning the full development lifecycle from requirements to production support.

This role is on-site.

Responsibilities

  • Design software applications and system architecture by translating user needs into functional requirements.
  • Develop, code, debug, and document applications while ensuring engineering resilience through automation testing.
  • Optimize complex SQL joins and data processing workflows for large-scale datasets.
  • Partner with SRE, testing, and production support teams to manage the full development life-cycle.
  • Provide post-implementation and ongoing production support for deployed systems.

Required Skills

  • 5+ years of software development experience, including leading engineers and scrum teams.
  • 3+ years of hands-on experience with Spark (core, SQL, and PySpark).
  • Direct experience working with Hive and Map-Reduce.
  • Proficiency in writing and optimizing complex SQL using Hive and PySpark dataframes.
  • Experience with UNIX shell scripting.
  • Bachelor’s degree in Engineering, Computer Science, or equivalent, or a Master’s in Computer Applications.

Education

Not specified

Related Jobs

No related jobs found

← Back to jobs