Description

Responsibilities

• Design and develop high-quality, maintainable software modules for the product suite
• Conduct unit and integration testing using appropriate methodology and techniques
• Analyze requirements and specifications and create detailed designs for implementation
• Analyze and resolve software-related issues from internal or external customers
• Analyze existing Hadoop architecture, workflows, and data pipelines to support migration to AWS
• Develop comprehensive migration strategies to transfer data, processing logic, and applications to AWS services
• Design target architecture using AWS big data services such as Amazon EMR, Airflow, Glue, and Lambda
• Evaluate and select appropriate AWS tools for data ingestion, storage, processing, and analytics
• Oversee the migration process, including data transfer, application re-platforming, and validation
• Ensure the new architecture meets performance, scalability, reliability, and security requirements
• Collaborate with developers, data engineers, DevOps, and stakeholders to ensure seamless migration
• Create detailed technical documentation and migration runbooks
• Mentor team members in proper software engineering methods, AWS big data best practices, and new technologies
• Review software engineering approaches to proposed solutions to ensure adherence to best practices
• Maintain and update professional knowledge of emerging technologies
• Perform duties with or without reasonable accommodation as needed

Qualifications

• Required
  • Bachelor's Degree in Computer Science, Information Technology, Information Systems, or related field
  • 10+ years of experience with enterprise and application design patterns applied on Hadoop and Big Data platforms in AWS
  • Deep expertise in both on-premises Hadoop ecosystems and modern cloud-native big data solutions on AWS
  • Hands-on experience with Cloudera Hadoop stack (HDFS, Hive, Spark, Oozie, Python)
  • Proficiency in writing, maintaining, and troubleshooting shell scripts (Bash or similar) for automation and operational support
  • Proven track record of migrating or modernizing big data workloads to AWS
  • Strong understanding of data security, compliance, and governance in the cloud
  • 5+ years of experience with platform engineering tools such as Bitbucket, Gradle, Octopus, and Artifactory
  • Familiarity with XML/JSON data formats
  • Knowledge of monitoring and logging tools
  • Experience with cloud automation and Infrastructure as Code (e.g., Terraform)
  • Ability to effectively communicate with executive leadership
• Preferred
  • AWS certifications (e.g., AWS Certified Solutions Architect, AWS Certified Big Data – Specialty)
  • Knowledge of healthcare data such as claims and entities such as providers, members, and their relationships within the framework of a claim

Key Skills

Education

Bachelor's degree