Description

Develop, build, and execute programs and scripts to automate various tasks. Maintain and design data pipelines and monitor cluster health. Automate spark jobs and shell scripts generating the input source for database ingestion and revising the schedule of automated scripts to ensure the data flow of the pipelines. Optimize scripts based on business requirements. Work with other technology and engineering teams to understand the business objectives and integrate data processing. Collaborated with data scientists to develop and implement data models. Utilize AWS, Python, Spark, Pyspark and SQL. Will work in various unanticipated locations throughout the U.S. Requires a Master’s in Computer Science, Engineering, or related

Key Skills

Education

Any Graduate