Description

Design, implement, and manage scalable big data solutions and cloud platforms.

Responsibilities

• Develop big data solutions on AWS using Athena, Glue, EMR, and open source Hadoop/Spark platforms.
• Implement ELT processes by loading disparate data sets and conducting pre-processing using Athena, Glue, Spark, Hive, or Pig.
• Build cloud platforms for application development and maintain production systems.
• Collaborate with software research and development teams to meet data requirements.
• Solve complex data processing and transformation problems.

Required Skills

• 4-6 years of experience as a Big Data Engineer.
• In-depth knowledge of Hadoop and Spark.
• Hands-on experience with AWS data analytics services including S3, Athena, Glue, Redshift, and EMR.
• Proficiency with JSON and Parquet file formats.
• Working knowledge of Java, Python, or R.
• Experience with NoSQL and RDBMS databases.
• Bachelor’s degree in computer engineering or computer science.

Preferred Skills

• Familiarity with Data warehousing.

Key Skills

Education

Bachelor’s degree in computer engineering