Description

You will design, implement, and manage scalable Big Data solutions and cloud platforms.

Responsibilities

• Design and implement Big Data tools, frameworks, and ELT processes.
• Develop data solutions on AWS using Apache Spark, Databricks, and Delta Tables.
• Load disparate datasets and conduct pre-processing using Athena, Glue, and Spark.
• Build cloud platforms for application development and maintain production systems.
• Collaborate with software research and development teams to meet data requirements.

Required Skills

• 5+ years of experience as a Big Data Engineer.
• Proficiency in Python and PySpark.
• In-depth knowledge of Hadoop, Apache Spark, Databricks, and Delta Tables.
• Extensive experience with JSON and Parquet file formats.
• Hands-on experience with AWS data analytics services including Athena, Glue, Redshift, and EMR.
• Knowledge of NoSQL and RDBMS databases.
• Ability to solve complex data processing and transformation problems.
• Any Graduate degree.

Preferred Skills

• Familiarity with Data warehousing.

Key Skills

Education

Any Graduate