Description

• Technical Skills:

• Proficiency in Apache SPARK, pySpark, and AWS EMR.
• Strong experience with Apache Hadoop, Hive, and SQL (Postgres-SQL).
• Advanced programming skills in Python and Scala.
• Solid understanding of UNIX systems and shell scripting.
• Must have Databricks knowledge and experience

Functional understanding of API

• Experience with data storage and retrieval from S3 and Elasticsearch.
• Knowledge of ETL tools like Airflow and Autosys.
• Familiarity with version control systems (Git, SVN).
• Basic understanding of HTML for web development tasks.
• Strong SQL skills for data querying and manipulation.
• Experience with API development and integration

Key Skills

Education

Bachelor's or Master's degrees