Description

You will design, document, and build scalable, fault-tolerant data systems in an agile environment.

Responsibilities

• Design and document data models at various levels of abstraction.
• Build highly scalable and fault-tolerant data systems.
• Work closely with stakeholders to discover data acquisition opportunities.
• Improve data quality, reliability, and efficiency across individual components and the complete system.
• Identify methods to extract value from existing data sets.

Required Skills

• 5+ years of experience in data engineering.
• Hands-on experience with PySpark, Redshift (SQL), and Airflow.
• Proficiency in Python, Scala, or Java programming.
• Strong experience with SQL-based technologies including MySQL and Oracle DB.
• Experience with NoSQL technologies such as Cassandra and MongoDB.
• Knowledge of the Hadoop ecosystem, including HDFS, YARN, MapReduce, Apache Pig, Hive, Flume, Sqoop, ZooKeeper, Oozie, Impala, and Kafka.
• Ability to lead technical initiatives and solve complex problems.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate