Description

You will design, build, and maintain data pipelines and complex analytical solutions. You own the technical requirements, high-level design, and implementation of data engineering systems.

Responsibilities

• Define technical requirements and perform high-level design for complex data solutions.
• Develop and maintain scalable data pipelines using Hadoop, Spark, and Kafka.
• Implement data processing logic in Java, Scala, or Python.
• Manage data warehousing and querying via SQL and Teradata.
• Orchestrate workflows and ensure data integrity across the stack.

Required Skills

• 5+ years of experience in systems analysis and data engineering.
• 3+ years of hands-on experience with Hadoop ecosystem components.
• Proficiency in Java, Scala, and Python for data processing.
• Strong expertise in SQL and scripting languages.
• Experience with Hive, Sqoop, Pig, and MapReduce.
• Knowledge of Spark (Streaming, MLib) and Kafka.
• Familiarity with Teradata and data warehousing concepts.
• Experience with Airflow for workflow orchestration.

Key Skills

Education

Any Graduate