Description

You will design, develop, and tune data products on large-scale platforms, focusing on performance and scalability. You own the end-to-end engineering lifecycle for data integrations and models.

Responsibilities

• Design and develop data products on Hadoop, Kafka, Hana, and SQL Server.
• Analyze business needs to profile large datasets and build custom data models.
• Develop and extend design patterns, standards, and reusable components for data engineering.
• Collaborate with architects and business stakeholders to resolve complex engineering challenges.

Required Skills

• 5+ years of experience in enterprise data warehousing and big data implementations.
• Strong proficiency in SQL and PL/SQL.
• Programming experience with Python, Java, Scala, or shell scripting.
• Experience with Hadoop ETL and data ingestion using Sqoop, Flume, Hive, Spark, or HBase.
• Hands-on expertise with data consumption via Hive, Hue, HBase, Spark, Pig, Impala, or Presto.
• Ability to monitor, troubleshoot, and tune services (CPU, memory, storage, networks).
• Bachelor's degree in Computer Science or a related technical field.

Preferred Skills

• Experience with real-time data ingestion using Kafka, Storm, Spark, or Complex Event Processing.
• Experience designing API frameworks using Python or Java.
• Experience developing BI dashboards and reports.

Key Skills

Education

Bachelor’s degree