Description

You design, develop, and tune large-scale data products, owning the end-to-end engineering lifecycle for integrations and models.

This role is on-site.

Responsibilities

• Design and develop data products on Hadoop, Kafka, Hana, and SQL Server.
• Analyze business needs to profile large datasets and build custom data models.
• Develop and extend design patterns, standards, and reusable components for data engineering.
• Collaborate with architects and stakeholders to resolve complex engineering challenges.
• Monitor, troubleshoot, and tune services for CPU, memory, storage, and network performance.

Required Skills

• 5+ years of experience in enterprise data warehousing and big data implementations.
• Strong proficiency in SQL and PL/SQL.
• Programming experience with Python, Java, Scala, or shell scripting.
• Experience with Hadoop ETL and data ingestion using Sqoop, Flume, Hive, Spark, or HBase.
• Hands-on expertise with data consumption via Hive, Hue, HBase, Spark, Pig, Impala, or Presto.
• Bachelor's degree in Computer Science or a related technical field.

Preferred Skills

• Experience with real-time data ingestion using Kafka, Storm, Spark, or Complex Event Processing.
• Experience designing API frameworks using Python or Java.
• Experience developing BI dashboards and reports.

Key Skills

Education

Bachelor’s degree