Description

You will lead the design, implementation, and optimization of data pipelines supporting customer onboarding, transaction, and decisioning workflows.

Responsibilities

• Architect and implement data ingestion, transformation, and storage frameworks using Hadoop, Avro, and distributed processing technologies.
• Partner with product, analytics, and technology teams to translate business requirements into scalable data engineering solutions.
• Provide technical leadership and mentor data engineers, enforcing coding, performance, and data quality standards.
• Design and implement data frameworks to support next-generation product launches.
• Drive optimization of existing data pipelines for improved efficiency and scalability.

Required Skills

• 8+ years of experience in data engineering, including 2-3 years in a technical leadership capacity.
• Expertise with the Hadoop ecosystem (HDFS, Hive, MapReduce, HBase, Pig).
• Proficiency in Python and Scala for large-scale data processing.
• Proven ability to design ETL/ELT pipelines using Spark, Flink, Airflow, or NiFi.
• Strong understanding of data modeling, data warehousing, and data lake architectures.
• Hands-on experience with SQL and relational/NoSQL data stores.
• Cloud data platform experience with AWS.
• Experience with serialization formats like Avro or Parquet.
• Deep understanding of data security, compliance, and governance frameworks.

Key Skills

Education

Any Graduate