Description

• We are looking for an experienced Senior Data Engineer with expertise in designing, building, and optimizing modern enterprise data integration and ingestion solutions. The ideal candidate should be a multi-pattern data engineer capable of working across various relational databases, storage technologies, and ingestion mechanisms rather than specializing in a single technology such as Oracle GoldenGate (OGG).
• The candidate will be responsible for implementing scalable, high-performance data pipelines connecting multiple enterprise data sources to Microsoft Fabric, ensuring reliable, low-latency, and secure data movement while supporting both batch and real-time data processing.
• This role requires strong expertise in Change Data Capture (CDC) and Change Data Feed (CDF) concepts, data engineering best practices, performance tuning, and cloud-native data architectures.

Key Responsibilities

• Design, develop, and optimize data ingestion pipelines into Microsoft Fabric.
• Build integration solutions across Oracle, SQL Managed Instance (SQL MI), MySQL, PostgreSQL, Azure Blob Storage, and flat files.
• Implement scalable batch and incremental data ingestion using CDC (Change Data Capture) and CDF (Change Data Feed) methodologies.
• Design efficient data synchronization strategies using primary keys, timestamps, watermarking, and change tracking.
• Optimize pipeline performance, scalability, and latency, including workload tuning across Microsoft Fabric capacities (e.g., F64 to F128).
• Develop reusable, metadata-driven data ingestion frameworks and ensure high standards of data quality, reliability, and governance.
• Collaborate with architects, analytics teams, and business stakeholders to deliver robust, enterprise-scale data solutions.

Required Skills & Experience

• Minimum of 6+ years of experience in Data Engineering and enterprise data integration.
• Strong hands-on experience with Oracle, SQL MI, MySQL, PostgreSQL, Azure Blob Storage, and flat file ingestion.
• Proven expertise in Microsoft Fabric and modern cloud-based data platforms.
• Deep understanding of CDC/CDF concepts, including primary keys, timestamps, incremental loads, merge/upsert logic, and change tracking.
• Strong SQL and data modeling skills with experience in performance tuning and scalable data pipeline design.
• Experience building cross-platform data ingestion solutions rather than relying on a single integration technology

Key Skills

Education

Bachelor's degree