Senior Data Engineer responsible for designing, developing, and maintaining IBM DataStage ETL jobs and SQL Server pipelines in Orlando, FL.
Responsibilities
Design and build end-to-end ETL flows using IBM DataStage, including staging, transformation, validation, and publishing to downstream SQL Server schemas.
Implement source-to-target mapping and transformation logic using common stages (Transformer, Lookup, Join/Merge, Aggregator) with a focus on parallel job design and partitioning.
Write, optimize, and tune SQL Server queries, stored procedures, and T-SQL scripts for performance and efficiency.
Ensure operational stability by implementing parameterization, robust logging, reject handling, auditing columns, and reconciliation checks.
Monitor ETL runs via DataStage Director/Operations Console, perform root-cause analysis on failures, and maintain clear runbooks and documentation.
Required Skills
Hands-on IBM DataStage ETL development experience, including data mapping and transformation implementation.
Strong SQL Server experience with advanced T-SQL (joins, window functions, CTEs, temp tables, indexing basics, query plans).
Solid understanding of file-based ingestion and parsing (CSV, fixed-width, headers/trailers, control totals, encoding, delimiters, quoting/escaping).
Experience designing ETL jobs with good operational characteristics: parameter-driven design, logging, error handling, restart/re-run strategy, and auditability.
Ability to troubleshoot data issues end-to-end (source file → stage tables → target tables) and communicate findings clearly.
Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent practical experience.
5+ years of relevant experience.
Preferred Skills
Familiarity with UNIX/Linux basics and shell scripting for orchestration and file handling.
Experience with job scheduling/orchestration tools (e.g., Control-M, Autosys) and CI/CD practices.
Knowledge of common warehousing patterns (incremental loads, slowly changing dimensions, surrogate keys, effective dating).