Description

Apex Systems is looking for a FULL TIME Senior Data Engineer who is a technical powerhouse who can scale a data platform to meet ever growing business needs of a data driven organization. The Data Engineering team builds data solutions that powers strategic and tactical business decisions and supports the Analytics and Artificial Intelligence operations. By implementing the data platform, data pipelines and data governance policies this team provides the basis for decision-making.
Work closely with various business, IT, Analyst and Data Science groups to collect business requirements

Design, develop, deploy and support high performance data pipelines both inbound and outbound

Optimize data pipelines for performance, scalability, and reliability

Ensure quality of critical data element, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root

Document the design and support strategy of the data pipelines

Capture, store and socialize data lineage and operational metadata

Troubleshoot and resolve data engineering issues as they arise

Mentor and guide junior data engineers

Qualifications

6+ plus years of experience in building data lakes and cloud data platforms

Experience working with GCP technologies like BigQuery, Composer, GCS, DataStream, Dataflows

Expert knowledge on SQL and Python programming

Experience working with Apache Airflow as workflow management tools and build operators to connect, extract and ingest data as needed

Experience in tuning queries for performance and scalability

Experience in Real Time Data Ingestion using GCP PubSub, Kafka, Spark or similar

Excellent organizational, prioritization and analytical abilities

Have proven experience working in incremental execution through successful launches

Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment

Key Skills

Education

ANY GRADUATE