Description

Design and support Big Data and Data Lake system architectures for enterprise data operations, IoT, and data science applications.

Responsibilities

• Develop Big Data and Data Lake architectures supporting enterprise data warehouses and open data portals.
• Implement data pipelines and ETL processes to ingest data between various systems.
• Integrate data platforms with enterprise tools including Esri, Tableau, MicroStrategy, and Oracle databases.
• Manage deployment and configuration of data tools and storage on Microsoft Azure.
• Lead project activities to ensure compliance with established technical standards and procedures.

Required Skills

• 5+ years implementing Big Data storage and analytics platforms like Databricks and Data Lakes.
• 5+ years with Big Data and Data Architecture implementation best practices.
• 5+ years with Microsoft Azure architecture, including networking, security, and storage.
• 5+ years querying structured and unstructured data using SQL and NoSQL.
• 5+ years with Apache products including Spark, Sedona, Airflow, Atlas, NiFi, Hive, and Impala.
• 5+ years modeling and ingesting data via pipelines using Streamsets, Apache NiFi, or Azure Data Factory.
• 3+ years with Web Services (REST/SOAP).
• 3+ years with complex event processing and real-time streaming data.
• 3+ years with Python, Java, or R for ETL and data processing.

Preferred Skills

• 3+ years with Cloudera Data Platform.
• 10+ years with data visualization tools such as Tableau, MicroStrategy, ArcGIS, or Kibana.

Key Skills

Education

ANY GRADUATE