← Back to jobs

Techwaukee Logo
Data Engineer

Techwaukee

 

NYC, NY, USA

Posted On: 30+ days ago
Experience: 14+ years
Availability: Onsite
Openings: 1
Category: Data Engineer
Tenure: Full-time Only
Related Jobs

No related jobs found

Description

You will own the design and implementation of data pipelines and warehousing solutions.

This role is on-site.

Responsibilities

  • Design and build data solutions using Azure Data Services, including ADF, Synapse, and Data Lake Storage (Gen2).
  • Develop and optimize ETL/ELT processes handling structured, semi-structured, and unstructured data.
  • Implement data architecture patterns, differentiating between batch and stream processing (Lambda/Kappa).
  • Manage data governance and security by applying principles like RBAC and managed identities.

Required Skills

  • 14+ years overall experience in data engineering, data warehousing, or software development.
  • 5+ years hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Data Lake Storage (Gen2).
  • Strong proficiency in SQL, Python, PySpark, and T-SQL.
  • Experience with data formats including JSON and Parquet.
  • Expertise in cloud infrastructure as code using Terraform or ARM.
  • Hands-on experience with CI/CD tools like Azure DevOps or GitHub Actions.
  • Deep understanding of data architecture principles.
  • Experience with modern data governance platforms such as Microsoft Purview.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs