Description

You will build and optimize big data pipelines and data sets within an Azure Data Engineering environment.

Responsibilities

  • Build and optimize big data pipelines and data sets using ETL tools.
  • Develop and maintain applications using .NET and .NET Core frameworks.
  • Implement data processing workflows using Databricks, Python, and PySpark.
  • Manage and query relational databases using SQL and T-SQL.
  • Design and maintain data schemas using XML, JSON, and EDI formats.

Required Skills

  • 5+ years of experience with Azure Data Factory, SSIS, SAS, or Informatica.
  • 3+ years of experience with Azure Databricks using Python and PySpark.
  • 3+ years of experience with .NET and .NET Core frameworks.
  • Expertise in XML, JSON, and EDI data schema formats.
  • Proficiency in C#, Visual Basic .NET, F#, or C++.
  • Experience with ASP.NET, MVC 1-6, and ASP.NET Web Api.
  • Strong knowledge of SQL Server, T-SQL, and Linq.
  • Experience with Azure Data Lake Storage.
  • Expertise in object-oriented analysis, SOA, and design patterns.
  • 5+ years of experience with Power BI or similar visualization tools.

Education

Any Graduate