You will build and optimize big data pipelines and data sets within an Azure Data Engineering environment.
Responsibilities
- Build and optimize big data pipelines and data sets using ETL tools.
- Develop and maintain applications using .NET and .NET Core frameworks.
- Implement data processing workflows using Databricks, Python, and PySpark.
- Manage and query relational databases using SQL and T-SQL.
- Design and maintain data schemas using XML, JSON, and EDI formats.
Required Skills
- 5+ years of experience with Azure Data Factory, SSIS, SAS, or Informatica.
- 3+ years of experience with Azure Databricks using Python and PySpark.
- 3+ years of experience with .NET and .NET Core frameworks.
- Expertise in XML, JSON, and EDI data schema formats.
- Proficiency in C#, Visual Basic .NET, F#, or C++.
- Experience with ASP.NET, MVC 1-6, and ASP.NET Web Api.
- Strong knowledge of SQL Server, T-SQL, and Linq.
- Experience with Azure Data Lake Storage.
- Expertise in object-oriented analysis, SOA, and design patterns.
- 5+ years of experience with Power BI or similar visualization tools.