Description

You will build and maintain modern data solutions using Azure PaaS services to support data visualization and processing.

Responsibilities

• Develop JSON scripts for Azure Data Factory (ADF) pipelines to process data via SQL activities.
• Extract, transform, and load data from source systems to Azure Data Storage using ADF, T-SQL, Spark SQL, and U-SQL.
• Build ADF pipelines using Linked Services, Datasets, and Pipelines to move data between Azure SQL, Blob storage, and Azure SQL Data Warehouse.
• Develop Spark applications using PySpark and Spark-SQL for data extraction, transformation, and aggregation.
• Follow a Dev-Ops model to support development and production operations.

Required Skills

• 3+ years of professional software development experience.
• Proficiency in Java.
• Experience with Azure Data Factory (ADF).
• Strong T-SQL skills for automation and data processing.
• Hands-on experience with Spark SQL and U-SQL Azure Data Lake Analytics.
• Ability to design and build data solutions using Azure PaaS services.
• Bachelor of Engineering, Technology, or Computer Engineering degree.

Key Skills

Education

Bachelor of Engineering / Tehcnology or Computer Engineering