Description

Responsibilities include:

Developing and optimizing Python-based data pipelines for OCR processing, text extraction, cleaning, normalization, and dataset preparation.

Managing large-scale data processing workflows and monitoring batch jobs to ensure reliable and efficient execution.

Performing data quality validation, identifying inconsistencies, duplicates, and missing data, and implementing corrective measures.

Managing and maintaining datasets within Azure Blob Storage or Azure Data Lake environments, ensuring data integrity and accessibility.

Collaborating with AI and machine learning teams to deliver high-quality, training-ready datasets that meet project requirements.

Creating and maintaining documentation, operational reports, and version-controlled code while adhering to data security and governance standards.

Required Qualifications:

Bachelor’s degree in computer science, Data Engineering, Data Science, Information Technology, or a related technical field.

3+ years of experience in data engineering, data pipeline development, or data-focused software engineering roles.

Strong proficiency in Python, including building scalable data-processing workflows, debugging, testing, and automation.

Hands-on experience working with large structured and unstructured datasets, utilizing memory-efficient and parallel processing techniques

Key Skills

Education

Any Graduate