Description

Key Skills: Pyspark, SQL, Azure Data lake

Roles and Responsibilities:

• Design and implement scalable REST APIs for platform integration using FastAPI.
• Build and optimize data pipelines using PySpark and SQL for reliable ingestion, transformation, and delivery.
• Develop cloud-native data solutions on Azure, including data lake integration and orchestration.
• Containerize and deploy services using Docker, ensuring consistent environments across development and production.
• Ensure secure API integration and robust data workflow automation, including monitoring and troubleshooting.

Skills Required:

• 3 - 7 years of relevant experience in data engineering and API/platform integration.
• PySpark for building distributed data processing pipelines.
• SQL for data modeling, querying, and performance tuning.
• Scalable pipeline development with attention to data quality and execution efficiency.
• API and deployment/testing fundamentals for production-ready integrations.

Good to Have:

• Azure Data Lake for organizing and managing data storage and ingestion patterns.

Education: Bachelor's degree in Computer Science, Engineering, or a related field

Key Skills

Education

Any Graduate