Description
You will build and maintain data pipelines and interactive visualization applications.
Responsibilities
- Develop and deploy R-based Shiny Apps for interactive data visualization and user-facing applications.
- Design and implement backend data processing workflows using AWS Glue, AWS Crawler, and AWS Athena.
- Write efficient, maintainable code in Python, R, and SQL for data ingestion, transformation, and analysis.
- Orchestrate and automate complex data pipelines using Azure Data Factory.
- Leverage Databricks to implement Medallion Architecture for big data processing.
- Translate business requirements into technical solutions through cross-functional collaboration.
Required Skills
- 5+ years of professional experience.
- Proficiency in Python, R, and SQL.
- Experience with AWS services including Glue, Crawler, and Athena.
- Hands-on experience with Azure Data Factory for pipeline orchestration.
- Experience using Databricks for big data processing.
- Knowledge of Medallion Architecture for data quality and scalability.
- Any Graduate degree.