Description

1.Designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.
2.Collaborating with Stakeholders, Business Analysts and Data Architects to assist and translate business requirements to technical solutions
3.Develop big data and analytic solutions leveraging new or existing technology
4.Exploratory data analysis by querying and processing data stores and databases and generate reports.
5.Design, upgrade and implement new data workflows.
6.Write and maintain technical documentation
7.Executes updates, patches, and other activities required to maintain and enhance the operations of on-premise or cloud-based environments

Must-Have:
Experience working as Data Engineer with focus on data ingestion, transformation, curation and with good understanding of Mongo DB
Experienced in programming/scripting languages such as Pyspark
Experienced with working on Structured and Semi-Structured datasets.
Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database, Azure Data Factory, ADLS storage account, Azure DataBricks and DevOps
Experienced in creating data pipelines & developing complex and optimized queries
Experience with implementing CI / CD pipeline on GitHub, Jenkins / JGP.
Experience writing complex SQL and NoSQL jobs to analyze data in traditional DBMS (MS-SQL, Oracle) environments
Experience with integrating to back-end/legacy environments
Experience integrating business and technology teams
Excellent organizational and time management skills, strong business presence with ability to multi-task and effectively deal with competing priorities

Key Skills

Education

Any Gradute