Description

Biggest needs
PySpark
Databricks
Informatica

What's the Job?

• Develop and optimize ETL pipelines using Pyspark and Databricks to support data migration projects
• Assist in migrating legacy on-premise applications from Informatica to cloud-based solutions
• Cleanse and transform unstructured and structured data from multiple vendors, including Bloomberg and other data sources
• Implement data rules based on business requirements to create accurate and reliable data models
• Collaborate with team members in an Agile environment to accelerate development and ensure project success

What's Needed?

• Proficiency in Pyspark with a focus on data processing and pipeline development
• Experience with Databricks workflows and cloud-based data environments
• Strong understanding of data cleansing, hierarchy, and applying business rules
• Background in development, data modeling, or related fields
• Ability to work effectively in a small, collaborative team with a positive attitude

Key Skills

Education

Any Graduate