Description
Key Skills Apache Iceberg, Oracle, Starburst, PySpark, ETL/ELT, Data Modeling, Database Development, Applications Development
Good to Have Skills Experience in Financial Services industry, Trino, data lakehouse architecture, data virtualization, performance tuning, data governance, data quality management, S3, ADLS, stored procedures, business intelligence, analytics and reporting, machine learning initiatives.
Roles & Responsibilities
- Utilize knowledge of applications development procedures and concepts to identify and define necessary system enhancements.
- Consult with users, clients, and other technology groups on issues and recommend programming solutions.
- Apply fundamental knowledge of programming languages for design specifications and conduct testing and debugging.
- Analyze applications to identify vulnerabilities and security issues throughout the development lifecycle.
- Design, develop, and maintain robust and scalable data solutions within data lakehouse architecture leveraging Apache Iceberg.
- Develop and optimize data ingestion, transformation, and curation processes using compatible technologies.
- Utilize Starburst for high-performance querying and data virtualization across various data sources including Iceberg tables.
- Work extensively with Oracle databases for enterprise data management including schema design and performance tuning.
- Collaborate with data architects, data scientists, and business intelligence teams to translate business requirements.
- Implement and manage ETL/ELT pipelines to move data efficiently between Oracle and data lake storage.
Experience Required 5-8 years of relevant experience in the Financial Service industry with intermediate level experience in Applications Development role.
Education Bachelor's degree/University degree or equivalent experience