You will be a Data Engineer responsible for building and maintaining data infrastructure.
Responsibilities
- Design and deliver system architecture and application features using Databricks.
- Develop and implement reusable ETL frameworks following best practices.
- Ensure operational stability and advanced features of data pipelines.
- Implement automation and continuous delivery methods across the SDLC.
Required Skills
- 10+ years of experience in data engineering.
- Expertise with Databricks and AWS Glue.
- Hands-on experience designing and developing systems on Databricks.
- Advanced proficiency in data processing frameworks, including Parquet and Iceberg.
- Proficiency in PySpark.
- Working knowledge of CI/CD and Application Resiliency principles.
- Practical experience with cloud-native environments.
- Solid understanding of the Software Development Life Cycle.
Preferred Skills
- Databricks Certification.
- AWS Certification.