Demonstrate a deep knowledge of Databricks products and solutions , and ability to operationalize, leading data and analytics initiatives
Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production.
Expert in Databricks design, coding, and scripting.
Facilitate problem diagnosis and resolution in technical and functional areas.
Encourage change, especially in support of data engineering best practices and developer satisfaction.
Demonstrate correctness with pragmatic automated tests.
Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices.
Develop strong working relationships with others across levels and functions.
Participate in, and potentially coordinate, Communities-of-Practice in those technologies in which you have an interest.
Serve as a member of an agile engineering team and participate in the team’s workflow.
What you know:
5 - 8 years of experience as a in Big Data
2-4 years of experience in Databricks (Knowledge is also fine)
Experience in driving end to end programs from Source to consumption, distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time.
Strong knowledge of programming languages/tools including Scala, Python, Spark, SQL, Hive, PowerBi
Added plus: Experience with streaming technologies such as Spark streaming. messaging systems, such as Kafka, implementing Lambda Architecture.
An understanding of software development best practice
Enthusiasm for constant improvement as a Databricks Data Engineer
Ability to review and critique code and proposed designs and offer thoughtful feedback in a collegial fashion.
Skilled in writing and presenting -- able to craft needed messages so they are clearly expressed and easily understood.
Ability to work independently on complex problems of varying complexity and scope.
Very good communication skills.
Strong Experience in Agile practice
Minimum 5 years of experience.
Good to have Databricks certification.
Education:
Bachelor’s degree in Computer Science, Engineering or equivalent demonstrable experience