← Back to jobs

Smart IT Frame LLC Logo
Senior Databricks Data Engineer

Smart IT Frame LLC

 

Rochester, NY, USA

Posted On: 3 days ago
Experience: 5+ years
Availability: Onsite
Openings: 2
Category: Databricks data engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will design, build, and maintain scalable data pipelines and foundational datasets to support analytics and product needs.

This role is on-site.

Responsibilities

  • Design and build database architectures for massive, complex datasets while balancing computational load and cost.
  • Develop scalable data quality audits, including alerting and anomaly detection systems for billions of rows.
  • Optimize ETL and dashboard performance to improve efficiency and reduce costs.
  • Create scalable dashboards and reports to enable data-driven decision making.
  • Collaborate with data science, machine learning, and engineering teams to improve instrumentation accuracy and reliability.

Required Skills

  • 5+ years of professional experience in data engineering.
  • 3+ years building production data pipelines with high volumes of consumer data.
  • 3+ years designing and maintaining data models from structured and unstructured sources.
  • 3+ years of experience with SQL, Python, and PySpark.
  • 3+ years of experience with public cloud platforms (AWS, Microsoft Azure, or Google Cloud).
  • 3+ years of experience with NoSQL implementations such as DynamoDB or CosmosDB.
  • Experience developing and maintaining CI/CD pipelines for Databricks using Azure DevOps.
  • Strong stakeholder management skills for working in ambiguous environments.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs