← Back to jobs
Senior Databricks Engineer
Atlanta, GA, USA
Posted On: 7 days ago
Experience: 14+ years
Availability: Hybrid
Openings: 1
Category: AWS Data Bricks Engineers
Tenure: Contract - Corp-to-Corp
Related Jobs
No related jobs found
Description
You will design and maintain scalable data pipelines and lakehouse architectures using Databricks and Spark.
Responsibilities
- Build and optimize ETL/ELT workflows to ingest and transform structured and unstructured data.
- Develop data lakehouse architectures using Delta Lake for efficient analytics.
- Optimize Spark performance and cluster configurations for cost-efficient processing.
- Implement real-time and batch processing pipelines using Kafka or Spark Streaming.
- Integrate Databricks with AWS, Azure, or Google Cloud Platform.
- Deploy CI/CD pipelines and DevOps best practices for data engineering workflows.
Required Skills
- 14+ years of experience in data engineering.
- Expertise in the Databricks platform.
- Strong proficiency in PySpark, Spark, and Spark SQL.
- Hands-on experience with Delta Lake architecture.
- Experience with AWS, Azure, or Google Cloud Platform.
- Knowledge of Kafka or Spark Streaming.
- Experience implementing CI/CD pipelines.
- Bachelor's degree.
Education
Bachelor's degree
Related Jobs
No related jobs found
Explore More Jobs
Jobs in AtlantaJobs in GAJobs in USAPyspark JobsDatabricks JobsSpark JobsAws JobsAzure JobsGle Cloud Platform JobsKafka JobsCi/cd JobsJobs at iitjobsJobs at Kaizen Soft SolutionsAWS Data Bricks Engineers JobsLangChain JobsStable Diffusion JobsMachine Learning JobsAI Models JobsVAE JobsRollups JobsTransformers JobsAirflow JobsSentiment Analysis JobsFine-Tuning Jobs
← Back to jobs