Description

What's the Job?

• Design, develop, and optimize data pipelines and ETL/ELT processes using Databricks (SQL, Python, PySpark).
• Architect and implement scalable, secure data engineering solutions aligned with federal compliance and governance standards.
• Build and manage Delta Lake architectures, including schema evolution, data quality, and performance tuning.
• Collaborate with federal stakeholders to translate business requirements into technical solutions within the Databricks platform.
• Implement CI/CD workflows for data pipelines and support DevSecOps best practices.

What's Needed?

• Minimum 4 years of hands-on experience building solutions in Databricks (SQL, Spark, MLflow, Delta Lake).
• Strong proficiency in Python and/or PySpark for advanced data engineering tasks.
• Experience with cloud data platforms (Azure Data Lake, AWS S3, GCP Cloud Storage, etc.).
• Experience working within federal environments or supporting regulated industries.
• Databricks Data Engineer Professional Certification or ability to obtain within an agreed timeframe

Key Skills

Education

Any Graduate