Manage and optimize the Databricks and Power BI infrastructure, ensuring security, performance, and cost efficiency.
Responsibilities
- Manage Power BI access controls, capacity settings, security policies, and downtime notifications.
- Administer Databricks Unity Catalog, including table management and data governance.
- Monitor Spark UI and optimize cluster configurations to reduce costs and improve performance.
- Troubleshoot platform issues and resolve performance bottlenecks in both Databricks and Power BI environments.
- Coordinate with stakeholders to align data infrastructure with reporting and analytics needs.
Required Skills
- 5-8 years of hands-on experience in Databricks and Power BI administration.
- Deep expertise in Power BI administration, including workspace management, capacity planning, and security.
- Strong knowledge of Databricks Unity Catalog, Spark architecture, and cluster management.
- Proven ability in performance tuning for both Databricks workloads and Power BI datasets.
- Experience with cost optimization strategies for cloud data platforms.
- Strong troubleshooting skills for complex data infrastructure issues.
- Effective stakeholder management and communication skills.
Preferred Skills
- Experience with Azure Data Factory or other ETL/ELT tools integrated with Databricks.
- Familiarity with SQL and Python for data manipulation and automation.