Enterprise Data Architect Databricks & Platinum Layer

Enterprise Data Architect – Databricks & Platinum Layer

Location: Remote- Austin, TX



Role Summary

The EDM Architect will lead the design and implementation of the Platinum Layer within the Databricks Lakehouse architecture for the clients MSI Transition Project.

This role requires deep expertise in Databricks, Delta Lake, Unity Catalog, and semantic modeling, with hands-on experience integrating ServiceNow (ITSM/SLM) and ApptioOne (ITFM).

The architect must also be able to articulate high-level technology benefits and the most efficient way to operate Databricks in its standard build configuration.

Key Responsibilities

• - Architect and implement the Platinum Layer for semantic modeling, SLA analytics, and AI readiness.

• - Design and deliver low-level technical solutions for ingestion, transformation, and reporting pipelines.

• - Integrate ServiceNow SLA data and ApptioOne financial models into the Lakehouse.

• - Define and enforce governance policies using Unity Catalog.

• - Collaborate with DIR and SCPs to align architecture with business goals.

• - Build reusable frameworks for real-time SLA breach prediction, cost analysis, and executive dashboards.

• - Support CI/CD pipeline development and DevOps automation for data workflows.

• - Explain high-level technology benefits of Databricks to leadership and stakeholders.

• - Recommend and implement the most efficient operational practices for Databricks in standard build configuration.

Required Skills & Experience

• - 8+ years in Data Architecture, with 3+ years in Databricks and Delta Lake.

• - Proven experience designing and implementing Platinum or Semantic Layers.

• - Strong understanding of Medallion Architecture and Unity Catalog.

• - Hands-on integration experience with ServiceNow (SLA, CMDB, incident data).

• - Hands-on integration experience with ApptioOne (cost modeling, allocations).

• - Proficiency in Python, Spark, SQL, and Power BI.

• - Experience with MLflow, Feature Store, and AI/ML pipelines.

• - Familiarity with Azure Data Factory, Azure DevOps, and GitHub Actions.

• - Excellent communication and stakeholder engagement skills.

Preferred Qualifications

• - Experience in public sector or clien's DIR environments.

• - ITIL v4 Certification.

• - ApptioOne and ServiceNow scripting experience.

• - Experience with SLA breach forecasting and cost optimization models.