Technology Partner Integrations Overview
Who this is for:
Architecture / Concept Overview: Technology Partner Integrations Overview
%%{init: {"theme":"base","themeVariables":{"background":"#0B0E14","primaryTextColor":"#E0E6ED","lineColor":"#5D6470","darkMode":true,"primaryColor":"#2E4A4A","secondaryColor":"#374151","secondaryTextColor":"#E0E6ED","tertiaryColor":"#111827","tertiaryTextColor":"#E0E6ED","edgeLabelBackground":"#1f2937"}}}%%
flowchart LR
classDef source fill:#3F4B59,stroke:#9CA3AF,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
classDef ingestion fill:#5A4B36,stroke:#C9A86B,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
classDef processing fill:#535072,stroke:#8E82B4,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
classDef storage fill:#2E4A4A,stroke:#5FAFA8,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
classDef serving fill:#3D5550,stroke:#6BB7AA,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
classDef governance fill:#5A3F52,stroke:#C28BB0,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
INGEST_P[Ingestion Partners]:::ingestion
TRANSFORM_P[Transformation Partners]:::processing
DBX[Databricks Lakehouse]:::storage
BI_P[BI & Analytics Partners]:::serving
GOV_P[Governance Partners]:::governance
ML_P[AI/ML Partners]:::source
INGEST_P --> DBX
TRANSFORM_P --> DBX
DBX --> BI_P
DBX --> GOV_P
DBX --> ML_P
*Technology partners complement Databricks across every stage of the data lifecycle—from ingestion to governance and AI.*
%%{init: {"theme":"base","themeVariables":{"background":"#0B0E14","primaryTextColor":"#E0E6ED","lineColor":"#5D6470","darkMode":true,"primaryColor":"#2E4A4A","secondaryColor":"#374151","secondaryTextColor":"#E0E6ED","tertiaryColor":"#111827","tertiaryTextColor":"#E0E6ED","edgeLabelBackground":"#1f2937"}}}%%
graph TD
classDef source fill:#3F4B59,stroke:#9CA3AF,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
classDef ingestion fill:#5A4B36,stroke:#C9A86B,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
classDef processing fill:#535072,stroke:#8E82B4,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
classDef storage fill:#2E4A4A,stroke:#5FAFA8,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
classDef serving fill:#3D5550,stroke:#6BB7AA,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
classDef governance fill:#5A3F52,stroke:#C28BB0,stroke-width:2px,rx:8,ry:8,color:#E0E6ED
ECO[Partner Ecosystem Categories]:::source
INGEST_C[Data Ingestion]:::ingestion
TRANSFORM_C[Transformation & Quality]:::processing
ORCH_C[Orchestration]:::source
BI_C[BI & Visualization]:::serving
GOV_C[Governance & Catalog]:::governance
SEC_C[Security & Compliance]:::governance
ECO --> INGEST_C
ECO --> TRANSFORM_C
ECO --> ORCH_C
ECO --> BI_C
ECO --> GOV_C
ECO --> SEC_C
INGEST_C --> FVT[Fivetran]:::ingestion
INGEST_C --> AIR[Airbyte]:::ingestion
INGEST_C --> QLIK[Qlik / Attunity]:::ingestion
TRANSFORM_C --> DBT_P[dbt Labs]:::processing
TRANSFORM_C --> GREAT[Great Expectations]:::processing
BI_C --> PBI[Power BI]:::serving
BI_C --> TAB[Tableau]:::serving
BI_C --> LOOK[Looker]:::serving
GOV_C --> ALTN[Alation]:::governance
GOV_C --> COLL[Collibra]:::governance
*The partner ecosystem spans data ingestion, transformation, orchestration, BI, governance, and security domains.*
Key Terms
Prerequisites and Setup
- Databricks workspace with Partner Connect enabled
- Admin or workspace-level permissions for Partner Connect setup
- Unity Catalog enabled (required for governance integrations)
- SQL Warehouse provisioned (required for BI tool connections)
- Appropriate cloud networking for partner connectivity
Step-by-Step Implementation
Configuration Reference
| Category | Partner | Connection Method | Auth Pattern |
|---|---|---|---|
| Ingestion | Fivetran | Partner Connect / API | Service Principal |
| Ingestion | Airbyte | JDBC / Python connector | PAT / OAuth |
| Transformation | dbt | dbt-databricks adapter | PAT / OAuth |
| Orchestration | Airflow | Databricks Provider | PAT / Service Principal |
| BI | Tableau | Native Databricks connector | OAuth / PAT |
| BI | Looker | JDBC connector | PAT / OAuth |
| Governance | Collibra | REST API / UC integration | Service Principal |
| Governance | Alation | Unity Catalog connector | Service Principal |
| Quality | Great Expectations | PySpark DataSource | Cluster auth |
| Security | Privacera | Unity Catalog policy sync | Service Principal |