Automate user provisioning from Azure Active Directory to Databricks using SCIM. Reduce manual account management and ensure consistent access control across teams.
Source: Databricks announcement
Key takeaways
- Azure AD SCIM provisioning automatically syncs users to Databricks every 40 minutes.
- Generate SCIM token and account URL from Databricks account console settings.
- Create Enterprise Application in Azure AD linked to Databricks SCIM connector.
- Select users and groups in Azure AD for automatic synchronization to Databricks.
- Synced users appear in account console user management for permission grants.
- Test SCIM connection before enabling automatic provisioning.
- SCIM provisioning reduces manual account management and ensures consistent access control.
Chapters
- 0:00 — Introduction to Azure AD SCIM Provisioning
- 0:32 — Step 1: Generate SCIM Token & URL in Databricks
- 1:04 — Step 2: Create Enterprise Application in AAD
- 1:34 — Step 3: Configure Automatic Provisioning
- 2:35 — Step 4: Select Users & Groups for Sync
- 3:06 — Step 5: Start Provisioning & Verify
- 3:37 — Conclusion & Access Control
Frequently asked questions
How often does SCIM provisioning sync users from Azure AD to Databricks?
SCIM provisioning automatically syncs users every 40 minutes after initial setup. This means new users or changes to existing users in Azure AD will propagate to Databricks within approximately 40 minutes of the sync interval.
Where do I get the SCIM token and URL?
Generate them in Databricks account console settings. Go to Settings > Setup User Provisioning and copy both the SCIM token and account SCIM URL to configure in Azure AD's Enterprise Application settings.
Can I sync groups from Azure AD to Databricks?
Yes, groups can be synced along with individual users. However, this requires the appropriate Azure Active Directory plan level in your organization.
What happens after users are synced to Databricks?
Synced users appear in the Databricks account console user management page. Administrators can then grant permissions such as account console access or workspace membership to these users.
Full transcript
Auto-generated from the video and lightly edited for readability. Timestamps link to the moment in the video.
Show full transcript (10 segments)
0:00hello my name is Yousef and in today's video I will show you how to push identities from Azure active directory to databricks and first of all you need to make sure that you have access to the account console and that you have the proper permission in Azure active directory to login into
0:25the account console we need to make sure that you have access to the accounts.azurdatabricks.net of course I will have over here I already have my workspace or this setup my meta store is already there of course only I'm only only user over here so what I will do I'll go to settings and click on setup user provisioning and I'll copy the
0:49scheme token and of course the scheme the account scheme URL and I'll need to go to Azure click on Azure active directory go to Enterprise applications click on new application then look for databricks once I'm here I need to create my
1:13Azure databricks scheme provisioning connector and then I need to set up or to copy the uh the URL and the uh the token that has been created so let's just wait a few seconds yes and then I need to go to
1:36provisioning get started I mean I can either choose manual or automatic so I'll choose automatic here I'll copy the secret token and I will grab of course the account scheme URL I will test the connection
1:58and once it's good I'll save it everything is saved now I'll go back again to up yeah now I'll go to users and groups and over here I can add like the users I
2:20can select the users what's also the groups who will be uh pushed to database so over here I'll choose Ali iuf Lauren Quinton yes scene I'll select them of course I can also select the groups but I don't have groups because I I don't have the right active directory plan level but that's only for the demo purpose
2:42I'll assign them and of course they are now assigned and now what I need to do I will go to provision and here I can start the provisioning of course that if I go to the details you will see that it will go and pop up or try to update this
3:04every uh every 14 minutes which means if I have a new user it will be pushed to the account after uh let's say 40 each 40 minutes so now you see that it's completed like I did sync all my uh all my users or the four users I do have if I go back to the
3:26accounts console and click on user management you'll see now I have those users over here and then like now I can either for example go I can click for example on yes scene and make sure to enable for example the access to the account console or or not
Official Databricks resources
Related
- What Is LTAP? Lakebase + Genie, Explained by Databricks CTO Matei Zaharia
- SET MANAGED: Convert External Tables with Predictive Optimization
- Databricks Data Science Agent: Auto-Generate & Execute Analytics
- Join 150K+ Data Professionals: Databricks Community Q&A
- All Databricks video guides
- All tutorials & videos
Databricks Answers
Looking for a quick, source-backed answer? Browse Databricks Answers on the Databricks Data and AI Platform — direct, documentation-validated answers to common Databricks questions, curated by Youssef Mrini, Senior Developer Advocate at Databricks.