Azure UC Setup: Prerequisites, Metastore, Tables

0:00thank you hello today I will show you how to set up Unity catalog in azure but first let's go and check the requirements so first of all you need to have the Azure active Global director Global administrator uh rule to access the account console once

0:22you do it you no longer need to have this specific access you need also to have a databricks uh workspace with a Premium plan and of course the permission to create an ADLs Gen 2 watch also to Grant permissions over this specific ADLs and now let's go to my Azure account

0:44I will go to my Resource Group that I have created and I would go and create my my azure databricks workspace of course I will name it Yusef rainy I will make sure to choose for

1:07example for my case West us and of course the premium tire is very very important I'm gonna create this workspace I will also go and create my azure storage

1:40Azure storage account something very very important to keep in mind so I will call it uses I will choose the same location as the West U.S of course should be premium and make sure to choose a block blobs

2:05and then in the advanced which is very very important enable the article namespace and then review and create of course this storage account I will go back again and you'll see that my workspace is still under

2:27under deployment and I will go and create the connector

2:49access connector for databricks I will call it connector it should be on the same region so West us and of course I'll create the connector

3:13I will go back to my other resource and something important make sure to uh to copy the resource ID you will have over here because we're gonna use it you're gonna need it later so go to the resource

3:36and this is let's skip this resource ID over here I'll go back to my workspace I need to log in to my specific workspace and I think it's not deployed

3:58yet I need to go to uh Usef Marine which is my storage I'll create a container I'll call it

4:21Yusuf I need to go to IM rules add role assignments that will be storage blob contributor next

4:43manage identity and I'll select my connector Grant the permission foreign space is now on yeah I need to launch my workspace

5:10I need to sign in first and then I can go and access the uh the account console

5:34I'll go to data create metastore first I bet I did not delete this meta source

5:56so I will go over here I'll call it Yousef West us and make and you you can only have one metastore per region I'll go to my connector and copy the resource ID and then I need to follow this specific uh

6:18to create my ideology path so over here my container is called USF arrowverse Usef I think I did call it name it Yusuf green maybe Usef braini yes so please Dot dfs.

6:40just want to make sure that the fs core windows okay and now I'm gonna create my metastore and then I just need to assign this meta store

7:04I'm gonna enable Delta sharing so I want to set an expiration but you can do it then as I will assign it to the specific to my workspace that I already created I'll go and open my workspace I'll create my first cluster so you see over here I have Unity

7:26catalog I'll set up discrimination to 15 minutes I'll enable photon then I will create my cluster in the meantime you can get to know how to use Unity catalog by following my the previous video that I have released where I explain the difference between

7:48manage tables external tables how you can benefit from the lineage how to track like uh everything you've done the audit logs how you can grant and revoke permissions with using the UI using the UI and the uh uh the API as well and you can see over

8:13here that's my my metastore has already been set up because over here you'll see my my meta store I can come over here and start granting permissions to users and groups so of course I will that's it for myself I will grant myself about permissions over here of course if I go back to the

8:35accounts console so over here you can you can add you can add users service principles groups I can come here and I can for example set up like the provisioning by adding the scheme I can activate or some features uh choose the language settings and of course my prefer and everything you want

8:58to have and then let's see if my cluster is ready to be used so in the meantime I will just go and create my first notebook getting started in unity this is my language SQL create

9:22and then once my uh I will create once my cluster is on I will create my catalog all college Yusuf use catalogs users and then what I will do I will just copy paste the creation of a specific of a

9:45specific table so for my case up and I copy paste it I'm going to create a database called databricks Paris then colleagues and of course once my cluster is created I will create my first Delta table manage data table in of course Unity catalog so

10:07in the meantime you've seen the cluster is still warming up so over here I'm creating a catalog of course there is something that changed slightly compared to uh using hybrid metastasource so now we have three level namespace we have the catalog then we have the database and then we have the table and of course you can grant permissions like at every at the

10:31granular level you can grant permissions per catalog database and per table or for example you can make sure to use the inheritance which means you grant all privileges to catalog and it goes chill till the tables and operate you and you can you can do this straight from the data Explorer tab or of course using the UI Grant select

10:54uh select on table two for example to a specific user or specific a group and there is something important to keep in mind Unity catalog comes at no cost or you always pay for the compute the uptime of the cluster so you you can see now that my uh

11:18catalog has been created we are currently creating the database and then I'm creating my uh my specific table of course it's under creation

11:45of course I will do something so let it create high meta source so I'll choose Okay so we've seen the table already

12:07exists so if I go to data I'll choose the catalog yourself databricks Paris and now you see you can see the colleagues you can see also sample sample of the data so now I you're ready to use Unity catalog of course you can also set up if you want to store the data in another ADLs you can set up what we call external locations and storage

12:32credential form thank you for following this session