Automate Unity Catalog Upgrade with UCX Part 4 - Group Migration
Skills:
AI Workflow Automation90%
Key Takeaways
This video tutorial by Databricks covers the process of automating Unity Catalog upgrade with UCX, specifically focusing on group migration from workspace-local groups to account-level groups using Unity Catalog and UCX tools.
Full Transcript
hello everyone welcome to the next video on the ucx series on this video we will focus on group migration group migration is the next step after running the assessment workflow so what does group migration involve here you can see a comparison of the command line commands and the workflow commands generally you would prefer to run the workflows and we would recommend using the workflows for this however looking at the command line commands will give you us a better idea of what this steps involve you can see that in the workflows commands we don't have a create account groups task this is because this can only be done either using the command line or using other methods such as integrating with scheme once the account groups are created then you can move on to the next steps if you're using the workflows this would mean running the migrate groups workflow we recommend using the normal workflow instead of the experimental one it will first rename your workspace local groups and it will use the prefix that we set during the installation in this case it was DB temp or this renaming it will then reflect the account groups on the workplace this means it will assign the new account groups to the workspace it will finally apply the permissions to the account groups these permissions are the workpace level permissions of your clusters jobs ml models experiments all of those permissions will be applied in the end there's also step for validating group permissions you can also run that validate group permissions independently as a workflow so let's say after a couple of days you want to check that the groups permissions are still consistent you can run that and there's also a final step called remove workspace local backup groups which once you feel comfortable with the group migration you can run that to delete your renamed workspace old groups with that said let's see how this looks in the UI as you remember from last time I had this DB test group created at account lab but on my workspace I had two groups these two groups had members within them so to do this correctly from scratch I'm just going to delete this group from the account level and use the create account groups command to create them correctly okay so let's go to the terminal to run this so in my terminal I'm going to run data R slabs ucx create account groups in this case I'm using my profile to authenticate and I'm also passing the workspace ID which is the workspace I want to migrate so this is this workspace here so let's run this once this runs you can see it has created the test group one and test group two in the account so if I go to the account and I refresh here you can see I have my two groups with their correct memberships now that the create account groups command has been run we can go to run our migrate groups workflow so for that we go to workflows we search for our ucx workflows and we open the migrate groups work I'm going to click run now and this will run the migration you can see here the tasks in more detail you will verify the meta stor is attached rename workspace logo groups reflect account groups on workspace apply permissions to account and validate valid group permissions so now when it finish s running what you will see is you will be able to go to your [Music] settings identi and access groups and you will see that you have the old groups being renamed to DB temp and you have the new groups here created and the permissions have been assigned once you use this and you found that everything works correctly what you can do is you can go back to workflows and run the remove workpace local backup groups to delete the DB temp groups so you can click run now for that one and it will clean that up for you so now you can see this has successfully run and if I go back to the groups you can see the old groups have been successfully removed and we have only the remaining account groups thank you very much
Original Description
Master group migration in Unity Catalog with UCX! Learn how to seamlessly transition workspace-local groups to account-level groups while preserving membership.
This tutorial covers:
• Step-by-step process for migrating local groups
• Maintaining group memberships during the transition
• Best practices for account-scoped group management
• Common pitfalls and how to avoid them
GitHub repository for UCX: https://github.com/databrickslabs/ucx/blob/main/README.md
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Databricks · Databricks · 6 of 60
1
2
3
4
5
▶
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Building AI Agent Systems with Databricks
Databricks
Databricks Workflows
Databricks
Automate Unity Catalog Upgrade with UCX Part 1: Overview
Databricks
Automate Unity Catalog Upgrade with UCX Part 2: Installation
Databricks
Automate Unity Catalog Upgrade with UCX Part 3 - Assessment
Databricks
Automate Unity Catalog Upgrade with UCX Part 4 - Group Migration
Databricks
Table Migration and Catalog Design with UCX | Part 5
Databricks
Setting Up Azure Access for UCX Table Migration | Part 6
Databricks
UCX Table Migration: Creating Catalogs and Schemas | Part 7
Databricks
Automate Unity Catalog Upgrade with UCX Part 8: Code Migration
Databricks
Streaming to Kafka Just Got Easier with DLT Pipelines
Databricks
Data Engineering From Data to Dashboards with DABs: Crunching the Cookies Dataset
Databricks
Epsilon helps businesses connect with their consumers using Databricks Data Intelligence Platform
Databricks
Unilever transforms operations with GenAI using the Databricks Data Intelligence Platform
Databricks
ActionIQ enables businesses to unlock customer data with the Databricks Data Intelligence Platform
Databricks
Mixed Attention & LLM Context | Data Brew | Episode 35
Databricks
Inside Databricks SQL: Engineering innovation with Hans
Databricks
Inside Databricks: Engineering innovation with Michael Armbrust
Databricks
The Money Team at Databricks: driving revenue and customer growth
Databricks
Unity Catalog unveiled: engineering data governance at scale
Databricks
Create a view in Databricks and share it with Power BI using Delta Sharing
Databricks
NDUS leverages Databricks Data Intelligence Platform to revolutionize higher education management
Databricks
Démo Databricks de AI/BI
Databricks
EMEA Data + AI World Tour 2024
Databricks
GenAI: The Shift to Data Intelligence - Customer Panel on Industry Use Cases
Databricks
GenAI: The Shift to Data Intelligence - Ft. Ash Jhaveri, VP of Reality Labs Partnerships at Meta
Databricks
Virtue Foundation leverages the Databricks Data Intelligence Platform to advance global health
Databricks
Announcing Synthetic Data Generation in Mosaic AI Agent Evaluation
Databricks
AI/BI Dashboards Embedding - A tutorial
Databricks
Bayer transforms global data management with the Databricks Data Intelligence Platform
Databricks
Databricks at AWS re:Invent 2024
Databricks
Hive Metastore and AWS Glue Federation in Unity Catalog
Databricks
Data + AI World Tour Paris 2024
Databricks
Retail reimagined: Currys data-first strategy to driving growth and improving operations
Databricks
Mixture of Memory Experts (MoME) | Data Brew | Episode 36
Databricks
Verana Health Data Curation and Innovation with Databricks and AWS
Databricks
Securing SaaS Applications: Obsidian Security on Their Journey with Databricks and AWS
Databricks
Twilio Eng VP on Data Intelligence & AI at AWS re:Invent 2024
Databricks
Chegg Eng SVP on Data-Driven Approach to Student Success with Databricks and AWS
Databricks
Ibotta Personalized Rewards Innovation with Databricks and AWS
Databricks
Simplify AI governance with #databricks AI Gateway
Databricks
Databricks SQL and Power BI Integration
Databricks
Databricks Serverless SQL Warehouses
Databricks
7 West powers audience growth with the Databricks Data Intelligence Platform
Databricks
Secret to Production AI: Tools & Infrastructure | Data Brew | Episode 37
Databricks
Skyflow CEO on Data Privacy with Databricks at AWS re:Invent
Databricks
Databricks Clean Rooms Product Demo
Databricks
Dun & Bradstreet Enrichment & Monitoring, powered by Delta Sharing & Databricks Marketplace
Databricks
Unpacking Libraries in Databricks
Databricks
Providence uses an AI agent system from Databricks to help doctors improve their communication
Databricks
How State Street Uses AI to Transform Millions of Trades Daily
Databricks
Vevo Therapeutics CEO on Curing Disease with Data at AWS re:Invent
Databricks
Over Architected with Nick & Holly: Databricks updates for Feb 2025
Databricks
The Power of Synthetic Data | Data Brew | Episode 38
Databricks
Use Databricks Lakehouse Federation to break down data silos
Databricks
AI's rugby score: National Rugby League rallies fans with analytics and unified data
Databricks
Open Variant Data Type in Delta Lake and Apache Spark
Databricks
How would you sort Ætheldred in the alphabet using Databricks?
Databricks
A guide on how to operationalize the Databricks AI Security Framework (DASF)
Databricks
Future-Proof Your Asset Performance Management with Generative AI - Field Assistant Live Demo
Databricks
More on: AI Workflow Automation
View skill →
🎓
Tutor Explanation
DeepCamp AI