Automate Unity Catalog Upgrade with UCX Part 4 - Group Migration

Databricks · Beginner ·🛠️ AI Tools & Apps ·1y ago

Key Takeaways

This video tutorial by Databricks covers the process of automating Unity Catalog upgrade with UCX, specifically focusing on group migration from workspace-local groups to account-level groups using Unity Catalog and UCX tools.

Full Transcript

hello everyone welcome to the next video on the ucx series on this video we will focus on group migration group migration is the next step after running the assessment workflow so what does group migration involve here you can see a comparison of the command line commands and the workflow commands generally you would prefer to run the workflows and we would recommend using the workflows for this however looking at the command line commands will give you us a better idea of what this steps involve you can see that in the workflows commands we don't have a create account groups task this is because this can only be done either using the command line or using other methods such as integrating with scheme once the account groups are created then you can move on to the next steps if you're using the workflows this would mean running the migrate groups workflow we recommend using the normal workflow instead of the experimental one it will first rename your workspace local groups and it will use the prefix that we set during the installation in this case it was DB temp or this renaming it will then reflect the account groups on the workplace this means it will assign the new account groups to the workspace it will finally apply the permissions to the account groups these permissions are the workpace level permissions of your clusters jobs ml models experiments all of those permissions will be applied in the end there's also step for validating group permissions you can also run that validate group permissions independently as a workflow so let's say after a couple of days you want to check that the groups permissions are still consistent you can run that and there's also a final step called remove workspace local backup groups which once you feel comfortable with the group migration you can run that to delete your renamed workspace old groups with that said let's see how this looks in the UI as you remember from last time I had this DB test group created at account lab but on my workspace I had two groups these two groups had members within them so to do this correctly from scratch I'm just going to delete this group from the account level and use the create account groups command to create them correctly okay so let's go to the terminal to run this so in my terminal I'm going to run data R slabs ucx create account groups in this case I'm using my profile to authenticate and I'm also passing the workspace ID which is the workspace I want to migrate so this is this workspace here so let's run this once this runs you can see it has created the test group one and test group two in the account so if I go to the account and I refresh here you can see I have my two groups with their correct memberships now that the create account groups command has been run we can go to run our migrate groups workflow so for that we go to workflows we search for our ucx workflows and we open the migrate groups work I'm going to click run now and this will run the migration you can see here the tasks in more detail you will verify the meta stor is attached rename workspace logo groups reflect account groups on workspace apply permissions to account and validate valid group permissions so now when it finish s running what you will see is you will be able to go to your [Music] settings identi and access groups and you will see that you have the old groups being renamed to DB temp and you have the new groups here created and the permissions have been assigned once you use this and you found that everything works correctly what you can do is you can go back to workflows and run the remove workpace local backup groups to delete the DB temp groups so you can click run now for that one and it will clean that up for you so now you can see this has successfully run and if I go back to the groups you can see the old groups have been successfully removed and we have only the remaining account groups thank you very much

Original Description

Master group migration in Unity Catalog with UCX! Learn how to seamlessly transition workspace-local groups to account-level groups while preserving membership. This tutorial covers: • Step-by-step process for migrating local groups • Maintaining group memberships during the transition • Best practices for account-scoped group management • Common pitfalls and how to avoid them GitHub repository for UCX: https://github.com/databrickslabs/ucx/blob/main/README.md
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Databricks · Databricks · 6 of 60

1 Building AI Agent Systems with Databricks
Building AI Agent Systems with Databricks
Databricks
2 Databricks Workflows
Databricks Workflows
Databricks
3 Automate Unity Catalog Upgrade with UCX Part 1: Overview
Automate Unity Catalog Upgrade with UCX Part 1: Overview
Databricks
4 Automate Unity Catalog Upgrade with UCX Part 2: Installation
Automate Unity Catalog Upgrade with UCX Part 2: Installation
Databricks
5 Automate Unity Catalog Upgrade with UCX Part 3 - Assessment
Automate Unity Catalog Upgrade with UCX Part 3 - Assessment
Databricks
Automate Unity Catalog Upgrade with UCX  Part 4 - Group Migration
Automate Unity Catalog Upgrade with UCX Part 4 - Group Migration
Databricks
7 Table Migration and Catalog Design with UCX | Part 5
Table Migration and Catalog Design with UCX | Part 5
Databricks
8 Setting Up Azure Access for UCX Table Migration | Part 6
Setting Up Azure Access for UCX Table Migration | Part 6
Databricks
9 UCX Table Migration: Creating Catalogs and Schemas | Part 7
UCX Table Migration: Creating Catalogs and Schemas | Part 7
Databricks
10 Automate Unity Catalog Upgrade with UCX  Part 8: Code Migration
Automate Unity Catalog Upgrade with UCX Part 8: Code Migration
Databricks
11 Streaming to Kafka Just Got Easier with DLT Pipelines
Streaming to Kafka Just Got Easier with DLT Pipelines
Databricks
12 Data Engineering From Data to Dashboards with DABs: Crunching the Cookies Dataset
Data Engineering From Data to Dashboards with DABs: Crunching the Cookies Dataset
Databricks
13 Epsilon helps businesses connect with their consumers using Databricks Data Intelligence Platform
Epsilon helps businesses connect with their consumers using Databricks Data Intelligence Platform
Databricks
14 Unilever transforms operations with GenAI using the Databricks Data Intelligence Platform
Unilever transforms operations with GenAI using the Databricks Data Intelligence Platform
Databricks
15 ActionIQ enables businesses to unlock customer data with the Databricks Data Intelligence Platform
ActionIQ enables businesses to unlock customer data with the Databricks Data Intelligence Platform
Databricks
16 Mixed Attention & LLM Context | Data Brew | Episode 35
Mixed Attention & LLM Context | Data Brew | Episode 35
Databricks
17 Inside Databricks SQL: Engineering innovation with Hans
Inside Databricks SQL: Engineering innovation with Hans
Databricks
18 Inside Databricks: Engineering innovation with Michael Armbrust
Inside Databricks: Engineering innovation with Michael Armbrust
Databricks
19 The Money Team at Databricks: driving revenue and customer growth
The Money Team at Databricks: driving revenue and customer growth
Databricks
20 Unity Catalog unveiled: engineering data governance at scale
Unity Catalog unveiled: engineering data governance at scale
Databricks
21 Create a view in Databricks and share it with Power BI using Delta Sharing
Create a view in Databricks and share it with Power BI using Delta Sharing
Databricks
22 NDUS leverages Databricks Data Intelligence Platform to revolutionize higher education management
NDUS leverages Databricks Data Intelligence Platform to revolutionize higher education management
Databricks
23 Démo Databricks de AI/BI
Démo Databricks de AI/BI
Databricks
24 EMEA Data + AI World Tour 2024
EMEA Data + AI World Tour 2024
Databricks
25 GenAI: The Shift to Data Intelligence - Customer Panel on Industry Use Cases
GenAI: The Shift to Data Intelligence - Customer Panel on Industry Use Cases
Databricks
26 GenAI: The Shift to Data Intelligence - Ft. Ash Jhaveri, VP of Reality Labs Partnerships at Meta
GenAI: The Shift to Data Intelligence - Ft. Ash Jhaveri, VP of Reality Labs Partnerships at Meta
Databricks
27 Virtue Foundation leverages the Databricks Data Intelligence Platform to advance global health
Virtue Foundation leverages the Databricks Data Intelligence Platform to advance global health
Databricks
28 Announcing Synthetic Data Generation in Mosaic AI Agent Evaluation
Announcing Synthetic Data Generation in Mosaic AI Agent Evaluation
Databricks
29 AI/BI Dashboards Embedding - A tutorial
AI/BI Dashboards Embedding - A tutorial
Databricks
30 Bayer transforms global data management with the Databricks Data Intelligence Platform
Bayer transforms global data management with the Databricks Data Intelligence Platform
Databricks
31 Databricks at AWS re:Invent 2024
Databricks at AWS re:Invent 2024
Databricks
32 Hive Metastore and AWS Glue Federation in Unity Catalog
Hive Metastore and AWS Glue Federation in Unity Catalog
Databricks
33 Data + AI World Tour Paris 2024
Data + AI World Tour Paris 2024
Databricks
34 Retail reimagined: Currys data-first strategy to driving growth and improving operations
Retail reimagined: Currys data-first strategy to driving growth and improving operations
Databricks
35 Mixture of Memory Experts (MoME) | Data Brew | Episode 36
Mixture of Memory Experts (MoME) | Data Brew | Episode 36
Databricks
36 Verana Health Data Curation and Innovation with Databricks and AWS
Verana Health Data Curation and Innovation with Databricks and AWS
Databricks
37 Securing SaaS Applications: Obsidian Security on Their Journey with Databricks and AWS
Securing SaaS Applications: Obsidian Security on Their Journey with Databricks and AWS
Databricks
38 Twilio Eng VP on Data Intelligence & AI at AWS re:Invent 2024
Twilio Eng VP on Data Intelligence & AI at AWS re:Invent 2024
Databricks
39 Chegg Eng SVP on Data-Driven Approach to Student Success with Databricks and AWS
Chegg Eng SVP on Data-Driven Approach to Student Success with Databricks and AWS
Databricks
40 Ibotta Personalized Rewards Innovation with Databricks and AWS
Ibotta Personalized Rewards Innovation with Databricks and AWS
Databricks
41 Simplify AI governance with #databricks AI Gateway
Simplify AI governance with #databricks AI Gateway
Databricks
42 Databricks SQL and Power BI Integration
Databricks SQL and Power BI Integration
Databricks
43 Databricks Serverless SQL Warehouses
Databricks Serverless SQL Warehouses
Databricks
44 7 West powers audience growth with the Databricks Data Intelligence Platform
7 West powers audience growth with the Databricks Data Intelligence Platform
Databricks
45 Secret to Production AI: Tools & Infrastructure | Data Brew | Episode 37
Secret to Production AI: Tools & Infrastructure | Data Brew | Episode 37
Databricks
46 Skyflow CEO on Data Privacy with Databricks at AWS re:Invent
Skyflow CEO on Data Privacy with Databricks at AWS re:Invent
Databricks
47 Databricks Clean Rooms Product Demo
Databricks Clean Rooms Product Demo
Databricks
48 Dun & Bradstreet Enrichment & Monitoring, powered by Delta Sharing & Databricks Marketplace
Dun & Bradstreet Enrichment & Monitoring, powered by Delta Sharing & Databricks Marketplace
Databricks
49 Unpacking Libraries in Databricks
Unpacking Libraries in Databricks
Databricks
50 Providence uses an AI agent system from Databricks to help doctors improve their communication
Providence uses an AI agent system from Databricks to help doctors improve their communication
Databricks
51 How State Street Uses AI to Transform Millions of Trades Daily
How State Street Uses AI to Transform Millions of Trades Daily
Databricks
52 Vevo Therapeutics CEO on Curing Disease with Data at AWS re:Invent
Vevo Therapeutics CEO on Curing Disease with Data at AWS re:Invent
Databricks
53 Over Architected with Nick & Holly: Databricks updates for Feb 2025
Over Architected with Nick & Holly: Databricks updates for Feb 2025
Databricks
54 The Power of Synthetic Data | Data Brew | Episode 38
The Power of Synthetic Data | Data Brew | Episode 38
Databricks
55 Use Databricks Lakehouse Federation to break down data silos
Use Databricks Lakehouse Federation to break down data silos
Databricks
56 AI's rugby score: National Rugby League rallies fans with analytics and unified data
AI's rugby score: National Rugby League rallies fans with analytics and unified data
Databricks
57 Open Variant Data Type in Delta Lake and Apache Spark
Open Variant Data Type in Delta Lake and Apache Spark
Databricks
58 How would you sort Ætheldred in the alphabet using Databricks?
How would you sort Ætheldred in the alphabet using Databricks?
Databricks
59 A guide on how to operationalize the Databricks AI Security Framework (DASF)
A guide on how to operationalize the Databricks AI Security Framework (DASF)
Databricks
60 Future-Proof Your Asset Performance Management with Generative AI - Field Assistant Live Demo
Future-Proof Your Asset Performance Management with Generative AI - Field Assistant Live Demo
Databricks

This tutorial teaches how to automate the migration of workspace-local groups to account-level groups in Unity Catalog using UCX, covering step-by-step processes, maintaining group memberships, and best practices for account-scoped group management. By following this tutorial, users can seamlessly transition their groups while preserving membership. The tutorial also covers common pitfalls and how to avoid them.

Key Takeaways
  1. Identify workspace-local groups to migrate
  2. Configure UCX for group migration
  3. Execute the migration process
  4. Verify group memberships
  5. Manage account-scoped groups
💡 UCX provides a seamless way to migrate workspace-local groups to account-level groups in Unity Catalog while preserving group memberships.

Related Reads

Up next
How I Used Gemini AI to Draft, Review & Analyze an NDA Contract | Complete Legal Drafting Workflow
Akshay Darade
Watch →