New in Migrations: Faster and More Predictable

· Source: Databricks · Field: Technology & Digital — Data Science & Analytics, Artificial Intelligence & Machine Learning, Cloud Computing & IT Infrastructure · Depth: Intermediate, quick

Summary

Databricks has enhanced Lakebridge, a free, open data migration tool, with new features designed to automate and simplify the process of moving off legacy data warehouses to the Databricks Platform. Since its launch last summer, Lakebridge has been used by over 1,000 customers and partners. The latest advancements include more comprehensive assessment capabilities, AI-powered SQL conversion, and a new guided user experience. The assessment feature, now supporting Synapse, profiles existing environments by analyzing metadata to provide insights into system configurations, resource utilization, query patterns, and performance metrics, publishing these to a Databricks dashboard. The AI-powered code conversion translates proprietary SQL dialects like T-SQL, Redshift, Teradata, Oracle, and Snowflake into ANSI SQL, leveraging an LLM-driven approach to handle complex transformations. Additionally, a new desktop app offers a guided, visual experience for planning and executing migrations, featuring automated checks and simplified workspace connectivity.

Key takeaway

For CTOs and VP of Engineering overseeing data strategy, Lakebridge offers a structured approach to mitigate the risks and unpredictable timelines associated with legacy data warehouse migrations. Your teams can leverage its AI-powered SQL conversion and comprehensive assessment tools to gain predictable effort and cost estimates, accelerating your transition to the Databricks Platform and reducing manual rework.

Key insights

Lakebridge automates data warehouse migrations using AI-powered SQL conversion and comprehensive environment assessment.

Principles

Method

Lakebridge assesses source environments, converts proprietary SQL dialects to ANSI SQL using LLMs, and provides a guided user interface for end-to-end migration execution.

In practice

Topics

Best for: CTO, VP of Engineering/Data, Data Engineer, MLOps Engineer, AI Architect

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Databricks.