Starburst's AI Innovations for Enhanced Data Management
New innovations unify on-premises, hybrid, and multi-cloud data to power AI
Starburst, the leading data platform for applications and artificial intelligence (AI), has rolled out an exciting set of innovations across its signature offerings: Starburst Enterprise Platform and Starburst Galaxy. The introduction of Starburst AI Agent and new AI Workflows is aimed at propelling enterprise AI initiatives forward and paving the way for future-ready data architecture based on a sophisticated data lakehouse. By integrating distributed, hybrid data lakes, Starburst allows for faster, more secure, and collaborative access to data necessary for AI, applications, and analytics.
The push for AI is challenging the boundaries of traditional enterprise data architecture, with businesses often hindered by disjointed data scattered across multiple clouds, formats, and departments. Crafting effective AI workflows typically involves piecing together fragile pipelines, bridging communication gaps between disparate tools, and handling sensitive data under inconsistent governance. Outdated architectures make it hard to retrieve the right data efficiently, engage relevant stakeholders, and uphold essential policies, leading to slower experimentation, increased risks, and postponed outcomes.
"AI is raising the bar for enterprise data platforms, but most architectures aren't ready," stated Justin Borgman, CEO and Co-Founder of Starburst. "Ultimately, your AI's capabilities are bound by the data it can access. Starburst is effectively reducing the friction between data and AI by bringing distributed, hybrid data lakes into play, enabling enterprise data teams to build AI, applications, and analytics rapidly on a single, governed foundation."
Introducing Starburst AI Agents: Unleashing the Value of Enterprise Data
According to Rob Strechay, Managing Director & Principal Analyst at theCUBE Research, "Starburst uniquely empowers enterprises to accelerate AI adoption, cut costs, and realize value more swiftly by allowing access to all their data, regardless of its location across clouds, on-premises, or hybrid environments. The best part? Data’s intrinsic nature means they don’t need to relocate or migrate it to develop, train, or fine-tune their AI models."
Central to Starburst's latest developments is Starburst AI Workflows, a thoughtfully designed suite of capabilities that expedites the transition from AI experimentation to deployment for enterprises. These workflows link various aspects such as vector-native search, metadata-driven context, and robust governance on an open data lakehouse architecture. Additionally, the launch of Starburst AI Agent represents a significant enhancement: an out-of-the-box natural language interface that can be built and utilized by data analysts and application-layer AI agents to deliver faster insights to business stakeholders. With these innovations, enterprises can swiftly create and scale AI applications, relying on dependable performance, cost-efficiency, and an assurance of security and compliance.
Matt Fuller, VP of AI/ML Products at Starburst, commented, "We're transforming the data lakehouse into an enterprise-grade platform for AI agents and applications, designed from the ground up to cater to air-gapped environments without sacrificing flexibility. Whether deployed in a secure on-premise setting or a cloud-enabled system, Starburst ensures federated, governed access, real-time context, and high-performance query processing. We’re not merely accelerating AI innovation; we’re operationalizing it securely and at scale."
Highlighting New Starburst AI Innovations
- Starburst AI Agent – A built-in conversational interface tailored for secure natural language data documentation and insight generation, available in Private Preview.
- Starburst AI Workflows – This new tool addresses critical AI challenges by swiftly unlocking governed data to drive outcomes effectively. It combines AI search, SQL orchestration, and governance, offering features like AI SQL Functions without complicated data movement. Available in Private Preview.
- Simplifying AI Governance and Collaboration – Galaxy's AI-Powered Auto-Tagging enhances governance by employing large language models (LLMs) to identify sensitive data efficiently, allowing secure, self-service access for business users while reducing manual policy enforcement. Available in General Availability.
- Starburst Data Catalog – A cutting-edge metastore solution designed to replace Hive Metastore. It streamlines metadata management, query performance, and governance without vendor lock-in, currently in Private Preview.
- Fully Managed Iceberg Pipelines – Offering an end-to-end experience with automated maintenance for Iceberg, it simplifies operational data readiness at scale for users. Available now with various ingestion options, including Fully Managed Streaming Ingest and File Loader.
- Automated Table Management – Streamlining large-scale Iceberg operations that enhance efficiency through automatic compaction and cleanup, now available, improving query performance significantly.
- Starburst-Native ODBC – A high-performance driver designed to boost analytics across Starburst Enterprise and Galaxy without third-party dependencies, enhancing BI access.
- Starburst: Data-to-AI Readiness Blueprint – This new service offering aims to align organizational data infrastructure with evolving AI strategies, providing tailored roadmaps and architectural guidance, available now.
Powering AI Innovations Across Industries
Numerous enterprises have started leveraging Starburst's innovations, substantially benefiting from enhanced data management practices. Pedro Pereira, Staff Data Engineer at Going, noted, "Since embracing Starburst Galaxy for our Lakehouse framework, we have successfully utilized the Streaming Ingest function to handle vast amounts of flight and user data, leading us to be highly satisfied with its performance and utility. The Galaxy Orphan File Removal feature also significantly reduced our storage costs by approximately $1000 monthly."
Ricardo Cardante, a Staff Engineer at TalkDesk, mentioned, "Before using Starburst, managing our Iceberg tables was an arduous, error-prone endeavor that only covered a fraction of our data. However, now with Automated Table Maintenance, we've achieved total coverage, leading to a 66% cut in S3 storage costs—an immense leap for scaling Iceberg performance without overhead."
George Karapalidis, the Director of Data at Checkatrade, lauded User Role-Based Routing in Galaxy for its intuitive and seamless integration into their user experience, optimizing both cost and performance without adding to the operational burden.
Virtual Event: Starburst Launch Point
Starburst will host a virtual event on May 28, presenting its vision for AI alongside several exciting announcements regarding its data applications and AI platform. This is an opportunity for attendees to hear directly from industry experts and learn more about recent product innovations.
About Starburst
Starburst delivers a data platform tailored for flexibility and efficiency, ensuring rapid and secure access to data across various environments. Built on an open data architecture with Trino and Apache Iceberg, Starburst simplifies the management of distributed data without complex migrations, enabling businesses to harness the full potential of their data lakehouse for analytics and AI.
Starburst serves organizations in over 60 countries, including major players such as Comcast and Citigroup, to extract maximum value from their data. Partnering with leading cloud providers allows seamless interoperability across platforms, emphasizing a commitment to provide scalable, compliant data solutions that empower enterprises in their AI journeys.
Frequently Asked Questions
What are Starburst AI Agents?
Starburst AI Agents are built-in conversational interfaces designed to enhance access to natural language data documentation and insights within secure environments.
How do Starburst AI Workflows enhance enterprise AI initiatives?
These workflows streamline the process of unlocking governed data, enabling teams to pursue successful AI outcomes rapidly by connecting various data management functions.
What features are included in Starburst's latest innovations?
Innovations include AI Workflows, Data Catalog, automatic table maintenance, and a high-performance ODBC driver, all aimed at optimizing data management for better AI performance.
How has Starburst impacted organizations' data management?
Starburst has facilitated significant cost reductions and improved operational efficiencies for organizations, transforming their data handling processes and empowering them to maximize value from their data.
What can attendees expect from the upcoming Starburst virtual event?
Participants can look forward to insights from thought leaders, discussions on product innovations, and an overview of Starburst's vision for AI and data applications.
