The Apache Software Foundation Announces Two New Top-Level Projects

Newest TLPs enable seamless management for data and AI workloads

Wilmington, DE, June 03, 2025 (GLOBE NEWSWIRE) -- The Apache Software Foundation (ASF), the global home of open source software the world relies on, today announced that Apache Gravitino and Apache StormCrawler have graduated from incubation and are now Top-Level Projects (TLP).

Apache Gravitino is a high-performance, open source metastore that unifies metadata across data warehouses, data lakes, lakehouses, streaming platforms, and AI systems. With a flexible and centralized architecture, Gravitino empowers organizations to seamlessly manage, discover, and govern distributed data and AI assets - eliminating data silos and simplifying modern data infrastructure. Supporting a broad ecosystem, including Apache Iceberg, Apache Hive, Apache Kafka, MySQL, PostgreSQL, and more, Gravitino provides a unified metadata layer to enable intelligent data discovery, governance, and lakehouse federation at scale.

"Gravitino is uniquely designed to bridge data and AI workloads. We're excited to deploy it across our multi-cloud AI clusters and contribute to many prioritized AI and agent-based use cases," said Jack Song, Director of Uber Data Platform. "Gravitino’s graduation marks its maturity entering the next level, backed by a thriving and engaged community."

Apache StormCrawler is an open source software development kit (SDK) for developers looking to build low-latency, scalable, and customizable web crawlers. The project consists of a collection of reusable resources and components, written mostly in Java and it uses Apache Storm®. StormCrawler is well suited for environments where URLs to be fetched and parsed arrive as a stream (i.e. continuously over time), as well as large-scale, recursive web crawling, especially when fast response times are important.

“Becoming an Apache Software Foundation Top-Level Project is a significant milestone for an open source community, and we are extremely proud of the accomplishment," said Julien Nioche, member of the Apache StormCrawler PMC. “We are eager to see how the StormCrawler community continues to grow, collaborate, and innovate as a TLP.”

Open source projects need healthy communities to thrive. The ASF provides projects with services and mentorship for building resilient and durable communities throughout their lifecycle. The Apache Incubator provides services to incoming projects (called podlings) that want to enter the ASF and adopt the Apache Way.

About The Apache Software Foundation (ASF)
The Apache Software Foundation (ASF) is the global home for open source software, powering some of the world’s most ubiquitous software projects including Apache Airflow, Apache Camel, Apache Cassandra, Apache Groovy, Apache HTTP Server, and Apache Kafka. Established in 1999, the ASF is at the forefront of open source innovation, setting industry standards to advance software for the public good. Learn more at https://apache.org.

ASF’s annual Community Over Code event is where open source technologists convene to share best practices and use cases, forge critical relationships, and learn about advancements in their field. https://communityovercode.org/
© The Apache Software Foundation. “Apache” is a registered trademark or trademark of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

CONTACT: Brian Proffitt
press@apache.org
Vice President, Marketing & Publicity
The Apache Software Foundation

Frequently Asked Questions

What is Apache Gravitino?

Apache Gravitino is an open-source metastore that unifies metadata across various data platforms like data warehouses, data lakes, and AI systems, enabling seamless data management and governance.

What is Apache StormCrawler?

Apache StormCrawler is an open-source SDK for building scalable and customizable web crawlers, suitable for environments with continuous URL streams and large-scale recursive crawling.

Why is this significant for the Apache Software Foundation?

The graduation of Gravitino and StormCrawler highlights the ASF's role in nurturing thriving open-source communities and providing a platform for innovative projects to reach maturity and widespread adoption.

First published on Wed, Jun 4, 2025

Enjoyed what you've read so far? Great news - there's more to explore!

Stay up to date with the latest news, a vast collection of tech articles including introductory guides, product reviews, trends and more, thought-provoking interviews, hottest AI blogs and entertaining tech memes.

Plus, get access to branded insights such as informative white papers, intriguing case studies, in-depth reports, enlightening videos and exciting events and webinars from industry-leading global brands.

Dive into TechDogs' treasure trove today and Know Your World of technology!

Disclaimer - Reference to any specific product, software or entity does not constitute an endorsement or recommendation by TechDogs nor should any data or content published be relied upon. The views expressed by TechDogs' members and guests are their own and their appearance on our site does not imply an endorsement of them or any entity they represent. Views and opinions expressed by TechDogs' Authors are those of the Authors and do not necessarily reflect the view of TechDogs or any of its officials. While we aim to provide valuable and helpful information, some content on TechDogs' site may not have been thoroughly reviewed for every detail or aspect. We encourage users to verify any information independently where necessary.

Tags:

Apache Gravitino Apache StormCrawler data management AI metadata web crawler open source data warehouse data lake data governance

Join The Discussion

- Promoted By TechDogs -

Data Management