The Apache Software Foundation Announces Apache® Beam™

New Post Public Reply Private Reply Replies (0) Message Board
News Desk 2018
92
The Apache Software Foundation Announces Apache® Beam™ as a Top-Level Project

Forest Hill, MD, Jan. 10, 2017 (GLOBE NEWSWIRE) -- The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today that Apache® Beam™ has graduated from the Apache Incubator to become a Top-Level Project (TLP), signifying that the project's community and products have been well-governed under the ASF's meritocratic process and principles. Apache Beam is a unified programming model for both batch and streaming data processing. It includes software development kits in Java and Python for defining the data processing pipelines, as well as runners to execute them on several execution engines, including Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow. "Graduation is an exciting milestone for Apache Beam," said Davor Bonaci, Vice President of Apache Beam. "Becoming a top-level project is a recognition of the amazing growth of the Apache Beam community, both in terms of size and diversity. Together we are pushing forward the state of the art in distributed data processing and, at the same time, enhancing the ability to interconnect additional storage/messaging systems and execution engines." The technology behind Apache Beam evolved in large part from Google's internal work on data processing, tracing its roots all the way back to the Google's initial MapReduce system and its fundamental changes to the science of distributed data processing. It also reflects modern advances in data processing, embodied in Google's FlumeJava and MillWheel systems, and culminating with the unified programming model of Google Cloud Dataflow, which became the heart of Apache Beam. This unified programming model can easily and intuitively express data processing pipelines for everything from simple batch-based data ingestion to complex event-time-based stream processing. The abstractions in the model are designed to support efficient parallel execution, while also cleanly separating the user's processing logic from details of the underlying engine. Raising the level of abstraction allows a single Apache Beam pipeline to run, without modification, on multiple execution engines. This portability across diverse execution engines is just one of many extensibility points that let Apache Beam integrate with the broader Apache and Big Data ecosystems. Beside runners, developers can already easily add support for additional IO connectors, libraries of transformations, SDKs, and even domain-specific extensions. "Apache Beam helps us make stream processing accessible to a broad audience of data engineers, by offering an API which is comprehensive, easy to reason about and at the same time fully decoupled from the underlying execution engine," said Assaf Pinhasi, Director of Big Data Platform at PayPal. "Our data engineers can now focus on what they do best – i.e. express their processing pipelines easily, and not have to worry about how these get translated to the complex underlying engine they run on." "The graduation of Apache Beam as a top-level project is a great achievement and, in the fast-paced Big Data world we live in, recognition of the importance of a unified, portable, and extensible abstraction framework to build complex batch and streaming data processing pipelines," said Laurent Bride, Chief Technology Officer at Talend. "Customers don't like to be locked-in, so they will appreciate the runtime flexibility Apache Beam provides. With four mature runners already available and I'm sure more to come, Beam represents the future and will be a key element of Talend's strategic technology stack moving forward." "We applaud the Apache Beam working group for its success in creating a unified and consistent platform for building portable data processing pipelines," said Fausto Ibarra, Director of Product Management, Google Cloud Platform. "We believe that we all have a responsibility to share what we're learning, and we are proud and delighted to witness the successful collaboration to build not only a powerful programming model for processing data from bounded and unbounded sources, but also a portability layer for running pipelines on many processing engines, including Apache Spark, Apache Flink, Apache Apex, and Google Cloud Dataflow. Apache Beam's graduation to Top Level Project is a well-deserved recognition for the individuals and companies who contributed to the project." "Apache Beam represents a principled approach for analyzing data streams, simplifying a range of complex data processing concepts and providing developers with a flexible, straightforward model," said Kostas Tzoumas, Co-founder and Chief Executive Officer at data Artisans. "The Apache Flink community wrote one of the first Beam runners, and those of us at data Artisans has been contributing to the Beam project since its inception."

"The Apache Beam community has quickly adapted the Apache Way and been very welcoming to new contributors and ideas. It also encourages communication across other projects that collaborate under the Beam umbrella," said Thomas Weise, Vice President of Apache Apex, and Chief Technology Officer/Co-Founder of Atrato. "Beam helps the wider ecosystem by establishing common terminology and well thought through concepts that reflect in multiple runners and even the native API of the underlying engines."

"In my work at Apache, I have rarely seen an incubating project build a community as well as the Apache Beam project has done," said Ted Dunning, Vice President of Apache Incubator, and Chief Application Architect at MapR Technologies. "The way that they have been able to complement and enhance other streaming data projects is really a credit to everyone involved."

"We'd like to invite you to consider joining us on this exciting ride, whether as a user or a contributor, as we work towards our first release with API stability," added Bonaci. "If you'd like to try out Apache Beam today, check out the latest 0.4.0 release. We welcome contribution and participation from anyone through our mailing lists, issue tracker, pull requests, and events." Catch Apache Beam in action at numerous face-to-face meetups and conferences, including Apache: Big Data North America 2017, DataWorks Summit and Hadoop Summit Munich 2017, Strata + Hadoop World San Jose and London 2017. Availability and Oversight Apache Beam software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For project updates, downloads, documentation, and ways to become involved with Apache Beam, visit https://beam.apache.org/ and @ApacheBeam. About the Apache Incubator The Apache Incubator is the entry path for projects and codebases wishing to become part of the efforts at The Apache Software Foundation. All code donations from external organizations and existing external projects wishing to join the ASF enter through the Incubator to: 1) ensure all donations are in accordance with the ASF legal standards; and 2) develop new communities that adhere to our guiding principles. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF. For more information, visit http://incubator.apache.org/ About The Apache Software Foundation (ASF) Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 620 individual Members and 5,900 Committers successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Alibaba Cloud Computing, ARM, Bloomberg, Budget Direct, Capital One, Cash Store, Cerner, Cloudera, Comcast, Confluent, Facebook, Google, Hortonworks, HP, Huawei, IBM, InMotion Hosting, iSigma, LeaseWeb, Microsoft, OPDi, PhoenixNAP, Pivotal, Private Internet Access, Produban, Red Hat, Serenata Flowers, Target, WANdisco, and Yahoo. For more information, visit http://www.apache.org/ and https://twitter.com/TheASF © The Apache Software Foundation. "Apache", "Beam", "Apache Beam", "Apache Apex", "Apex", "Apache Flink", "Flink", "Apache Spark", "Spark", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Sally Khudairi Vice President The Apache Software Foundation +1 617 921 8656

Scroll down for more posts ▼

Top 10 Most Recent News Articles

Kayla Harrison Dominates UFC 334, Earns Big Win

Updated Category News Views 59

Kicking off UFC 334 with a bang, Kayla Harrison didn't just step into the Octagon—she bulldozed her way through Amanda Nunes to retain her Women's Bantamweight Championship. This showdown didn't just electrify New York's Madison Square Garden, it shook the entire MMA landscape. Harrison, the face of Monster Energy's athlete roster, wasn't content with just defending her...

Continue Reading
FFR's Michigan Milestone and Major Robotics Update

Updated Category News Views 160

Nobody's going to argue that breaking into new territories isn't a gamble, but sometimes you just need to roll the dice. FF EAI Robotics Ecosystem Inc. (NASDAQ: FFR) is banking on their move with Aegis Ultra robots, making an academic splash at Central Michigan University. This isn't just about ticking off another state; it's about stacking the deck with new...

Continue Reading
Thunes Boosts Bhutan Remittances with Instant Payments

Updated Category News Views 161

Thunes' Network Expands to Bhutan: A Game Changer I'll say one thing clear—Thunes isn't messing around. They've just opened the gates for real-time payouts to Bhutan, and it's going to be a game-changer for those living abroad who want to send money back home. Look, for years, Non-Resident Bhutanese have been diving into hoops just to get their bucks across borders....

Continue Reading
Berry Street Integrates AI with What Matters: Human Touch

Updated Category News Views 283

Health Meets AI at Berry Street In recent waves of news, Berry Street has decided to toss MyScribe, a standalone AI service, into its shopping cart and welcomed its brainwave behind it, Dr. Wasif Bokhari, into their corridors. Yep, they’ve snagged both the tech and the mind! It's the kind of move that makes you stop midway through your diner coffee. Here’s Berry...

Continue Reading
Princess Cruises Launches New Era at Celebration Key

Updated Category News Views 229

Never thought I'd see the day when a cruise ship docking would stir such excitement, but here we are. The Star Princess has made its grand debut at Celebration Key, the latest jewel in Princess Cruises' crown. And they're going all out with Bahamian flair—something about a Junkanoo band and beach art that would make even the crustiest sailor crack a smile. Inaugural Fun...

Continue Reading
Pan-Mass Challenge Gifts $80M to Dana-Farber for 2026

Updated Category News Views 266

A Momentous Gift in a Crunch Time for Cancer Research Biking and philanthropy might seem like an odd duo, but let me tell you, the Pan-Mass Challenge (PMC) is making that partnership look like peanut butter and jelly. This year, PMC rolled out a jaw-dropping $80 million gift to the Dana-Farber Cancer Institute. You heard right—eighty million smackeroos. Talk about going...

Continue Reading
Employment Law Suit Hits ABC: Alleged Wage Violations

Updated Category News Views 238

ABC Under Fire for Labor Code Violations You know it's a rocky road when a company like American Broadcasting Companies, Inc. lands itself in hot water with accusations riding high on labor law violations. People yapping about lunch breaks? Well, that’s the ball game here. Meal and Rest Break Controversies According to a recent lawsuit filed by Blumenthal Nordrehaug...

Continue Reading
Pony.ai & Toyota Launch 1,000 Gen-7 Robotaxis in China

Updated Category News Views 18

Revving Up the Autonomous Ride Revolution Not every day you see two giants, Pony.ai and Toyota, join forces to shake up the way folks get from A to B. But here we are — they’ve fired up their engines in Guangzhou, unleashing their Gen-7 bZ4X Robotaxis for commercial use. And let me tell you, this is no shot in the dark. With plans to dot about 1,000 of these...

Continue Reading
Portillo's Faces Class Action: Investor Losses at Stake

Updated Category News Views 286

Investor Tensions Rise as Portillo's Inc. Lawsuit Unfolds Investment ain't all sunshine and rainbows, and if you've been holding Portillo's Inc. (NASDAQ: PTLO) stocks between September 19, 2023, and May 4, 2026, you might find yourself caught in a storm front. We're talking shareholder class action lawsuit, folks, thanks to some allegedly misguided management moves. This...

Continue Reading
Innovent's Big Leap: Targeting European Lung Cancer Market

Updated Category News Views 131

Innovent's Regulatory Milestone in Europe They say every underdog has its day, and for Innovent Biologics, that time just might be now. Receiving a positive opinion from the Committee for Medicinal Products for Human Use (CHMP) is no small potatoes. Especially when we're talking lung cancer—a notorious heavyweight in the cancer world. The Finer Details of Zybrivo’s...

Continue Reading

Top 5 Most Recently Viewed Articles

Elon Musk Reflects on PayPal Departure: Insights and Implications

Updated Category News Views 269

Elon Musk's PayPal Exit: A Twist of Fate Elon Musk, the CEO of Tesla Inc. (NASDAQ: TSLA) and SpaceX, recently spoke candidly about his departure from PayPal Holdings Inc. (NASDAQ: PYPL). He described the situation as a "palace coup,” asserting that significant members of the executive team conspired against him. According to Musk, the decision to push him out was met...

Continue Reading
Stellantis Approves Major Dividend Distribution and Board Appointments

Updated Category News Views 210

Stellantis Annual General Meeting Outcomes Stellantis N.V. recently held a significant Annual General Meeting where notable resolutions received the green light from shareholders. The meeting, attended in person and streamed online, showcased Stellantis' commitment to engaging with its stakeholders. Dividend Distribution Approved One of the key highlights was the approval...

Continue Reading
Smart Strategies to Stay Safe During Summer Storms

Updated Category News Views 259

Stay Prepared for Summer Storms Be Prepared & Keep Safety in Mind, Says the Outdoor Power Equipment Institute As we enter the summer storm season, it is crucial to equip ourselves with essential outdoor power equipment to withstand potential disruptions. The Outdoor Power Equipment Institute emphasizes that being proactive can help minimize damage caused by high winds,...

Continue Reading
NativState Delivers Verified Carbon Credits from New Projects

Updated Category News Views 136

NativState's Latest Milestone in Carbon Credit Verification In a significant achievement for environmental sustainability, NativState, LLC, based in Conway, Arkansas, has successfully verified and released high-quality carbon credits from two groundbreaking projects. These efforts highlight the company's commitment to fostering nature-based solutions that combat climate...

Continue Reading
Qatar Airways and QNB Group Forge New Ground in Financing

Updated Category News Views 725

Qatar Airways and QNB Group Join Forces for Strategic Financing Recently, the Qatar Airways Group secured a significant loan facility with several local banks amounting to QAR 4.5 billion. This remarkable financial arrangement represents a strategic step forward for Qatar Airways, aligning with the national vision to promote sustainable economic growth in the region....

Continue Reading