A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

The nice thing about open source projects and standards is that there are so many of them to choose from. And on January 10, the Apache community welcomed Beam as its "="" project"=""> (getting top ...

New, useful Apache big data projects seem to arrive daily. Rather than relearn your way every time, what if you could go through a unified API? A long-standing joke about the Hadoop ecosystem is that ...

The Apache Software Foundation’s stable of open-source projects continues to grow, with the addition of two more top-level projects in the past 24 hours. They include a Google Inc.-backed unified ...

Google today announced that it has made a proposal to submit its Dataflow data processing technology to the Apache Software Foundation (ASF) in order to make Dataflow an Apache incubator project and ...

Setting up a data processing pipeline is a juggling act. What applications work with the backend? Can those applications work together? What about fitting it into existing infrastructure? The best ...

In a simple batch processing test, Google Cloud Dataflow beat Apache Spark by a factor of two or more, depending on cluster size On Tuesday, my company, Mammoth Data, released benchmarks on Google ...

Value stream management involves people in the organization to examine workflows and other processes to ensure they are deriving the maximum value from their efforts while eliminating waste — of ...