InfoQ Live Logo

The Software Architects' Newsletter
January 2025
View in browser

Welcome to the InfoQ Software Architects' Newsletter! We bring you essential news and experience on emerging patterns and technologies from industry peers each month.

This month, we focus on "Next-generation architecture: from event-driven to cell-based architecture and beyond". Technologies, patterns, and practices from this topic span the entire "diffusion of innovation" graphs in our InfoQ Trends Reports 2024 eMag and InfoQ Software Architecture and Design Trends 2024 Report.

We also discussed the impact of these topics in our end-of-year podcast, "Key Trends from 2024: Cell-Based Architecture, DORA & SPACE, LLM & SLM, Cloud Databases and Portals".

News

DoorDash Uses Service Mesh and Cell-Based Architecture to Significantly Reduce Data Transfer Costs

In a recent move, DoorDash has significantly optimized its cloud infrastructure costs. The company faced increased cross-AZ data transfer costs when transitioning to a microservices architecture. To substantially reduce these costs, DoorDash implemented zone-aware routing with its Envoy-based service mesh, taking advantage of its cell-based architecture.

Stream All the Things: Patterns of Effective Data Stream Processing Explored by Adi Polak at QCon SF

Adi Polak, Director of Advocacy and Developer Experience Engineering at Confluent, presented "Stream All the Things—Patterns of Effective Data Stream Processing" at the latest QCon San Francisco. Polak's talk highlighted the persistent challenges of data streaming and unveiled pragmatic solutions that can aid organizations in managing scalable and efficient data streaming pipelines.

Inside Netflix's Distributed Counter: Scalable, Accurate, and Real-Time Counting at Global Scale

Netflix engineers recently published a deep dive into their Distributed Counter Abstraction, a scalable service designed to globally track user interactions, feature usage, and business performance metrics with low latency. Built atop Netflix's TimeSeries Abstraction, the system balances performance, accuracy, and cost through configurable counting modes, resilient data aggregation, and a globally distributed architecture.

Orchestrating a Path to Success - a Conversation with Bernd Ruecker

In this podcast, Michael Stiefel and Bernd Ruecker discussed how vital process orchestration is for solving business problems and how architects and developers often misunderstand it. They also discussed the importance of visual tools, training new developers, and the dangers of being trapped by the joy of technology.

Databases in 2024: Growth, Change and Controversy

Andrew Pavlo's annual retrospective on the database world has recently been released, covering trends and innovations from the past year. The opinionated report, "Databases in 2024: A Year in Review", highlights that while we may indeed be in the "golden era of databases", last year brought significant license changes, the rapid growth of DuckDB, and some surprising new releases.

Sponsored

Designing Data Intensive Applications (By O'Reilly) - Sponsored by ScyllaDB

In these three selected chapters from his book, Martin Kleppmann helps you navigate the fast-changing landscape of approaches to processing and storing data for data-intensive applications. Understand the distributed systems research upon which modern databases are built, learn from the data architectures of major online services, and more.

Download the three chapters from “Designing Data-Intensive Applications,” sponsored by ScyllaDB

Case Study

Software Architecture and the Art of Experimentation

Being wrong is frustrating, wasteful, sometimes embarrassing, and yet … inevitable. Especially with respect to software architecture, if you are never wrong, you are not challenging yourself enough and are not learning. But being wrong is psychologically painful enough that most people avoid it, primarily by never checking their work.

Some people think they can't test the architecture of a software product without building the whole thing. However, software architecture is not a single thing; it results from many decisions, each of which can be isolated and evaluated through experimentation.

While we can't avoid being wrong sometimes, we can reduce the cost of being wrong by running small experiments to test our assumptions and reverse wrong decisions before their costs compound. But here, time is the enemy. There is never enough time to test every assumption, so knowing which ones to confront is the art of architecting.

Successful architecting also means experimenting to test decisions that affect the system architecture, i.e. those decisions that are "fatal" to the success of the product you are building if you are wrong.

Knowing what to test is half the problem; the other half is devising effective but low-cost experiments that reveal flaws in one's assumptions.

This is the key idea behind the concept we call the Minimum Viable Architecture (MVA). The MVA is a set of decisions you believe will enable the increment of the system or product to sustainably deliver value over time.

The complete article explores the attributes of a good experiment.

This content is an excerpt from a recent InfoQ article by Pierre Pureur and Kurt Bittner, "Software Architecture and the Art of Experimentation".

To get notifications when InfoQ publishes content on these topics, follow "Architecture and Design", "Event-Driven Architecture", and "Cell-based Architecture" on InfoQ.

Missed a newsletter? You can find all of the previous issues on InfoQ.

Sponsored

Real-World Event Sourcing (Pragmatic Bookshelf) - Sponsored by Akka

Discover how event sourcing can help you build applications that are easier to understand, maintain, and scale. This book demonstrates how treating data as events can simplify complex problems and enhance software development. Through clear examples and practical tips, you'll learn to turn data streams into useful application states with event sourcing, master key rules and patterns for designing reliable and manageable systems, and apply fundamental building blocks like commands, aggregates, and projectors to tackle real-world challenges. Starting from the basics, you'll progress to advanced techniques that work seamlessly in practical applications.

Download the eBook “Real-World Event Sourcing (By Pragmatic Bookshelf),” sponsored by Akka

Upcoming Events

InfoQ and QCon: For practitioners, by practitioners

QCon London 2025 Conference & Training (April 7-11)

Get actionable insights into the latest architecture, AI, and cloud-native developments from 125+ senior practitioners leading innovation in software development. Add 2 days of optional training to upskill on essential software development practices. Save with early bird pricing before February 11. Team savings available for groups of 3+. Register now!


InfoQ Dev Summit Boston 2025 (June 9-10)

Join InfoQ Dev Summit Boston for two days of actionable advice from trusted, active senior software developers. Discover in-depth insights on critical topics like scalable architectures, resilience, and AI use cases. Early bird rate of $630 until February 11. Team savings available for groups of 3+. Join us and save your spot today.


QCon San Francisco 2025 Conference & Training (November 17-21)

QCon San Francisco showcases senior software practitioners driving enterprise innovation with emerging trends. Gain actionable insights from 60+ speakers across 12 tracks to transform your leadership and elevate your software development strategies. Don't miss our lowest price. Book by February 11 to save 45%! Limited group savings are available. Register now.


Coming soon!

InfoQ Dev Summit Munich 2025 (October 2025)

Back for it's second year, learn from 25+ senior software developers sharing how they are addressing current software development challenges. Leave with valuable inisghts and new ideas you can immediately apply to your work.


InfoQ Dev Summit New York 2025 (December 2025)

New for 2025. Join leading developers in New York as they share practical approaches and proven techniques to solve modern software development challenges. Learn from their real-world experiences, openly shared with the community.

About InfoQ

Senior software developers rely on the InfoQ community to keep ahead of the adoption curve. One of the main reasons software architects and engineers tell us they keep coming back to InfoQ is because they trust the information provided and selected by their peers.

We've been helping software development teams adopt new technologies and practices for over 19 years through InfoQ articles, news items, podcasts, tech talks, trends reports, and QCon software development conferences.

We hope you find this newsletter useful. If not, you can unsubscribe using the link below.

Unsubscribe

Forwarded email? Subscribe and get your own copy.

Subscribe

Follow InfoQ on:

If you are based in the European Economic Area (EEA), please contact us so we can provide you with the protections afforded to you under the General Data Protection Regulation (GDPR).

You have received this email because you subscribed to "The Architects' Newsletter". To stop receiving the Architects' Newsletter, please click the following link: Unsubscribe

- - -

C4Media Inc. (InfoQ.com), 705-2267 Lake Shore Blvd. West,
Toronto, Ontario, Canada, M8V 3X2