Category: Scalability

  • The Fragmented IoT Problem: Why a Unified Address Space is the Key to True Network Effects

    The Fragmented IoT Problem: Why a Unified Address Space is the Key to True Network Effects

    The Internet of Things promised connectivity, interoperability, and value at scale. Yet today’s commercial building ecosystems look more like a tower of Babel—a chaotic collection of proprietary protocols, incompatible devices, and vendor lock-in that fractures the vision IoT was supposed to deliver. The cost? Lost innovation, duplicated infrastructure, and value trapped in silos.

    The problem is fundamental: we’ve built the IoT on the wrong architecture.

    The Network Effect is Broken

    Bob Metcalfe’s famous law tells us that the value of a network is proportional to the square of the number of compatible communicating devices (n²). In a truly connected network of 1,000 devices working together, the value grows exponentially. But what happens when those 1,000 devices speak 10 different languages and belong to 5 different vendors?

    The network effect collapses. You’re left with isolated subnetworks—lighting systems that can’t talk to energy management systems, security devices that can’t integrate with facility operations. Each silo delivers minimal value. Each requires separate management, separate expertise, separate cloud platforms.

    The root cause isn’t complexity—it’s a lack of unified naming and addressing. Without a common way to identify and access information across devices, protocols, and physical mediums, interoperability remains theoretical. System integrators can’t build solutions freely. Customers remain locked in.

    The Wrong Paradigm: Host-Centric Architecture

    Most IoT protocols today are host-centric. They route data point-to-point: from Device A to Device B, through a broker, to a cloud application. The connection between hosts is what’s secured; the data itself is treated as ephemeral. Security protocols like TLS/DTLS require expensive multi-step handshakes that drain battery-driven devices. Devices must be constantly online to participate. Sleeping sensors miss group messages.

    This model was inherited from the Internet’s original design—built for servers and PCs with unlimited power and persistent connectivity. It’s a poor fit for IoT.

    Research in Information-Centric Networking (ICN) has demonstrated that the paradigm must shift: from securing connections between hosts to securing the data itself. When information becomes the focal point—not the endpoints—something remarkable happens. Data can be cached, forwarded, and processed at the edge by any device holding the right decryption key. Sleeping devices can pull information when they wake. Groups of devices can consume the same data without establishing point-to-point connections. Applications become simple data consumers instead of critical infrastructure.

    The Shift to Data-Centric Architecture

    In a data-centric model, the value is in the information, not the application. The app is merely a viewer. A temperature sensor publishes data on an “office/floor-3/temperature” topic. A HVAC controller subscribes to that topic. An analytics dashboard, a predictive maintenance system, a building optimization algorithm—all can subscribe to the same data stream independently. Each new subscriber adds exponential value without requiring changes to the infrastructure.

    This is where the network effect truly emerges.

    The Multiple Protocol Problem

    The PDF’s comparison table tells a sobering story. Look at the current landscape:

    • MQTT supports real-time pub/sub but has no support for sleeping devices
    • CoAP requires both endpoints to be online simultaneously and lacks standard encryption for multicast
    • LoRaWAN is a closed gateway architecture; firmware updates consume 20% of battery; LoRa is patented and controlled by American Semtech.
    • ZigBee is locked to a single physical layer (802.15.4); each gateway implements its own API
    • Thread requires IP routing, limiting its reach; device management is left to the implementer
    • Bluetooth has no device management standard and no central governance

    Every protocol solves pieces of the puzzle but fragments the overall picture. Worse, they’re all bound to specific hardware, owned by standards bodies with membership requirements, or controlled by corporations protecting intellectual property rights.

    This fragmentation kills what Z-Mesh pioneer researchers call “ubiquitous information access”—the ability to access and share data across different device types, physical mediums, and network domains using the same naming scheme.

    Z-Mesh: Breaking Vendor Lock-In and Enabling True Interoperability

    Z-Mesh is royalty-free and open source. It’s designed from the ground up for information-centric communication in constrained environments. Here’s why it matters for commercial building IoT:

    Unified Address Space Across Physical Mediums

    Z-Mesh uses a unified content-naming scheme that works across sub-GHz wireless, WiFi, Ethernet, and any other physical layers. A sensor’s data has the same address whether it travels over Z-Mesh radio or flows through a wired forwarder. This is the unified address space that Metcalfe’s law demands.

    Data-Centric Security

    Encryption targets the message itself, not the connection. Each MQTT-like topic has its own key. Only devices holding that key can decrypt the data—but any device can forward it. Sleeping devices don’t miss multicast messages because gateways cache them until the device wakes and requests the data. No expensive TLS/DTLS handshakes. No forced connectivity.

    Built-In Device and Data Management

    Unlike CoAP or Thread (which leave device management undefined), Z-Mesh includes:

    • Device management for secure network joining
    • Content management for topic/content subscriptions and key distribution
    • Both are standardized, not vendor-specific

    System Integrators Can Own the Solution

    Because Z-Mesh is open and royalty-free, system integrators can build devices, gateways, and analytics platforms without navigating certification bureaucracies or paying licensing fees. Customers own their data and infrastructure. A sensor from one vendor works seamlessly with a gateway from another. Applications can be swapped without ripping and replacing hardware. Everything can be on-prem and cloud-free.

    This is what freedom from vendor lock-in looks like.

    The EU Cyber Resilience Act: The OTA Update Imperative

    When the EU Cyber Resilience Act is ratified, it will mandate that connected devices receive security updates for extended periods. For IoT devices—especially battery-driven sensors in commercial buildings—this is a critical challenge.

    Z-Mesh is the only IoT protocol that enables efficient Over-The-Air (OTA) firmware updates for low-power battery devices. Why? Because:

    1. Data-centric encryption means firmware updates can be broadcast to groups of devices without expensive point-to-point setup
    2. Sleeping devices can pull updates when they wake, not miss them
    3. No multicast encryption gaps (the problem haunting CoAP and others)
    4. Efficient updates don’t drain batteries (unlike LoRaWAN’s 20% overhead)

    When regulatory requirements demand secure, continuous updates across your entire deployed base, Z-Mesh won’t force you to choose between compliance and battery life.

    Reclaiming the Network Effect

    The IoT was promised to us as a multiplier — each connected device increasing the value for all others. Instead, we’ve seen value diminish as proprietary protocols create walled gardens.

    A unified address space — accessible across physical mediums, secured at the data layer, owned by no single vendor — is the missing piece. It’s what unlocks genuine interoperability. It’s what lets system integrators build freely. It’s what keeps customers from being held hostage by lock-in.

    Z-Mesh demonstrates that this architecture is possible. Not as research. Not as speculation. As an open, deployable standard today.

    The question for building owners and operators isn’t whether to adopt Z-Mesh specifically. It’s whether your next IoT investment will be architected on principles of fragmentation and lock-in, or on the open interoperability that the network effect actually requires.

    The choice determines whether your IoT infrastructure becomes strategic asset or expensive debt.

  • Why Star Topologies Are Failing Smart Buildings — And Why Mesh is Winning the Indoor IoT War

    Why Star Topologies Are Failing Smart Buildings — And Why Mesh is Winning the Indoor IoT War

    When designing Internet of Things (IoT) networks for large commercial spaces or smart buildings, the natural instinct for many engineers is to look at what works for smartphones: Direct-link routing (a Star Topology). You place a central gateway or cellular access point in a hallway and expect every sensor, thermostat, and light bulb to speak directly to it. But buildings are brutal environments for wireless signals. Concrete walls, steel beams, tinted glass, and dynamic layouts turn star topologies into operational nightmares. If you want a truly efficient, resilient, and scalable building IoT deployment, Wireless Mesh Networks are no longer just an alternative—they are the architectural gold standard. Here is why.

    1. Energy Efficiency: From a “Scream” to a “Whisper”

    In a star topology, a sensor located deep within a mechanical room or on a different floor must blast its signal at maximum transmission power just to pierce through the building’s infrastructure to reach the central gateway. This raw power spike rapidly drains the battery, leading to frequent, costly maintenance cycles. The Mesh Advantage: A wireless mesh network operates on a “multi-hop” approach. Devices don’t need to shout across the building. Instead, a battery-powered sensor only needs enough energy to whisper its data to its nearest neighbor—perhaps a mains-powered smart light fixture just ten feet away. That neighbor passes the data to the next node, and so on, until it reaches the destination. By breaking a long, obstructed transmission into tiny, highly efficient hops, mesh networks extend device battery life from months to years.

    2. Spectrum Efficiency: Doing More with Less Airtime

    Radio spectrum is finite and crowded. In a traditional direct-link network, as you add hundreds or thousands of devices to a single central access point, the airwaves choke. Devices experience collisions, data packets drop, and they are forced to retransmit, compounding the congestion. The Mesh Advantage: Because mesh nodes communicate locally with immediate neighbors, they use spatial reuse to maximize the spectrum. Two nodes on the first floor can converse at a low power level on the exact same frequency block as two nodes on the fifth floor without interfering with each other. This dramatically slashes the overall ambient noise floor of the building’s radio environment, ensuring high throughput and minimal data packet loss.

    3. Structural Resilience: The Self-Healing Network

    Buildings are living environments. Heavy machinery moves, fire doors shut, and interior walls are put up overnight.

    • In a Star Network: If a new physical barrier blocks a sensor’s direct line to the gateway, that device drops off the grid entirely. It represents a single point of failure.
    • In a Mesh Network: The system is inherently self-healing. If a path becomes blocked or a specific node goes offline, the network’s routing protocol instantly calculates a new detour through surrounding active devices. The data still gets through, requiring zero manual IT intervention or “truck rolls” to fix.

    4. Scalability and Infrastructure Cost

    Expanding a star network means buying and wiring more expensive central gateways to fill dead zones. Conversely, a mesh network actually gets stronger and more reliable as it grows. Every new node you add to a mesh ecosystem acts as another potential router, creating more redundant paths and expanding the overall coverage footprint natively—without adding infrastructure overhead.

    Enter Z-Mesh: The Next Evolution of IoT Mesh

    While traditional mesh networks (like Zigbee or Thread) have pushed building automation forward, the IoT landscape is still plagued by proprietary fragmentation and heavy computational overhead. That is where Z-Mesh changes the game. Z-Mesh is an open, royalty-free Layer-3 IoT networking protocol designed to strip away vendor lock-in and optimize resource efficiency for modern deployments. It is uniquely suited for building IoT for three major reasons:

    • Information-Centric Networking (ICN): Unlike traditional networking that routes data based on where a device is (IP addresses), Z-Mesh utilizes a Content-Centric approach. Data is requested and routed based on what it is (e.g., asking for the payload location/hq/room101/temp). A unified namespace allows any device or application to retrieve data effortlessly, removing the need for complex, custom protocol bridges.
    • Ultra-Low-Power Caching: In Z-Mesh, sleepy, battery-driven sensors can wake up, broadcast their data, and instantly drop back into a deep sleep. The network itself takes care of caching and routing the message. If an application needs that sensor’s data later, the nearest network Content Store answers on behalf of the sleeping device.
    • Physical Layer Agnostic: Z-Mesh is built from scratch for the constraints of IoT. It can run on top of virtually any physical layer link — whether that’s Sub-GHz, 2.4 GHz, or even tunneled over standard UDP. It breaks down the silos, allowing low-power devices and edge applications from entirely different vendors to communicate natively in a single mesh.

    The Bottom Line

    If you are designing for smart buildings, relying on traditional direct-link star networks is a race against physics and battery life. Embracing wireless mesh architecture is the path to true efficiency and resilience—and open protocols like Z-Mesh are paving the way for a more interoperable, resource-friendly IoT future.

  • Kafka vs Z-Mesh

    Both Z-Mesh and Apache Kafka are both distributed event streaming platforms. Both can be used for real-time data processing, data integration and message queuing. But what are the differences?

    TLDR: Z-Mesh uses a request-response pattern and supports publish/subscribe. Kafka uses one-way message queues that supports event-streaming.

    Z-Mesh

    Z-Mesh is a distributed network of interconnected Forwarders, device and systems.

    Message pattern: request-response

    Kafka

    Kafka is a message queue / broker.

    Message pattern: One-way

    Consumers are systems like space-, cleaning or energy-optimization systems, Facility Management- or analytics- or manufacturing intelligence systems.

    Z-Mesh request-response pattern

    In Z-Mesh, the network is tasked with the responsibility to return the requested content (event). There are two scenarios, depending on whether the network has stored (cached) the content or not:

    • If stored, the network returns the content
    • If not stored, the network forwards the request to the producing node, which then responds with the content

    Z-Mesh data-frame

    Content (events) in a Z-Mesh network are pieces of data that are labeled with a Name and a sequence number. IoT-devices and systems (nodes) can request content by using it’s name and sequence number. Content produced by IoT-devices and systems are stored in the Forwarding nodes (Forwarders) for a set period of time (eg. 24 hours) and can be requested at a later time. This enables battery-driven IoT-devices to wake up from sleep and request or publish content.

    Event Streaming or Publish / Subscribe

    Event streaming or publish/subscribe is initiated by the requesting device, by sending a request to the network with a wildcard sequence number and a long timeout. When content is published, it is instantly forwarded to all the requesting nodes.

    Direct data-exchange

    Content between two nodes can be exchanged directly; Two wireless Sub-GHz nodes can exchange directly, without the need for a Forwarder/network being present.

    Kafka one-way message queuing

    In Kafka, producers (devices or systems) sends data/events to a queue (Kafka) which consumers then either receive or retrieve at a later point in time. Content flows one-way and as the request, by the consumer, is served by Kafka, it never reaches the producer.

    Encryption and authorization

    In Z-Mesh, any node (that has access to the network) can request any piece if content at any time, however only the nodes with the encryption key can decode it. The object of encryption is the content (event/data), not the connection like in TCP/IP.

    Kafka is built on top of TCP/IP and so the connection between the sender/receiver and Kafka is encrypted (TLS). It means that data is stored unencrypted in Kafka and that access to data (authorization) is implemented at the connection level.

    Application layer

    The Z-Mesh Device Management protocol defines data-formats for many types of events. This means that when consumers are given access to an event-stream (by providing them with the Content Name and Encryption Key) they are also provided with the data-format, so they know how to interpret the received data. The Z-Mesh network itself has no knowledge of the data-format.

    Like MQTT and Z-Mesh, Kafka is agnostic to the data-format. There is no standard that defines how producers and consumers “speak together”.

    Device Management

    The Z-Mesh Device Management protocol authorizes devices and systems to participate in the network. Each Content Name has it’s own encryption key and data-format and the Z-Mesh Device Management protocol defines how they are managed.

    Kafka, like MQTT, is a transport layer and does not define Device Management.

    Addressing content

    Any device or system in a Z-Mesh network is able to request (address) any piece of content.

    The value of a telecommunications network is proportional to the square (N2) of the number of connected compatible communicating devices
    — Bob Metcalfe

    Kafka is not designed as a network is was designed as a one-way event streaming platform. Addressing content is done by connecting to a message queue (topic). But you could argue that it supports addressing any piece of content by using the Message Queue Name (topic) as the address.

    A note on distributed systems

    Distributed systems has no single-point of failure. Z-Mesh is a distributed network. MQTT is an example of a centralized network.

    Comparison table

    Z-MeshKafkaMQTTLoRa
    PatternReq/ResOne-way
    ArchitectureDistributedDecentralizedCentralizedCentralized
    Central Device ManagementXX
    Application layerX
    Direct commsX
    Group comm.X
    Centrally manage secure data-flowsXX
    Offline supportXX
    Vendor neutral hardwareXXX
    Software update possibleXX(?)
    Uses 20% of battery.
    No vendors support it.
    Royalty freeXXX

  • Why Event Streaming for IoT?

    Event streaming is particularly well-suited for the Internet of Things (IoT) for several reasons, primarily due to the nature of IoT data and the requirements for processing that data in real-time.

    Here are some key factors that make event streaming an ideal fit for IoT applications:

    1. High Volume of Data:

    • Continuous Data Generation: IoT devices generate vast amounts of data continuously, often in real-time. Event streaming platforms can handle high-throughput data streams, making them capable of processing the large volumes of data produced by numerous IoT devices.

    2. Real-Time Processing:

    • Immediate Insights: Many IoT applications require real-time data processing to derive insights, trigger actions, or make decisions. Event streaming allows for the immediate processing of events as they occur, enabling timely responses to changing conditions (e.g., alerts for anomalies, automated adjustments in smart systems).

    3. Decoupling of Data Producers and Consumers:

    • Loose Coupling: Event streaming architectures decouple data producers (IoT devices) from data consumers (applications, analytics engines). This allows for greater flexibility in how data is processed and consumed, enabling multiple applications to subscribe to the same data stream without direct dependencies.

    4. Scalability:

    • Dynamic Scaling: Event streaming platforms can scale horizontally to accommodate increasing numbers of IoT devices and data streams. This scalability is crucial as IoT deployments grow and evolve over time.

    5. Data Integration:

    • Unified Data Pipeline: Event streaming platforms can serve as a central data pipeline that integrates data from various IoT devices and sources. This integration allows for a holistic view of the data and facilitates analytics, machine learning, and other processing tasks.

    6. Event-Driven Architecture:

    • Reactive Systems: IoT applications often benefit from an event-driven architecture, where systems react to events as they occur. Event streaming supports this paradigm, allowing for the development of reactive applications that respond dynamically to incoming data.

    7. Support for Complex Event Processing:

    • Advanced Analytics: Event streaming platforms enables the detection of patterns, trends, and anomalies in real-time. This is particularly valuable for applications like predictive maintenance, fraud detection, and smart city management.

    8. Durability and Reliability:

    • Data Persistence: Many event streaming systems provide durability and reliability features, ensuring that data is not lost even in the event of failures. This is important for IoT applications where data integrity is critical.

    Conclusion:

    In summary, event streaming is well-suited for IoT due to its ability to handle high volumes of real-time data, support for scalable and flexible architectures, and capabilities for immediate processing and integration. These features enable organizations to leverage IoT data effectively, driving insights and actions that enhance operational efficiency and decision-making.

  • IoT solutions must design for “anarchic scalability”

    In semi-open or closed loops (i.e., value chains, whenever a global finality can be settled) the IoT will often be considered and studied as a complex system due to the huge number of different links, interactions between autonomous actors, and its capacity to integrate new actors. At the overall stage (full open loop) it will likely be seen as a chaotic environment.

    Given widespread recognition of the evolving nature of the design and management of the Internet of things, sustainable and secure deployment of IoT solutions must design for “anarchic scalability”

    Source: Wikipedia: Internet of Things

  • Polite Spectrum Access (listen before talk)

    When an IoT device is about to transmit, it should listen if some other IoT device is transmitting before itself transmits. This is just like humans, we wait until the other finishes before talking. This is called Polite Spectrum Access. If you transmit without listening first, it is referred to as Aloha.

    Listen-before-talk (LBT) can increase the spectrum efficiency compared to Aloha by reducing the number of collisions and retransmissions.

    In Aloha, each node transmits its packets without checking if the channel is busy, which can lead to collisions and retransmissions. This can result in a significant waste of bandwidth and reduce the overall spectrum efficiency.

    LBT, on the other hand, requires each node to listen to the channel before transmitting, which can help to reduce the number of collisions and retransmissions. By listening to the channel, a node can determine if the channel is busy and wait until it is clear before transmitting.

    Studies have shown that LBT can increase the spectrum efficiency compared to Aloha by a factor of 2-5, depending on the specific scenario and parameters. For example, a study by the European Telecommunications Standards Institute (ETSI) found that LBT can increase the spectrum efficiency by a factor of 2.5 compared to Aloha in a scenario with a large number of nodes and a high traffic load.

    Here is a rough estimate of the spectrum efficiency gain of LBT compared to Aloha:

    • Aloha: 18% (this is a typical value for Aloha in a scenario with a large number of nodes and a high traffic load)
    • LBT: 45-60% (this is a rough estimate of the spectrum efficiency gain of LBT compared to Aloha, depending on the specific scenario and parameters)

    LoRa is based on a modulation scheme called Chirp Spread Spectrum (CSS). It means that during transmission it increases/decreases the frequency at a rate depending on the speed. This makes it almost impossible for CSS to use Polite Spectrum Access.

    The EU/US regulation states that an IoT device using the sub-GHz band (868MHz/915MHz) must only transmit 1% if the time, unless it is using Polite Spectrum Access (ETSI EN 300 220-2). Being polite allows for a much more efficient use of the frequency spectrum, which is very important as the frequency spectrum is a limited finite natrual resource. Going forward, we will have many more IoT devices using the spectrum, so using it efficiently is very important.

    Almost all commercial off-the-shelf FSK transmitters is able to be polite and listen before talk. Surely we must access the frequency spectrum most efficiently and not use inpolite transmitters.

  • LoRa is not frequency spectrum efficient

    LoRa uses a spread spectrum modulation technique to transmit data. While LoRa has some advantages, such as its ability to transmit data over long distances and its low power consumption, it is not considered to be a spectrum-efficient technology.

    There are several reasons why LoRa is not considered to be spectrum-efficient:

    1. Modulation technique: LoRa uses a modulation technique, which spreads the data signal across a wide frequency band. This can lead to a lower spectral efficiency, as the signal is spread across a wider frequency band than is necessary.
    2. Low data rate: LoRa is designed for low-data-rate applications, such as sensor networks and IoT devices. While this can be beneficial for certain applications, it also means that LoRa is not well-suited for higher-data-rate applications, which can be more spectrum-efficient.
    3. Listen-before-talk (LBT): LoRa is not able to use LBT due to it’s modulation technique. LBT increases the spectrum efficiency reducing the number of collisions and retransmissions.
    4. In-Building environments: LoRa (Long Range) has been developed for use in long range applications (kilometers) but is being used in building environments in which the long range is not needed. Higher data-rate modulation techniques, such as FSK or BPSK, allows for a shorter on-air transmission time therefore being more spectrum efficient.

    LoRa is not as spectrum efficient as other modulation schemes such as BPSK or TurboFSK, which can be implemented in an commercial of-the-shelf radio transceiver. Going forward, The number of IoT devices per square meter will only increase and since the amount of frequency spectrum available is is a natural and finite resource, we should strive to use it as efficiently as possible.

    Fun fact: The first wireless transmissions was done by Marconi using spark-gap transmitters, back in 1896. They basically emitted white noise, which could then be detected at long distances. Whenever a spark-gap transmission was in progress, it was using the entire frequency spectrum and hence only room for one transmission at a time! As time went on, the ability to modulate signals caused the frequency spectrum to be used much more efficiently.