Category: Interoperability

  • US NIST: Interoperability is the problem

    A report, made for the U.S. National Institute of Standards (NIST),

    Similar results to what Eclipse IoT finds in their survey.

    Foundational gaps that hinder the scaling of IoT:

    InteroperabilityThe lack of interoperability hinders different devices and systems from integrating, communicating and sharing information with each other.
    Barriers to achieving interoperability include limited focus of standards initiatives, resistance to open and industry consensus standards, regional standards and standards implementation errors and deviations.
    Cybersecurity
    Privacy
    ConnectivityConnectivity challenges are multi-dimensional in nature and challenging to solve due to various factors, including the need for substantial infrastructure investment, the lack of a “one size fits all” approach along with issues in market economics, funding and incentives, “last acre” coverage and spectrum.
    Data management
    challenges
    As IoT scales, so does data management complexity. The IoT data collected comes in a variety of types, formats and sizes. Some data are time-sensitive and must be processed immediately while others are stored for future actions. Data may be required to comply with industrial, state and national regulations. Robust data management is foundational for artificial intelligence systems. Data management challenges are complicated by exponential growth in data volume and velocity, privacy considerations, cybersecurity factors, interoperability concerns and regulatory compliance requirements.
    IoT data ecosystemThe future IoT data ecosystem is envisioned to be a highly interconnected network where data generated by IoT devices and systems is seamlessly shared, monetized and utilized across various sectors.
    There are, however, a number of technical challenges to building such an IoT data ecosystem. These include data quality, interoperability, privacy and security, data sovereignty, scaling and standards for data management.
    Communications and
    network infrastructure
    Industry analysts estimate that there will be 55.9 billion IoT devices generating 79.4 zettabytes (ZB) of data by 2025. Current communication networks and architectures are not designed to manage the needs of IoT at this scale.
    New processes and technologies for configuring, managing, operating and maintaining the hyperconnected network will be necessary. Representative areas of infrastructure innovation are needed to support real-time autonomy and complex IoT applications, be fault tolerant and resilient and defend and heal against threats.

    Good quotes:

    P. 28: There are millions of legacy and OT systems in use today, from manufacturing machinery to Programmable Logic Controllers (PLCs) and SCADA (Supervisory Control and Data Acquisition) systems. While some of these legacy and OT systems may offer data collection and control capabilities, they were not designed to connect to and communicate across the Internet.
    It is neither feasible nor practical to replace all these legacy and OT systems with new connected “smart systems”. Some of the legacy systems must be retrofitted with IoT technologies to enable them to connect, communicate and be interoperable with existing systems and modern smart systems. An ecosystem of solutions providers who build “bridging” solutions is required.

    p. 29 (Edge computing / Problem with device-to-cloud): In a traditional IoT architecture, data is routed from the device to a remote cloud data center for processing and storage. Not all data collected needs to be or should be sent to the cloud for processing. In mission critical applications or in those where connectivity is intermittent or unreliable, processing is performed at the gateway or by the device itself. A 2022 survey of 910 IoT developers’, conducted by the Eclipse IoT Foundation, found that the top computing workloads performed at the edge were artificial intelligence (38% of respondents), control logic (34%), data exchange across multiple nodes (22%) and data analytics (20%).

    P. 30: While this approach leads to lower development and ownership costs, continuous innovation, improved code functionality, performance and resilience and mitigation of vendor lock-in concerns associated with proprietary software, there are implications for long-term maintenance and cybersecurity updates.

    P. 35: Interoperability

    • In transportation and logistics, the lack of universal standards for freight systems hampers data exchange, causing supply chain delays and increased costs.
    • Smart cities, filled with IoT devices and systems owned by different entities, struggle with interoperability, locking cities into specific vendor solutions and preventing efficient data exchange between systems.
    • Healthcare also suffers from fragmented, incompatible systems that make it difficult for medical devices to communicate, slowing down care and reducing operational efficiency.
    • In renewable energy, interoperability is crucial for grid reliability, but inconsistent standards and policies hinder the integration of distributed energy resources (DERs) and energy management systems into the grid.

    Ultimately, across these sectors, the lack of universally adopted standards and reliance on proprietary systems prevents seamless communication and data sharing, leading to inefficiencies, higher costs and reduced innovation. Without a concerted effort to adopt open standards and improve interoperability, these industries will continue to face challenges in maximizing the potential of their technologies.

    As IoT scales, so does data management complexity.

    Robust data management capabilities simplify these challenges and help unlock the value of IoT by enabling massive amounts of data to be collected, processed, stored, discovered, queried and analyzed.

    P. 37: However, data management faces a variety of challenges:

    • In the construction industry, the integration of IoT with Building Information Modeling (BIM) systems is challenged by siloed and fragmented data from various contractors, their reluctance to share data and a general lack of trust in a fragmented value chain.
    • In transportation and logistics, managing the vast data generated by IoT systems in the global supply chain is essential for smooth operations. With data flowing through multiple touchpoints such as manufacturing, transportation and warehousing, the challenge for supply chain and technology managers lies in handling decentralized and diverse data formats, while adhering to various regulatory standards. The exponentially growing volume of data requires businesses to have a scalable infrastructure capable of processing and storing information effectively.

    P. 38 Industrial: In manufacturing, factories are faced with a challenging wireless environment, where machinery, metallic surfaces and concrete structures interfere with signal propagation and create latency. Many manufacturing operations require real-time data monitoring, making on-device or local gateway processing essential. Additionally, many factories lack the necessary network infrastructure to support connected operations, further hindering their deployment of edge computing solutions.

    The high cost of implementing IoT presents a major barrier to their adoption across industries like manufacturing and retail. A large manufacturer may operate multiple factories containing thousands to hundreds of thousands of machines and production equipment of varying types. The cost to fit all production equipment in these factories with various devices can be cost prohibitive. The total IoT investment required is more than just devices, as hardware is usually around 30% of the initial implementation cost. Additionally, the total cost of implementing IoT includes not just the devices, but also infrastructure upgrades, professional services and recurring costs for cloud services. Small and medium-sized manufacturers face even greater challenges due to limited capital and outdated infrastructure.

    P 39: For smart cities, edge computing is crucial for managing the growing number of IoT applications that demand real-time data analysis and processing at the device, gateway, or local server level. However, technical advances are needed in areas like scalable architectures, energy efficiency, interoperability and cybersecurity to fully realize the potential of smart city technologies. Without these improvements, cities will struggle to support the vast amount of data generated by IoT devices, limiting the effectiveness and expansion of smart urban environments.

    P. 77: Interoperability: 6.1.1

    P 91: Connectivity – spectrum 6.1.4.3.

    6.2.1. Intelligence: Data management

    The problem with Interoperability has been solved by the royalty-free layer-3 protocol Z-Mesh: https://z-mesh.org/

    For IoT to succeed, it must be:

    1. Scalable (async to support offline devices): have a look at why Apache Kafka is a success.
    2. Interoperable (Network Effect): Any IoT-event (eg. temperature reading) must be accessible to any other client
    3. Support for both Constrained and TCP/IP devices
    4. Royalty-free: Not patented by anyone. It must be an equal market in which any vendor can contribute sensor or app or networking equipment – look at the success of the Internet
    5. Direct Devices-to-Device communication: To support Edge and low-latency AI applications, sensor-to-cloud technologies are not good enough.

    Download the report here: https://strategyofthings.io/nist

  • EU Landscape report on Interoperability

    Quotes:

    The energy system is therefore progressively evolving from a system centrally operated and optimized into a federated system … As a consequence the associated digital infrastructures need to accelerate their transformation from few central monolithic control room environments … towards new orchestrated platform architectures taking advantage of IOT, edge computing as well as hybrid private and public cloud architectures where real-time data exchanges, interoperability and Open Application Programmable Interfaces have become critical technology building blocks to enable plug and play data interfaces.

    Enterprise service bus (ESB) or other integration solutions were used for the deployment of first Service Oriented architectures to decouple systems. However, the number of connectors, as well as the growing requirements for heterogeneous data consuming interfaces feeding a variety of data interfaces through real-time has led applications, system components and enterprise services to remain closely intertwined, as legacy SCADA platform vendors did not provide sufficient reengineering efforts to establish interoperability across data interfaces although the emergence the IEC CIM standards. This situation has limited the possibility to integrate platform and application from different vendors as well as expand control room platforms with modern technology stacks developed through the opensource community.

    Event streaming platforms:

    This recent transformation is progressively heading towards the migration of original Control Room platforms into new event streaming platforms leveraging events as a core integration principle and orchestrating most of energy management and control business processes around real-time data streams. This new architecture is designed in view of the event data flows while data processing is orchestrated on data while they are in motion. It has the following key benefits:

    • Event-based data flows is a foundation for (near) real-time and batch processing as required in most of flexibility management processes. In previous SOA architectures, applications were built on data stores (data at rest), which was making it impossible to build flexible and agile services to act on data very close to real-time.
    • Scalable architectures for all events shared across infinite source and sink processes. As opposed to centralised monolithic applications, the architecture is built on scalable, distributed infrastructures by design for zero downtime, handling the failure of nodes and networks while being able to roll out upgrades online. Different versions of infrastructure (like Kafka) and applications (business services) can be deployed and managed in an agile, dynamic way. This approach minimises dependencies across application which was particularly complex to manage through historical SOA architectures.
    • Openness to any kind of applications, system components and microservices. Technology does not matter. The streaming environment connects anything: programming languages, APIs like REST or MQTT, open standards, proprietary tools, and legacy applications which reduces the need to redesign existing legacy applications while benefitting from highly scalable cloud containerized environments enabling rapid prototyping of new applications. It also allows to minimize processing speed constraints for real-time control applications.
    • Distributed storage for decoupling applications. The platform data streaming environment allows to store the state of a microservice instead of requiring a separate database.
    • Stateless service and stateful business processes. Business processes typically are stateful processes. They often need to be implemented with events and state changes, for which remote procedure calls and request-response as considered through SOA architecture is not optimal.

    The solid Open Source approach deployed around Apache Kafka makes it the preferred choice…

    Link to the report

  • Digital sovereignty for Europe

    Where is EU is heading in the IoT space?

    Quotes from the PDF

    1. Europe’s ability to act independently in the digital world
    2. Reliable digital infrastructure and services are critical in today’s society
    3. There are calls to build a European cloud and data infrastructure to strengthen Europe’s data sovereignty and address the fact that today, the cloud and data storage market is almost exclusively dominated by non-European suppliers.
    4. Furthermore, investment in frontier technologies, including artificial intelligence, IoT,…
    5. In the long run, building a genuinely sovereign EU digital environment will also require addressing the current lack of coordination between regulators in this field. … Such mechanisms would be critical for instance to ensuring a coherent EU sovereign approach in many areas, such as applications management (e.g. apps or IoT devices in the data privacy field), or platform regulation.

    An open IoT platform approach is absolutely critical and will succeed in the long run.

    What EU is saying

    Rolf Riemenschneider – Head of Sector IoT at European Commission:

    Quotes:

    • 4:38 Aver the air updates
    • 5:00 Avoid Vendor lock in
    • 6:40 Support IoT – Platform approach in the centre – demonstrate orchestation across application sectors (application agnostic)
    • 7:22: So a Platform approach to enforce an open ecosystem
    • 8:00 Open Core – 8M EUR to attract Open Core Open source developers
    • 8:36: Open Calls for a vibrant IoT ecosystem
    • 8:58: Interoperability – most important. Open Interface, Open standards
    • 10:10 Lack of cross sector orchestration
    • 11:20 Data sharing (quite a challenge) – we must go back to the platform strategy/standards

    Max Lemke – Head of Unit for IoT

    Quotes:

    • 1:56 Competitiveness and Standardization are mentioned again and again in the Draghi Report
    • 2:40 Geopolitical tensions … we are either smached in the middle or we find our way … underscoring the need for unified IoT standardization in Europe
    • 3:33 By fostering collaboration and sharing we can better navigate these challenges
    • 6:01 We [must] merge things of different ownership [vendor] into a integrated infrastructure
    • 7:40 We need to look at Open Platforms … not driven by one actor
    • 8:32 It means a multi-sided market place with different actors … and standards are crutial for scalability
    • 9:00 They enable devices from different manufactures … to ensure interoperability …

  • Interoperability is the devil

    40% of the total economic value of the Industrial IoT will remain locked

    In any interconnected system, all of its component devices must be able to communicate with each other—to speak in the same language, even if these devices work in very different fields. A lack of common software interfaces, standard data formats, and common connectivity protocols are complicating things in IoT-land. For industries, this means that 40% of the total economic value of the Industrial IoT will remain locked because different systems cannot work together.

    Source: Madison.tech

    Standardization creates interoperability

    The lack of standardization creates interoperability issues, which can lead to compatibility problems and limited functionality.

    For example, if two IoT devices cannot communicate with each other because they use different protocols or data formats, they cannot work together to achieve a common goal.

    Source: LinkedIn

  • IETF believes in ICN for IoT

    Internet Ingineering Task Force (IETF), the group that governs the Internet Standards (RFCs), believes that Information-Centric Networking (ICN) is much better suited to IoT than the current host based paradigms such as TCP/IP. Here are their findings:

    https://datatracker.ietf.org/doc/html/draft-irtf-icnrg-icniot-03

  • Why is patented infrastructure a problem?

    Patented infrastructure is a problem because it can limit access, stifle competition, increase costs, reduce interoperability, and create dependence on a single entity, ultimately hindering innovation and progress.

    1. Limited access: When infrastructure is patented, it can limit access to the technology and prevent others from using it, even if they have a legitimate need to do so.
    2. High costs: Patent holders can charge high licensing fees to use their patented technology, which can make it difficult for others to access the infrastructure.
    3. Innovation stifling: Patented infrastructure can stifle innovation by preventing others from building upon or improving the existing technology.
    4. Dependence on a single entity: When infrastructure is patented, it can create a dependence on a single entity, which can be a risk if the entity experiences financial difficulties or changes its business model.
    5. Limited interoperability: Patented infrastructure can limit interoperability with other technologies and systems, making it difficult to integrate with other solutions.
    6. Barriers to entry: Patented infrastructure can create barriers to entry for new companies or individuals who want to enter the market, as they may not be able to access the patented technology.
    7. Inequitable distribution of benefits: Patented infrastructure can lead to an inequitable distribution of benefits, as the patent holder may reap most of the benefits while others may not be able to access the technology.

    In the context of infrastructure, patents can be particularly problematic because they can limit access to essential technologies and create barriers to entry for new companies or individuals. This can lead to a lack of competition, innovation, and progress in the field.

    In contrast, open standards and technologies can promote innovation, competition, and progress by allowing multiple companies and individuals to access and build upon the technology.

    Quoting the Linux Foundation report “The 2023 state of open standards”:

    Royalties and patent licenses are seen as a way for organizations to recoup investment costs in developing new technologies and are argued to provide incentives for innovation. In practice, however, this approach can reduce innovation in the market when these fees are cost-prohibitive to new entrants and viable alternatives to the incumbent, royalty-bearing standards are not available.
    Therefore, Royalty Free essential patent licensing standard options are seen as an important way to ensure competitive, democratic access to innovation, greatly reducing the risk of an organization monopolizing the market or controlling access to important market technology.

    Non-royalty free wireless communication standards:

    • WiFi
    • Bluetooth
    • Zigbee
    • Matter / Thread
    • LoRa

    Royalty free wireless communication standards:

    • Z-Mesh
    • FSK / OOK / BPSK
    • Wireless M-Bus

  • IoT is infrastructure

    IoT (Internet of Things) is considered infrastructure because it provides a foundation for the development of various applications and services that can be used by individuals, businesses, and governments. Just like roads, bridges, and highways provide a physical infrastructure for transportation, IoT provides a digital infrastructure for the exchange of data and information between devices, sensors, and systems.

    IoT infrastructure includes:

    • Devices: Sensors, actuators, and other devices that collect and transmit data.
    • Networks: Wireless and wired networks that connect devices and sensors.
    • IoT Platforms: Software platforms that manage encryption keys, data-flows, devices and sensors.

    Just like physical infrastructure, IoT infrastructure requires investment, maintenance, and management to ensure its reliability, security, and efficiency.

    IoT (Internet of Things) can be compared to infrastructure in several ways:

    1. Enabling connectivity: Just like roads, bridges, and highways enable the movement of people and goods, IoT enables the connection of devices, sensors, and systems to the internet, facilitating the exchange of data and information.
    2. Providing a foundation: Infrastructure provides a foundation for economic growth, development, and innovation. Similarly, IoT provides a foundation for the development of smart cities, industries, and services.
    3. Facilitating communication: Infrastructure enables communication between people, businesses, and governments. IoT facilitates communication between devices, sensors, and systems, enabling real-time data exchange and decision-making.
    4. Enabling efficiency and productivity: Infrastructure can improve efficiency and productivity by reducing congestion, improving logistics, and enhancing supply chain management. IoT can also improve efficiency and productivity by automating processes, optimizing resource allocation, and enhancing decision-making.
    5. Scalability: IoT, like infrastructure, needs to be scalable to accommodate growing demands and evolving needs. As the number of IoT devices and the complexity of the systems they operate in increase, the infrastructure supporting IoT must also scale accordingly.
    6. Requiring maintenance and management: Infrastructure requires regular maintenance and management to ensure its continued functionality and efficiency. IoT also requires maintenance and management to ensure the security, reliability, and performance of connected devices and systems.
  • Interoperability and Open Standard

    The open standard, Z-Mesh, is crucial IoT for several reasons:

    1. Interoperability: An open standard ensures that devices from different manufacturers can communicate with each other seamlessly, which is essential for IoT applications.
    2. Scalability: An open standard allows for the development of a large number of devices and applications, which is necessary for the widespread adoption of IoT.
    3. Innovation: An open standard encourages innovation by allowing developers to create new applications and devices without being limited by proprietary technologies.
    4. Security: An open standard can help to ensure the security of IoT devices and applications by providing a common framework for security protocols and procedures.
    5. Cost-effectiveness: An open standard can help to reduce the cost of IoT devices and applications by allowing manufacturers to develop devices that are compatible with a wide range of systems and applications.
    6. Flexibility: An open standard provides flexibility in the development of IoT devices and applications, allowing developers to choose the best technologies and protocols for their specific needs.
    7. Avoidance of vendor lock-in: An open standard helps to avoid vendor lock-in, which can limit the ability of users to switch between different devices and applications.
    8. Promoting competition: An open standard promotes competition among manufacturers, which can lead to better products and services.
    9. Enabling new business models: An open standard can enable new business models, such as device-as-a-service, which can provide new revenue streams for manufacturers.
    10. Improving user experience: An open standard can improve the user experience by providing a consistent and seamless experience across different devices and applications.

    Citing the paper Internet of Things for Smart Cities: Interoperability and Open Data:

    https://cloud.aernetworks.com/s/4STReMBdYET96rr

    Quote

    Interoperability and Open Standard Development
    With the popularity of IoT devices, many IoT protocols and standards have been developed. In contrast to ordinary computers, IoT devices are normally constrained when it comes to memory space and processing capacity. In addition, IoT devices might be deployed where there’s limited or no access to continuous power supply, which means that they need to operate under power supplied from batteries or small solar panels. As a consequence, power-efficient communication protocols with small memory footprints and limited demands on processing have been developed to support IoT devices. Traditional TCP/IP protocols haven’t been designed with these requirements in mind.
    …
    Standard protocols are important to guarantee interoperability of different IoT devices.
    However, using open standards doesn’t automatically result in open systems. In our context, an open system means an integrated open IoT infrastructure solution for smart cities, providing access to open data and APIs for cloud services. In many cities, that infrastructure will be paid for, at least in part, by the city authorities using public funding. To motivate this investment, and get the most benefit for society, we argue that any smart city IoT infrastructure needs to be a truly open system, where equipment from many vendors can be used, and where the generated data can be more or less freely used by anyone to develop new services, based on low-level as well as processed sensor and IoT data. This kind of system will maximize innovation in the IoT domain, much as the Internet has done for information and communication services. Many current IoT systems — for example, for air quality monitoring or the smart home — are either incomplete systems with limited functionalities (that is, in terms of sensing, storage, and analytics), or are closed, proprietary systems dedicated for a particular task. The latter are vertically integrated systems, sometimes called stove pipes or vertical silos, which can’t be combined or extended easily with third-party components or services. The result is that once invested in a particular system, you’re locked into that vendor’s system. Vertically integrated systems are particularly problematic for the public sector, because this prevents fair competition in public procurement and is less suitable for large-scale data sharing.
    Patrik Fältström (7) argues similarly that market forces work against open interoperability, specially in the IoT domain where, for example, a smart lighting system from one vendor only works with light bulbs from the same vendor. Systems are designed as end-to-cloud-to-end, where the cloud part is vendor-controlled with limited possibilities for third parties, and where the IoT devices often speak proprietary protocols to the cloud. Fältström argues that this lack of interoperability severely limits the market growth (for example, with smart light bulbs). Also, the dependence on a cloud service might render the device non-functional, should that cloud service for any reason, temporarily or permanently, disappear.
    Instead of these stove pipes, we need horizontally designed systems with well-defined interfaces and data formats that can unleash the potential of open data, and that enable third parties to independently develop new applications and services, possibly combining several data sources. Providing open data has huge potential for innovation in digital applications and services, resulting in very large economic values. These interfaces (APIs) through which the IoT data can be accessed at multiple levels of refinement — from raw data directly from sensors, to highly processed data — also need standardization. The challenge is to provide an open system that lets users access the open data and cloud services without being locked by a particular platform. The open system should also allow third-parties to innovate based on the open data and open APIs.