Diffusion Benefits

Quickly capitalise on existing or new data sources. Purpose-built to simplify event-driven, real-time application development, Diffusion enables you to swiftly add new capabilities with minimal development costs.

Data Consumption icon

Unrestricted Data Consumption

Accommodates any size, format or velocity of data.

Data Wrangling icon

Low-code Data Transformation

Low-code features enable dynamic data enrichment without application modification.

Resource Requirements icon

Minimal Resource Requirements

Delta Streaming delivers internet scalability with 90% fewer server resources.

More Than Just a Pipeline to the Edge

Data Gateway

Makes it easy to integrate with any data source within your data center or outside, with pre-built Adapters for Kafka, MQTT, Redis, REST, JMS or backend applications using our WebSocket-based SDKs in all popular languages. Accommodates both streaming and static data sources, supports any size, format, or velocity of data.

Data Transformation

Provides a flexible, hierarchical data model to organize incoming event-data in a multi-level topic tree structure. Easily scalable to millions of topics. Facilitates transformation of event data using low-code features of the platform. Enables subscription to event-data at a fine-grained level for hyper-personalization and efficient distribution at Internet scale.

Data Distribution

Includes a real-time Event Broker that can scale to millions of concurrent connections. Supports Pub/Sub model with history tracking as well as asynchronous Request/Response. With intelligent queuing, conflation, compression, and patented delta-streaming protocol you can save over 90% in bandwidth costs.

“The Diffusion Intelligent Data Platform reduces both complexity and development time. It provides a common gateway into our clients’ micro services via a single API to consume and transform event data. It also manages fan-out, scaling, and high availability of event data delivery for the large global systems we build.”

David Bull, Director, Baker Technology

Read the Use Case

Real-Time Distribution Framework

The Diffusion Framework combines 10 powerful feature sets to accelerate even-driven, real-time application development.

Modes

PUB-SUB

One of four delivery mechanisms available inside Diffusion enabling you to publish real-time data to hundreds of thousands of consumers efficiently.

REQUEST-RESPONSE

Provides reliable two-way messaging between multiple endpoints, allowing you to build sophisticated asynchronous interactions.

TIME SERIES (EVENT HISTORY)

Store real-time events and dynamically query historial data, replay past events at any point in time.

FETCH

Retrieve snapshots from real-time streams and efficiently access static data through a simple query API.

Data Dynamics

DELTA STREAMING

Diffusion automatically transmits only the changes from the previous message, resulting in bandwidth reductions of over 90% – providing consistently faster delivery, more efficient scaling, and lower costs.

FLOW CONTROL

Diffusion’s networking layer adapts to congestion or slow responses, allowing clients to maintain connectivity across unpredictable networks.

THROTTLING/CONFLATION

Control the rate of data delivery whilst ensuring slow consumers always receive the most recent updates, with intelligent, per-topic conflation policies.

Hierarchial Topic Trees

TOPIC MANAGEMENT

A topic tree that can be organised in a way that best fits the application.

DATA AGNOSTIC

Diffusion is completely data agnostic; stream text, JSON or binary data in any combination or format.

PERSISTED

Reliable disk-based persistence with cluster aware restoration, ensuring service resiliency.

Low-Code Features

DECLARATIVE LANGUAGE – DSL

Diffusion provides low-code features via Domain Specific Languages (DSLs) enabling easy configuration. DSL simplifies data wrangling via the management console without having to make any code changes to customer applications.

LOW CODE CAPABILITIES

Build a simple backend application to publish a firehose of event data to Diffusion using our SDKs. Then use our DSL to re-organize and transform data via the management console with no changes to your applications.

TRANSFORMATION

Restructure JSON values in-flight, enabling you to disaggregate and filter data, enabling you to deliver and secure data at a fine-grained level.

Protocols

REST API

Diffusion’s simple REST API enables quick integration of stateless applications, letting you scale real-time systems with minimal effort.

MQTT

Support for MQTT offers a lightweight alternative to Diffusion SDK. A wide variety of existing IoT devices and web apps can now connect to Diffusion to leverage the benefits of its topic management and security frameworks.

PRE-BUILT ADAPTERS

Use pre-built adapters to start scaling and distributing real-time data from external services such as Kafka, JMS or REST interfaces in minutes.

RICH CLIENTS

Standardised client libraries in popular programming languages make it easy to develop advanced real-time functionality within web, mobile, IoT & desktop applications.

Fine-Grained Security

AUTH INTEGRATION

Fully control your application’s authentication flow with adapters for standard and bespoke integration points.

DYNAMIC ACL

Dynamically apply and modify topic level security enabling you to add and remove access in real time.

TTL

Establish automated rules over the lifecycle of data, making it easy to control when data is available.

Seamless Scalability

CLUSTERING

Distribute data, security and connections in real time across a local cluster, making it easier to reliably scale services horizontally.

REMOTE SERVERS

Create dynamic connections between Diffusion Clusters over a WAN, enabling global replication and hybrid deployments.

EDGE REPLICATION

Store data at the network edge for faster access, whilst also removing load from back-end systems.

Analytics Dashboard

METRICS

Gain meaningful insights by exposing data, session and infrastructure metrics to industry standard real-time monitoring tools such as Prometheus.

DASHBOARD

Configure, manage and report on connections, data, processing and security through a real-time UI (Diffusion management console).

CONTROL API

Expose every event inside Diffusion to an API for handling by back-end services providing end-to-end control.

Topologies

REMOTE SERVERS

Create dynamic connections between Diffusion clusters over a WAN, enabling global replication and hybrid deployments. Architectures that scale.

REMOTE TOPIC VIEWS

To manage data across a geographically dispersed user base, remote topic view allows global replication of real-time data, assures compliance, and minimizes delivery latency.

CLUSTER-AWARE MESSAGING

Diffusion’s request-response messaging is cluster-aware, enabling automatic message routing within a cluster including delivery acknowledgment. Messages can be selectively targeted to individual clients, groups of clients, or all clients, via property-based addressing.

Integrations

PRE-BUILT ADAPTERS

Use pre-built adapters to start scaling and distributing real-time data from external services such as Kafka, JMS or REST in minutes.

BESPOKE INTEGRATIONS

Distributed coordination, state management, and partial updates make the integration of bespoke data sources simple.

REAL-TIME FIRE HOSES

High-performance networking and flow-control ensures that you can reliably consume real-time data streams, regardless of throughput.

Powering Success for Tradition Financial Services

Founded in 1959, Tradition is one of the world leaders in the IDB (Interdealer broker) sector of financial and non-financial products. The Diffusion framework was selected to deliver real-time pricing data, research reports, trade alerts and risk reports for Tradition’s new cloud-based data and & analytics SaaS offerings. Diffusion scales to meet the trade volumes Tradition needs, while lowering compute and network capacity demands.

Get the Whole Story

Yann picture
“Diffusion is a secure, robust, fast & flexible real-time platform which supports our Electronic Trading Platform & the features within our GUI.”

Yann L’Huillier
Group CIO, Tradition

Start publishing real-time data with Diffusion Today!