Diffusion Benefits
Quickly capitalise on existing or new data sources. Purpose-built to simplify event-driven, real-time application development, Diffusion enables you to swiftly add new capabilities with minimal development costs.
Unrestricted Data Consumption
Accommodates any size, format or velocity of data.
Low-code Data Transformation
Low-code features enable dynamic data enrichment without application modification.
Minimal Resource Requirements
Delta Streaming delivers internet scalability with 90% fewer server resources.
More Than Just a Pipeline to the Edge
Data Gateway
Makes it easy to integrate with any data source within your data center or outside, with pre-built Adapters for Kafka, MQTT, Redis, REST, JMS or backend applications using our WebSocket-based SDKs in all popular languages. Accommodates both streaming and static data sources, supports any size, format, or velocity of data.
Data Transformation
Provides a flexible, hierarchical data model to organize incoming event-data in a multi-level topic tree structure. Easily scalable to millions of topics. Facilitates transformation of event data using low-code features of the platform. Enables subscription to event-data at a fine-grained level for hyper-personalization and efficient distribution at Internet scale.
Data Distribution
Includes a real-time Event Broker that can scale to millions of concurrent connections. Supports Pub/Sub model with history tracking as well as asynchronous Request/Response. With intelligent queuing, conflation, compression, and patented delta-streaming protocol you can save over 90% in bandwidth costs.
David Bull, Director, Baker Technology
Read the Use Case : Baker Technology
Real-Time Distribution Framework
The Diffusion Framework combines 10 powerful feature sets to accelerate even-driven, real-time application development.
Modes
PUB-SUB
One of four delivery mechanisms available inside Diffusion enabling you to publish real-time data to hundreds of thousands of consumers efficiently.
REQUEST-RESPONSE
Provides reliable two-way messaging between multiple endpoints, allowing you to build sophisticated asynchronous interactions.
TIME SERIES (EVENT HISTORY)
Store real-time events and dynamically query historial data, replay past events at any point in time.
FETCH
Retrieve snapshots from real-time streams and efficiently access static data through a simple query API.
Data Dynamics
DELTA STREAMING
Diffusion automatically transmits only the changes from the previous message, resulting in bandwidth reductions of over 90% – providing consistently faster delivery, more efficient scaling, and lower costs.
FLOW CONTROL
Diffusion’s networking layer adapts to congestion or slow responses, allowing clients to maintain connectivity across unpredictable networks.
THROTTLING/CONFLATION
Control the rate of data delivery whilst ensuring slow consumers always receive the most recent updates, with intelligent, per-topic conflation policies.
Hierarchial Topic Trees
TOPIC MANAGEMENT
A topic tree that can be organised in a way that best fits the application.
DATA AGNOSTIC
Diffusion is completely data agnostic; stream text, JSON or binary data in any combination or format.
PERSISTED
Reliable disk-based persistence with cluster aware restoration, ensuring service resiliency.
Low-Code Features
DECLARATIVE LANGUAGE – DSL
Diffusion provides low-code features via Domain Specific Languages (DSLs) enabling easy configuration. DSL simplifies data wrangling via the management console without having to make any code changes to customer applications.
LOW CODE CAPABILITIES
Build a simple backend application to publish a firehose of event data to Diffusion using our SDKs. Then use our DSL to re-organize and transform data via the management console with no changes to your applications.
TRANSFORMATION
Restructure JSON values in-flight, enabling you to disaggregate and filter data, enabling you to deliver and secure data at a fine-grained level.
Protocols
REST API
Diffusion’s simple REST API enables quick integration of stateless applications, letting you scale real-time systems with minimal effort.
MQTT
Support for MQTT offers a lightweight alternative to Diffusion SDK. A wide variety of existing IoT devices and web apps can now connect to Diffusion to leverage the benefits of its topic management and security frameworks.
PRE-BUILT ADAPTERS
Use pre-built adapters to start scaling and distributing real-time data from external services such as Kafka, JMS or REST interfaces in minutes.
RICH CLIENTS
Standardised client libraries in popular programming languages make it easy to develop advanced real-time functionality within web, mobile, IoT & desktop applications.
Fine-Grained Security
AUTH INTEGRATION
Fully control your application’s authentication flow with adapters for standard and bespoke integration points.
DYNAMIC ACL
Dynamically apply and modify topic level security enabling you to add and remove access in real time.
TTL
Establish automated rules over the lifecycle of data, making it easy to control when data is available.
Seamless Scalability
CLUSTERING
Distribute data, security and connections in real time across a local cluster, making it easier to reliably scale services horizontally.
REMOTE SERVERS
Create dynamic connections between Diffusion Clusters over a WAN, enabling global replication and hybrid deployments.
EDGE REPLICATION
Store data at the network edge for faster access, whilst also removing load from back-end systems.
Analytics Dashboard
METRICS
Gain meaningful insights by exposing data, session and infrastructure metrics to industry standard real-time monitoring tools such as Prometheus.
DASHBOARD
Configure, manage and report on connections, data, processing and security through a real-time UI (Diffusion management console).
CONTROL API
Expose every event inside Diffusion to an API for handling by back-end services providing end-to-end control.
Topologies
REMOTE SERVERS
Create dynamic connections between Diffusion clusters over a WAN, enabling global replication and hybrid deployments. Architectures that scale.
REMOTE TOPIC VIEWS
To manage data across a geographically dispersed user base, remote topic view allows global replication of real-time data, assures compliance, and minimizes delivery latency.
CLUSTER-AWARE MESSAGING
Diffusion’s request-response messaging is cluster-aware, enabling automatic message routing within a cluster including delivery acknowledgment. Messages can be selectively targeted to individual clients, groups of clients, or all clients, via property-based addressing.
Integrations
PRE-BUILT ADAPTERS
Use pre-built adapters to start scaling and distributing real-time data from external services such as Kafka, JMS or REST in minutes.
BESPOKE INTEGRATIONS
Distributed coordination, state management, and partial updates make the integration of bespoke data sources simple.
REAL-TIME FIRE HOSES
High-performance networking and flow-control ensures that you can reliably consume real-time data streams, regardless of throughput.
Powering Success for Tradition Financial Services
Founded in 1959, Tradition is one of the world leaders in the IDB (Interdealer broker) sector of financial and non-financial products. The Diffusion framework was selected to deliver real-time pricing data, research reports, trade alerts and risk reports for Tradition’s new cloud-based data and & analytics SaaS offerings. Diffusion scales to meet the trade volumes Tradition needs, while lowering compute and network capacity demands.
Yann L’Huillier
Group CIO, Tradition
