DiffusionData Joins the Connect with Confluent Partner Program 

Extend the benefits of Confluent and Diffusion

We’re excited to announce that DiffusionData has joined the Connect with Confluent technology partner program. This program helps businesses accelerate the development of real-time applications through fully managed integrations with Confluent Cloud.  

This partnership brings together Confluent’s industry-leading data streaming platform, powered by Apache Kafka®, with Diffusion’s proven edge data distribution technology. While Confluent Cloud provides enterprises with a fully managed, cloud-native Kafka service for capturing and processing real-time event streams, Diffusion extends this capability to the edge. By efficiently distributing data through the internet to millions of end users, devices, and applications, Diffusion ensures that the value of Kafka-powered event streams reaches customers where it matters most – at scale, in real-time, and over unpredictable networks. 

 Grethe Brown, CEO of DiffusionData said “The Confluent-DiffusionData partnership demonstrates the strength of our combined solution. We are delivering an innovative, trusted foundation for enterprises that need to reliably stream, transform, and distribute data to millions of end users and devices in real-time.” 

Expanding the data streaming ecosystem together with Confluent 

Connect with Confluent brings fully managed data streams directly to organizations through a single integration to the cloud-native and complete data streaming platform, Confluent Cloud. It’s now easier than ever for organizations to stream any data to or from Diffusion with a fully managed Apache Kafka® service that spans hybrid, multi-cloud, and on-premises environments. 

Build real-time applications with Diffusion 

With Confluent Cloud powering real-time event streaming across the enterprise, Diffusion ensures that those streams can be consumed, transformed, and delivered efficiently to any end-point – whether mobile apps, web clients, IoT devices, or edge services. Acting as a powerful Edge server, Diffusion bridges the gap between Kafka streams in the cloud and the users and systems that rely on them. 

At its core, Diffusion is built for scalable, reliable, and cost-efficient distribution of data over the internet. Using patented delta-compression technology, Diffusion reduces bandwidth and egress costs by up to 90% while ensuring real-time delivery at sub-millisecond latency worldwide. This means enterprises can confidently extend Kafka-powered applications to millions of users, without worrying about performance bottlenecks, spiralling infrastructure costs, or inconsistent user experiences. 

Diffusion doesn’t just move data, it adds intelligence in flight. With built-in low-code data transformation, protocol translation, and granular data delivery controls, Diffusion ensures that each consumer gets the right data, in the right format, at the right time. Together, Confluent and Diffusion enable enterprises to capture, process, and act on event streams centrally, then seamlessly deliver personalized, real-time updates at scale to the edge.

Benefits on Diffusion for Business:

• Reduce bandwidth & cloud egress costs with patented data optimization technology. Our efficient architecture helps optimize resource utilization, significantly lowering the need for extensive hardware and server infrastructure. This efficient data handling reduces both bandwidth usage and energy consumption, leading to substantial cost savings.

• Improve user experience by easily integrating new data sources and delivering personalized content per user in real-time. Our real-time data streaming enables you to deliver tailored content and insights to your users. By leveraging precise, real-time data, you can offer personalized experiences, such as customized alerts and recommendations, enhancing user engagement. 

• Improve data performance with Diffusion’s real-time data streaming distribution ensures your data is being delivered with instant updates with single digit millisecond latency across the world to mobile and web applications. 

• Ensure scalability and optimize data handling, reducing bottlenecks and ensures consistent performance even during peak usage times. This efficiency translates to more reliable and robust service, capable of handling high traffic volumes without compromising on speed or accuracy. 

Benefits of Diffusion for Development:

• Data Consumption Simplified – Diffusion captures raw source data using the platform’s Gateway adapters, saving development time and effort. 

• In-Flight Data Transformation – Diffusion handles protocol translation, data transformation, and payload conversion with its low-code data transformation capability, to reduce development effort and assure consumers receive the exact data needed – every time, in real-time. 

• Data Delivery Assured – Diffusion provides reliable, efficient delivery of the data required and permitted for each data consumer. In addition, incoming event data can be buffered, throttled or conflated if the rate of event production exceeds the capacity of a particular event consumer or consumers. 

Ready to extend your Kafka data streams to the edge? Explore the Confluent–Diffusion integration and start building real-time applications that scale. 

How to configure the Confluent connector 

Getting started with the Confluent-Diffusion integration is straightforward. The connector makes it easy to stream data from Confluent Cloud into Diffusion, where it can be transformed, optimized, and distributed in real-time to end users and devices. In the following steps, we’ll walk you through the configuration process – complete with screenshots – so you can quickly connect your Confluent data streams to Diffusion and begin powering real-time applications at scale. 

• Follow the instructions to provision the Diffusion Kafka Connector.

Note: A networking connection endpoint may need to be configured if your sink is hosted elsewhere, such as Diffusion Cloud.

• The Diffusion Kafka Connector will be provisioned and start to run.

• Log into the Diffusion Cloud or your Diffusion instance.

• Based upon the configuration in the Diffusion Kafka connector, the topic(s) will be dynamically created in Diffusion.

• Using the Diffusion console, if the user has the relevant permissions, the contents of the topic(s) are visible. Below is the order JSON data that originated from Kafka.

Note: The Diffusion console allows the topic(s) to be subscribed to in the form a a Diffusion subscription.

• Once a Diffusion subscription has been setup within the Diffusion console, then the ‘Subscriptions’ tab allows the changes to be viewed, with each change, the value flashes green to denote it has been updated.

Populating Sample Data with Datagen Connector Plugin

If you don’t already have data in your Confluent Cloud instance, then Confluent has a fully managed sample data generator – called the Datagen Connector plugin. Datagen can generate and publish realistic mock data into Kafka topics.

• Within the Confluent Cloud console, configure the data generator to publish the type of data you’re interested in, such as JSON-based orders.

• The data generator plugin will be provisioned and start to run.

• The data for this example is published into the topic named ‘stock.trades.feed‘ and the messages can be viewed within Confluent Cloud.

Getting Started 

You can download the connector here.

Get started with DiffusionData’s Diffusion Cloud 30-day free trial today. You can also watch DiffusionData’s 5 minute explainer video which takes a technical dive into how Diffusion works. 

Not yet a Confluent customer? Start your free trial of Confluent Cloud today. New signups receive $400 to spend during their first 30 days-no credit card required. 

Support

If you require any support, please contact [email protected].