Kafka
Search results
Apache Kafka is a scalable, high-performance, and fault-tolerant platform for data pipelines, streaming analytics, and mission-critical applications. Learn how Kafka is used by thousands of companies across various industries and how to connect, process, and store streams of events.
- Download
Kafka 3.0.0 includes a number of significant new features....
- Documentation
Here is a description of a few of the popular use cases for...
- Quickstart
Apache Kafka: A Distributed Streaming Platform. Apache Kafka...
- Introduction
Learn what event streaming is and how Apache Kafka can help...
- Powered By
Apache Kafka is the most popular open-source...
- Community
KAFKA-14021: MirrorMaker 2 should implement KIP-618 APIs:...
- Apache
Home page of The Apache Software Foundation. Licenses¶. The...
- Use Cases
Kafka's support for very large stored log data makes it an...
- Download
- Introduction
- Why Kafka? Benefits and Use Cases
- Kafka Architecture – Fundamental Concepts
- Kafka Components and Ecosystem
- GeneratedCaptionsTabForHeroSec
Apache Kafka is an event streaming platform used to collect, process, store, and integrate data at scale. It has numerous use cases including distributed streaming, stream processing, data integration, and pub/sub messaging. In order to make complete sense of what Kafka does, we'll delve into what an event streaming platform is and how it works. So...
Kafka is used by over 100,000 organizations across the world and is backed by a thriving community of professional developers, who are constantly advancing the state of the art in stream processing together. Due to Kafka's high throughput, fault tolerance, resilience, and scalability, there are numerous use cases across almost every industry - from...
Kafka Topics
Events have a tendency to proliferate—just think of the events that happened to you this morning—so we’ll need a system for organizing them. Kafka’s most fundamental unit of organization is the topic, which is something like a table in a relational database. As a developer using Kafka, the topic is the abstraction you probably think the most about. You create different topics to hold different kinds of events and different topics to hold filtered and transformed versions of the same kind of e...
Kafka Partitioning
If a topic were constrained to live entirely on one machine, that would place a pretty radical limit on the ability of Kafka to scale. It could manage many topics across many machines—Kafka is a distributed system, after all—but no one topic could ever get too big or aspire to accommodate too many reads and writes. Fortunately, Kafka does not leave us without options here: It gives us the ability to partitiontopics. Partitioning takes the single topic log and breaks it into multiple logs, eac...
How Kafka Partitioning Works
Having broken a topic up into partitions, we need a way of deciding which messages to write to which partitions. Typically, if a message has no key, subsequent messages will be distributed round-robin among all the topic’s partitions. In this case, all partitions get an even share of the data, but we don’t preserve any kind of ordering of the input messages. If the message does have a key, then the destination partition will be computed from a hash of the key. This allows Kafka to guarantee t...
If all you had were brokers managing partitioned, replicated topics with an ever-growing collection of producers and consumers writing and reading events, you would actually have a pretty useful system. However, the experience of the Kafka community is that certain patterns will emerge that will encourage you and your fellow developers to build the...
Learn what Kafka is, how it works, and why it is used for event streaming and data integration. Explore Kafka architecture, core concepts, and use cases with examples and videos.
Learn the basic and advanced concepts of Apache Kafka, a software platform for real-time data streaming and processing. This tutorial covers the architecture, APIs, features, and use cases of Kafka with examples and exercises.
Feb 8, 2018 · Learn about Apache Kafka, a publish-subscribe messaging system that lets you send and receive messages between processes, applications, and servers. Find out how Kafka topics, partitions, consumers, producers, and replicas work, and see some real-time applications of Kafka.
- 1 min
Apache Kafka is a distributed data store for streaming data in real-time. It combines messaging, storage, and stream processing to build data pipelines and applications that adapt to data streams.
Learn what event streaming is and how Apache Kafka can help you implement it end-to-end with a single solution. Kafka is a distributed system that publishes, subscribes, stores, and processes streams of events in real-time and at scale.
Apache Kafka is an open-source system for handling real-time data feeds. It provides APIs for producing, consuming, connecting, and streaming data, and supports external systems via Kafka Connect.
People also ask
Why is Kafka so popular?
Where did Kafka come from?
What is Apache Kafka?
What is a beginner's Kafka tutorial?
