万本电子书0元读

万本电子书0元读

顶部广告

Apache Kafka 1.0 Cookbook电子书

售       价:¥

7人正在读 | 0人评论 9.8

作       者:Raúl Estrada

出  版  社:Packt Publishing

出版时间:2017-12-22

字       数:25.4万

所属分类: 进口书 > 外文原版书 > 电脑/网络

温馨提示:数字商品不支持退换货,不提供源文件,不支持导出打印

为你推荐

  • 读书简介
  • 目录
  • 累计评论(条)
  • 读书简介
  • 目录
  • 累计评论(条)
Simplify real-time data processing by leveraging the power of Apache Kafka 1.0 About This Book ? Use Kafka 1.0 features such as Confluent platforms and Kafka streams to build efficient streaming data applications to handle and process your data ? Integrate Kafka with other Big Data tools such as Apache Hadoop, Apache Spark, and more ? Hands-on recipes to help you design, operate, maintain, and secure your Apache Kafka cluster with ease Who This Book Is For This book is for developers and Kafka administrators who are looking for quick, practical solutions to problems encountered while operating, managing or monitoring Apache Kafka. If you are a developer, some knowledge of Scala or Java will help, while for administrators, some working knowledge of Kafka will be useful. What You Will Learn ? Install and configure Apache Kafka 1.0 to get optimal performance ? Create and configure Kafka Producers and Consumers ? Operate your Kafka clusters efficiently by implementing the mirroring technique ? Work with the new Confluent platform and Kafka streams, and achieve high availability with Kafka ? Monitor Kafka using tools such as Graphite and Ganglia ? Integrate Kafka with third-party tools such as Elasticsearch, Logstash, Apache Hadoop, Apache Spark, and more In Detail Apache Kafka provides a unified, high-throughput, low-latency platform to handle real-time data feeds. This book will show you how to use Kafka efficiently, and contains practical solutions to the common problems that developers and administrators usually face while working with it. This practical guide contains easy-to-follow recipes to help you set up, configure, and use Apache Kafka in the best possible manner. You will use Apache Kafka Consumers and Producers to build effective real-time streaming applications. The book covers the recently released Kafka version 1.0, the Confluent Platform and Kafka Streams. The programming aspect covered in the book will teach you how to perform important tasks such as message validation, enrichment and composition.Recipes focusing on optimizing the performance of your Kafka cluster, and integrate Kafka with a variety of third-party tools such as Apache Hadoop, Apache Spark, and Elasticsearch will help ease your day to day collaboration with Kafka greatly. Finally, we cover tasks related to monitoring and securing your Apache Kafka cluster using tools such as Ganglia and Graphite. If you're looking to become the go-to person in your organization when it comes to working with Apache Kafka, this book is the only resource you need to have. Style and approach Following a cookbook recipe-based approach, we’ll teach you how to solve everyday difficulties and struggles you encounter using Kafka through hands-on examples.
目录展开

Title Page

Copyright

Apache Kafka 1.0 Cookbook

Credits

About the Author

About the Reviewers

www.PacktPub.com

Why subscribe?

Customer Feedback

Dedication

Preface

What this book covers

What you need for this book

Who this book is for

Sections

Getting ready

How to do it…

How it works…

There's more…

See also

Conventions

Reader feedback

Customer support

Downloading the example code

Downloading the color images of this book

Errata

Piracy

Questions

Configuring Kafka

Introduction

Installing Kafka

Getting ready

How to do it...

Installing Java in Linux

Installing Scala in Linux

Installing Kafka in Linux

There's more...

See also

Running Kafka

Getting ready

How to do it...

There's more...

See also

Configuring Kafka brokers

Getting ready

How to do it...

How it works...

There's more...

See also

Configuring Kafka topics

Getting ready

How to do it...

How it works...

There's more…

Creating a message console producer

Getting ready

How to do it...

How it works...

There's more…

Creating a message console consumer

Getting ready

How to do it...

How it works...

There's more...

Configuring the broker settings

Getting ready

How to do it...

How it works…

There's more…

Configuring threads and performance

Getting ready

How to do it...

How it works…

There's more...

Configuring the log settings

Getting ready

How to do it...

How it works…

There's more…

See also

Configuring the replica settings

Getting ready

How to do it...

How it works…

There's more...

Configuring the ZooKeeper settings

Getting ready

How to do it…

How it works…

See also

Configuring other miscellaneous parameters

Getting ready

How to do it...

How it works…

See also

Kafka Clusters

Introduction

Configuring a single-node single-broker cluster – SNSB

Getting ready

How to do it...

Starting ZooKeeper

Starting the broker

How it works...

There's more...

See also

SNSB – creating a topic, producer, and consumer

Getting ready

How to do it...

Creating a topic

Starting the producer

Starting the consumer

How it works...

There's more...

Configuring a single-node multiple-broker cluster – SNMB

Getting ready

How to do it...

How it works...

There's more...

See also

SNMB – creating a topic, producer, and consumer

Getting ready

How to do it...

Creating a topic

Starting a producer

Starting a consumer

How it works...

There's more...

See also

Configuring a multiple-node multiple-broker cluster – MNMB

Getting ready

How to do it...

How it works...

See also

Message Validation

Introduction

Modeling the events

Getting ready

How to do it...

How it works...

There's more...

See also

Setting up the project

Getting ready

How to do it...

How it works...

There's more...

See also

Reading from Kafka

Getting ready

How to do it...

How it works...

There's more...

See also

Writing to Kafka

Getting ready

How to do it...

How it works...

There's more...

See also

Running ProcessingApp

Getting ready

How to do it...

How it works...

There's more...

See also

Coding the validator

Getting ready

How to do it...

There's more...

See also

Running the validator

Getting ready

How to do it...

How it works...

There's more...

See also

Message Enrichment

Introduction

Geolocation extractor

Getting ready

How to do it...

How it works...

There's more...

See also

Geolocation enricher

Getting ready

How to do it...

How it works...

There's more...

See also

Currency price extractor

Getting ready

How to do it...

How it works...

There's more...

See also

Currency price enricher

Getting ready

How to do it...

How it works...

There's more...

See also

Running the currency price enricher

Getting ready

How to do it...

How it works...

Modeling the events

Getting ready

How to do it...

How it works...

There's more...

See also

Setting up the project

Getting ready

How to do it...

How it works...

There's more...

See also

Open weather extractor

Getting ready

How to do it...

How it works...

There's more...

See also

Location temperature enricher

Getting ready

How to do it...

How it works...

There's more...

See also

Running the location temperature enricher

Getting ready

How to do it...

How it works...

The Confluent Platform

Introduction

Installing the Confluent Platform

Getting ready

How to do it...

There's more...

See also

Using Kafka operations

Getting ready

How to do it...

There's more...

See also

Monitoring with the Confluent Control Center

Getting ready

How to do it...

How it works...

There's more...

Using the Schema Registry

Getting ready

How to do it...

See also

Using the Kafka REST Proxy

Getting ready

How to do it...

There's more...

See also

Using Kafka Connect

Getting ready

How to do it...

There's more...

See also

Kafka Streams

Introduction

Setting up the project

Getting ready

How to do it...

How it works...

Running the streaming application

Getting ready

How to do it...

Managing Kafka

Introduction

Managing consumer groups

Getting ready

How to do it...

How it works...

Dumping log segments

Getting ready

How to do it...

How it works...

Importing ZooKeeper offsets

Getting ready

How to do it...

How it works...

Using the GetOffsetShell

Getting ready

How to do it...

How it works...

Using the JMX tool

Getting ready

How to do it...

How it works...

There's more...

Using the MirrorMaker tool

Getting ready

How to do it...

How it works...

There's more...

See also

Replaying log producer

Getting ready

How to do it...

How it works...

Using state change log merger

Getting ready

How to do it...

How it works...

Operating Kafka

Introduction

Adding or removing topics

Getting ready

How to do it...

How it works...

There's more...

See also

Modifying message topics

Getting ready

How to do it...

How it works...

There's more...

See also

Implementing a graceful shutdown

Getting ready

How to do it...

How it works...

Balancing leadership

Getting ready

How to do it...

How it works...

There's more...

Expanding clusters

Getting ready

How to do it...

How it works...

There's more...

Increasing the replication factor

Getting ready

How to do it...

How it works...

There's more...

Decommissioning brokers

Getting ready

How to do it...

How it works...

Checking the consumer position

Getting ready

How to do it...

How it works...

Monitoring and Security

Introduction

Monitoring server statistics

Getting ready

How to do it...

How it works...

See also

Monitoring producer statistics

Getting ready

How to do it...

How it works...

See also

Monitoring consumer statistics

Getting ready

How to do it...

How it works...

See also

Connecting with the help of Graphite

Getting ready

How to do it...

How it works...

See also

Monitoring with the help of Ganglia

Getting ready

How to do it...

How it works...

See also

Implementing authentication using SSL

How to do it...

See also

Implementing authentication using SASL/Kerberos

How to do it...

See also

Third-Party Tool Integration

Introduction

Moving data between Kafka nodes with Flume

Getting ready

How to do it...

How it works...

See also

Writing to an HDFS cluster with Gobblin

Getting ready

How to do it...

How it works...

See also

Moving data from Kafka to Elastic with Logstash

Getting ready

How to do it...

How it works...

There's more...

See also

Connecting Spark streams and Kafka

Getting ready

How to do it...

How it works...

There's more...

Ingesting data from Kafka to Storm

Getting ready

How to do it...

How it works...

There's more...

See also

Pushing data from Kafka to Elastic

Getting ready

How to do it...

How it works...

See also

Inserting data from Kafka to SolrCloud

Getting ready

How to do it...

How it works...

See also

Building a Kafka producer with Akka

Getting ready

How to do it...

How it works...

There's more...

Building a Kafka consumer with Akka

Getting ready

How to do it...

Storing data in Cassandra

Getting ready

How to do it...

How it works...

Running Kafka on Mesos

Getting ready

How to do it...

How it works...

There's more...

Reading Kafka with Apache Beam

Getting ready

How to do it...

How it works...

There's more...

See also

Writing to Kafka from Apache Beam

Getting ready

How to do it...

How it works...

There's more...

See also

累计评论(条) 个书友正在讨论这本书 发表评论

发表评论

发表评论,分享你的想法吧!

买过这本书的人还买过

读了这本书的人还在读

回顶部