The DevOps 2.1 Toolkit: Docker Swarm电子书

Title Page

Copyright

Credits

About the Author

www.PacktPub.com

Why subscribe?

Customer Feedback

Preface

Overview

Audience

Continuous Integration with Docker Containers

Defining a fully Dockerized manual Continuous Integration flow

Running unit tests and building service binary

Building service images

Running staging tests

Pushing images to the registry

Setting Up and Operating a Swarm Cluster

Scalability

Axis scaling

X-axis scaling

Y-axis scaling

Z-axis scaling

Clustering

Docker Swarm Mode

Setting up a Swarm cluster

Deploying services to the Swarm cluster

Scaling services

Failover

What now?

Docker Swarm Networking and Reverse Proxy

Setting up a cluster

Requirements of secured and fault tolerant services running with high availability

Running a database in isolation

Running a service through a reverse proxy

Creating a reverse proxy service in charge of routing requests depending on their base URLs

Load balancing requests across all instances of a service

What now?

Service Discovery inside a Swarm Cluster

What would Docker Swarm look like without?

What does standalone Docker Swarm look like with service discovery?

Service discovery in the Swarm cluster

Do we need service discovery?

Setting up Consul as service registry inside a Swarm cluster

Problems when scaling stateful instances

Using service registry to store the state

Discovering addresses of all instances that form a service

Using service registry or key value store to store service state

What now?

Continuous Delivery and Deployment with Docker Containers

Defining the Continuous Delivery environment

Setting up Continuous Delivery clusters

Using node labels to constrain services

Creating services

Walking through Continuous Delivery steps

Walking the extra mile from Continuous Delivery to Continuous Deployment

What now?

Automating Continuous Deployment Flow with Jenkins

Jenkins architecture

Production environment setup

Jenkins service

Jenkins failover

Jenkins agent

Creating services in production and production-like environments

Automating Continuous Deployment flow with Jenkins

Creating Jenkins Pipeline jobs

Defining Pipeline nodes

Defining Pipeline stages

Defining Pipeline steps

What now?

Exploring Docker Remote API

Setting up the environment

Operating Docker Swarm through the Docker Remote API

Using Docker Remote API to automate proxy configuration

Combining the Swarm listener with the proxy

Automatically reconfiguring the proxy

Removing a service from the proxy

What now?

Using Docker Stack and Compose YAML Files to Deploy Swarm Services

Swarm cluster setup

Creating Swarm services through Docker stack commands

Deploying more stacks

To stack or not to stack

Cleanup

Defining Logging Strategy

The need for centralized logging

Setting up ElasticSearch as the logging database

Setting up LogStash as the logs parser and forwarder

Forwarding logs from all containers running anywhere inside a Swarm cluster

Exploring logs

Discussing other logging solutions

What now?

Collecting Metrics and Monitoring the Cluster

The requirements of a cluster monitoring system

Choosing the right database to store system metrics

Creating the cluster

Prometheus metrics

Exporting system wide metrics

Scraping, querying, and visualizing Prometheus metrics

Using Grafana to create dashboards

Exploring Docker Swarm and container overview dashboard in Grafana

Adjusting services through dashboard metrics

Monitoring best practices

What now?

Embracing Destruction: Pets versus Cattle

What now?

Creating and Managing a Docker Swarm Cluster in Amazon Web Services

Installing AWS CLI and setting up the environment variables

Setting up a Swarm cluster with Docker Machine and AWS CLI

Setting up a Swarm cluster with Docker for AWS

Automatically setting up a Swarm cluster with Docker for AWS

Setting up a Swarm cluster with Packer and Terraform

Using Packer to create Amazon Machine Images

Using Terraform to create a Swarm cluster in AWS

Choosing the right tools to create and manage Swarm clusters in AWS

To Docker Machine or not to Docker Machine?

To Docker for AWS or not to Docker for AWS?

To Terraform or not to Terraform?

The final verdict

Creating and Managing a Docker Swarm Cluster in DigitalOcean

Setting up the environment variables

Setting up a Swarm cluster with Docker Machine and DigitalOcean API

Setting up a Swarm cluster with Packer and Terraform

Using Packer to create DigitalOcean snapshots

Using Terraform to create a Swarm cluster in DigitalOcean

Choosing the right tools to create and manage Swarm clusters in DigitalOcean

To Docker Machine or not to Docker Machine?

To Terraform or not to Terraform?

The final verdict

To DigitalOcean or not to DigitalOcean

Creating and Managing Stateful Services in a Swarm Cluster

Exploring the twelve-factor app methodology

Setting up a Swarm cluster and the proxy

Running stateful services without data persistence

Persisting stateful services on the host

Persisting stateful services on a Network File System

Data volume orchestration

Persisting stateful services with REX-Ray

Choosing the persistence method for stateful services

Adding REX-Ray to packer and terraform

Persisting stateful services without replication

Persisting stateful services with synchronization and replication

Persisting docker flow proxy state

Persisting MongoDB state

Initializing MongoDB replica set through a swarm service

What now?

Managing Secrets in Docker Swarm Clusters

Creating secrets

Consuming secrets

A real-world example of using secrets

Using secrets with Docker Compose

Common ways to use secrets

What now?

Monitor Your GitHub Repos with Docker and Prometheus

Docker, Prometheus, and Grafana

Getting started

Configuration

Post configuration

Install dashboard

Conclusion

About the author