Successfully scrape data from any website with the power of Python 3.x About This Book ? A hands-on guide to web scraping using Python with solutions to real-world problems ? Create a number of different web scrapers in Python to extract information ? This book includes practical examples on using the popular and well-maintained libraries in Python for your web scraping needs Who This Book Is For This book is aimed at developers who want to use web scraping for legitimate purposes. Prior programming experience with Python would be useful but not essential. Anyone with general knowledge of programming languages should be able to pick up the book and understand the principals involved. What You Will Learn ? Extract data from web pages with simple Python programming ? Build a concurrent crawler to process web pages in parallel ? Follow links to crawl a website ? Extract features from the HTML ? Cache downloaded HTML for reuse ? Compare concurrent models to determine the fastest crawler ? Find out how to parse JavaScript-dependent websites ? Interact with forms and sessions In Detail The Internet contains the most useful set of data ever assembled, most of which is publicly accessible for free. However, this data is not easily usable. It is embedded within the structure and style of websites and needs to be carefully extracted. Web scraping is becoming increasingly useful as a means to gather and make sense of the wealth of information available online. This book is the ultimate guide to using the latest features of Python 3.x to scrape data from websites. In the early chapters, you’ll see how to extract data from static web pages. You’ll learn to use caching with databases and files to save time and manage the load on servers. After covering the basics, you’ll get hands-on practice building a more sophisticated crawler using browsers, crawlers, and concurrent scrapers. You’ll determine when and how to scrape data from a JavaScript-dependent website using PyQt and Selenium. You’ll get a better understanding of how to submit forms on complex websites protected by CAPTCHA. You’ll find out how to automate these actions with Python packages such as mechanize. You’ll also learn how to create class-based scrapers with Scrapy libraries and implement your learning on real websites. By the end of the book, you will have explored testing websites with scrapers, remote scraping, best practices, working with images, and many other relevant topics. Style and approach This hands-on guide is full of real-life examples and solutions starting simple and then progressively becoming more complex. Each chapter in this book introduces a problem and then provides one or more possible solutions.

Master the capabilities of PostgreSQL 9.6 to efficiently manage and maintain your database About This Book ? Your one-stop guide to mastering the advanced concepts in PostgreSQL with ease ? Master query optimization, replication, and high availability with PostgreSQL ? Extend the functionalities of PostgreSQL to suit your organizational needs with minimum effort Who This Book Is For If you are a PostgreSQL data architect or an administrator who wants to understand how to implement advanced functionalities and master complex administrative tasks with PostgreSQL, then this book is perfect for you. Prior experience of administrating a PostgreSQL database and a working knowledge of SQL is required to make the best use of this book. What You Will Learn ? Get to grips with the advanced features of PostgreSQL 9.6 and handle advanced SQL ? Make use of the indexing features in PostgreSQL and fine-tune the performance of your queries ? Work with the stored procedures and manage backup and recovery ? Master the replication and failover techniques ? Troubleshoot your PostgreSQL instance for solutions to the common and not-so-common problems ? Learn how to migrate your database from MySQL and Oracle to PostgreSQL without any hassle In Detail PostgreSQL is an open source database used for handling large datasets (Big Data) and as a JSON document database. It also has applications in the software and web domains. This book will enable you to build better PostgreSQL applications and administer databases more efficiently. We begin by explaining the advanced database design concepts in PostgreSQL 9.6, along with indexing and query optimization. You will also see how to work with event triggers and perform concurrent transactions and table partitioning, along with exploring SQL and server tuning. We will walk you through implementing advanced administrative tasks such as server maintenance and monitoring, replication, recovery and high availability, and much more. You will understand the common and not-so-common troubleshooting problems and how you can overcome them. By the end of this book, you will have an expert-level command of the advanced database functionalities and will be able to implement advanced administrative tasks with PostgreSQL. Style and Approach This book is a comprehensive guide covering all the concepts you need to master PostgreSQL. Packed with hands-on examples, tips and tricks, even the most advanced concepts are explained in a very easy-to-follow manner. Every chapter in the book does not only focus on how each task is performed, but also why.

Deliver end-to-end real-time distributed data processing solutions by leveraging the power of Elastic Stack 6.0 About This Book ? Get to grips with the new features introduced in Elastic Stack 6.0 ? Get valuable insights from your data by working with the different components of the Elastic stack such as Elasticsearch, Logstash, Kibana, X-Pack, and Beats ? Includes handy tips and techniques to build, deploy and manage your Elastic applications efficiently on-premise or on the cloud Who This Book Is For This book is for data professionals who want to get amazing insights and business metrics from their data sources. If you want to get a fundamental understanding of the Elastic Stack for distributed, real-time processing of data, this book will help you. A fundamental knowledge of JSON would be useful, but is not mandatory. No previous experience with the Elastic Stack is required. What You Will Learn ? Familiarize yourself with the different components of the Elastic Stack ? Get to know the new functionalities introduced in Elastic Stack 6.0 ? Effectively build your data pipeline to get data from terabytes or petabytes of data into Elasticsearch and Logstash for searching and logging ? Use Kibana to visualize data and tell data stories in real-time ? Secure, monitor, and use the alerting and reporting capabilities of Elastic Stack ? Take your Elastic application to an on-premise or cloud-based production environment In Detail The Elastic Stack is a powerful combination of tools for distributed search, analytics, logging, and visualization of data from medium to massive data sets. The newly released Elastic Stack 6.0 brings new features and capabilities that empower users to find unique, actionable insights through these techniques. This book will give you a fundamental understanding of what the stack is all about, and how to use it efficiently to build powerful real-time data processing applications. After a quick overview of the newly introduced features in Elastic Stack 6.0, you’ll learn how to set up the stack by installing the tools, and see their basic configurations. Then it shows you how to use Elasticsearch for distributed searching and analytics, along with Logstash for logging, and Kibana for data visualization. It also demonstrates the creation of custom plugins using Kibana and Beats. You’ll find out about Elastic X-Pack, a useful extension for effective security and monitoring. We also provide useful tips on how to use the Elastic Cloud and deploy the Elastic Stack in production environments. On completing this book, you’ll have a solid foundational knowledge of the basic Elastic Stack functionalities. You’ll also have a good understanding of the role of each component in the stack to solve different data processing problems. Style and approach This step-by-step guide will show you the Elastic Stack, covering all the components through interactive and easy-to-follow examples. It also includes handy tips.

Simplify real-time data processing by leveraging the power of Apache Kafka 1.0 About This Book ? Use Kafka 1.0 features such as Confluent platforms and Kafka streams to build efficient streaming data applications to handle and process your data ? Integrate Kafka with other Big Data tools such as Apache Hadoop, Apache Spark, and more ? Hands-on recipes to help you design, operate, maintain, and secure your Apache Kafka cluster with ease Who This Book Is For This book is for developers and Kafka administrators who are looking for quick, practical solutions to problems encountered while operating, managing or monitoring Apache Kafka. If you are a developer, some knowledge of Scala or Java will help, while for administrators, some working knowledge of Kafka will be useful. What You Will Learn ? Install and configure Apache Kafka 1.0 to get optimal performance ? Create and configure Kafka Producers and Consumers ? Operate your Kafka clusters efficiently by implementing the mirroring technique ? Work with the new Confluent platform and Kafka streams, and achieve high availability with Kafka ? Monitor Kafka using tools such as Graphite and Ganglia ? Integrate Kafka with third-party tools such as Elasticsearch, Logstash, Apache Hadoop, Apache Spark, and more In Detail Apache Kafka provides a unified, high-throughput, low-latency platform to handle real-time data feeds. This book will show you how to use Kafka efficiently, and contains practical solutions to the common problems that developers and administrators usually face while working with it. This practical guide contains easy-to-follow recipes to help you set up, configure, and use Apache Kafka in the best possible manner. You will use Apache Kafka Consumers and Producers to build effective real-time streaming applications. The book covers the recently released Kafka version 1.0, the Confluent Platform and Kafka Streams. The programming aspect covered in the book will teach you how to perform important tasks such as message validation, enrichment and composition.Recipes focusing on optimizing the performance of your Kafka cluster, and integrate Kafka with a variety of third-party tools such as Apache Hadoop, Apache Spark, and Elasticsearch will help ease your day to day collaboration with Kafka greatly. Finally, we cover tasks related to monitoring and securing your Apache Kafka cluster using tools such as Ganglia and Graphite. If you're looking to become the go-to person in your organization when it comes to working with Apache Kafka, this book is the only resource you need to have. Style and approach Following a cookbook recipe-based approach, we’ll teach you how to solve everyday difficulties and struggles you encounter using Kafka through hands-on examples.

Implement and manage your software-defined, massively scalable storage system About This Book ? Explore Ceph's architecture in order to achieve scalability and high availability ? Learn to utilize Ceph efficiently with the help of practical examples ? Successfully implement Ceph clusters to scale-out storage solutions along with outstanding data protection Who This Book Is For A basic knowledge of GNU/Linux, and storage systems, and server components is assumed. If you have no experience of software-defined storage solutions and Ceph, but are eager to learn about them, this is the book for you. What You Will Learn ? The limitations of existing systems and why you should use Ceph as a storage solution ? Familiarity with Ceph's architecture, components, and services ? Instant deployment and testing of Ceph within a Vagrant and VirtualBox environment ? Ceph operations including maintenance, monitoring, and troubleshooting ? Storage provisioning of Ceph's block, object, and filesystem services ? Integrate Ceph with OpenStack ? Advanced topics including erasure coding, CRUSH maps, and performance tuning ? Best practices for your Ceph clusters In Detail Learning Ceph, Second Edition will give you all the skills you need to plan, deploy, and effectively manage your Ceph cluster. You will begin with the first module, where you will be introduced to Ceph use cases, its architecture, and core projects. In the next module, you will learn to set up a test cluster, using Ceph clusters and hardware selection. After you have learned to use Ceph clusters, the next module will teach you how to monitor cluster health, improve performance, and troubleshoot any issues that arise. In the last module, you will learn to integrate Ceph with other tools such as OpenStack, Glance, Manila, Swift, and Cinder. By the end of the book you will have learned to use Ceph effectively for your data storage requirements. Style and approach This step-by-step guide, including use cases and examples, not only helps you to easily use Ceph but also demonstrates how you can use it to solve any of your server or drive storage issues.

Perform Interactive Data Analysis with Smarter Visualizations and Support your Enterprise-wide Analytical Needs About This Book ? Get a practical demonstration of discovering data for sales, human resources, and more using Qlik Sense ? Create dynamic dashboards for business intelligence and predictive analytics ? Create and collaborate comprehensive analytical solutions using Rattle and Qlik Sense Who This Book Is For This course is for anyone who wishes to understand and utilize the various new approaches to business intelligence actively in their business practice. Knowing the basics of business intelligence concepts would be helpful when picking up this course, but is not mandatory. What You Will Learn ? Build simple visualization models with Rattle and Qlik Sense Desktop ? Get to grips with the life cycle and new visualization functions of a Qlik Sense application ? Discover simple ways to examine data and get it ready for analysis ? Visualize your data with Qlik Sense's engaging and informative graphs ? Build efficient and responsive Associative Models ? Optimize Qlik Sense for sales, human resources, and demographic data discovery ? Explore various tips and tricks of navigation for the Qlik Sense? front end ? Develop creative extensions for your Qlik Sense? dashboard In Detail Qlik Sense is powerful and creative visual analytics software that allows users to discover data, explore it, and dig out meaningful insights in order to make a profit and make decisions for your business. This course begins by introducing you to the features and functions of the most modern edition of Qlik Sense so you get to grips with the application. The course will teach you how to administer the data architecture in Qlik Sense, enabling you to customize your own Qlik Sense application for your business intelligence needs. It also contains numerous recipes to help you overcome challenging situations while creating fully featured desktop applications in Qlik Sense. It explains how to combine Rattle and Qlik Sense Desktop to apply predictive analytics to your data to develop real-world interactive data applications. The course includes premium content from three of our most popular books: ? Learning Qlik Sense: The Official Guide Second Edition ? Qlik Sense Cookbook ? Predictive Analytics using Rattle and Qlik Sense On completion of this course, you will be self-sufficient in improving your data analysis and will know how to apply predictive analytics to your datasets. Through this course, you will be able to create predictive models and data applications, allowing you to explore your data insights much deeper. Style and approach The course will follow a practical approach with rich set of examples through which it will demonstrate its concepts, features and its implementation. The course will also feature numerous solutions which will cover entire spectrum of BI use cases.

Create engaging user experiences and awesome user interfaces using this guide About This Book ? Move beyond default UI templates, create and customize amazing UIs with Android Custom View ? Enable smooth data flow and create futuristic UIs by creating flexible custom views ? Scale your apps with responsive and data intensive views Who This Book Is For This book is for Android developers who want to create great user interfaces and move beyond the basics of the standard UI elements. They must have basic Android development knowledge along with basic Java programming. What You Will Learn ? Extend the standard UI widget framework by creating Custom views ? Add complex rendering, animations, and interactions to your views ? Optimize performance and decrease battery usage ? Implement custom views to share between multiple projects, or share it publicly ? Create 3D custom views using OpenGL ES In Detail To build great user interfaces for your Android apps that go beyond the standard UI elements, you need to use custom Android views. With these, you can give your app a distinctive look and ensure that it functions properly across multiple devices. This book will help you construct a great UI for your apps by teaching you how to create custom Android views. You will start by creating your first Android custom view and go through the design considerations. You will then see how the right choices will enable your custom view to perform seamlessly across multiple platforms and Android versions. You will create custom styleable attributes that work with Android XML layouts, learn to process touch events, define custom attributes, and add properties and events to them. By the end of this book, you will be able to create apps with custom views that are responsive and adaptable to make your app distinctive and an instant hit with its users. Style and approach The approach will be that of a step by step practical tutorial. The book will take you through a complete journey, right from creating your first Android view to customizing it to enable it to support any complex app.

Solve different problems in modelling deep neural networks using Python, Tensorflow, and Keras with this practical guide About This Book ? Practical recipes on training different neural network models and tuning them for optimal performance ? Use Python frameworks like TensorFlow, Caffe, Keras, Theano for Natural Language Processing, Computer Vision, and more ? A hands-on guide covering the common as well as the not so common problems in deep learning using Python Who This Book Is For This book is intended for machine learning professionals who are looking to use deep learning algorithms to create real-world applications using Python. Thorough understanding of the machine learning concepts and Python libraries such as NumPy, SciPy and scikit-learn is expected. Additionally, basic knowledge in linear algebra and calculus is desired. What You Will Learn ? Implement different neural network models in Python ? Select the best Python framework for deep learning such as PyTorch, Tensorflow, MXNet and Keras ? Apply tips and tricks related to neural networks internals, to boost learning performances ? Consolidate machine learning principles and apply them in the deep learning field ? Reuse and adapt Python code snippets to everyday problems ? Evaluate the cost/benefits and performance implication of each discussed solution In Detail Deep Learning is revolutionizing a wide range of industries. For many applications, deep learning has proven to outperform humans by making faster and more accurate predictions. This book provides a top-down and bottom-up approach to demonstrate deep learning solutions to real-world problems in different areas. These applications include Computer Vision, Natural Language Processing, Time Series, and Robotics. The Python Deep Learning Cookbook presents technical solutions to the issues presented, along with a detailed explanation of the solutions. Furthermore, a discussion on corresponding pros and cons of implementing the proposed solution using one of the popular frameworks like TensorFlow, PyTorch, Keras and CNTK is provided. The book includes recipes that are related to the basic concepts of neural networks. All techniques s, as well as classical networks topologies. The main purpose of this book is to provide Python programmers a detailed list of recipes to apply deep learning to common and not-so-common scenarios. Style and approach Unique blend of independent recipes arranged in the most logical manner

Getting started with the processes and the tools to continuously deliver high-quality software About This Book ? Incorporate popular development practices to prevent messy code ? Automate your build, integration, release, and deployment processes with Jenkins, Git, and Gulp―and learn how continuous integration (CI) can save you time and money ? Gain an end-to-end overview of Continuous Integration using different languages (JavaScript and C#) and tools (Gulp and Jenkins) Who This Book Is For This book is for developers who want to understand and implement Continuous Integration and Delivery in their daily work. A basic knowledge of at least JavaScript and HTML/CSS is required. Knowing C# and SQL will come in handy. Most programmers who have programmed in a (compiled) C-like language will be able to follow along. What You Will Learn ? Get to know all the aspects of Continuous Integration, Deployment, and Delivery ? Find out how Git can be used in a CI environment ? Set up browser tests using Karma and Selenium and unit tests using Jasmine ? Use Node.js, npm, and Gulp to automate tasks such as linting, testing, and minification ? Explore different Jenkins jobs to integrate with Node.js and C# projects ? Perform Continuous Delivery and Deployment using Jenkins ? Test and deliver a web API In Detail The challenge faced by many teams while implementing Continuous Deployment is that it requires the use of many tools and processes that all work together. Learning and implementing all these tools (correctly) takes a lot of time and effort, leading people to wonder whether it's really worth it. This book sets up a project to show you the different steps, processes, and tools in Continuous Deployment and the actual problems they solve. We start by introducing Continuous Integration (CI), deployment, and delivery as well as providing an overview of the tools used in CI. You'll then create a web app and see how Git can be used in a CI environment. Moving on, you'll explore unit testing using Jasmine and browser testing using Karma and Selenium for your app. You'll also find out how to automate tasks using Gulp and Jenkins. Next, you'll get acquainted with database integration for different platforms, such as MongoDB and PostgreSQL. Finally, you'll set up different Jenkins jobs to integrate with Node.js and C# projects, and Jenkins pipelines to make branching easier. By the end of the book, you'll have implemented Continuous Delivery and deployment from scratch. Style and approach This practical book takes a step-by-step approach to explaining all the concepts of Continuous Integration and delivery, and how it can help you deliver a high-quality product.

Learn the importance of architectural and design patterns in producing and sustaining next-generation IT and business-critical applications with this guide. About This Book ? Use patterns to tackle communication, integration, application structure, and more ? Implement modern design patterns such as microservices to build resilient and highly available applications ? Choose between the MVP, MVC, and MVVM patterns depending on the application being built Who This Book Is For This book will empower and enrich IT architects (such as enterprise architects, software product architects, and solution and system architects), technical consultants, evangelists, and experts. What You Will Learn ? Understand how several architectural and design patterns work to systematically develop multitier web, mobile, embedded, and cloud applications ? Learn object-oriented and component-based software engineering principles and patterns ? Explore the frameworks corresponding to various architectural patterns ? Implement domain-driven, test-driven, and behavior-driven methodologies ? Deploy key platforms and tools effectively to enable EA design and solutioning ? Implement various patterns designed for the cloud paradigm In Detail Enterprise Architecture (EA) is typically an aggregate of the business, application, data, and infrastructure architectures of any forward-looking enterprise. Due to constant changes and rising complexities in the business and technology landscapes, producing sophisticated architectures is on the rise. Architectural patterns are gaining a lot of attention these days. The book is divided in three modules. You'll learn about the patterns associated with object-oriented, component-based, client-server, and cloud architectures. The second module covers Enterprise Application Integration (EAI) patterns and how they are architected using various tools and patterns. You will come across patterns for Service-Oriented Architecture (SOA), Event-Driven Architecture (EDA), Resource-Oriented Architecture (ROA), big data analytics architecture, and Microservices Architecture (MSA). The final module talks about advanced topics such as Docker containers, high performance, and reliable application architectures. The key takeaways include understanding what architectures are, why they're used, and how and where architecture, design, and integration patterns are being leveraged to build better and bigger systems. Style and Approach This book adopts a hands-on approach with real-world examples and use cases.

A comprehensive guide to learning Cacti and using it to implement performance measurement and reporting within a Network Operations Center About This Book ? A complete Cacti book that focuses on the basics as well as the advanced concepts you need to know for implementing a Network Operations Center ? A step-by-step Beginner's Guide with detailed instructions on how to create and implement custom plugins ? Written by Thomas Urban – creator of the "Cereus" and "NMID" plugins for Cacti known as Phalek in the Cacti forum Who This Book Is For If you are a network operator and want to use Cacti for implementing performance measurement for trending, troubleshooting, and reporting purposes, then this book is for you. You only need to know the basics of network management and SNMP. What You Will Learn ? Setting up Cacti on Linux and Windows systems ? Extending the core functionality by using the plugin architecture ? Building your own custom plugins ? Creating your own custom data input method to retrieve data from your systems ? Using SNMP, SSH, and WMI to retrieve remote performance data ? Designing and create enterprise-class reports with the reporting plugins ? Implementing threshold-based alerting using the Thold plugin ? Automating common administrative tasks utilizing the command-line interface and the automate functionality ? Migrating Cacti to new servers ? Building a multi remote-poller environment In Detail Cacti is a performance measurement tool that provides easy methods and functions for gathering and graphing system data. You can use Cacti to develop a robust event management system that can alert on just about anything you would like it to. But to do that, you need to gain a solid understanding of the basics of Cacti, its plugin architecture, and automation concepts. Cacti Beginner's Guide will introduce you to the wide variety of features of Cacti and will guide you on how to use them for maximum effectiveness. Advanced topics such as the plugin architecture and Cacti automation using the command-line interface will help you build a professional performance measurement system. Designed as a beginner's guide, the book starts off with the basics of installing and using Cacti, and also covers the advanced topics that will show you how to customize and extend the core Cacti functionalities. The book offers essential tutorials for creating advanced graphs and using plugins to create enterprise-class reports to show your customers and colleagues. From data templates to input methods and plugin installation to creating your own customized plugins, this book provides you with a rich selection of step-by-step instructions to reach your goals. It covers all you need to know to implement professional performance measurement techniques with Cacti and ways to fully customize Cacti to fit your needs. You will also learn how to migrate Cacti to new servers. Lastly you will also be introduced to the latest feature of building a scalable remote poller environment. By the end of the book, you will be able to implement and extend Cacti to monitor, display, and report the performance of your network exactly the way you want. Style and approach Written for beginners to Cacti, this book contains step-by-step instructions and hands-on tutorials for network operators to learn how to implement and use the core Cacti functions.

Explore the necessary concepts of REST API development by building few real world services from scratch. About This Book ? Follow best practices and explore techniques such as clustering and caching to achieve a reactive, scalable web service ? Leverage the Buffalo Framework to quickly implement RESTful endpoints ? Learn to implement a client library for a RESTful web service using Go Who This Book Is For This book is intended for those who want to learn to build RESTful web services with a framework like Buffalo. To make best use of the code samples included in the book, you should have a basic knowledge of Go programming. What You Will Learn ? Create HTTP handler and introspect the Gorilla Mux router ? OAuth 2 implementation with Go ? Build RESTFul API with go-restful, Revel.Go and Buffalo Go ? Create REST API with MongoDB and Go ? Build a working client library and unit test for REST API ? Debug, test, and profile RESTful APIs with each of the frameworks ? Optimize and scale REST API using microservices In Detail REST is an architectural style that tackles the challenges of building scalable web services and in today's connected world, APIs have taken a central role on the web. APIs provide the fabric through which systems interact, and REST has become synonymous with APIs. The depth, breadth, and ease of use of Go, makes it a breeze for developers to work with it to build robust Web APIs. This book takes you through the design of RESTful web services and leverages a framework like Buffalo Go to implement these services. The book starts with a brief introduction to REST API development and how it transformed the modern web. You will learn how to handle routing and authentication of web services along with working with middleware for internal service. The book explains how to use Go frameworks to build RESTful web services and work with MongoDB to create REST API. You will learn how to integrate Postgres SQL and JSON with a Go web service and build a client library in Go for consuming REST API. You will learn how to scale APIs using the microservice architecture and deploy the REST APIs using Nginx as a proxy server. Finally you will learn how to metricize a REST API using an API Gateway. By the end of the book you will be proficient in building RESTful APIs in Go. Style and approach This book is a step-by-step, hands-on guide to designing and building RESTful web services.

Help your organization join the DevOps revolution About This Book ? Helps you skill up your DevOps knowledge without a strong set of prerequisites ? Deliver continuously improved software by showcasing the most advanced tools and techniques ? Acquire a deeper insight into implementing DevOps in your organization and deliver results from day 1 Who This Book Is For This book is written for engineers and companies that want to learn the minimum set of required technologies and processes to be successful in the DevOps world. This book also targets system administrators, developers, and IT professionals who would like to employ DevOps techniques and best practices to manage IT infrastructures or would like to acquire the necessary skills needed to work in DevOps teams. What You Will Learn ? Master development best practices. ? Understand how the Agile Delivery Methodology helps you ensure accuracy and quality. ? Analyze branching strategies such as branch creation, merging, and synchronization. ? Learn to automate builds to deploy and deliver code faster and more often ? Explore testing frameworks and how to automate testing ? Learn to put specific metrics in place to measure ROI of DevOps and monitor logs and events in a system In Detail This book follows a unique approach to modern DevOps using cutting-edge tools and technologies such as Ansible, Kubernetes, and Google Cloud Platform. This book starts by explaining the organizational alignment that has to happen in every company that wants to implement DevOps in order to be effective, and the use of cloud datacenters in combination with the most advanced DevOps tools to get the best out of a small team of skilled engineers. It also delves into how to use Kubernetes to run your applications in Google Cloud Platform, minimizing the friction and hassle of maintaining a cluster but ensuring its high availability. By the end of this book, you will be able to realign teams in your company and create a Continuous Delivery pipeline with Kubernetes and Docker. With strong monitoring in place, you will also be able to react to adverse events in your system, minimizing downtime and improving the overall up-time and stability of your system. Style and approach This book takes a step-by-step practical approach to the implementation of DevOps. This book will teach you how to enable IT organizations to deliver faster and smarter through a unique approach using Code-Build-Test-Release-Configure-Monitor (CBTRCM).

Build exciting AR applications on mobile and wearable devices with Unity 3D, Vuforia, ARToolKit, Microsoft Mixed Reality HoloLens, Apple ARKit, and Google ARCore About This Book ? Create unique AR applications from scratch, from beginning to end, with step-by-step tutorials ? Use Unity 3D to efficiently create AR apps for Android, iOS, and Windows platforms ? Use Vuforia, ARTookKit, Windows Mixed Reality, and Apple ARKit to build AR projects for a variety of markets ? Learn best practices in AR user experience, software design patterns, and 3D graphics Who This Book Is For The ideal target audience for this book is developers who have some experience in mobile development, either Android or iOS. Some broad web development experience would also be beneficial. What You Will Learn ? Build Augmented Reality applications through a step-by-step, tutorial-style project approach ? Use the Unity 3D game engine with the Vuforia AR platform, open source ARToolKit, Microsoft's Mixed Reality Toolkit, Apple ARKit, and Google ARCore, via the C# programming language ? Implement practical demo applications of AR including education, games, business marketing, and industrial training ? Employ a variety of AR recognition modes, including target images, markers, objects, and spatial mapping ? Target a variety of AR devices including phones, tablets, and wearable smartglasses, for Android, iOS, and Windows HoloLens ? Develop expertise with Unity 3D graphics, UIs, physics, and event systems ? Explore and utilize AR best practices and software design patterns In Detail Augmented Reality brings with it a set of challenges that are unseen and unheard of for traditional web and mobile developers. This book is your gateway to Augmented Reality development—not a theoretical showpiece for your bookshelf, but a handbook you will keep by your desk while coding and architecting your first AR app and for years to come. The book opens with an introduction to Augmented Reality, including markets, technologies, and development tools. You will begin by setting up your development machine for Android, iOS, and Windows development, learning the basics of using Unity and the Vuforia AR platform as well as the open source ARToolKit and Microsoft Mixed Reality Toolkit. You will also receive an introduction to Apple's ARKit and Google's ARCore! You will then focus on building AR applications, exploring a variety of recognition targeting methods. You will go through multiple complete projects illustrating key market sectors including business marketing, education, industrial training, and gaming. By the end of the book, you will have gained the necessary knowledge to make quality content appropriate for a range of AR devices, platforms, and intended uses. Style and approach This book adopts a practical, step-by-step, tutorial-style approach. The design principles and methodology will be explained by creating different modules of the AR app.

Get up and running with the Pentaho Data Integration tool using this hands-on, easy-to-read guide About This Book ? Manipulate your data by exploring, transforming, validating, and integrating it using Pentaho Data Integration 8 CE ? A comprehensive guide exploring the features of Pentaho Data Integration 8 CE ? Connect to any database engine, explore the databases, and perform all kind of operations on relational databases Who This Book Is For This book is a must-have for software developers, business intelligence analysts, IT students, or anyone involved or interested in developing ETL solutions. If you plan on using Pentaho Data Integration for doing any data manipulation task, this book will help you as well. This book is also a good starting point for data warehouse designers, architects, or anyone who is responsible for data warehouse projects and needs to load data into them. What You Will Learn ? Explore the features and capabilities of Pentaho Data Integration 8 Community Edition ? Install and get started with PDI ? Learn the ins and outs of Spoon, the graphical designer tool ? Learn to get data from all kind of data sources, such as plain files, Excel spreadsheets, databases, and XML files ? Use Pentaho Data Integration to perform CRUD (create, read, update, and delete) operations on relationaldatabases ? Populate a data mart with Pentaho Data Integration ? Use Pentaho Data Integration to organize files and folders, run daily processes, deal with errors, and more In Detail Pentaho Data Integration(PDI) is an intuitive and graphical environment packed with drag-and-drop design and powerful Extract-Tranform-Load (ETL) capabilities. This book shows and explains the new interactive features of Spoon, the revamped look and feel, and the newest features of the tool including transformations and jobs Executors and the invaluable Metadata Injection capability. We begin with the installation of PDI software and then move on to cover all the key PDI concepts. Each of the chapter introduces new features, enabling you to gradually get practicing with the tool. First, you will learn to do all kind of data manipulation and work with simple plain files. Then, the book teaches you how you can work with relational databases inside PDI. Moreover, you will be given a primer on data warehouse concepts and you will learn how to load data in a data warehouse. During the course of this book, you will be familiarized with its intuitive, graphical and drag-and-drop design environment. By the end of this book, you will learn everything you need to know in order to meet your data manipulation requirements. Besides, your will be given best practices and advises for designing and deploying your projects. Style and approach Step by step guide filled with practical, real world scenarios and examples.

Master Wireshark and discover how to analyze network packets and protocols effectively, along with engaging recipes to troubleshoot network problems About This Book ? Gain valuable insights into the network and application protocols, and the key fields in each protocol ? Use Wireshark’s powerful statistical tools to analyze your network and leverage its expert system to pinpoint network problems ? Master Wireshark and train it as your network sniffer Who This Book Is For This book is aimed at IT professionals who want to develop or enhance their packet analysis skills. A basic familiarity with common network and application services terms and technologies is assumed. What You Will Learn ? Discover how packet analysts view networks and the role of protocols at the packet level ? Capture and isolate all the right packets to perform a thorough analysis using Wireshark’s extensive capture and display filtering capabilities ? Decrypt encrypted wireless traffic ? Use Wireshark as a diagnostic tool and also for network security analysis to keep track of malware ? Find and resolve problems due to bandwidth, throughput, and packet loss ? Identify and locate faults in communication applications including HTTP, FTP, mail, and various other applications – Microsoft OS problems, databases, voice, and video over IP ? Identify and locate faults in detecting security failures and security breaches in the network In Detail This Learning Path starts off installing Wireshark, before gradually taking you through your first packet capture, identifying and filtering out just the packets of interest, and saving them to a new file for later analysis. You will then discover different ways to create and use capture and display filters. By halfway through the book, you'll be mastering Wireshark features, analyzing different layers of the network protocol, and looking for any anomalies.We then start Ethernet and LAN switching, through IP, and then move on to TCP/UDP with a focus on TCP performance problems. It also focuses on WLAN security. Then, we go through application behavior issues including HTTP, mail, DNS, and other common protocols. This book finishes with a look at network forensics and how to locate security problems that might harm the network.This course provides you with highly practical content explaining Metasploit from the following books: 1) Wireshark Essentials 2) Network Analysis Using Wireshark Cookbook 3) Mastering Wireshark Style and approach This step-by-step guide follows a practical approach, starting from the basic to the advanced aspects. Through a series of real-world examples, this learning path will focus on making it easy for you to become an expert at using Wireshark.

Leverage the power of Type* 2.0 using real-world examples About This Book ? Begin with the fundamentals of TypeScript and learn how to write better JavaScript code ? Build three amazing applications throughout the book ? Leverage the power of tools such as Angular 2 and NativeScript to build for the web as well as for mobile Who This Book Is For Web developers who would like to learn how to use TypeScript to build amazing applications will benefit from this book. What You Will Learn ? Design your first project in Visual Studio ? Learn about the different data types in TypeScript ? Create web applications in an object-oriented fashion using TypeScript ? Build a Trello application using TypeScript's complex features. ? Explore the tools available in a web application ecosystem to write unit test cases ? Deploy web applications to cloud and assign resources to the application In Detail The TypeScript language, compiler, and open source development toolset brings JavaScript development up to the enterprise level. It allows you to use ES5, ES6, and ES7 JavaScript language features today, including classes, interfaces, generics, modules, and more. Its simple typing syntax enables building large, robust applications using object-oriented techniques and industry-standard design principles. This book aims at teaching you how to get up and running with TypeScript development in the most practical way possible. Taking you through two exciting projects built from scratch, you will learn the basics of TypeScript, before progressing to functions, generics, promises, and callbacks. Then, you’ll get to implement object-oriented programming as well as optimize your applications with effective memory management. You’ll also learn to test and secure your applications, before deploying them. Starting with a basic SPA built using Angular, you will progress on to building, maybe, a Chat application or a cool application. You’ll also learn how to use NativeScript to build a cool mobile application. Each of these applications with be explained in detail, allowing you to grasp the concepts fast. By the end of this book, you will have not only built two amazing projects but you will also have the skills necessary to take your development to the next level. Style and approach Example-based approach to get you quickly started with Type*

A comprehensive guide to mastering the art of preventing your Linux system from getting compromised. About This Book ? Leverage this guide to confidently deliver a system that reduces the risk of being hacked ? Perform a number of advanced Linux security techniques such as network service detection, user authentication, controlling special permissions, encrypting file systems, and much more ? Master the art of securing a Linux environment with this end-to-end practical guide Who This Book Is For If you are a systems administrator or a network engineer interested in making your Linux environment more secure, then this book is for you. Security consultants wanting to enhance their Linux security skills will also benefit from this book. Prior knowledge of Linux is mandatory. What You Will Learn ? Use various techniques to prevent intruders from accessing sensitive data ? Prevent intruders from planting malware, and detect whether malware has been planted ? Prevent insiders from accessing data that they aren’t authorized to access ? Do quick checks to see whether a computer is running network services that it doesn’t need to run ? Learn security techniques that are common to all Linux distros, and some that are distro-specific In Detail This book has extensive coverage of techniques that will help prevent attackers from breaching your system, by building a much more secure Linux environment. You will learn various security techniques such as SSH hardening, network service detection, setting up firewalls, encrypting file systems, protecting user accounts, authentication processes, and so on. Moving forward, you will also develop hands-on skills with advanced Linux permissions, access control, special modes, and more. Lastly, this book will also cover best practices and troubleshooting techniques to get your work done efficiently. By the end of this book, you will be confident in delivering a system that will be much harder to compromise. Style and approach An advanced-level guide filled with real-world examples that will help you secure your Linux system

Learn to design, implement and secure your IoT infrastructure About This Book ? Build a complete IoT system that is the best fit for your organization ? Learn about different concepts, technologies, and tradeoffs in the IoT architectural stack ? Understand the theory, concepts, and implementation of each element that comprises IoT design—from sensors to the cloud ? Implement best practices to ensure the reliability, scalability, robust communication systems, security, and data analysis in your IoT infrastructure Who This Book Is For This book is for architects, system designers, technologists, and technology managers who want to understand the IoT ecosphere, various technologies, and tradeoffs and develop a 50,000-foot view of IoT architecture. What You Will Learn ? Understand the role and scope of architecting a successful IoT deployment, from sensors to the cloud ? Scan the landscape of IoT technologies that span everything from sensors to the cloud and everything in between ? See the trade-offs in choices of protocols and communications in IoT deployments ? Build a repertoire of skills and the vernacular necessary to work in the IoT space ? Broaden your skills in multiple engineering domains necessary for the IoT architect In Detail The Internet of Things (IoT) is the fastest growing technology market. Industries are embracing IoT technologies to improve operational expenses, product life, and people's well-being. An architectural guide is necessary if you want to traverse the spectrum of technologies needed to build a successful IoT system, whether that's a single device or millions of devices. This book encompasses the entire spectrum of IoT solutions, from sensors to the cloud. We start by examining modern sensor systems and focus on their power and functionality. After that, we dive deep into communication theory, paying close attention to near-range PAN, including the new Bluetooth? 5.0 specification and mesh networks. Then, we explore IP-based communication in LAN and WAN, including 802.11ah, 5G LTE cellular, SigFox, and LoRaWAN. Next, we cover edge routing and gateways and their role in fog computing, as well as the messaging protocols of MQTT and CoAP. With the data now in internet form, you'll get an understanding of cloud and fog architectures, including the OpenFog standards. We wrap up the analytics portion of the book with the application of statistical analysis, complex event processing, and deep learning models. Finally, we conclude by providing a holistic view of the IoT security stack and the anatomical details of IoT exploits while countering them with software defined perimeters and blockchains. Style and approach This hands-on guide combines theory and application to the Internet of Things. This book covers the entire architectural stack of components and engineering domains from sensors to power analysis, communication systems, information theory, networking and routing, data security, protocols, software stacks, cloud mechanics, and data analytics with deep learning.

A perfect guide to speed up the predicting power of machine learning algorithms About This Book ? Design, discover, and create dynamic, efficient features for your machine learning application ? Understand your data in-depth and derive astonishing data insights with the help of this Guide ? Grasp powerful feature-engineering techniques and build machine learning systems Who This Book Is For If you are a data science professional or a machine learning engineer looking to strengthen your predictive analytics model, then this book is a perfect guide for you. Some basic understanding of the machine learning concepts and Python *ing would be enough to get started with this book. What You Will Learn ? Identify and leverage different feature types ? Clean features in data to improve predictive power ? Understand why and how to perform feature selection, and model error analysis ? Leverage domain knowledge to construct new features ? Deliver features based on mathematical insights ? Use machine-learning algorithms to construct features ? Master feature engineering and optimization ? Harness feature engineering for real world applications through a structured case study In Detail Feature engineering is the most important step in creating powerful machine learning systems. This book will take you through the entire feature-engineering journey to make your machine learning much more systematic and effective. You will start with understanding your data—often the success of your ML models depends on how you leverage different feature types, such as continuous, categorical, and more, You will learn when to include a feature, when to omit it, and why, all by understanding error analysis and the acceptability of your models. You will learn to convert a problem statement into useful new features. You will learn to deliver features driven by business needs as well as mathematical insights. You'll also learn how to use machine learning on your machines, automatically learning amazing features for your data. By the end of the book, you will become proficient in Feature Selection, Feature Learning, and Feature Optimization. Style and approach This step-by-step guide with use cases, examples, and illustrations will help you master the concepts of feature engineering. Along with explaining the fundamentals, the book will also introduce you to slightly advanced concepts later on and will help you implement these techniques in the real world.

Deploy functions efficiently using different cloud-based serverless offerings Key Features *Understand the concept of Function-as-a-Service *Implement Serverless solutions using AWS Lambda, Azure Functions and Google Cloud Functions *Practical approach towards choosing the best tool for your serverless environment Book Description Serverless applications and architectures are gaining momentum and are increasingly being used by companies of all sizes. Serverless software takes care of many problems that developers face when running systems and servers, such as fault tolerance, centralized logging, horizontal scalability, and deployments. You will learn how to harness serverless technology to rapidly reduce production time and minimize your costs, while still having the freedom to customize your code, without hindering functionality. Upon finishing the book, you will have the knowledge and resources to build your own serverless application hosted in AWS, Microsoft Azure, or Google Cloud Platform, and will have experienced the benefits of event-driven technology for yourself. This hands-on guide dives into the basis of serverless architectures and how to build them using Node.js as a programming language, Visual Studio Code for code editing, and Postman for quickly and securely developing applications without the hassle of configuring and maintaining infrastructure on three public cloud platforms. What you will learn *Understand the benefts of serverless computing and know when to use it *Develop serverless applications on AWS, Azure, and Google Cloud *Get to grips with Function as a Service (FaaS) *Apply triggers to serverless functions *Build event-driven apps using serverless frameworks *Use the Node.js programming language to build serverless apps *Use code editors, such as Visual Studio Code, as development environments *Master the best development practices for creating scalable and practical solutions Who this book is for This book is targeted towards developers, system administrators or any stakeholder working in the Serverless environment and want to understand how functions work. Basic idea of serverless architecture can be an added advantage