Leverage the power of reward-based training for your deep learning models with Python Key Features * Understand Q-learning algorithms to train neural networks using Markov Decision Process (MDP) * Study practical deep reinforcement learning using Q-Networks * Explore state-based unsupervised learning for machine learning models Book Description Q-learning is a machine learning algorithm used to solve optimization problems in artificial intelligence (AI). It is one of the most popular fields of study among AI researchers. This book starts off by introducing you to reinforcement learning and Q-learning, in addition to helping you get familiar with OpenAI Gym as well as libraries such as Keras and TensorFlow. A few chapters into the book, you will gain insights into modelfree Q-learning and use deep Q-networks and double deep Q-networks to solve complex problems. This book will guide you in exploring use cases such as self-driving vehicles and OpenAI Gym’s CartPole problem. You will also learn how to tune and optimize Q-networks and their hyperparameters. As you progress, you will understand the reinforcement learning approach to solving real-world problems. You will also explore how to use Q-learning and related algorithms in real-world applications such as scientific research. Toward the end, you’ll gain a sense of what’s in store for reinforcement learning. By the end of this book, you will be equipped with the skills you need to solve reinforcement learning problems using Q-learning algorithms with OpenAI Gym, Keras, and TensorFlow. What you will learn * Explore the fundamentals of reinforcement learning and the state-action-reward process * Understand Markov decision processes * Get well versed with libraries such as Keras, and TensorFlow * Create and deploy model-free learning and deep Q-learning agents with TensorFlow, Keras, and OpenAI Gym * Choose and optimize a Q-Network’s learning parameters and fine-tune its performance * Discover real-world applications and use cases of Q-learning Who this book is for If you are a machine learning developer, engineer, or professional who wants to delve into the deep learning approach for a complex environment, then this is the book for you. Proficiency in Python programming and basic understanding of decision-making in reinforcement learning is assumed.

Create end-to-end systems that can power robots with artificial vision and deep learning techniques Key Features * Study ROS, the main development framework for robotics, in detail * Learn all about convolutional neural networks, recurrent neural networks, and robotics * Create a chatbot to interact with the robot Book Description Artificial Vision and Language Processing for Robotics begins by discussing the theory behind robots. You'll compare different methods used to work with robots and explore computer vision, its algorithms, and limits. You'll then learn how to control the robot with natural language processing commands. You'll study Word2Vec and GloVe embedding techniques, non-numeric data, recurrent neural network (RNNs), and their advanced models. You'll create a simple Word2Vec model with Keras, as well as build a convolutional neural network (CNN) and improve it with data augmentation and transfer learning. You'll study the ROS and build a conversational agent to manage your robot. You'll also integrate your agent with the ROS and convert an image to text and text to speech. You'll learn to build an object recognition system using a video. By the end of this book, you'll have the skills you need to build a functional application that can integrate with a ROS to extract useful information about your environment. What you will learn * Explore the ROS and build a basic robotic system * Understand the architecture of neural networks * Identify conversation intents with NLP techniques * Learn and use the embedding with Word2Vec and GloVe * Build a basic CNN and improve it using generative models * Use deep learning to implement artificial intelligence(AI)and object recognition * Develop a simple object recognition system using CNNs * Integrate AI with ROS to enable your robot to recognize objects Who this book is for Artificial Vision and Language Processing for Robotics is for robotics engineers who want to learn how to integrate computer vision and deep learning techniques to create complete robotic systems. It will prove beneficial to you if you have working knowledge of Python and a background in deep learning. Knowledge of the ROS is a plus.

A comprehensive guide to building full stack applications covering frontend and server-side programming, data management, and web security Key Features * Unleash the power of React Hooks to build interactive and complex user interfaces * Build scalable full stack applications designed to meet demands of modern users * Understand how the Axios library simplifies CRUD operations Book Description React Hooks have changed the way React components are coded. They enable you to write components in a more intuitive way without using classes, which makes your code easier to read and maintain. Building on from the previous edition, this book is updated with React Hooks and the latest changes introduced in create-react-app and Spring Boot 2.1. This book starts with a brief introduction to Spring Boot. You’ll understand how to use dependency injection and work with the data access layer of Spring using Hibernate as the ORM tool. You’ll then learn how to build your own RESTful API endpoints for web applications. As you advance, the book introduces you to other Spring components, such as Spring Security to help you secure the backend. Moving on, you’ll explore React and its app development environment and components for building your frontend. Finally, you’ll create a Docker container for your application by implementing the best practices that underpin professional full stack web development. By the end of this book, you’ll be equipped with all the knowledge you need to build modern full stack applications with Spring Boot for the backend and React for the frontend. What you will learn * Create a RESTful web service with Spring Boot * Grasp the fundamentals of dependency injection and how to use it for backend development * Discover techniques for securing the backend using Spring Security * Understand how to use React for frontend programming * Benefit from the Heroku cloud server by deploying your application to it * Delve into the techniques for creating unit tests using JUnit * Explore the Material UI component library to make more user-friendly user interfaces Who this book is for If you are a Java developer familiar with Spring, but are new to building full stack applications, this is the book for you.

Gain hands-on experience with industry-standard data analysis and machine learning tools in Python Key Features * Learn techniques to use data to identify the exact problem to be solved * Visualize data using different graphs * Identify how to select an appropriate algorithm for data extraction Book Description Data Science Projects with Python is designed to give you practical guidance on industry-standard data analysis and machine learning tools in Python, with the help of realistic data. The book will help you understand how you can use pandas and Matplotlib to critically examine a dataset with summary statistics and graphs, and extract the insights you seek to derive. You will continue to build on your knowledge as you learn how to prepare data and feed it to machine learning algorithms, such as regularized logistic regression and random forest, using the scikit-learn package. You’ll discover how to tune the algorithms to provide the best predictions on new and, unseen data. As you delve into later chapters, you’ll be able to understand the working and output of these algorithms and gain insight into not only the predictive capabilities of the models but also their reasons for making these predictions. By the end of this book, you will have the skills you need to confidently use various machine learning algorithms to perform detailed data analysis and extract meaningful insights from unstructured data. What you will learn * Install the required packages to set up a data science coding environment * Load data into a Jupyter Notebook running Python * Use Matplotlib to create data visualizations * Fit a model using scikit-learn * Use lasso and ridge regression to reduce overfitting * Fit and tune a random forest model and compare performance with logistic regression * Create visuals using the output of the Jupyter Notebook Who this book is for If you are a data analyst, data scientist, or a business analyst who wants to get started with using Python and machine learning techniques to analyze data and predict outcomes, this book is for you. Basic knowledge of computer programming and data analytics is a must. Familiarity with mathematical concepts such as algebra and basic statistics will be useful.

Explore the entire Hyperledger blockchain family, including frameworks such as Fabric, Sawtooth, Indy, Burrow, and Iroha; and tools such as Composer, Explorer, and Caliper. Key Features * Plan, design, and create a full-fledged private decentralized application using Hyperledger services * Master the ins and outs of the Hyperledger network using real-world examples * Packed with problem-solution-based recipes to tackle pain areas in the blockchain development cycle Book Description Hyperledger is an open-source project and creates private blockchain applications for a range of domains. This book will be your desk reference as you explore common and not-so-common challenges faced while building blockchain networks using Hyperledger services. We'll work through all Hyperledger platform modules to understand their services and features and build end-to-end blockchain applications using various frameworks and tools supported by Hyperledger. This book's independent, recipe-based approach (packed with real-world examples) will familiarize you with the blockchain development cycle. From modeling a business network to integrating with various tools, you will cover it all. We'll cover common and not-so-common challenges faced in the blockchain life cycle. Later, we'll delve into how we can interact with the Hyperledger Fabric blockchain, covering all the principles you need to master, such as chaincode, smart contracts, and much more. We'll also address the scalability and security issues currently faced in blockchain development. By the end of this book, you will be able to implement each recipe to plan, design, and create a full-fledged, private, decentralized application to meet organizational needs. What you will learn * Create the most popular permissioned blockchain network with Fabric and Composer * Build permissioned and permission-less blockchains using Sawtooth * Utilize built-in Iroha asset/account management with role-based permissions * Implement and run Ethereum smart contracts with Burrow * Get to grips with security and scalability in Hyperledger * Explore and view blockchain data using Hyperledger Explorer * Produce reports containing performance indicators and benchmarks using Caliper Who this book is for This book is for blockchain developers who want to understand how they can apply Hyperledger services in their day-to-day projects. This book uses a recipe-based approach to help you use Hyperledger to build powerful, decentralized autonomous applications. We assume the reader has a basic knowledge of the Blockchain technology and cryptography concepts

Design and create neural networks with deep learning and artificial intelligence principles using OpenAI Gym, TensorFlow, and Keras Key Features * Explore neural network architecture and understand how it functions * Learn algorithms to solve common problems using back propagation and perceptrons * Understand how to apply neural networks to applications with the help of useful illustrations Book Description Neural networks play a very important role in deep learning and artificial intelligence (AI), with applications in a wide variety of domains, right from medical diagnosis, to financial forecasting, and even machine diagnostics. Hands-On Neural Networks is designed to guide you through learning about neural networks in a practical way. The book will get you started by giving you a brief introduction to perceptron networks. You will then gain insights into machine learning and also understand what the future of AI could look like. Next, you will study how embeddings can be used to process textual data and the role of long short-term memory networks (LSTMs) in helping you solve common natural language processing (NLP) problems. The later chapters will demonstrate how you can implement advanced concepts including transfer learning, generative adversarial networks (GANs), autoencoders, and reinforcement learning. Finally, you can look forward to further content on the latest advancements in the field of neural networks. By the end of this book, you will have the skills you need to build, train, and optimize your own neural network model that can be used to provide predictable solutions. What you will learn * Learn how to train a network by using backpropagation * Discover how to load and transform images for use in neural networks * Study how neural networks can be applied to a varied set of applications * Solve common challenges faced in neural network development * Understand the transfer learning concept to solve tasks using Keras and Visual Geometry Group (VGG) network * Get up to speed with advanced and complex deep learning concepts like LSTMs and NLP * Explore innovative algorithms like GANs and deep reinforcement learning Who this book is for If you are interested in artificial intelligence and deep learning and want to further your skills, then this intermediate-level book is for you. Some knowledge of statistics will help you get the most out of this book.

A practical guide to building high performance systems for object detection, segmentation, video processing, smartphone applications, and more. This book is based on the alpha version of TensorFlow 2. Key Features * Discover how to build, train, and serve your own deep neural networks with TensorFlow 2 and Keras * Apply modern solutions to a wide range of applications such as object detection and video analysis * Learn how to run your models on mobile devices and webpages and improve their performance Book Description Computer vision solutions are becoming increasingly common, making their way in fields such as health, automobile, social media, and robotics. This book will help you explore TensorFlow 2, the brand new version of Google's open source framework for machine learning. You will understand how to benefit from using convolutional neural networks (CNNs) for visual tasks. Hands-On Computer Vision with TensorFlow 2 starts with the fundamentals of computer vision and deep learning, teaching you how to build a neural network from scratch. You will discover the features that have made TensorFlow the most widely used AI library, along with its intuitive Keras interface, and move on to building, training, and deploying CNNs efficiently. Complete with concrete code examples, the book demonstrates how to classify images with modern solutions, such as Inception and ResNet, and extract specific content using You Only Look Once (YOLO), Mask R-CNN, and U-Net. You will also build Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) to create and edit images, and LSTMs to analyze videos. In the process, you will acquire advanced insights into transfer learning, data augmentation, domain adaptation, and mobile and web deployment, among other key concepts. By the end of the book, you will have both the theoretical understanding and practical skills to solve advanced computer vision problems with TensorFlow 2.0. What you will learn * Create your own neural networks from scratch * Classify images with modern architectures including Inception and ResNet * Detect and segment objects in images with YOLO, Mask R-CNN, and U-Net * Tackle problems in developing self-driving cars and facial emotion recognition systems * Boost your application’s performance with transfer learning, GANs, and domain adaptation * Use recurrent neural networks for video analysis * Optimize and deploy your networks on mobile devices and in the browser Who this book is for If you’re new to deep learning and have some background in Python programming and image processing, like reading/writing image files and editing pixels, this book is for you. Even if you’re an expert curious about the new TensorFlow 2 features, you’ll find this book useful. While some theoretical explanations require knowledge in algebra and calculus, the book covers concrete examples for learners focused on practical applications such as visual recognition for self-driving cars and smartphone apps.

Develop technical skills and expertise to automate AWS networking tasks Key Features * A fast paced guide that will help you pass the exam with confidence * Learn advanced skill sets to build effective AWS networking solutions * Enhance your AWS skills with practice exercises and mock tests Book Description Amazon has recently come up a with specialty certifications which validates a particular user's expertise that he/she would want to build a career in. Since the Cloud market now demands of AWS networking skills this becomes the most wanted certification to upheld ones industry portfolio. This book would be your ideal companion to getting skilled with complex and creative networking solutions. Cloud practitioners or associate-level certified individuals interested in validating advanced skills in networking can opt for this practical guide. This book will include topics that will help you design and implement AWS and hybrid IT network architectures along with some network automation tasks. You will also delve deep into topics that will help you design and maintain network architecture for all AWS services. Like most of our certification guides this book will also follow a unique approach of testing your learning with chapter-level practice exercises and certification-based mock tests. The exam mock tests will help you gauge whether you are ready to take the certification exam or not. This book will also be an advanced guide for networking professionals to enhance their networking skills and get certified. By the end of this book, you will be all equipped with AWS networking concepts and techniques and will have mastered core architectural best practices. What you will learn * Formulate solution plans and provide guidance on AWS architecture best practices * Design and deploy scalable, highly available, and fault-tolerant systems on AWS * Identify the tools required to replicate an on-premises network in AWS * Analyze the access and egress of data to and from AWS * Select the appropriate AWS service based on data, compute, database, or security requirements * Estimate AWS costs and identify cost control mechanisms Who this book is for If you are a system administrator, or a network engineer interested in getting certified with an advanced Cloud networking certification then this book is for you. Prior experience in Cloud administration and networking would be necessary.

Presented in a hands-on style, this guide presents you with real world examples to guide you through every process step by step.This book will be useful for any developer, novice or expert, who uses Framework Manager to build packages, but wants to expand their knowledge even further.

The book is styled on a Cookbook, containing recipes - combined with free datasets - which will turn readers into proficient OpenRefine users in the fastest possible way.This book is targeted at anyone who works on or handles a large amount of data. No prior knowledge of OpenRefine is required, as we start from the very beginning and gradually reveal more advanced features. You don't even need your own dataset, as we provide example data to try out the book's recipes.

This book is targeted at information security professionals, penetration testers and network/system administrators who want to get started with wireless penetration testing. No prior experience with Kali Linux and wireless penetration testing is required, but familiarity with Linux and basic networking concepts is recommended.

Create your own massively scalable Cassandra database with highly responsive database queries About This Book Create a Cassandra cluster and tweak its configuration to get the best performance based on your environment Analyze the key concepts and architecture of Cassandra, which are essential to create highly responsive Cassandra databases A fast-paced and step-by-step guide on handling huge amount of data and getting the best out of your database applications Who This Book Is For If you are a developer who is working with Cassandra and you want to deep dive into the core concepts and understand Cassandra’s non-relational nature, then this book is for you. A basic understanding of Cassandra is expected. What You Will Learn Install and set up your Cassandra Cluster using various installation types Use Cassandra Query Language (CQL) to design Cassandra database and tables with various configuration options Design your Cassandra database to be evenly loaded with the lowest read/write latencies Employ the available Cassandra tools to monitor and maintain a Cassandra cluster Debug CQL queries to discover why they are performing relatively slowly Choose the best-suited compaction strategy for your database based on your usage pattern Tune Cassandra based on your deployment operation system environment In Detail Apache Cassandra Essentials takes you step-by-step from from the basics of installation to advanced installation options and database design techniques. It gives you all the information you need to effectively design a well distributed and high performance database. You’ll get to know about the steps that are performed by a Cassandra node when you execute a read/write query, which is essential to properly maintain of a Cassandra cluster and to debug any issues. Next, you’ll discover how to integrate a Cassandra driver in your applications and perform read/write operations. Finally, you’ll learn about the various tools provided by Cassandra for serviceability aspects such as logging, metrics, backup, and recovery. Style and approach This step-by-step guide is packed with examples that explain the core concepts as well as advanced concepts, techniques, and usages of Apache Cassandra.

Explore architectural approaches to building Data Lakes that ingest, index, manage, and analyze massive amounts of data using Big Data technologies About This Book Comprehend the intricacies of architecting a Data Lake and build a data strategy around your current data architecture Efficiently manage vast amounts of data and deliver it to multiple applications and systems with a high degree of performance and scalability Packed with industry best practices and use-case scenarios to get you up-and-running Who This Book Is For This book is for architects and senior managers who are responsible for building a strategy around their current data architecture, helping them identify the need for a Data Lake implementation in an enterprise context. The reader will need a good knowledge of master data management, information lifecycle management, data governance, data product design, data engineering, and systems architecture. Also required is experience of Big Data technologies such as Hadoop, Spark, Splunk, and Storm. What You Will Learn Identify the need for a Data Lake in your enterprise context and learn to architect a Data Lake Learn to build various tiers of a Data Lake, such as data intake, management, consumption, and governance, with a focus on practical implementation scenarios Find out the key considerations to be taken into account while building each tier of the Data Lake Understand Hadoop-oriented data transfer mechanism to ingest data in batch, micro-batch, and real-time modes Explore various data integration needs and learn how to perform data enrichment and data transformations using Big Data technologies Enable data discovery on the Data Lake to allow users to discover the data Discover how data is packaged and provisioned for consumption Comprehend the importance of including data governance disciplines while building a Data Lake In Detail A Data Lake is a highly scalable platform for storing huge volumes of multistructured data from disparate sources with centralized data management services. It eliminates the need for up-front modeling and rigid data structures by allowing schema-less writes. Data Lakes make it possible to ask complex far-reaching questions to find out hidden data patterns and relationships. This book explores the potential of Data Lakes and explores architectural approaches to building data lakes that ingest, index, manage, and analyze massive amounts of data using batch and real-time processing frameworks. It guides you on how to go about building a Data Lake that is managed by Hadoop and accessed as required by other Big Data applications such as Spark, Storm, Hive, and so on, to create an environment in which data from different sources can be meaningfully brought together and analyzed. Data Lakes can be viewed as having three capabilities—intake, management, and consumption. This book will take readers through each of these processes of developing a Data Lake and guide them (using best practices) in developing these capabilities. It will also explore often ignored, yet crucial considerations while building Data Lakes, with the focus on how to architect data governance, security, data quality, data lineage tracking, metadata management, and semantic data tagging. By the end of this book, you will have a good understanding of building a Data Lake for Big Data. You will be able to utilize Data Lakes for efficient and easy data processing and analytics. Style and approach Data Lake Development with Big Data provides architectural approaches to building a Data Lake. It follows a use case-based approach where practical implementation scenarios of each key component are explained. It also helps you understand how these use cases are implemented in a Data Lake. The chapters are organized in a way that mimics the sequential data flow evidenced in a Data Lake.

A step-by-step tutorial on implementing Liferay- based portals to learn performance best practices.The book is good for Liferay portal developers and architects who want to learn performance best practices for implementing Liferay- based solutions. It is assumed that you have a working knowledge of the Liferay portal.

This book is packed with real world examples that cover the design and discipline of the software and service of CRMOD. If you are an architect, designer, developer or administrator looking for a quick reference guide on how to build a Tuxedo application, then this is the best guide for you. This book also helps business users to understand this technology, various features, and functionalities and relate business benefits. No prior knowledge of Tuxedo is required.

With lots of practical, handson, stepbystep examples, this book will lead you through how to extend and optimize your Symfony2 framework. If you have a good understanding of how Symfony works and are now trying to integrate complex tasks in your application, or want to better organize your application by keeping each piece of code where it belongs so it can be decoupled and easily used elsewhere, then this book is for you.

This book uses a stepbystep approach to teach you how to design, deploy, and manage a Horizon Workspace based on real world experience. Written in an easytofollow style, this book explains the terminology in a clear and concise manner. Each feature is explained starting at a high level and then drilling down into the technical detail, using diagrams and screenshots. This book is perfect for IT administrators who want to deploy a solution to centrally manage access to corporate applications, data, and virtual desktops using Horizon Workspace. You need to have some experience in delivering BYOD initiatives and delivering applications from the Cloud (SaaS).

This book is an examplebased tutorial that deals with Optimizing Hadoop for MapReduce job performance. If you are a Hadoop administrator, developer, MapReduce user, or beginner, this book is the best choice available if you wish to optimize your clusters and applications. Having prior knowledge of creating MapReduce applications is not necessary, but will help you better understand the concepts and snippets of MapReduce class template code.

This book is a stepbystep compositing guide, with lots of illustrations and practical approaches and implementations to attain a desired visual quality to a deadline. Each chapter progressively adds to your skillset, covering a wide range of CG film making compositing concepts. This book is for digital CG artists looking to add photo realism and life to their footage. This book also assists technical CG artists in strategizing and implementing productive lighting. If you are new to Blender or compositing, this book will guide you step by step in gaining compositing skills.

If you want to discover one of the latest tools designed to produce stunning Big Data insights, this book features everything you need to get to grips with your data. Whether you are a data architect, developer, or a business strategist, HDInsight adds value in everything from development, administration, and reporting.

If you use CSS for web development tasks and want to learn how to create maintainable and reusable code, this is the book for you. Basic knowledge of web development would be helpful.