Apply modern reinforcement learning and deep reinforcement learning methods using Python and its powerful libraries Key Features * Your entry point into the world of artificial intelligence using the power of Python * An example-rich guide to master various RL and DRL algorithms * Explore the power of modern Python libraries to gain confidence in building self-trained applications Book Description Reinforcement Learning (RL) is the trending and most promising branch of artificial intelligence. This Learning Path will help you master not only the basic reinforcement learning algorithms but also the advanced deep reinforcement learning algorithms. The Learning Path starts with an introduction to RL followed by OpenAI Gym, and TensorFlow. You will then explore various RL algorithms, such as Markov Decision Process, Monte Carlo methods, and dynamic programming, including value and policy iteration. You'll also work on various datasets including image, text, and video. This example-rich guide will introduce you to deep RL algorithms, such as Dueling DQN, DRQN, A3C, PPO, and TRPO. You will gain experience in several domains, including gaming, image processing, and physical simulations. You'll explore TensorFlow and OpenAI Gym to implement algorithms that also predict stock prices, generate natural language, and even build other neural networks. You will also learn about imagination-augmented agents, learning from human preference, DQfD, HER, and many of the recent advancements in RL. By the end of the Learning Path, you will have all the knowledge and experience needed to implement RL and deep RL in your projects, and you enter the world of artificial intelligence to solve various real-life problems. This Learning Path includes content from the following Packt products: * Hands-On Reinforcement Learning with Python by Sudharsan Ravichandiran * Python Reinforcement Learning Projects by Sean Saito, Yang Wenzhuo, and Rajalingappaa Shanmugamani What you will learn * Train an agent to walk using OpenAI Gym and TensorFlow * Solve multi-armed-bandit problems using various algorithms * Build intelligent agents using the DRQN algorithm to play the Doom game * Teach your agent to play Connect4 using AlphaGo Zero * Defeat Atari arcade games using the value iteration method * Discover how to deal with discrete and continuous action spaces in various environments Who this book is for If you’re an ML/DL enthusiast interested in AI and want to explore RL and deep RL from scratch, this Learning Path is for you. Prior knowledge of linear algebra is expected.

Learn end-to-end automation testing techniques for web and mobile browsers using Selenium WebDriver, AppiumDriver, Java, and TestNG Key Features * Explore the Selenium grid architecture and build your own grid for browser and mobile devices * Use ExtentReports for processing results and SauceLabs for cloud-based test services * Unlock the full potential of Selenium to test your web applications. Book Description Selenium WebDriver 3.x is an open source API for testing both browser and mobile applications. With the help of this book, you can build a solid foundation and can easily perform end-to-end testing on web and mobile browsers.You'll begin by being introduced to the Selenium Page Object Model for software development. You'll architect your own framework with a scalable driver class, Java utility classes, and support for third-party tools and plugins. You'll design and build a Selenium grid from scratch to enable the framework to scale and support different browsers, mobile devices, and platforms.You'll strategize and handle a rich web UI using the advanced WebDriver API and learn techniques to handle real-time challenges in WebDriver. You'll perform different types of testing, such as cross-browser testing, load testing, and mobile testing. Finally, you will also be introduced to data-driven testing, using TestNG to create your own automation framework.By the end of this Learning Path, you'll be able to design your own automation testing framework and perform data-driven testing with Selenium WebDriver. This Learning Path includes content from the following Packt products: * Selenium WebDriver 3 Practical Guide - Second Edition by Unmesh Gundecha * Selenium Framework Design in Data-Driven Testing by Carl Cocchiaro What you will learn * Use different mobile and desktop browser platforms with Selenium 3 * Use the Actions API for performing various keyboard and mouse actions * Design the Selenium Driver Class for local, remote, and third-party grid support * Build page object classes with the Selenium Page Object Model * Develop data-driven test classes using the TestNG framework * Encapsulate data using the JSON protocol * Build a Selenium Grid for RemoteWebDriver testing * Build and use utility classes in synchronization, file I/O, reporting and test listener classes Who this book is for This Learning Path is ideal for software quality assurance/testing professionals, software project managers, or software developers interested in using Selenium for testing their applications. Professionals responsible for designing and building enterprise-based testing frameworks will also find this Learning Path useful. Prior programming experience in Java are TestNG is necessary.

This book is intended for developers who want to learn what it takes to deploy and manage production level applications on Heroku. You may have already deployed applications to Heroku or may be entirely new to the platform. This book will get you up to speed quickly with all the knowledge needed to run real-world web applications on Heroku. When using the recipes in this book, it would be helpful to have some prior experience of working with Git and command line applications.

If you are a GIS professional who intends to explore advanced techniques and get more out of GeoServer deployment rather than simply delivering good looking maps, then this book is for you.

If you are an experienced Configuration Manager administrator looking to advance your career or get more from your current environment, then this book is ideal for you. Prior experience of deploying and managing a Configuration Manager site would be helpful in following the examples throughout this book.

This book is for those Splunk developers who want to learn advanced strategies to deal with big data from an enterprise architectural perspective. You need to have good working knowledge of Splunk.

This book is intended for anyone who wants to learn how to efficiently analyze geospatial data with R, including GIS analysts, researchers, educators, and students who work with spatial data and who are interested in expanding their capabilities through programming. The book assumes familiarity with the basic geographic information concepts (such as spatial coordinates), but no prior experience with R and/or programming is required. By focusing on R exclusively, you will not need to depend on any external software—a working installation of R is all that is necessary to begin.

Whether you are a seasoned Objective-C developer or new to the Xcode platform, Swift Essentials will provide you with all you need to know to get started with the language. Prior experience with iOS development is not necessary, but will be helpful to get the most out of the book.

If you're a JavaScript developer interested in a deeper understanding of how to create and design Node.js applications, this is the book for you.

This book is for programmers who want to learn about real-time communication and utilize the full potential of WebRTC. It is assumed that you have working knowledge of setting up a basic telecom infrastructure as well as basic programming and *ing knowledge.

This book is for developers who want an alternative way to store and process data within their applications. No previous graph database experience is required; however, some basic database knowledge will help you understand the concepts more easily.

Visualforce Development Cookbook is written in such a way that even complex concepts are explained in an easy-to-understand manner. Following a Cookbook structure, the book covers some essential technical scenarios and includes over 75 recipes focusing on real-world development problems. This book is packed with illustrations and also contains lots of code samples for the better understanding of the reader."Visualforce Development Cookbook" is aimed at developers who have already grasped the basics of Visualforce. Awareness of the standard component library and the purpose of controllers is expected.

This book is a practical, hands-on guide that provides the reader with a number of clear, step-by-step exercises.This book is great for developers who already have knowledge of PHP and MySQL and who want to learn about integrating Twilio’s API into their websites for telephone solutions.

As a practical tutorial for Analysis Services, get started with developing cubes. "Getting Started with SQL Server 2012 Cube Development" walks you through the basics, working with SSAS to build cubes and get them up and running.Written for SQL Server developers who have not previously worked with Analysis Services. It is assumed that you have experience with relational databases, but no prior knowledge of cube development is required. You need SQL Server 2012 in order to follow along with the exercises in this book.

Written in a friendly, example-driven Beginner’s Guide format, there are plenty of step-by-step instructions and examples that are designed to help you get started with RavenDB. If you are a .NET developer, new to document-oriented databases, and you wish to learn how to build applications using NoSQL databases, then this book is for you. Experience with relational database systems will be helpful, but not necessary.

Written in a conversational style, the author will share his knowledge on advanced Aperture topics with detailed discussions of advanced topics, the theory behind some of those topics and lots of hints and tips for ways to improve your workflow.Photographer’s who have a basic understanding of Aperture

Developing Web Applications with Oracle ADF Essentials covers the basics of Oracle ADF and then works through more complex topics such as debugging and logging features and JAAS Security in JDeveloper as the reader gains more skills. This book will follow a tutorial approach, using a practical example, with the content and tasks getting harder throughout."Developing Web Applications with Oracle ADF Essentials" is for you if you want to build modern, user-friendly web applications for all kinds of data gathering, analysis, and presentations. You do not need to know any advanced HTML or JavaScript programming. Business logic can be implemented by adding Java code at well-defined hook points, so you do not need do know advanced object-oriented programming—regular Java programming skills are enough.

This is a tutorial-driven and practical, but well-grounded book showcasing good Machine Learning practices. There will be an emphasis on using existing technologies instead of showing how to write your own implementations of algorithms. This book is a scenario-based, example-driven tutorial. By the end of the book you will have learnt critical aspects of Machine Learning Python projects and experienced the power of ML-based systems by actually working on them.This book primarily targets Python developers who want to learn about and build Machine Learning into their projects, or who want to provide Machine Learning support to their existing projects, and see them get implemented effectively .Computer science researchers, data scientists, Artificial Intelligence programmers, and statistical programmers would equally gain from this book and would learn about effective implementation through lots of the practical examples discussed.Readers need no prior experience with Machine Learning or statistical processing. Python development experience is assumed.

This book is a hands-on Beginner’s Guide for developers who are new to Vaadin and/or Vaadin UI components. The book will teach readers through examples to use each of the exciting components to build and add various aspects of the user interface to their web apps.If you have experience with the Java language and want to create web applications that look good without having to deal with HTML, XML, and JavaScript, this book is for you. Basic Java programming skills are required, but no web development knowledge is needed at all.

A practical approach with hands-on recipes to learn more about Scratch and its features.Scratch Cookbook is great for people who are still relatively new to programming but wish to learn more. It assumes you know the basics of computer operation. The methods of using Scratch are worked through quickly with a focus on more advanced topics, though readers can move at their own pace to learn all the techniques they need.

By teaching HTML5 by developing exciting games, the reader will see concrete applications for each of the concepts, and will also have a powerful deliverable at the end of each chapter – a fully functional game. We learn the various concepts using very abstract examples – how to model animals, foods, or fictitious machines. This makes learning and understanding a lot easier, and much more enjoyable.If you are are looking to get a good grounding in how to use the new awesome technology that is HTML5, this book is for you. Basic knowledge of HTML and/or HTML5 is welcome, but optional. The book is a friendly and exciting reference for beginners.