A hands-on guide enriched with examples to master deep reinforcement learning algorithms with Python About This Book ? Your entry point into the world of artificial intelligence using the power of Python ? An example-rich guide to master various RL and DRL algorithms ? Explore various state-of-the-art architectures along with math Who This Book Is For If you’re a machine learning developer or deep learning enthusiast interested in artificial intelligence and want to learn about reinforcement learning from scratch, this book is for you. Some knowledge of linear algebra, calculus, and the Python programming language will help you understand the concepts covered in this book. What You Will Learn ? Understand the basics of reinforcement learning methods, algorithms, and elements ? Train an agent to walk using OpenAI Gym and Tensorflow ? Understand the Markov Decision Process, Bellman’s optimality, and TD learning ? Solve multi-armed-bandit problems using various algorithms ? Master deep learning algorithms, such as RNN, LSTM, and CNN with applications ? Build intelligent agents using the DRQN algorithm to play the Doom game ? Teach agents to play the Lunar Lander game using DDPG ? Train an agent to win a car racing game using dueling DQN In Detail Reinforcement Learning (RL) is the trending and most promising branch of artificial intelligence. Hands-On Reinforcement learning with Python will help you master not only the basic reinforcement learning algorithms but also the advanced deep reinforcement learning algorithms. The book starts with an introduction to Reinforcement Learning followed by OpenAI Gym, and TensorFlow. You will then explore various RL algorithms and concepts, such as Markov Decision Process, Monte Carlo methods, and dynamic programming, including value and policy iteration. This example-rich guide will introduce you to deep reinforcement learning algorithms, such as Dueling DQN, DRQN, A3C, PPO, and TRPO. You will also learn about imagination-augmented agents, learning from human preference, DQfD, HER, and many more of the recent advancements in reinforcement learning. By the end of the book, you will have all the knowledge and experience needed to implement reinforcement learning and deep reinforcement learning in your projects, and you will be all set to enter the world of artificial intelligence. Style and approach This is a hands-on book designed to further expand your machine learning skills by understanding reinforcement to deep reinforcement learning algorithms with applications in Python.

Enhance the power of NumPy and start boosting your scientific computing capabilities About This Book ? Grasp all aspects of numerical computing and understand NumPy ? Explore examples to learn exploratory data analysis (EDA), regression, and clustering ? Access NumPy libraries and use performance benchmarking to select the right tool Who This Book Is For Mastering Numerical Computing with NumPy is for you if you are a Python programmer, data analyst, data engineer, or a data science enthusiast, who wants to master the intricacies of NumPy and build solutions for your numeric and scientific computational problems. You are expected to have familiarity with mathematics to get the most out of this book. What You Will Learn ? Perform vector and matrix operations using NumPy ? Perform exploratory data analysis (EDA) on US housing data ? Develop a predictive model using simple and multiple linear regression ? Understand unsupervised learning and clustering algorithms with practical use cases ? Write better NumPy code and implement the algorithms from scratch ? Perform benchmark tests to choose the best configuration for your system In Detail NumPy is one of the most important scientific computing libraries available for Python. Mastering Numerical Computing with NumPy teaches you how to achieve expert level competency to perform complex operations, with in-depth coverage of advanced concepts. Beginning with NumPy's arrays and functions, you will familiarize yourself with linear algebra concepts to perform vector and matrix math operations. You will thoroughly understand and practice data processing, exploratory data analysis (EDA), and predictive modeling. You will then move on to working on practical examples which will teach you how to use NumPy statistics in order to explore US housing data and develop a predictive model using simple and multiple linear regression techniques. Once you have got to grips with the basics, you will explore unsupervised learning and clustering algorithms, followed by understanding how to write better NumPy code while keeping advanced considerations in mind. The book also demonstrates the use of different high-performance numerical computing libraries and their relationship with NumPy. You will study how to benchmark the performance of different configurations and choose the best for your system. By the end of this book, you will have become an expert in handling and performing complex data manipulations. Style and approach This mastering guide will help you master your skills required to perform a complex numerical computation. The book contains the right mixture of theory and practical examples that will help you in dealing with the advanced NumPy and build solutions for your numeric and scientific computational problems

Test your C++ programming skills by solving real-world programming problems covered in the book About This Book ? Solve a variety of real-world programming and logic problems by leveraging the power of C++17 ? Test your skills in using language features, algorithms, data structures, design patterns, and more ? Explore areas such as cryptography, communication, and image handling in C++ Who This Book Is For This book will appeal to C++ developers of all levels. There's a challenge inside for everyone. What You Will Learn ? Serialize and deserialize JSON and XML data ? Perform encryption and signing to facilitate secure communication between parties ? Embed and use SQLite databases in your applications ? Use threads and asynchronous functions to implement generic purpose parallel algorithms ? Compress and decompress files to/from a ZIP archive ? Implement data structures such as circular buffer and priority queue ? Implement general purpose algorithms as well as algorithms that solve specific problems ? Create client-server applications that communicate over TCP/IP ? Consume HTTP REST services ? Use design patterns to solve real-world problems In Detail C++ is one of the most widely-used programming languages and has applications in a variety of fields, such as gaming, GUI programming, and operating systems, to name a few. Through the years, C++ has evolved into (and remains) one of the top choices for software developers worldwide. This book will show you some notable C++ features and how to implement them to meet your application needs. Each problem is unique and doesn't just test your knowledge of the language; it tests your ability to think out of the box and come up with the best solutions. With varying levels of difficulty, you'll be faced with a wide variety of challenges. And in case you're stumped, you don't have to worry: we've got the best solutions to the problems in the book. So are you up for the challenge? Style and approach A recipe-based approach where each problem is solved with the help of step by step instructions.

KNIME Essentials is a practical guide aimed at getting the results you want, as quickly as possible."Knime Essentials" is written for data analysts looking to quickly get up to speed using the market leader in data processing tools, KNIME. No knowledge of KNIME is required, but we will assume that you have some background in data processing.

If you are a professional, student, or educator who wants to learn to use IPython Notebook as a tool for technical and scientific computing, visualization, and data analysis, this is the book for you. This book will prove valuable for anyone that needs to do computations in an agile environment.

Create solutions that are easy to maintain, quick to upgrade, and follow proven concepts and designs About This Book Design software that is maintainable outside the ecosystem of their creators Ensure quality by following patterns that have been proved to work Over two dozen practical Architectural and Design patterns Who This Book Is For Learning Dynamics NAV Patterns is intended for developers, architects, (technical) consultants, and application managers. You may have very little or no knowledge about NAV patterns, but you should be acquainted with programming. What You Will Learn Apply object-oriented practices to C/AL programming Structure your application to avoid merge conflicts Refactor legacy code and avoid anti-patterns Design decision trees to decide when to use which patterns Clone codes and their application in Dynamics NAV Make your application extensible by creating predefined hooks and facades In Detail Microsoft Dynamics NAV is a complete ERP system, which also contains a robust set of development tools to support customization and enhancement. These include an object designer for each of the seven application object types, a business application oriented programming language with .NET interface capability, a compiler, a debugger, and programming testing language support. Learning Dynamics NAV Patterns will guide you through the NAV way of solving problems. This book will first introduce you to patterns and the software architecture of the NAV and then help you to build an example application. Then, it walks you through the details of architectural patterns, design patterns, and implementation patterns. This book will also talk about anti-patterns and handling legacy code. Finally, it teaches you to build solutions using patterns. Proven patterns and best practices will help you create better solutions that are easy to maintain in larger teams across several locations. It will guide you through combining abstract patterns using easy-to-understand examples and will help you decide which patterns to use in which scenarios. Style and approach This book explains the concepts of patterns, code structuring, and object-oriented concepts in a way that is easy to understand for Dynamics NAV specialists through practical examples.

Take the security of your ASP.NET Web API to the next level using some of the most amazing security techniques around About This Book This book has been completely updated for ASP.NET Web API 2.0 including the new features of ASP.NET Web API such as Cross-Origin Resource Sharing (CORS) and OWIN self-hosting Learn various techniques to secure ASP.NET Web API, including basic authentication using authentication filters, forms, Windows Authentication, external authentication services, and integrating ASP.NET’s Identity system An easy-to-follow guide to enable SSL, prevent Cross-Site Request Forgery (CSRF) attacks, and enable CORS in ASP.NET Web API Who This Book Is For This book is intended for anyone who has previous knowledge of developing ASP.NET Web API applications. Good working knowledge and experience with C# and.NET Framework are prerequisites for this book. What You Will Learn Secure your web API by enabling Secured Socket Layer (SSL) Manage your application’s user accounts by integrating ASP.NET’s Identity system Ensure the security of your web API by implementing basic authentication Implement forms and Windows authentication to secure your web API Use external authentication such as Facebook and Twitter to authenticate a request to a web API Protect your web API from CSRF attacks Enable CORS in your web API to explicitly allow some cross-origin requests while rejecting others Fortify your web API using OAuth2 In Detail This book incorporates the new features of ASP.NET Web API 2 that will help you to secure an ASP.NET Web API and make a well-informed decision when choosing the right security mechanism for your security requirements. We start by showing you how to set up a browser client to utilize ASP.NET Web API services. We then cover ASP.NET Web API’s security architecture, authentication, and authorization to help you secure a web API from unauthorized users. Next, you will learn how to use SSL with ASP.NET Web API, including using SSL client certificates, and integrate the ASP.NET Identity system with ASP.NET Web API. We’ll show you how to secure a web API using OAuth2 to authenticate against a membership database using OWIN middleware. You will be able to use local logins to send authenticated requests using OAuth2. We also explain how to secure a web API using forms authentication and how users can log in with their Windows credentials using integrated Windows authentication. You will come to understand the need for external authentication services to enable OAuth/OpenID and social media authentication. We’ll then help you implement anti-Cross-Site Request Forgery (CSRF) measures in ASP.NET Web API. Finally, you will discover how to enable Cross-Origin Resource Sharing (CORS) in your web API application. Style and approach Each chapter is dedicated to a specific security technique, in a task-based and easy-to-follow way. Most of the chapters are accompanied with source code that demonstrates the step-by-step guidelines of implementing the technique, and includes an explanation of how each technique works.

Over 40 hands-on recipes to develop and deploy real-world applications using Amazon EC2 About This Book Design and build applications using Amazon EC2 and a range of supporting AWS tools Find highly effective solutions to your AWS Cloud-based application development, deployment, and infrastructural issues A comprehensive set of recipes to implement your product’s functional and non-functional requirements Who This Book Is For This book is targeted at Cloud-based developers who have prior exposure to AWS concepts and features. Some experience in building small applications and creating some proof-of-concept applications is required. What You Will Learn Select and configure the right EC2 instances Create, configure, and secure a Virtual Private Cloud Create an AWS CloudFormation template Use AWS Identity and Access Management to secure access to EC2 instances Configure auto-scaling groups using CloudWatch Choose and use the right data service such as SimpleDB and DynamoDB for your cloud applications Access key AWS services using client tools and AWS SDKs Deploy AWS applications using Docker containers In Detail Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides flexible and resizable compute capacity in the cloud. The main purpose of Amazon EC2 is to make web-scale cloud computing easier for the developers. It offers developers and companies the raw building blocks like load balancers, object stores and virtual machines running on general hardware (that is, Amazon runs a multitude of hardware components but presents them as a generic utility to its users) with accessible APIs in order to create scalable software products This book covers designing, developing, and deploying scalable, highly available, and secure applications on the AWS platform. By following the steps in the recipes, you will be able to effectively and systematically resolve issues related to development, deployment, and infrastructure for enterprise-grade cloud applications or products. This book starts with helping you choose and configure the right EC2 instances to meet your application-specific requirements. The book then moves on to creating a CloudFormation template and will teach you how to work with stacks. You will then be introduced to using IAM services to configure users, groups, roles, and multi-factor authentication. You will also learn how to connect AD to AWS IAM. Next, you will be using AWS data services and accessing other AWS services including Route 53, Amazon S3, and AWS SES (Amazon Simple Email Service). Finally, you will be deploying AWS applications using Docker containers. Style and approach This book contains a rich set of recipes that cover not only the full spectrum of real-world cloud application development using Amazon EC2, but also the services and security of the applications. The book contains easy-to-follow recipes with step-by-step instructions to leverage EC2 within your applications.

Leverage the power of Wireshark to troubleshoot your networking issues by using effective packet analysis techniques and performing improved protocol analysis About This Book Gain hands-on experience of troubleshooting errors in TCP/IP and SSL protocols through practical use cases Identify and overcome security flaws in your network to get a deeper insight into security analysis This is a fast-paced book that focuses on quick and effective packet captures through practical examples and exercises Who This Book Is For If you are a network or system administrator who wants to effectively capture packets, a security consultant who wants to audit packet flows, or a white hat hacker who wants to view sensitive information and remediate it, this book is for you. This book requires decoding skills and a basic understanding of networking. What You Will Learn Utilize Wireshark's advanced features to analyze packet captures Locate the vulnerabilities in an application server Get to know more about protocols such as DHCPv6, DHCP, DNS, SNMP, and HTTP with Wireshark Capture network packets with tcpdump and snoop with examples Find out about security aspects such as OS-level ARP scanning Set up 802.11 WLAN captures and discover more about the WAN protocol Enhance your troubleshooting skills by understanding practical TCP/IP handshake and state diagrams In Detail Wireshark provides a very useful way to decode an RFC and examine it. The packet captures displayed in Wireshark give you an insight into the security and flaws of different protocols, which will help you perform the security research and protocol debugging. The book starts by introducing you to various packet analyzers and helping you find out which one best suits your needs. You will learn how to use the command line and the Wireshark GUI to capture packets by employing filters. Moving on, you will acquire knowledge about TCP/IP communication and its use cases. You will then get an understanding of the SSL/TLS flow with Wireshark and tackle the associated problems with it. Next, you will perform analysis on application-related protocols. We follow this with some best practices to analyze wireless traffic. By the end of the book, you will have developed the skills needed for you to identify packets for malicious attacks, intrusions, and other malware attacks. Style and approach This is an easy-to-follow guide packed with illustrations and equipped with lab exercises to help you reproduce scenarios using a sample program and command lines.

This is a hands-on book to quickly get you up to speed with SQL Server 2012. It covers all the new features of the core database engine as well as the business intelligence (BI) services.The book begins by taking you step-by-step through the installation process, showing you what to install and which services and features you need. Once you have your SQL Server in place, you learn how to administer it and then explore new T-SQL functions to expand your query-writing toolkit. You will discover how the enhancements to Integration Services, Analysis Services and Reporting Services make developing BI solutions easier. It will then introduce you to SQL Server Data Tools, your new and improved development environment for creating database and BI projects.A hands-on example guides you through the steps required to run Distributed Replay, giving you the experience you need to apply this in the field. The book then takes you through a detailed example to show you how to create a Data Quality Services project and cleanse real-world data. Easy to follow code samples provide you with the queries you need to set up Availability Groups using the new AlwaysOn technology.Once you are comfortable with these new features you will be ready to migrate your data to the cloud and into SQL Azure. An exploration of Hadoop will help you understand big data and how it really is the next big thing,This concise reference is for database administrators, SQL Server Developers and BI professionals. Anyone who is familiar with SQL Server 2008 R2 and needs to make the jump to the latest version with the shortest learning curve will find this book useful.

If you are an IT professional with a basic knowledge of Microsoft Azure and want to learn Azure Storage services, then this book is for you.

This book is packed with real world examples that cover concepts and usability of the core modules of a complex application. If you are Project manager or consultant looking forward to using and implementing Oracle Primavera Contract Management in your organization, then this is the best guide for you. No prior knowledge of PCM required.

A practical guide, packed with illustrations, that will help you become proficient with Hudson and able to utilize it how you want.If you are a Java developer or administrator who would to like automate some of the mundane work required to build and test software and improve software quality, this is the book for you. If you are a development manager or tester, you can also benefit from learning how Hudson works by gaining some insight into test results and historical trends.

If you are a Splunk user and want to enter the wonderful world of Splunk application development, then this book is for you. Some experience with Splunk, writing searches, and designing basic dashboards is expected.

This book is targeted at those who want to gain time in their administrative tasks and profit from it to also improve their environment by reaching a more autonomous infrastructure.

If you are an iOS developer with experience in Objective-C, and wish to develop applications with Swift, then this book is ideal for you. Familiarity with the fundamentals of Swift is an added advantage but not a necessity.

A stepbystep, practical tutorial to help you transform into a Grunt poweruser. This book is for JavaScript developers who want to get to grips with GruntJS and use it to build and test their JavaScript applications. The only requirement for this book is a basic understanding of objects and functions in JavaScript.

This book is an easytofollow tutorial with best practices and advanced references which will help you to take full advantage of Magento with SEO. This book is aimed at both Magento developers and SEO specialists who wish to optimize search and end user elements such as clickthrough rates to ensure the design of their online shop sites effectively maximize sales. Magento store owners may also find large sections of this book useful in order to understand the larger impact small tweaks and changes can have on SEO especially when editing products and categories. This book assumes that the reader will understand the basic concepts of keyword research and the external factors that are required in order to manage an ongoing SEO campaign.

This book is for web developers willing to build better web applications. A basic knowledge of PHP, XML, JavaScript and MySQL, or a strong will to learn-as-you-type, is assumed.

The book is uniquely practical. A richly textured case study is used throughout the book. Although some aspects of the Airport Passenger Services business process are simplified for sake of clarity and efficiency, it provides a comprehensive practical grounding for theoretical UML knowledge. The case study itself was developed in partnership with employees of Zurich Airport. The book was written for business analysts, technical architects and developers. It does not require detailed programming knowledge, nor is prior experience of UML mandatory. It shows how, with UML, simple models of business processes and specification models can be created and read with little effort.

This is a step-by-step tutorial that covers the basics of working with the MicroStrategy platform.If you are a BI developer who would like to use MicroStrategy to build BI apps, this book is ideal for you. This book is also for mid-management executives who need to analyze data and Excel files that are too complicated to manage. A basic concept of BI is assumed.