Leverage the power of the Reinforcement Learning techniques to develop self-learning systems using Tensorflow About This Book ? Learn reinforcement learning concepts and their implementation using TensorFlow ? Discover different problem-solving methods for Reinforcement Learning ? Apply reinforcement learning for autonomous driving cars, robobrokers, and more Who This Book Is For If you want to get started with reinforcement learning using TensorFlow in the most practical way, this book will be a useful resource. The book assumes prior knowledge of machine learning and neural network programming concepts, as well as some understanding of the TensorFlow framework. No previous experience with Reinforcement Learning is required. What You Will Learn ? Implement state-of-the-art Reinforcement Learning algorithms from the basics ? Discover various techniques of Reinforcement Learning such as MDP, Q Learning and more ? Learn the applications of Reinforcement Learning in advertisement, image processing, and NLP ? Teach a Reinforcement Learning model to play a game using TensorFlow and the OpenAI gym ? Understand how Reinforcement Learning Applications are used in robotics In Detail Reinforcement Learning (RL), allows you to develop smart, quick and self-learning systems in your business surroundings. It is an effective method to train your learning agents and solve a variety of problems in Artificial Intelligence—from games, self-driving cars and robots to enterprise applications that range from datacenter energy saving (cooling data centers) to smart warehousing solutions. The book covers the major advancements and successes achieved in deep reinforcement learning by synergizing deep neural network architectures with reinforcement learning. The book also introduces readers to the concept of Reinforcement Learning, its advantages and why it’s gaining so much popularity. The book also discusses on MDPs, Monte Carlo tree searches, dynamic programming such as policy and value iteration, temporal difference learning such as Q-learning and SARSA. You will use TensorFlow and OpenAI Gym to build simple neural network models that learn from their own actions. You will also see how reinforcement learning algorithms play a role in games, image processing and NLP. By the end of this book, you will have a firm understanding of what reinforcement learning is and how to put your knowledge to practical use by leveraging the power of TensorFlow and OpenAI Gym. Style and approach An Easy-to-follow, step-by-step guide to help you get to grips with real-world applications of Reinforcement Learning with TensorFlow.

Learn how to build efficient, secure and robust code in C++ by using data structures and algorithms - the building blocks of C++ About This Book ? Use data structures such as arrays, stacks, trees, lists, and graphs with real-world examples ? Learn the functional and reactive implementations of the traditional data structures ? Explore illustrations to present data structures and algorithms, as well as their analysis, in a clear, visual manner Who This Book Is For This book is for developers who would like to learn the Data Structures and Algorithms in C++. Basic C++ programming knowledge is expected. What You Will Learn ? Know how to use arrays and lists to get better results in complex scenarios ? Build enhanced applications by using hashtables, dictionaries, and sets ? Implement searching algorithms such as linear search, binary search, jump search, exponential search, and more ? Have a positive impact on the efficiency of applications with tree traversal ? Explore the design used in sorting algorithms like Heap sort, Quick sort, Merge sort and Radix sort ? Implement various common algorithms in string data types ? Find out how to design an algorithm for a specific task using the common algorithm paradigms In Detail C++ is a general-purpose programming language which has evolved over the years and is used to develop software for many different sectors. This book will be your companion as it takes you through implementing classic data structures and algorithms to help you get up and running as a confident C++ programmer. We begin with an introduction to C++ data structures and algorithms while also covering essential language constructs. Next, we will see how to store data using linked lists, arrays, stacks, and queues. Then, we will learn how to implement different sorting algorithms, such as quick sort and heap sort. Along with these, we will dive into searching algorithms such as linear search, binary search and more. Our next mission will be to attain high performance by implementing algorithms to string datatypes and implementing hash structures in algorithm design. We'll also analyze Brute Force algorithms, Greedy algorithms, and more. By the end of the book, you'll know how to build components that are easy to understand, debug, and use in different applications. Style and approach Readers will be taken through an indispensable list of data structures and algorithms so they can confidently begin coding in C++.

Automate data and model pipelines for faster machine learning applications About This Book ? Build automated modules for different machine learning components ? Understand each component of a machine learning pipeline in depth ? Learn to use different open source AutoML and feature engineering platforms Who This Book Is For If you’re a budding data scientist, data analyst, or Machine Learning enthusiast and are new to the concept of automated machine learning, this book is ideal for you. You’ll also find this book useful if you’re an ML engineer or data professional interested in developing quick machine learning pipelines for your projects. Prior exposure to Python programming will help you get the best out of this book. What You Will Learn ? Understand the fundamentals of Automated Machine Learning systems ? Explore auto-sklearn and MLBox for AutoML tasks ? Automate your preprocessing methods along with feature transformation ? Enhance feature selection and generation using the Python stack ? Assemble individual components of ML into a complete AutoML framework ? Demystify hyperparameter tuning to optimize your ML models ? Dive into Machine Learning concepts such as neural networks and autoencoders ? Understand the information costs and trade-offs associated with AutoML In Detail AutoML is designed to automate parts of Machine Learning. Readily available AutoML tools are making data science practitioners’ work easy and are received well in the advanced analytics community. Automated Machine Learning covers the necessary foundation needed to create automated machine learning modules and helps you get up to speed with them in the most practical way possible. In this book, you’ll learn how to automate different tasks in the machine learning pipeline such as data preprocessing, feature selection, model training, model optimization, and much more. In addition to this, it demonstrates how you can use the available automation libraries, such as auto-sklearn and MLBox, and create and extend your own custom AutoML components for Machine Learning. By the end of this book, you will have a clearer understanding of the different aspects of automated Machine Learning, and you’ll be able to incorporate automation tasks using practical datasets. You can leverage your learning from this book to implement Machine Learning in your projects and get a step closer to winning various machine learning competitions. Style and approach Step by step approach to understand how to automate your machine learning tasks

Your one-stop guide to using Python, creating your own hacking tools, and making the most out of resources available for this programming language About This Book ? Comprehensive information on building a web application penetration testing framework using Python ? Master web application penetration testing using the multi-paradigm programming language Python ? Detect vulnerabilities in a system or application by writing your own Python scripts Who This Book Is For This book is for ethical hackers; penetration testers; students preparing for OSCP, OSCE, GPEN, GXPN, and CEH; information security professionals; cybersecurity consultants; system and network security administrators; and programmers who are keen on learning all about penetration testing. What You Will Learn ? Code your own reverse shell (TCP and HTTP) ? Create your own anonymous shell by interacting with Twitter, Google Forms, and SourceForge ? Replicate Metasploit features and build an advanced shell ? Hack passwords using multiple techniques (API hooking, keyloggers, and clipboard hijacking) ? Exfiltrate data from your target ? Add encryption (AES, RSA, and XOR) to your shell to learn how cryptography is being abused by malware ? Discover privilege escalation on Windows with practical examples ? Countermeasures against most attacks In Detail Python is an easy-to-learn and cross-platform programming language that has unlimited third-party libraries. Plenty of open source hacking tools are written in Python, which can be easily integrated within your script. This book is packed with step-by-step instructions and working examples to make you a skilled penetration tester. It is divided into clear bite-sized chunks, so you can learn at your own pace and focus on the areas of most interest to you. This book will teach you how to code a reverse shell and build an anonymous shell. You will also learn how to hack passwords and perform a privilege escalation on Windows with practical examples. You will set up your own virtual hacking environment in VirtualBox, which will help you run multiple operating systems for your testing environment. By the end of this book, you will have learned how to code your own scripts and mastered ethical hacking from scratch. Style and approach This book follows a practical approach that takes a gradual learning curve, building up your knowledge about ethical hacking, right from scratch. The focus is less on theory and more on practical examples through a step-by-step approach.

A complete guide to designing and building fun games with Qt and Qt Quick using associated toolsets About This Book ? A step by step guide to learn Qt by building simple yet entertaining games ? Get acquainted with a small yet powerful addition—Qt Gamepad Module, that enables Qt applications to support the use of gamepad hardware ? Understand technologies such as QML, OpenGL, and Qt Creator to design intuitive games Who This Book Is For If you want to create great graphical user interfaces and astonishing games with Qt, this book is ideal for you. No previous knowledge of Qt is required; however knowledge of C++ is mandatory. What You Will Learn ? Install the latest version of Qt on your system ? Understand the basic concepts of every Qt game and application ? Develop 2D object-oriented graphics using Qt Graphics View ? Build multiplayer games or add a chat function to your games with Qt Network module ? Script your game with Qt QML ? Explore the Qt Gamepad module in order to integrate gamepad support in C++ and QML applications ? Program resolution-independent and fluid UIs using QML and Qt Quick ? Control your game flow in line with mobile device sensors ? Test and debug your game easily with Qt Creator and Qt Test In Detail Qt is the leading cross-platform toolkit for all significant desktop, mobile, and embedded platforms and is becoming popular by the day, especially on mobile and embedded devices. It's a powerful tool that perfectly fits the needs of game developers. This book will help you learn the basics of Qt and will equip you with the necessary toolsets to build apps and games. The book begins by how to create an application and prepare a working environment for both desktop and mobile platforms. You will learn how to use built-in Qt widgets and Form Editor to create a GUI application and then learn the basics of creating graphical interfaces and Qt's core concepts. Further, you'll learn to enrich your games by implementing network connectivity and employing scripting. You will learn about Qt's capabilities for handling strings and files, data storage, and serialization. Moving on, you will learn about the new Qt Gamepad module and how to add it in your game and then delve into OpenGL and Vulcan, and how it can be used in Qt applications to implement hardware-accelerated 2D and 3D graphics. You will then explore various facets of Qt Quick: how it can be used in games to add game logic, add game physics, and build astonishing UIs for your games. By the end of this book, you will have developed the skillset to develop interesting games with Qt. Style and approach Learn Qt with the help of numerous sample games, introduced step-by-step in each chapter

A step by step guide for beginners to create interactive and dynamic websites from scratch. About This Book ? A fun-filled book with incrementing projects that would help you learn and adapt the fundamentals of web development ? Bring your web design to life with the help of HTML, CSS, JQuery, and learn to kick-start your future projects with Bootstrap ? Explore popular web development techniques such as responsive, adaptive, and material design and initiate yourself with Vue.js Who This Book Is For This book is for anyone who wants to learn about web development regardless of previous experience. It's perfect for complete beginners with zero experience; it's also great for anyone who does have some experience in a few technologies (such as HTML and CSS) but not all of them. What You Will Learn ? Understand the importance of web design and the basic design components ? Learn HTML5 and CSS3 ? Difference between adaptive and responsive web design ? Learn how to create your first website ? Add interaction and dynamic content to your website with JavaScript and JQuery ? Implement Bootstrap Framework in your project ? Get familiar with server-side rendering In Detail Web design is the process of creating websites. It encompasses several different aspects, including webpage layout, content production, and graphic design. This book offers you everything you need to know to build your websites. The book starts off by explaining the importance of web design and the basic design components used in website development. It'll show you insider tips to work quickly and efficiently with web technologies such as HTML5, CSS3, and JavaScript, concluding with a project on creating a static site with good layout. Once you've got that locked down, we'll get our hands dirty by diving straight into learning JavaScript and JQuery, ending with a project on creating dynamic content for your website. After getting our basic website up and running with the dynamic functionalities you'll move on to building your own responsive websites using more advanced techniques such as Bootstrap. Later you will learn smart ways to add dynamic content, and modern UI techniques such as Adaptive UI and Material Design. This will help you understand important concepts such as server-side rendering and UI components. Finally we take a look at various developer tools to ease your web development process. Style and approach This is a fun-filled book with conversational and engaging content ; with each incrementing project, you'll would easily learn and adapt the fundamentals of web development. Each project showcases a different use case and incrementally teaches the web development basics.

React 16 Tooling covers the most important tools, utilities, and libraries that every React developer needs to know - in detail. About This Book ? Each chapter presents meta-development solutions to help React developers ? The tools used are presented in a practical, solution-oriented approach with no fluff ? The chapters are arranged in a logical order that mirrors a typical React development workflow, but you are free to tweak the approaches discussed to fit your own unique style Who This Book Is For This book is for React developers of any skill level who want to make their lives easier. It helps to have some familiarity with React, but if you are an experienced web developer looking at React, then this book will show you how to build a resilient toolset around you before you begin. What You Will Learn ? Bootstrap a React application using create-react-app ? Isolate React component development using Storybook ? Write effective unit tests for your React components using Jest ? Ensure that your component code is to standard using ESLint ? Use browser extensions and built-in component instrumentation to debug React applications ? Enable type safety in React components with Flowtype ? Deploy React applications inside a Docker container as part of a larger application stack In Detail React 16 Tooling covers the most important tools, utilities, and libraries that every React developer needs to know - in detail. As React has grown, the amazing toolset around it has also grown, adding features and enhancing the development workflow. Each of these essential tools is presented in a practical manner and in a logical order mirroring the development workflow. These tools will make your development life simpler and happier, enabling you to create better and more performant apps. Adam starts with a hand-picked selection of the best tools for the React 16 ecosystem. For starters, there's the create-react-app utility that's officially supported by the React team. Not only does this tool bootstrap your React project for you, it also provides a consistent and stable framework to build upon. The premise is that when you don't have to think about meta development work, more focus goes into the product itself. Other React tools follow this same approach to automating and improving your development life. Jest makes unit testing quicker. Flow makes catching errors easier. Docker containers make deployment in a stack simpler. Storybook makes developing components straightforward. ESLint makes writing standardized code faster. The React DevTools plugin makes debugging a cinch. React 16 Tooling clears away the barriers so you can focus on developing the good parts. In this book, we'll look at each of these powerful tools in detail, showing you how to build the perfect React ecosystem to develop your apps within. Style and approach This book covers React tools that help developers with the most relevant challenges they face today. Each chapter begins by defining the challenge faced by developers and why the tool is required, then shows how to fix the problem using React tooling.

Solve all your Ionic-related issues through dedicated recipes that will help you get the best out of Ionic. Working with Ionic components to find out the best way to share data between them effectively. About This Book ? Leverage Ionic 3.9 and its exciting new features to create cutting-edge, real-time apps ? Work through simple recipes to address your problems directly and solve them effectively ? Get examples at each step to guide you on your learning curve with Angular Who This Book Is For This book targets JavaScript developers. No previous knowledge of Ionic is necessary, but prior knowledge of web development techniques would be useful. What You Will Learn ? Help readers to jump-start Ionic apps ? Explore essential features of Ionic with examples ? Learn how to use native device functionalities ? Make the best use of the REST API to handle back-end services ? Work with Cordova to support native functionalities on both iOS and Android. ? Master advanced topics in app development such as deep linking and lazy loading In Detail Ionic is the preferred choice for JavaScript developers to develop real-time hybrid applications. This book will get you started with Ionic 3.9 and help you create Angular 5 components that interact with templates. You will work with Ionic components and find out how to share data efficiently between them. You'll discover how to make the best use of the REST API to handle back-end services and then move on to animating your application to make it look pretty. You then learn to add in a local push notification in order to test the app. Then you'll work with Cordova to support native functionalities on both iOS and Android. From there, you'll get to grips with using the default themes for each platform and customizing your own. We then take you through the advanced Ionic features like lazy loading, deep linking, localizing ionic apps etc. Finally, you'll see how best to deploy your app to different platforms. This book will solve all your Ionic-related issues through dedicated recipes that will help you get the best out of Ionic. Style and approach The book's recipe-based approach will help you get the best out of Ionic 3.9

Leverage the power of the popular Jupyter notebooks to simplify your data science tasks without any hassle About This Book ? Create and share interactive documents with live code, text and visualizations ? Integrate popular programming languages such as Python, R, Julia, Scala with Jupyter ? Develop your widgets and interactive dashboards with these innovative recipes Who This Book Is For This cookbook is for data science professionals, developers, technical data analysts, and programmers who want to execute technical coding, visualize output, and do scientific computing in one tool. Prior understanding of data science concepts will be helpful, but not mandatory, to use this book. What You Will Learn ? Install Jupyter and configure engines for Python, R, Scala and more ? Access and retrieve data on Jupyter Notebooks ? Create interactive visualizations and dashboards for different scenarios ? Convert and share your dynamic codes using HTML, JavaScript, Docker, and more ? Create custom user data interactions using various Jupyter widgets ? Manage user authentication and file permissions ? Interact with Big Data to perform numerical computing and statistical modeling ? Get familiar with Jupyter's next-gen user interface - JupyterLab In Detail Jupyter has garnered a strong interest in the data science community of late, as it makes common data processing and analysis tasks much simpler. This book is for data science professionals who want to master various tasks related to Jupyter to create efficient, easy-to-share, scientific applications. The book starts with recipes on installing and running the Jupyter Notebook system on various platforms and configuring the various packages that can be used with it. You will then see how you can implement different programming languages and frameworks, such as Python, R, Julia, JavaScript, Scala, and Spark on your Jupyter Notebook. This book contains intuitive recipes on building interactive widgets to manipulate and visualize data in real time, sharing your code, creating a multi-user environment, and organizing your notebook. You will then get hands-on experience with Jupyter Labs, microservices, and deploying them on the web. By the end of this book, you will have taken your knowledge of Jupyter to the next level to perform all key tasks associated with it. Style and approach The recipes in this book are highly practical and very easy to follow, and include tips and tricks that will help you crack any problem that you might come across while getting the most out of your Jupyter notebook.

Exploit the features of TypeScript to easily create your very own web applications About This Book ? Develop modular, scalable, maintainable, and adaptable web applications by taking advantage of TypeScript ? Walk through the fundamentals of TypeScript with the help of practical examples ? Enhance your web development skills using TypeScript 2.x Who This Book Is For If you are a developer aiming to learn TypeScript to build attractive web applications, this book is for you. No prior knowledge of TypeScript is required. However, a basic understanding of JavaScript would be an added advantage. What You Will Learn ? Understand TypeScript in depth, including its runtime and advanced type system features ? Master the core principles of the object-oriented programming and functional programming paradigms with TypeScript ? Save time using automation tools such as Gulp, Webpack, ts-node, and npm scripts ? Develop robust, modular, scalable, maintainable, and adaptable applications with testing frameworks such as Mocha, Chai, and Sinon.JS ? Put your TypeScript skills to practice by developing full-stack web applications with Node.js, React and Angular ? Use the APIs of the TypeScript compiler to build custom code analysis tool In Detail TypeScript is an open source and cross-platform statically typed superset of JavaScript that compiles to plain JavaScript and runs in any browser or host. This book is a step-by-step guide that will take you through the use and benefits of TypeScript with the help of practical examples. You will start off by understanding the basics as well as the new features of TypeScript 2.x. Then, you will learn how to work with functions and asynchronous programming APIs. You will continue by learning how to resolve runtime issues and how to implement TypeScript applications using the Object-oriented programming (OOP) and functional programming (FP) paradigms. Later, you will automate your development workflow with the help of tools such as Webpack. Towards the end of this book, you will delve into some real-world scenarios by implementing some full-stack TypeScript applications with Node.js, React and Angular as well as how to optimize and test them. Finally, you will be introduced to the internal APIs of the TypeScript compiler, and you will learn how to create custom code analysis tools. Style and approach This is a step-by-step guide that covers the fundamentals of TypeScript with practical examples.

Improve information security by learning Social Engineering. About This Book ? Learn to implement information security using social engineering ? Get hands-on experience of using different tools such as Kali Linux, the Social Engineering toolkit and so on ? Practical approach towards learning social engineering, for IT security Who This Book Is For This book targets security professionals, security analysts, penetration testers, or any stakeholder working with information security who wants to learn how to use social engineering techniques. Prior knowledge of Kali Linux is an added advantage What You Will Learn ? Learn to implement information security using social engineering ? Learn social engineering for IT security ? Understand the role of social media in social engineering ? Get acquainted with Practical Human hacking skills ? Learn to think like a social engineer ? Learn to beat a social engineer In Detail This book will provide you with a holistic understanding of social engineering. It will help you to avoid and combat social engineering attacks by giving you a detailed insight into how a social engineer operates. Learn Social Engineering starts by giving you a grounding in the different types of social engineering attacks,and the damages they cause. It then sets up the lab environment to use different toolS and then perform social engineering steps such as information gathering. The book covers topics from baiting, phishing, and spear phishing, to pretexting and scareware. By the end of the book, you will be in a position to protect yourself and your systems from social engineering threats and attacks. All in all, the book covers social engineering from A to Z , along with excerpts from many world wide known security experts. Style and approach A step-by-step practical guide that will get you well acquainted with Social Engineering. You’ll be able to get started with it in a matter of minutes with the help of different tools such as the Social Engineering toolkit , Kali Linux and so on.

Become familiar with ICND1 (100-105) exam objectives, and learn how to get ready for the exam About This Book ? A step by step guide that will build you skills from basic concepts to completely understanding network communication ? Comprehensive coverage to help you implement the knowledge you've gained in real-world scenarios ? Take practice questions and mock tests to check how prepared you are for the CCENT exam Who This Book Is For If you are a Network Administrator, Network Technician, Networking professional, or would simply like to prepare for your CCENT certification, then this book is for you. Some basic understanding of networks and how they work would be helpful. Sufficient information will be provided to those new to this field. What You Will Learn ? Get to grips with the computer network concepts ? Understand computer network components and learn to create a computer network ? Understand switching and learn how to configure a switch ? Understand routing and learn how to configure a router ? Understand network services and the maintenance process ? Learn how to troubleshoot networking issues ? Become familiar with, and learn how to prepare for, the ICND1 100-105 exam In Detail CCENT is the entry-level certification for those looking to venture into the networking world. This guide will help you stay up-to date with your networking skills. This book starts with the basics and will take you through everything essential to pass the certification exam. It extensively covers IPv4 and IPv6 addressing, IP data networks, switching and routing, network security, and much more—all in some detail. This guide will provide real-world examples with a bunch of hands-on labs to give you immense expertise in important networking tasks, with a practical approach. Each chapter consists of practice questions to help you take up a challenge from what you have procured. This book ends with mock tests with several examples to help you confidently pass the certification. This Certification Guide consists of everything you need to know in order to pass the ICND 1 100-105 Exam, thus obtaining a CCENT certification. However, practicing with real switches and routers or a switch or router simulator will help you succeed. Style and approach This book is for everyone! It will help beginners who are taking their first steps into the world of computer networks. At the same time, this book can be used by intermediate and advanced network administrators to recap computer network concepts. It will be a handy certification guide for anyone who is studying and preparing to take the Interconnecting Cisco Networking Devices Part 1 (100-105) exam, thus obtaining CCENT certification, which will be a handy professional asset.

A developer's field-guide to designing scalable services using Kubernetes About This Book ? Develop and run your software using containers within a Kubernetes environment ? Get hands-on experience of using Kubernetes with DevOps concepts such as continuous integration, benchmark testing, monitoring, and so on ? Pragmatic example-based approach showing how to use Kubernetes in the development process Who This Book Is For If you are a full-stack or back-end software developers interested, curious, or being asked to test as well as run the code you're creating, you can leverage Kubernetes to make that process simpler and consistent regardless of where you deploy. If you're looking for developer focused examples in NodeJS and Python for how to build, test, deploy, and run your code with Kubernetes, this is perfect for you. What You Will Learn ? Build your software into containers ? Deploy and debug software running in containers within Kubernetes ? Declare and add configuration through Kubernetes ? Define how your application fits together, using internal and external services ? Add feedback to your code to help Kubernetes manage your services ? Monitor and measure your services through integration testing and in production deployments In Detail Kubernetes is documented and typically approached from the perspective of someone running software that has already been built. Kubernetes may also be used to enhance the development process, enabling more consistent testing and analysis of code to help developers verify not only its correctness, but also its efficiency. This book introduces key Kubernetes concepts, coupled with examples of how to deploy and use them with a bit of Node.js and Python example code, so that you can quickly replicate and use that knowledge. You will begin by setting up Kubernetes to help you develop and package your code. We walk you through the setup and installation process before working with Kubernetes in the development environment. We then delve into concepts such as automating your build process, autonomic computing, debugging, and integration testing. This book covers all the concepts required for a developer to work with Kubernetes. By the end of this book, you will be in a position to use Kubernetes in development ecosystems. Style and approach This book will cover examples using NodeJS and Python that walk you through building containers, defining your deployments, deploying, debugging, testing, and generally interacting with your code running on Kubernetes. The examples are focused on common development needs, and include pragmatic advice and the explanations behind that advice.

A hands-on guide enriched with examples to master deep reinforcement learning algorithms with Python About This Book ? Your entry point into the world of artificial intelligence using the power of Python ? An example-rich guide to master various RL and DRL algorithms ? Explore various state-of-the-art architectures along with math Who This Book Is For If you’re a machine learning developer or deep learning enthusiast interested in artificial intelligence and want to learn about reinforcement learning from scratch, this book is for you. Some knowledge of linear algebra, calculus, and the Python programming language will help you understand the concepts covered in this book. What You Will Learn ? Understand the basics of reinforcement learning methods, algorithms, and elements ? Train an agent to walk using OpenAI Gym and Tensorflow ? Understand the Markov Decision Process, Bellman’s optimality, and TD learning ? Solve multi-armed-bandit problems using various algorithms ? Master deep learning algorithms, such as RNN, LSTM, and CNN with applications ? Build intelligent agents using the DRQN algorithm to play the Doom game ? Teach agents to play the Lunar Lander game using DDPG ? Train an agent to win a car racing game using dueling DQN In Detail Reinforcement Learning (RL) is the trending and most promising branch of artificial intelligence. Hands-On Reinforcement learning with Python will help you master not only the basic reinforcement learning algorithms but also the advanced deep reinforcement learning algorithms. The book starts with an introduction to Reinforcement Learning followed by OpenAI Gym, and TensorFlow. You will then explore various RL algorithms and concepts, such as Markov Decision Process, Monte Carlo methods, and dynamic programming, including value and policy iteration. This example-rich guide will introduce you to deep reinforcement learning algorithms, such as Dueling DQN, DRQN, A3C, PPO, and TRPO. You will also learn about imagination-augmented agents, learning from human preference, DQfD, HER, and many more of the recent advancements in reinforcement learning. By the end of the book, you will have all the knowledge and experience needed to implement reinforcement learning and deep reinforcement learning in your projects, and you will be all set to enter the world of artificial intelligence. Style and approach This is a hands-on book designed to further expand your machine learning skills by understanding reinforcement to deep reinforcement learning algorithms with applications in Python.

Enhance the power of NumPy and start boosting your scientific computing capabilities About This Book ? Grasp all aspects of numerical computing and understand NumPy ? Explore examples to learn exploratory data analysis (EDA), regression, and clustering ? Access NumPy libraries and use performance benchmarking to select the right tool Who This Book Is For Mastering Numerical Computing with NumPy is for you if you are a Python programmer, data analyst, data engineer, or a data science enthusiast, who wants to master the intricacies of NumPy and build solutions for your numeric and scientific computational problems. You are expected to have familiarity with mathematics to get the most out of this book. What You Will Learn ? Perform vector and matrix operations using NumPy ? Perform exploratory data analysis (EDA) on US housing data ? Develop a predictive model using simple and multiple linear regression ? Understand unsupervised learning and clustering algorithms with practical use cases ? Write better NumPy code and implement the algorithms from scratch ? Perform benchmark tests to choose the best configuration for your system In Detail NumPy is one of the most important scientific computing libraries available for Python. Mastering Numerical Computing with NumPy teaches you how to achieve expert level competency to perform complex operations, with in-depth coverage of advanced concepts. Beginning with NumPy's arrays and functions, you will familiarize yourself with linear algebra concepts to perform vector and matrix math operations. You will thoroughly understand and practice data processing, exploratory data analysis (EDA), and predictive modeling. You will then move on to working on practical examples which will teach you how to use NumPy statistics in order to explore US housing data and develop a predictive model using simple and multiple linear regression techniques. Once you have got to grips with the basics, you will explore unsupervised learning and clustering algorithms, followed by understanding how to write better NumPy code while keeping advanced considerations in mind. The book also demonstrates the use of different high-performance numerical computing libraries and their relationship with NumPy. You will study how to benchmark the performance of different configurations and choose the best for your system. By the end of this book, you will have become an expert in handling and performing complex data manipulations. Style and approach This mastering guide will help you master your skills required to perform a complex numerical computation. The book contains the right mixture of theory and practical examples that will help you in dealing with the advanced NumPy and build solutions for your numeric and scientific computational problems

Invent your own Python scripts to automate your infrastructure About This Book ? Make the most of Python libraries and modules to automate your infrastructure ? Leverage Python programming to automate server configurations and administration tasks ? Efficiently develop your Python skill set Who This Book Is For Hands-On Enterprise Automation with Python is for system administrators and DevOps engineers who are looking for an alternative to major automation frameworks such as Puppet and Chef. Basic programming knowledge with Python and Linux shell scripting is necessary. What You Will Learn ? Understand common automation modules used in Python ? Develop Python scripts to manage network devices ? Automate common Linux administration tasks with Ansible and Fabric ? Managing Linux processes ? Administrate VMware, OpenStack, and AWS instances with Python ? Security automation and sharing code on GitHub In Detail Hands-On Enterprise Automation with Python starts by covering the set up of a Python environment to perform automation tasks, as well as the modules, libraries, and tools you will be using. We’ll explore examples of network automation tasks using simple Python programs and Ansible. Next, we will walk you through automating administration tasks with Python Fabric, where you will learn to perform server configuration and administration, along with system administration tasks such as user management, database management, and process management. As you progress through this book, you’ll automate several testing services with Python scripts and perform automation tasks on virtual machines and cloud infrastructure with Python. In the concluding chapters, you will cover Python-based offensive security tools and learn how to automate your security tasks. By the end of this book, you will have mastered the skills of automating several system administration tasks with Python. Style and approach This book will follow a practical approach to help you script and automate tasks using Python.

Mastering material for dealing with DBA certification exams About This Book ? Prepare yourself for the IBM C2090-600 certification exam ? Cover over 50 Db2 procedures including database design, performance, and security ? Work through over 150 Q&As to gain confidence on each topic Who This Book Is For The IBM Db2 11.1 Certification Guide is an excellent choice for database administrators, architects, and application developers who are keen to obtain certification in Db2. Basic understanding of Db2 is expected in order to get the most out of this guide. What You Will Learn ? Configure and manage Db2 servers, instances, and databases ? Implement Db2 BLU Acceleration and a DB2 pureScale environment ? Create, manage, and alter Db2 database objects ? Use the partitioning capabilities available within Db2 ? Enforce constraint checking with the SET INTEGRITY command ? Utilize the Db2 problem determination (db2pd) and dsmtop tools ? Configure and manage HADR ? Understand how to encrypt data in transit and at rest In Detail IBM Db2 is a relational database management system (RDBMS) that helps you store, analyze, and retrieve data efficiently. This comprehensive book is designed to help you master all aspects of IBM Db2 database administration and prepare you to take and pass IBM's Certification Exams C2090-600. Building on years of extensive experience, the authors take you through all areas covered by the test. The book delves deep into each certification topic: Db2 server management, physical design, business rules implementation, activity monitoring, utilities, high availability, and security. IBM Db2 11.1 Certification Guide provides you with more than 150 practice questions and answers, simulating real certification examination questions. Each chapter includes an extensive set of practice questions along with carefully explained answers. This book will not just prepare you for the C2090-600 exam but also help you troubleshoot day-to-day database administration challenges. Style and approach A comprehensive certification preparation guide for the C2090-600 exam, covering all the topics in greater detail and with sample questions and answers at the end of each chapter.

Develop blockchain application with step-by-step instructions, working example and helpful recommendations About This Book ? Understanding the blockchain technology from the cybersecurity perspective ? Developing cyber security solutions with Ethereum blockchain technology ? Understanding real-world deployment of blockchain based applications Who This Book Is For The book is targeted towards security professionals, or any stakeholder dealing with cybersecurity who wants to understand the next-level of securing infrastructure using Blockchain. Basic understanding of Blockchain can be an added advantage. What You Will Learn ? Understand the cyberthreat landscape ? Learn about Ethereum and Hyperledger Blockchain ? Program Blockchain solutions ? Build Blockchain-based apps for 2FA, and DDoS protection ? Develop Blockchain-based PKI solutions and apps for storing DNS entries ? Challenges and the future of cybersecurity and Blockchain In Detail Blockchain technology is being welcomed as one of the most revolutionary and impactful innovations of today. Blockchain technology was first identified in the world’s most popular digital currency, Bitcoin, but has now changed the outlook of several organizations and empowered them to use it even for storage and transfer of value. This book will start by introducing you to the common cyberthreat landscape and common attacks such as malware, phishing, insider threats, and DDoS. The next set of chapters will help you to understand the workings of Blockchain technology, Ethereum and Hyperledger architecture and how they fit into the cybersecurity ecosystem. These chapters will also help you to write your first distributed application on Ethereum Blockchain and the Hyperledger Fabric framework. Later, you will learn about the security triad and its adaptation with Blockchain. The last set of chapters will take you through the core concepts of cybersecurity, such as DDoS protection, PKI-based identity, 2FA, and DNS security. You will learn how Blockchain plays a crucial role in transforming cybersecurity solutions. Toward the end of the book, you will also encounter some real-world deployment examples of Blockchain in security cases, and also understand the short-term challenges and future of cybersecurity with Blockchain. Style and approach This book will follow a practical approach to help understand blockchain technology to transform cybersecurity solutions

Write custom plugins for Puppet, including facts, providers, and functions About This Book ? Grasp recipes that work with centralized and decentralized deployments ? Explore language differences and enhancements anticipated in Puppet version 5.x ? Gain expert understanding of Puppet's latest and most advanced features Who This Book Is For Puppet 5 Cookbook is for anyone who builds and administers servers, especially in a web operations context. You’ll need some experience of Linux systems administration, including familiarity with the command line, filesystem, and text editing. No prior programming experience is required. What You Will Learn ? Discover the latest and most advanced features of Puppet ? Bootstrap your Puppet installation using powerful tools like Rake ? Master techniques to deal with centralized and decentralized Puppet deployments ? Use exported resources and forge modules to set up Puppet modules ? Create efficient manifests to streamline your deployments ? Automate Puppet master deployment using Git hooks and PuppetDB ? Make Puppet reliable, performant, and scalable In Detail Puppet is a configuration management system that automates all your IT configurations, giving you control of managing each node.Puppet 5 Cookbook will take you through Puppet's latest and most advanced features, including Docker containers, Hiera, and AWS Cloud Orchestration. Updated with the latest advancements and best practices, this book delves into various aspects of writing good Puppet code, which includes using Puppet community style, checking your manifests with puppet-lint, and learning community best practices with an emphasis on real-world implementation. You will learn to set up, install, and create your first manifests with Puppet version control, and also understand various sysadmin tasks, including managing config files, using Augeas, and generating files from snippets and templates. As the book progresses, you’ll explore virtual resources and use Puppet's resource scheduling and auditing features. In the concluding chapters, you’ll walk through managing applications and writing your own resource types, providers, and external node classifiers. By the end of this book, you will have learned to report, log, and debug your system. Style and approach A recipe-based guide filled with quick step-by-step instructions that are immediately applicable

Develop a fully functional dynamic Android application using the latest features of Firebase About This Book ? Explore all the latest tools in Firebase—Firebase Firestore, ML-Kit, and Firebase Predictions ? Master Firebase cloud messaging, remote configuration, and work with a real-time database ? Make your app a global success with the help of Google Analytics and AdMob Who This Book Is For Mastering Firebase for Android Development is for individualslooking to extend their skills with Firebase and build faster, scalable, and real-time mobile applications. Basic understanding of Android programming is necessary. In all, this in-depth guide is an accessible pathway to mastering Firebase. What You Will Learn ? Learn about Firebase push notifications and write backend functionalities ? Identify the root cause of an application crash and diagnose and fix bugs ? Store different Multipurpose Internet MailExtension(MIME) type files ? Explore web hosting and connect the Firebase functions to the host website ? Send push notifications and understand the deep integration of analytics tools and cohorts ? Market and monetize your application using Firebase Adwords and Admob ? Build a secure authentication framework while enhancing the sign-in and on-boarding experience for end users In Detail Firebase offers a wide spectrum of tools and services to help you develop high-quality apps in a short period of time. It also allows you to build web and mobile apps quickly without managing the infrastructure.Mastering Firebase for Android Development takes you through the complete toolchain of Firebase,including the latest tools announced in Google IO 2018 such as Firebase ML-Kit, FireStore, and Firebase Predictions. The book begins by teaching you to configure your development environment with Firebase and set up a different structure for a Firebase real-time database. As you make your way through the chapters, you’ll establish the authentication feature in Android and explore email and phone authentication for managing the on-boarding of users. You’ll be taken through topics on Firebase crash reporting, Firebase functions, Firebase Cloud, Firebase Hosting, and Cloud Messaging for push notifications and explore other key areas in depth. In the concluding chapters, you will learn to use Firebase Test Lab to test your application before using Firebase Performance Monitoring to trace performance setbacks. By the end of the book, you will be well equipped with the Firebase ecosystem, which will help you find solutions to your common application development challenges. Style and approach A step by step guide taking you through the different features of Firebase

Learn to evaluate and compare data encryption methods and attack cryptographic systems About This Book ? Explore popular and important cryptographic methods ? Compare cryptographic modes and understand their limitations ? Learn to perform attacks on cryptographic systems Who This Book Is For Hands-On Cryptography with Python is for security professionals who want to learn to encrypt and evaluate data, and compare different encryption methods. What You Will Learn ? Protect data with encryption and hashing ? Explore and compare various encryption methods ? Encrypt data using the Caesar Cipher technique ? Make hashes and crack them ? Learn how to use three NIST-recommended systems: AES, SHA, and RSA ? Understand common errors in encryption and exploit them In Detail Cryptography is essential for protecting sensitive information, but it is often performed inadequately or incorrectly. Hands-On Cryptography with Python starts by showing you how to encrypt and evaluate your data. The book will then walk you through various data encryption methods,such as obfuscation, hashing, and strong encryption, and will show how you can attack cryptographic systems. You will learn how to create hashes, crack them, and will understand why they are so different from each other. In the concluding chapters, you will use three NIST-recommended systems: the Advanced Encryption Standard (AES), the Secure Hash Algorithm (SHA), and the Rivest-Shamir-Adleman (RSA). By the end of this book, you will be able to deal with common errors in encryption. Style and approach A practical guide that will help the readers to encrypt their data with ease