An example-rich, comprehensive guide for all of your Python computational needs About This Book Your ultimate resource for getting up and running with Python numerical computations Explore numerical computing and mathematical libraries using Python 3.x code with SciPy and NumPy modules A hands-on guide to implementing mathematics with Python, with complete coverage of all the key concepts Who This Book Is For This book is for anyone who wants to perform numerical and mathematical computations in Python. It is especially useful for developers, students, and anyone who wants to use Python for computation. Readers are expected to possess basic a knowledge of scientific computing and mathematics, but no prior experience with Python is needed. What You Will Learn The principal syntactical elements of Python The most important and basic types in Python The essential building blocks of computational mathematics, linear algebra, and related Python objects Plot in Python using matplotlib to create high quality figures and graphics to draw and visualize your results Define and use functions and learn to treat them as objects How and when to correctly apply object-oriented programming for scientific computing in Python Handle exceptions, which are an important part of writing reliable and usable code Two aspects of testing for scientific programming: Manual and Automatic In Detail Python can be used for more than just general-purpose programming. It is a free, open source language and environment that has tremendous potential for use within the domain of scientific computing. This book presents Python in tight connection with mathematical applications and demonstrates how to use various concepts in Python for computing purposes, including examples with the latest version of Python 3. Python is an effective tool to use when coupling scientific computing and mathematics and this book will teach you how to use it for linear algebra, arrays, plotting, iterating, functions, polynomials, and much more. Style and approach This book takes a concept-based approach to the language rather than a systematic introduction. It is a complete Python tutorial and introduces computing principles, using practical examples to and showing you how to correctly implement them in Python. You’ll learn to focus on high-level design as well as the intricate details of Python syntax. Rather than providing canned problems to be solved, the exercises have been designed to inspire you to think about your own code and give you real-world insight.

Explore the new frontier of virtual reality with the Oculus Rift and bring the VR revolution to your own projects About This Book Create immersive 3D games especially designed for the Oculus Rift platform Build complex realistic virtual reality (VR) games with the Unity Engine Create striking VR environments with advanced graphical techniques Who This Book Is For This book is for aspiring indie developers and VR enthusiasts who want to bring their ideas into virtual reality with a new platform that provides an unprecedented level of realism and immersion. What You Will Learn Increase immersion with 3D audio and intuitive interfaces Create group VR experiences using multi-player networking Design fun and engaging mechanics that utilize VR principles Explore the best ways to navigate and interact using the Oculus Rift Design intuitive ways to navigate and interact with scenes in VR Add stunning realism to a scene with three-dimensional audio Invent mechanics and features that take full advantage of VR hardware In Detail Virtual reality (VR) is changing the world of gaming and entertainment as we know it. VR headsets such as the Oculus Rift immerse players in a virtual world by tracking their head movements and simulating depth, giving them the feeling that they are actually present in the environment. We will first use the Oculus SDK in the book and will then move on to the widely popular Unity Engine, showing you how you can add that extra edge to your VR games using the power of Unity. In this book, you’ll learn how to take advantage of this new medium by designing around each of its unique features. This book will demonstrate the Unity 5 game engine, one of most widely-used engines for VR development, and will take you through a comprehensive project that covers everything necessary to create and publish a complete VR experience for the Oculus Rift. You will also be able to identify the common perils and pitfalls of VR development to ensure that your audience has the most comfortable experience possible. By the end of the book, you will be able to create an advanced VR game for the Oculus Rift, and you’ll have everything you need to bring your ideas into a new reality. Style and approach This book takes a step-by-step tutorial approach with illustrative examples to help you implement the projects on your own. The book lets you first get to grips with the Oculus SDK and then moves on to the Unity Engine to add realistic graphics and features in your games.

Recipes to help you build computer vision applications that make the most of the popular C++ library OpenCV 3 About This Book Written to the latest, gold-standard specification of OpenCV 3 Master OpenCV, the open source library of the computer vision community Master fundamental concepts in computer vision and image processing Learn about the important classes and functions of OpenCV with complete working examples applied to real images Who This Book Is For OpenCV 3 Computer Vision Application Programming Cookbook Third Edition is appropriate for novice C++ programmers who want to learn how to use the OpenCV library to build computer vision applications. It is also suitable for professional software developers who wish to be introduced to the concepts of computer vision programming. It can also be used as a companion book for university-level computer vision courses. It constitutes an excellent reference for graduate students and researchers in image processing and computer vision. What You Will Learn Install and create a program using the OpenCV library Process an image by manipulating its pixels Analyze an image using histograms Segment images into homogenous regions and extract meaningful objects Apply image filters to enhance image content Exploit the image geometry in order to relay different views of a pictured scene Calibrate the camera from different image observations Detect people and objects in images using machine learning techniques Reconstruct a 3D scene from images In Detail Making your applications see has never been easier with OpenCV. With it, you can teach your robot how to follow your cat, write a program to correctly identify the members of One Direction, or even help you find the right colors for your redecoration. OpenCV 3 Computer Vision Application Programming Cookbook Third Edition provides a complete introduction to the OpenCV library and explains how to build your first computer vision program. You will be presented with a variety of computer vision algorithms and exposed to important concepts in image and video analysis that will enable you to build your own computer vision applications. This book helps you to get started with the library, and shows you how to install and deploy the OpenCV library to write effective computer vision applications following good programming practices. You will learn how to read and write images and manipulate their pixels. Different techniques for image enhancement and shape analysis will be presented. You will learn how to detect specific image features such as lines, circles or corners. You will be introduced to the concepts of mathematical morphology and image filtering. The most recent methods for image matching and object recognition are described, and you’ll discover how to process video from files or cameras, as well as how to detect and track moving objects. Techniques to achieve camera calibration and perform multiple-view analysis will also be explained. Finally, you’ll also get acquainted with recent approaches in machine learning and object classification. Style and approach This book will arm you with the basics you need to start writing world-aware applications right from a pixel level all the way through to processing video sequences.

Discover over 90 practical and exciting recipes that leverage the power of OpenVPN 2.4 to help you obtain a reliable and secure VPN About This Book Master the skills of configuring, managing, and securing your VPN using the latest OpenVPN Gain expertise in establishing IPv6 connections and understand PolarSSL using the latest version of OpenVPN This book contains enticing recipes about OpenVPN functionalities that cater to mission critical applications Who This Book Is For This book is for system administrators who have a basic knowledge of OpenVPN and are eagerly waiting to build, secure, and manage VPNs using the latest version. This book assumes some prior knowledge of TCP/IP networking and OpenVPN and you must have network administration skills to get the most out of this book. What You Will Learn Determine the best type of OpenVPN setup for your networking needs Get to grips with the encryption, authentication, and certifications features of OpenSSL. Integrate an OpenVPN server into the local IT infrastructure with the *ing features of OpenVPN Ease the integration of Windows clients into the VPN using Windows-specific client-side configuration Understand the authentication plugins for PAM and LDAP Get to know the difference between TUN-style and TAP-style networks and when to use what Troubleshoot your VPN setup Establish a connection via IPv6 along with demonstrations In Detail OpenVPN provides an extensible VPN framework that has been designed to ease site-specific customization, such as providing the capability to distribute a customized installation package to clients, and supporting alternative authentication methods via OpenVPN’s plugin module interface. This book provides you with many different recipes to help you set up, monitor, and troubleshoot an OpenVPN network. You will learn to configure a scalable, load-balanced VPN server farm that can handle thousands of dynamic connections from incoming VPN clients. You will also get to grips with the encryption, authentication, security, extensibility, and certifications features of OpenSSL. You will also get an understanding of IPv6 support and will get a demonstration of how to establish a connection via IPv64. This book will explore all the advanced features of OpenVPN and even some undocumented options, covering all the common network setups such as point-to-point networks and multi-client TUN-style and TAP-style networks. Finally, you will learn to manage, secure, and troubleshoot your virtual private networks using OpenVPN 2.4. Style and approach This practical, recipe-based book covers the core functionalities of OpenVPN ending with troubleshooting, performance tuning and making the readers inquisitive about the advanced features.

The ultimate guide to successful interviews for Enterprise, Business, Domain, Solution, and Technical Architect roles as well as IT Advisory Consultant and Software Designer roles About This Book Learn about Enterprise Architects IT strategy and NFR – this book provides you with methodologies, best practices, and frameworks to ace your interview A holistic view of key architectural skills and competencies with 500+ questions that cover 12 domains 100+ diagrams depicting scenarios, models, and methodologies designed to help you prepare for your interview Who This Book Is For This book is for aspiring enterprise, business, domain, solution, and technical architects. It is also ideal for IT advisory consultants and IT designers who wish to interview for such a role. Interviewers will be able leverage this book to make sure they hire candidates with the right competencies to meet the role requirements. What You Will Learn Learn about IT strategies, NFR, methodologies, best practices, and frameworks to ace your interview Get a holistic view of key concepts, design principles, and patterns related to evangelizing web and Java enterprise applications Discover interview preparation guidelines through case studies Use this as a reference guide for adopting best practices, standards, and design guidelines Get a better understanding with 60+ diagrams depicting various scenarios, models, and methodologies Benefit from coverage of all architecture domains including EA (Business, Data, Infrastructure, and Application), SA, integration, NFRs, security, and SOA, with extended coverage from IT strategies to the NFR domain In Detail An architect attends multiple interviews for jobs or projects during the course of his or her career. This book is an interview resource created for designers, consultants, technical, solution, domain, enterprise, and chief architects to help them perform well in interview discussions and launch a successful career. The book begins by providing de*ions of architecture skills and competencies that cover the 12 key domains, including 350+ questions relating to these domains. The goal of this book is to cover all the core architectural domains. From an architect’s perspective, it is impossible to revise or learn about all these key areas without a good reference guide – this book is the solution. It shares experiences, learning, insights, and proven methodologies that will benefit practitioners, SMEs, and aspirants in the long run. This book will help you tackle the NFR domain, which is a key aspect pertaining to architecting applications. It typically takes years to understand the core concepts, fundamentals, patterns, and principles related to architecture and designs. This book is a goldmine for the typical questions asked during an interview and will help prepare you for success! Style and approach This book will help you prepare for interviews for architectural profiles by providing likely questions, explanations, and expected answers. It is an insight-rich guide that will help you develop strategic, tactical, and operational thinking for your interview.

The latest in modern Python recipes for the busy modern programmer About This Book Develop succinct, expressive programs in Python Learn the best practices and common idioms through carefully explained and structured recipes Discover new ways to apply Python for the new age of development Who This Book Is For The book is for web developers, programmers, enterprise programmers, engineers, big data scientist, and so on. If you are a beginner, Python Cookbook will get you started. If you are experienced, it will expand your knowledge base. A basic knowledge of programming would help. What You Will Learn See the intricate details of the Python syntax and how to use it to your advantage Improve your code readability through functions in Python Manipulate data effectively using built-in data structures Get acquainted with advanced programming techniques in Python Equip yourself with functional and statistical programming features Write proper tests to be sure a program works as advertised Integrate application software using Python In Detail Python is the preferred choice of developers, engineers, data scientists, and hobbyists everywhere. It is a great *ing language that can power your applications and provide great speed, safety, and scalability. By exposing Python as a series of simple recipes, you can gain insight into specific language features in a particular context. Having a tangible context helps make the language or standard library feature easier to understand. This book comes with over 100 recipes on the latest version of Python. The recipes will benefit everyone ranging from beginner to an expert. The book is broken down into 13 chapters that build from simple language concepts to more complex applications of the language. The recipes will touch upon all the necessary Python concepts related to data structures, OOP, functional programming, as well as statistical programming. You will get acquainted with the nuances of Python syntax and how to effectively use the advantages that it offers. You will end the book equipped with the knowledge of testing, web services, and configuration and application integration tips and tricks. The recipes take a problem-solution approach to resolve issues commonly faced by Python programmers across the globe. You will be armed with the knowledge of creating applications with flexible logging, powerful configuration, and command-line options, automated unit tests, and good documentation. Style and approach This book takes a recipe-based approach, where each recipe addresses specific problems and issues. The recipes provide discussions and insights and an explanation of the problems.

Develop your first interactive 2D and 3D platformer game by learning the fundamentals of C# About This Book ? This is a step-by-step guide to learn the fundamentals of C# 7 *ing to develop GameObjects and master the basics of the new UI system in Unity ? Build and develop your 2D game right from scratch while implementing the principles of object-oriented programming and coding in C# 7 ? Get to grips with the fundamentals of optimizing your game using the latest features of Unity 2017 Who This Book Is For The book is targeted at beginner level Unity developers with no programming experience. If you are a Unity developer and you wish to learn how to write C# *s and code by creating games, then this book is for you. What You Will Learn ? Learn C# 7 using new features like tuples, variables, and non-nullable reference types while building games ? Understand the fundamentals of variables, methods, and code syntax in C# ? Use loops and collections efficiently in Unity to reduce the amount of code ? Develop a game using the object-oriented programming principles ? Implement simple enemy characters into the game to learn point to point movement and Tree behaviors ? Avoid performance mistakes by implementing different optimization techniques ? Export 3D models and 3D animations and import them inside a Unity project ? With your new knowledge of coding, you will be able to look at Unity's Scripting Reference code examples with confidence In Detail With the latest version of Unity 2017 released, are you interested in developing creative and interactive games while learning C# alongside? Then this is the book that you are looking for. Its all about offering you a fun introduction to the world of game programming with C#. You’ll start with the basics to get started with C# 7 and its latest features. Then you’ll see how to use C# 7 and its latest functional programming capabilities to create amazing games with Unity 2017. You’ll create your first C# * for Unity, add objects into it, and learn how to create game elements with them. Then you’ll work with the latest functional programming features of C# and how to leverage them for great game *ing. Throughout the book, you’ll learn to use the new Unity 2017 2D tool set and create an interactive 2D game with it. You will make enemies appear to challenge your player, and go through some optimization techniques to ensure great game performance. At the end, your 2D game will be transformed into 3D, and you’ll be able to skill up to become a pro C# programmer with Unity 2017! Style and approach The book takes a practical, step-by-step approach where you learn C# coding while developing fun and interactive games.

Learn the basics of Geographic Information Systems by solving real-world problems with powerful open source tools About This Book ? This easy-to-follow guide allows you to manage and analyze geographic data with ease using open source tools ? Publish your geographical data online ? Learn the basics of geoinformatics in a practical way by solving problems Who This Book Is For The book is for IT professionals who have little or no knowledge of GIS. It’s also useful for those who are new to the GIS field who don’t want to spend a lot of money buying licenses of commercial tools and training. What You Will Learn ? Collect GIS data for your needs ? Store the data in a PostGIS database ? Exploit the data using the power of the GIS queries ? Analyze the data with basic and more advanced GIS tools ? Publish your data and share it with others ? Build a web map with your published data In Detail The most commonly used GIS tools automate tasks that were historically done manually—compiling new maps by overlaying one on top of the other or physically cutting maps into pieces representing specific study areas, changing their projection, and getting meaningful results from the various layers by applying mathematical functions and operations. This book is an easy-to-follow guide to use the most matured open source GIS tools for these tasks. We’ll start by setting up the environment for the tools we use in the book. Then you will learn how to work with QGIS in order to generate useful spatial data. You will get to know the basics of queries, data management, and geoprocessing. After that, you will start to practice your knowledge on real-world examples. We will solve various types of geospatial analyses with various methods. We will start with basic GIS problems by imitating the work of an enthusiastic real estate agent, and continue with more advanced, but typical tasks by solving a decision problem. Finally, you will find out how to publish your data (and results) on the web. We will publish our data with QGIS Server and GeoServer, and create a basic web map with the API of the lightweight Leaflet web mapping library. Style and approach The book guides you step by step through each of the core concepts of the GIS toolkit, building an overall picture of its capabilities. This guide approaches the topic systematically, allowing you to build upon what you learned in previous chapters. By the end of this book, you’ll have an understanding of the aspects of building a GIS system and will be able to take that knowledge with you to whatever project calls for it.

Become an expert in implementing advanced, network-related tasks with Python. About This Book ? Build the skills to perform all networking tasks using Python with ease ? Use Python for network device automation, DevOps, and software-defined networking ? Get practical guidance to networking with Python Who This Book Is For If you are a network engineer or a programmer who wants to use Python for networking, then this book is for you. A basic familiarity with networking-related concepts such as TCP/IP and a familiarity with Python programming will be useful. What You Will Learn ? Review all the fundamentals of Python and the TCP/IP suite ? Use Python to execute commands when the device does not support the API or programmatic interaction with the device ? Implement automation techniques by integrating Python with Cisco, Juniper, and Arista eAPI ? Integrate Ansible using Python to control Cisco, Juniper, and Arista networks ? Achieve network security with Python ? Build Flask-based web-service APIs with Python ? Construct a Python-based migration plan from a legacy to scalable SDN-based network. In Detail This book begins with a review of the TCP/ IP protocol suite and a refresher of the core elements of the Python language. Next, you will start using Python and supported libraries to automate network tasks from the current major network vendors. We will look at automating traditional network devices based on the command-line interface, as well as newer devices with API support, with hands-on labs. We will then learn the concepts and practical use cases of the Ansible framework in order to achieve your network goals. We will then move on to using Python for DevOps, starting with using open source tools to test, secure, and analyze your network. Then, we will focus on network monitoring and visualization. We will learn how to retrieve network information using a polling mechanism, ?ow-based monitoring, and visualizing the data programmatically. Next, we will learn how to use the Python framework to build your own customized network web services. In the last module, you will use Python for SDN, where you will use a Python-based controller with OpenFlow in a hands-on lab to learn its concepts and applications. We will compare and contrast OpenFlow, OpenStack, OpenDaylight, and NFV. Finally, you will use everything you’ve learned in the book to construct a migration plan to go from a legacy to a scalable SDN-based network. Style and approach An easy-to-follow guide packed with hands-on examples of using Python for network device automation, DevOps, and SDN.

Learn and implement various Quantitative Finance concepts using the popular Python libraries About This Book ? Understand the fundamentals of Python data structures and work with time-series data ? Implement key concepts in quantitative finance using popular Python libraries such as NumPy, SciPy, and matplotlib ? A step-by-step tutorial packed with many Python programs that will help you learn how to apply Python to finance Who This Book Is For This book assumes that the readers have some basic knowledge related to Python. However, he/she has no knowledge of quantitative finance. In addition, he/she has no knowledge about financial data. What You Will Learn ? Become acquainted with Python in the first two chapters ? Run CAPM, Fama-French 3-factor, and Fama-French-Carhart 4-factor models ? Learn how to price a call, put, and several exotic options ? Understand Monte Carlo simulation, how to write a Python program to replicate the Black-Scholes-Merton options model, and how to price a few exotic options ? Understand the concept of volatility and how to test the hypothesis that volatility changes over the years ? Understand the ARCH and GARCH processes and how to write related Python programs In Detail This book uses Python as its computational tool. Since Python is free, any school or organization can download and use it. This book is organized according to various finance subjects. In other words, the first edition focuses more on Python, while the second edition is truly trying to apply Python to finance. The book starts by explaining topics exclusively related to Python. Then we deal with critical parts of Python, explaining concepts such as time value of money stock and bond evaluations, capital asset pricing model, multi-factor models, time series analysis, portfolio theory, options and futures. This book will help us to learn or review the basics of quantitative finance and apply Python to solve various problems, such as estimating IBM’s market risk, running a Fama-French 3-factor, 5-factor, or Fama-French-Carhart 4 factor model, estimating the VaR of a 5-stock portfolio, estimating the optimal portfolio, and constructing the efficient frontier for a 20-stock portfolio with real-world stock, and with Monte Carlo Simulation. Later, we will also learn how to replicate the famous Black-Scholes-Merton option model and how to price exotic options such as the average price call option. Style and approach This book takes a step-by-step approach in explaining the libraries and modules in Python, and how they can be used to implement various aspects of quantitative finance. Each concept is explained in depth and supplemented with code examples for better understanding.

A practical guide to testing your network’s security with Kali Linux, the preferred choice of penetration testers and hackers. About This Book ? Employ advanced pentesting techniques with Kali Linux to build highly-secured systems ? Get to grips with various stealth techniques to remain undetected and defeat the latest defenses and follow proven approaches ? Select and configure the most effective tools from Kali Linux to test network security and prepare your business against malicious threats and save costs Who This Book Is For Penetration Testers, IT professional or a security consultant who wants to maximize the success of your network testing using some of the advanced features of Kali Linux, then this book is for you.Some prior exposure to basics of penetration testing/ethical hacking would be helpful in making the most out of this title. What You Will Learn ? Select and configure the most effective tools from Kali Linux to test network security ? Employ stealth to avoid detection in the network being tested ? Recognize when stealth attacks are being used against your network ? Exploit networks and data systems using wired and wireless networks as well as web services ? Identify and download valuable data from target systems ? Maintain access to compromised systems ? Use social engineering to compromise the weakest part of the network—the end users In Detail This book will take you, as a tester or security practitioner through the journey of reconnaissance, vulnerability assessment, exploitation, and post-exploitation activities used by penetration testers and hackers. We will start off by using a laboratory environment to validate tools and techniques, and using an application that supports a collaborative approach to penetration testing. Further we will get acquainted with passive reconnaissance with open source intelligence and active reconnaissance of the external and internal networks. We will also focus on how to select, use, customize, and interpret the results from a variety of different vulnerability scanners. Specific routes to the target will also be examined, including bypassing physical security and exfiltration of data using different techniques. You will also get to grips with concepts such as social engineering, attacking wireless networks, exploitation of web applications and remote access connections. Later you will learn the practical aspects of attacking user client systems by backdooring executable files. You will focus on the most vulnerable part of the network—directly and bypassing the controls, attacking the end user and maintaining persistence access through social media. You will also explore approaches to carrying out advanced penetration testing in tightly secured environments, and the book's hands-on approach will help you understand everything you need to know during a Red teaming exercise or penetration testing Style and approach An advanced level tutorial that follows a practical approach and proven methods to maintain top notch security of your networks.

Master the art of container management utilizing the power of Kubernetes. About This Book ? This practical guide demystifies Kubernetes and ensures that your clusters are always available, scalable, and up to date ? Discover new features such as autoscaling, rolling updates, resource quotas, and cluster size ? Master the skills of designing and deploying large clusters on various cloud platforms Who This Book Is For The book is for system administrators and developers who have intermediate level of knowledge with Kubernetes and are now waiting to master its advanced features. You should also have basic networking knowledge. This advanced-level book provides a pathway to master Kubernetes. What You Will Learn ? Architect a robust Kubernetes cluster for long-time operation ? Discover the advantages of running Kubernetes on GCE, AWS, Azure, and bare metal ? See the identity model of Kubernetes and options for cluster federation ? Monitor and troubleshoot Kubernetes clusters and run a highly available Kubernetes ? Create and configure custom Kubernetes resources and use third-party resources in your automation workflows ? Discover the art of running complex stateful applications in your container environment ? Deliver applications as standard packages In Detail Kubernetes is an open source system to automate the deployment, scaling, and management of containerized applications. If you are running more than just a few containers or want automated management of your containers, you need Kubernetes. This book mainly focuses on the advanced management of Kubernetes clusters. It covers problems that arise when you start using container orchestration in production. We start by giving you an overview of the guiding principles in Kubernetes design and show you the best practises in the fields of security, high availability, and cluster federation. You will discover how to run complex stateful microservices on Kubernetes including advanced features as horizontal pod autoscaling, rolling updates, resource quotas, and persistent storage back ends. Using real-world use cases, we explain the options for network configuration and provides guidelines on how to set up, operate, and troubleshoot various Kubernetes networking plugins. Finally, we cover custom resource development and utilization in automation and maintenance workflows. By the end of this book, you’ll know everything you need to know to go from intermediate to advanced level. Style and approach Delving into the design of the Kubernetes platform, the reader will be exposed to the advanced features and best practices of Kubernetes. This book will be an advanced level book which will provide a pathway to master Kubernetes

Over 100 practical recipes to help you become an expert Hadoop administrator About This Book ? Become an expert Hadoop administrator and perform tasks to optimize your Hadoop Cluster ? Import and export data into Hive and use Oozie to manage workflow. ? Practical recipes will help you plan and secure your Hadoop cluster, and make it highly available Who This Book Is For If you are a system administrator with a basic understanding of Hadoop and you want to get into Hadoop administration, this book is for you. It’s also ideal if you are a Hadoop administrator who wants a quick reference guide to all the Hadoop administration-related tasks and solutions to commonly occurring problems What You Will Learn ? Set up the Hadoop architecture to run a Hadoop cluster smoothly ? Maintain a Hadoop cluster on HDFS, YARN, and MapReduce ? Understand high availability with Zookeeper and Journal Node ? Configure Flume for data ingestion and Oozie to run various workflows ? Tune the Hadoop cluster for optimal performance ? Schedule jobs on a Hadoop cluster using the Fair and Capacity scheduler ? Secure your cluster and troubleshoot it for various common pain points In Detail Hadoop enables the distributed storage and processing of large datasets across clusters of computers. Learning how to administer Hadoop is crucial to exploit its unique features. With this book, you will be able to overcome common problems encountered in Hadoop administration. The book begins with laying the foundation by showing you the steps needed to set up a Hadoop cluster and its various nodes. You will get a better understanding of how to maintain Hadoop cluster, especially on the HDFS layer and using YARN and MapReduce. Further on, you will explore durability and high availability of a Hadoop cluster. You’ll get a better understanding of the schedulers in Hadoop and how to configure and use them for your tasks. You will also get hands-on experience with the backup and recovery options and the performance tuning aspects of Hadoop. Finally, you will get a better understanding of troubleshooting, diagnostics, and best practices in Hadoop administration. By the end of this book, you will have a proper understanding of working with Hadoop clusters and will also be able to secure, encrypt it, and configure auditing for your Hadoop clusters. Style and approach This book contains short recipes that will help you run a Hadoop cluster efficiently. The recipes are solutions to real-life problems that administrators encounter while working with a Hadoop cluster

Tap into the realm of social media and unleash the power of analytics for data-driven insights using R About This Book ? A practical guide written to help leverage the power of the R eco-system to extract, process, analyze, visualize and model social media data ? Learn about data access, retrieval, cleaning, and curation methods for data originating from various social media platforms. ? Visualize and analyze data from social media platforms to understand and model complex relationships using various concepts and techniques such as Sentiment Analysis, Topic Modeling, Text Summarization, Recommendation Systems, Social Network Analysis, Classification, and Clustering. Who This Book Is For It is targeted at IT professionals, Data Scientists, Analysts, Developers, Machine Learning Enthusiasts, social media marketers and anyone with a keen interest in data, analytics, and generating insights from social data. Some background experience in R would be helpful, but not necessary, since this book is written keeping in mind, that readers can have varying levels of expertise. What You Will Learn ? Learn how to tap into data from diverse social media platforms using the R ecosystem ? Use social media data to formulate and solve real-world problems ? Analyze user social networks and communities using concepts from graph theory and network analysis ? Learn to detect opinion and sentiment, extract themes, topics, and trends from unstructured noisy text data from diverse social media channels ? Understand the art of representing actionable insights with effective visualizations ? Analyze data from major social media channels such as Twitter, Facebook, Flickr, Foursquare, Github, StackExchange, and so on ? Learn to leverage popular R packages such as ggplot2, topicmodels, caret, e1071, tm, wordcloud, twittR, Rfacebook, dplyr, reshape2, and many more In Detail The Internet has truly become humongous, especially with the rise of various forms of social media in the last decade, which give users a platform to express themselves and also communicate and collaborate with each other. This book will help the reader to understand the current social media landscape and to learn how analytics can be leveraged to derive insights from it. This data can be analyzed to gain valuable insights into the behavior and engagement of users, organizations, businesses, and brands. It will help readers frame business problems and solve them using social data. The book will also cover several practical real-world use cases on social media using R and its advanced packages to utilize data science methodologies such as sentiment analysis, topic modeling, text summarization, recommendation systems, social network analysis, classification, and clustering. This will enable readers to learn different hands-on approaches to obtain data from diverse social media sources such as Twitter and Facebook. It will also show readers how to establish detailed workflows to process, visualize, and analyze data to transform social data into actionable insights. Style and approach This book follows a step-by-step approach with detailed strategies for understanding, extracting, analyzing, visualizing, and modeling data from several major social network platforms such as Facebook, Twitter, Foursquare, Flickr, Github, and StackExchange. The chapters cover several real-world use cases and leverage data science, machine learning, network analysis, and graph theory concepts along with the R ecosystem, including popular packages such as ggplot2, caret,dplyr, topicmodels, tm, and so on.

Do amazing things with the shell About This Book ? Become an expert in creating powerful shell *s and explore the full possibilities of the shell ? Automate any administrative task you could imagine, with shell *s ? Packed with easy-to-follow recipes on new features on Linux, particularly, Debian-based, to help you accomplish even the most complex tasks with ease Who This Book Is For If you are a beginner or an intermediate Linux user who wants to master the skill of quickly writing *s and automate tasks without reading the entire man pages, then this book is for you. You can start writing *s and one-liners by simply looking at the relevant recipe and its de*ions without any working knowledge of shell *ing or Linux. Intermediate / advanced users, system administrators / developers, and programmers can use this book as a reference when they face problems while coding. What You Will Learn ? Interact with websites via *s ? Write shell *s to mine and process data from the Web ? Automate system backups and other repetitive tasks with crontab ? Create, compress, and encrypt archives of your critical data. ? Configure and monitor Ethernet and wireless networks ? Monitor and log network and system activity ? Tune your system for optimal performance ? Improve your system's security ? Identify resource hogs and network bottlenecks ? Extract audio from video files ? Create web photo albums ? Use git or fossil to manage revision control and interact with FOSS projects ? Create and maintain Linux containers and Virtual Machines ? Run a private Cloud server In Detail The shell is the most powerful tool your computer provides. Despite having it at their fingertips, many users are unaware of how much the shell can accomplish. Using the shell, you can generate databases and web pages from sets of files, automate monotonous admin tasks such as system backups, monitor your system's health and activity, identify network bottlenecks and system resource hogs, and more. This book will show you how to do all this and much more. This book, now in its third edition, describes the exciting new features in the newest Linux distributions to help you accomplish more than you imagine. It shows how to use simple commands to automate complex tasks, automate web interactions, download videos, set up containers and cloud servers, and even get free SSL certificates. Starting with the basics of the shell, you will learn simple commands and how to apply them to real-world issues. From there, you'll learn text processing, web interactions, network and system monitoring, and system tuning. Software engineers will learn how to examine system applications, how to use modern software management tools such as git and fossil for their own work, and how to submit patches to open-source projects. Finally, you'll learn how to set up Linux Containers and Virtual machines and even run your own Cloud server with a free SSL Certificate from letsencrypt.org. Style and approach This book will take you through useful real-world recipes designed to make your daily life easier when working with the shell.

Learn how to develop web applications that deploy cross-platform and are optimized for high performance using ASP.NET Core 2 About This Book ? Master high-level web app performance improvement techniques using ASP.NET Core 2.0 ? Find the right balance between premature optimization and inefficient code ? Design workflows that run asynchronously and are resilient to transient performance issues Who This Book Is For This book is aimed for readers who can build a web application and have some experience with ASP.NET or some other web application framework (such as Ruby on Rails or Django). They can be people who are happy learning details independently but who struggle to discover the topics that they should be researching. The reader should be interested in improving the performance of their web app and in learning about ASP.NET Core and modern C#. What You Will Learn ? Understand ASP.NET Core 2 and how it differs from its predecessor ? Address performance issues at the early stages of development ? Set up development environments on Windows, Mac, and Linux ? Measure, profile and find the most significant problems ? Identify the differences between development workstations and production infrastructures, and how these can exacerbate problems ? Boost the performance of your application but with an eye to how it affects complexity and maintenance ? Explore a few cutting-edge techniques such as advanced hashing and custom transports In Detail The ASP.NET Core 2 framework is used to develop high-performance and cross-platform web applications. It is built on .NET Core 2 and includes significantly more framework APIs than version 1. This book addresses high-level performance improvement techniques. It starts by showing you how to locate and measure problems and then shows you how to solve some of the most common ones. Next, it shows you how to get started with ASP.NET Core 2 on Windows, Mac, Linux, and with Docker containers. The book illustrates what problems can occur as latency increases when deploying to a cloud infrastructure. It also shows you how to optimize C# code and choose the best data structures for the job. It covers new features in C# 6 and 7, along with parallel programming and distributed architectures. By the end of this book, you will be fixing latency issues and optimizing performance problems, but you will also know how this affects the complexity and maintenance of your application. Finally, we will explore a few highly advanced techniques for further optimization. Style and approach A step-by-step practical guide filled with real-world use cases and examples

Learn to implement DevOps using Docker & Kubernetes. About This Book ? Learning DevOps, container, and Kubernetes within one book. ? Leverage Kubernetes as a platform to deploy, scale, and run containers efficiently. ? A practical guide towards container management and orchestration Who This Book Is For This book is targeted for anyone, who wants to learn containerization and clustering in a practical way using Kubernetes. No prerequisite skills required, however, essential DevOps skill and public/private Cloud knowledge will accelerate the reading speed. If you’re advanced readers, you can also get a deeper understanding of all the tools and technique described in the book. What You Will Learn ? Learn fundamental and advanced DevOps skills and tools ? Get a comprehensive understanding for container ? Learn how to move your application to container world ? Learn how to manipulate your application by Kubernetes ? Learn how to work with Kubernetes in popular public cloud ? Improve time to market with Kubernetes and Continuous Delivery ? Learn how to monitor, log, and troubleshoot your application with Kubernetes In Detail Containerization is said to be the best way to implement DevOps. Google developed Kubernetes, which orchestrates containers efficiently and is considered the frontrunner in container orchestration. Kubernetes is an orchestrator that creates and manages your containers on clusters of servers. This book will guide you from simply deploying a container to administrate a Kubernetes cluster, and then you will learn how to do monitoring, logging, and continuous deployment in DevOps. The initial stages of the book will introduce the fundamental DevOps and the concept of containers. It will move on to how to containerize applications and deploy them into. The book will then introduce networks in Kubernetes. We then move on to advanced DevOps skills such as monitoring, logging, and continuous deployment in Kubernetes. It will proceed to introduce permission control for Kubernetes resources via attribute-based access control and role-based access control. The final stage of the book will cover deploying and managing your container clusters on the popular public cloud Amazon Web Services and Google Cloud Platform. At the end of the book, other orchestration frameworks, such as Docker Swarm mode, Amazon ECS, and Apache Mesos will be discussed. Style and approach Readers will be taken through fundamental DevOps skills and Kubernetes concept and administration with detailed examples. It introduces comprehensive DevOps topics, including microservices, automation tools, containers, monitoring, logging, continuous delivery, and popular public cloud environments. At each step readers will learn how to leverage Kubernetes in their everyday lives and transform their original delivery pipeline for fast and efficient delivery.

Learn how to confidently install, configure, secure, and fully utilize your ArcGIS Enterprise system. About This Book ? Install and configure the components of ArcGIS Enterprise to meet your organization's requirements ? Administer all aspects of ArcGIS Enterprise through user interfaces and APIs ? Optimize and Secure ArcGIS Enterprise to make it run efficiently and effectively Who This Book Is For This book will be geared toward senior GIS analysts, GIS managers, GIS administrators, DBAs, GIS architects, and GIS engineers that need to install, configure, and administer ArcGIS Enterprise 10.5.1. What You Will Learn ? Effectively install and configure ArcGIS Enterprise, including the Enterprise geodatabase, ArcGIS Server, and Portal for ArcGIS ? Incorporate different methodologies to manage and publish services ? Utilize the security methods available in ArcGIS Enterprise ? Use Python and Python libraries from Esri to automate administrative tasks ? Identify the common pitfalls and errors to get your system back up and running quickly from an outage In Detail ArcGIS Enterprise, the next evolution of the ArcGIS Server product line, is a full-featured mapping and analytics platform. It includes a powerful GIS web services server and a dedicated Web GIS infrastructure for organizing and sharing your work. You will learn how to first install ArcGIS Enterprise to then plan, design, and finally publish and consume GIS services. You will install and configure an Enterprise geodatabase and learn how to administer ArcGIS Server, Portal, and Data Store through user interfaces, the REST API, and Python *s. This book starts off by explaining how ArcGIS Enterprise 10.5.1 is different from earlier versions of ArcGIS Server and covers the installation of all the components required for ArcGIS Enterprise. We then move on to geodatabase administration and content publication, where you will learn how to use ArcGIS Server Manager to view the server logs, stop and start services, publish services, define users and roles for security, and perform other administrative tasks. You will also learn how to apply security mechanisms on ArcGIS Enterprise and safely expose services to the public in a secure manner. Finally, you’ll use the RESTful administrator API to automate server management tasks using the Python *ing language. You’ll learn all the best practices and troubleshooting methods to streamline the management of all the interconnected parts of ArcGIS Enterprise. Style and approach The book takes a pragmatic approach, starting with installation & configuration of ArcGIS Enterprise to finally building a robust GIS web infrastructure for your organization.

Over 60 high-quality recipes covering debugging, security, performance, microservices, web frameworks, databases, deployment and more; rewritten for Node 4, 6, and 8. About This Book ? Security between Node.js and browser applications explained and applied in depth ? Cutting edge techniques and tools for measuring and improving performance ? Contemporary techniques to create developer-ergonomic, readily-scalable production systems Who This Book Is For If you have good knowledge of JavaScript and want to build fast, efficient, scalable client-server solutions, then this book is for you. Some experience with Node.js is assumed to get the most out of this book. If working from a beginner level Node Cookbook 2nd Edition is recommended as a primer for Node Cookbook 3rd Edition. What You Will Learn ? Rapidly become proficient at debugging Node.js programs ? Write and publish your own Node.js modules ? Become deeply acquainted with Node.js core API’s ? Use web frameworks such as Express, Hapi and Koa for accelerated web application development ? Apply Node.js streams for low-footprint infinite-capacity data processing ? Fast-track performance knowledge and optimization abilities ? Compare and contrast various persistence strategies, including database integrations with MongoDB, MySQL/MariaDB, Postgres, Redis, and LevelDB ? Grasp and apply critically essential security concepts ? Understand how to use Node with best-of-breed deployment technologies: Docker, Kubernetes and AWS In Detail The principles of asynchronous event-driven programming are perfect for today's web, where efficient real-time applications and scalability are at the forefront. Server-side JavaScript has been here since the 90s but Node got it right. This edition is a complete rewrite of the original, and is targeted against Node 4, 6, and 8. It shows you how to build fast, efficient, and scalable client-server solutions using the latest versions of Node. Beginning with adopting debugging tips and tricks of the trade and learning how to write your own modules, then covering the fundamentals of streams in Node.js, you will go on to discover I/O control, implementation of various web protocols, you’ll work up to integrating with cross-section of databases such as MongoDB, MySQL/MariaDB, Postgres, Redis, and LevelDB and building web application with Express, Hapi and Koa. You will then learn about security essentials in Node.js and the advanced optimization tools and techniques By the end of the book you should have acquired a level of proficiency that allows you to confidently build a full production-ready and scalable Node.js system. Style and approach This recipe-based practical guide presents each topic with step-by-step instructions on how you can create fast and efficient server side applications using the latest features and capabilities in Node 8 whilst also supporting usage with Node 4 and 6.

Expand your OpenCV knowledge and master key concepts of machine learning using this practical, hands-on guide. About This Book ? Load, store, edit, and visualize data using OpenCV and Python ? Grasp the fundamental concepts of classification, regression, and clustering ? Understand, perform, and experiment with machine learning techniques using this easy-to-follow guide ? Evaluate, compare, and choose the right algorithm for any task Who This Book Is For This book targets Python programmers who are already familiar with OpenCV; this book will give you the tools and understanding required to build your own machine learning systems, tailored to practical real-world tasks. What You Will Learn ? Explore and make effective use of OpenCV's machine learning module ? Learn deep learning for computer vision with Python ? Master linear regression and regularization techniques ? Classify objects such as flower species, handwritten digits, and pedestrians ? Explore the effective use of support vector machines, boosted decision trees, and random forests ? Get acquainted with neural networks and Deep Learning to address real-world problems ? Discover hidden structures in your data using k-means clustering ? Get to grips with data pre-processing and feature engineering In Detail Machine learning is no longer just a buzzword, it is all around us: from protecting your email, to automatically tagging friends in pictures, to predicting what movies you like. Computer vision is one of today's most exciting application fields of machine learning, with Deep Learning driving innovative systems such as self-driving cars and Google’s DeepMind. OpenCV lies at the intersection of these topics, providing a comprehensive open-source library for classic as well as state-of-the-art computer vision and machine learning algorithms. In combination with Python Anaconda, you will have access to all the open-source computing libraries you could possibly ask for. Machine learning for OpenCV begins by introducing you to the essential concepts of statistical learning, such as classification and regression. Once all the basics are covered, you will start exploring various algorithms such as decision trees, support vector machines, and Bayesian networks, and learn how to combine them with other OpenCV functionality. As the book progresses, so will your machine learning skills, until you are ready to take on today's hottest topic in the field: Deep Learning. By the end of this book, you will be ready to take on your own machine learning problems, either by building on the existing source code or developing your own algorithm from scratch! Style and approach OpenCV machine learning connects the fundamental theoretical principles behind machine learning to their practical applications in a way that focuses on asking and answering the right questions. This book walks you through the key elements of OpenCV and its powerful machine learning classes, while demonstrating how to get to grips with a range of models.

Master the principles to make applications robust, scalable and responsive About This Book ? Implement concurrent applications using the Java 9 Concurrency API and its new components ? Improve the performance of your applications and process more data at the same time, taking advantage of all of your resources ? Construct real-world examples related to machine learning, data mining, natural language processing, and more Who This Book Is For This book is for competent Java developers who have basic understanding of concurrency, but knowledge of effective implementation of concurrent programs or usage of streams for making processes more efficient is not required What You Will Learn ? Master the principles that every concurrent application must follow ? See how to parallelize a sequential algorithm to obtain better performance without data inconsistencies and deadlocks ? Get the most from the Java Concurrency API components ? Separate the thread management from the rest of the application with the Executor component ? Execute phased-based tasks in an efficient way with the Phaser components ? Solve problems using a parallelized version of the divide and conquer paradigm with the Fork / Join framework ? Find out how to use parallel Streams and Reactive Streams ? Implement the “map and reduce” and “map and collect” programming models ? Control the concurrent data structures and synchronization mechanisms provided by the Java Concurrency API ? Implement efficient solutions for some actual problems such as data mining, machine learning, and more In Detail Concurrency programming allows several large tasks to be divided into smaller sub-tasks, which are further processed as individual tasks that run in parallel. Java 9 includes a comprehensive API with lots of ready-to-use components for easily implementing powerful concurrency applications, but with high flexibility so you can adapt these components to your needs. The book starts with a full de*ion of the design principles of concurrent applications and explains how to parallelize a sequential algorithm. You will then be introduced to Threads and Runnables, which are an integral part of Java 9's concurrency API. You will see how to use all the components of the Java concurrency API, from the basics to the most advanced techniques, and will implement them in powerful real-world concurrency applications. The book ends with a detailed de*ion of the tools and techniques you can use to test a concurrent Java application, along with a brief insight into other concurrency mechanisms in JVM. Style and approach This is a complete guide that implements real-world examples of algorithms related to machine learning, data mining, and natural language processing in client/server environments. All the examples are explained using a step-by-step approach.