Successfully scrape data from any website with the power of Python 3.x About This Book ? A hands-on guide to web scraping using Python with solutions to real-world problems ? Create a number of different web scrapers in Python to extract information ? This book includes practical examples on using the popular and well-maintained libraries in Python for your web scraping needs Who This Book Is For This book is aimed at developers who want to use web scraping for legitimate purposes. Prior programming experience with Python would be useful but not essential. Anyone with general knowledge of programming languages should be able to pick up the book and understand the principals involved. What You Will Learn ? Extract data from web pages with simple Python programming ? Build a concurrent crawler to process web pages in parallel ? Follow links to crawl a website ? Extract features from the HTML ? Cache downloaded HTML for reuse ? Compare concurrent models to determine the fastest crawler ? Find out how to parse JavaScript-dependent websites ? Interact with forms and sessions In Detail The Internet contains the most useful set of data ever assembled, most of which is publicly accessible for free. However, this data is not easily usable. It is embedded within the structure and style of websites and needs to be carefully extracted. Web scraping is becoming increasingly useful as a means to gather and make sense of the wealth of information available online. This book is the ultimate guide to using the latest features of Python 3.x to scrape data from websites. In the early chapters, you’ll see how to extract data from static web pages. You’ll learn to use caching with databases and files to save time and manage the load on servers. After covering the basics, you’ll get hands-on practice building a more sophisticated crawler using browsers, crawlers, and concurrent scrapers. You’ll determine when and how to scrape data from a JavaScript-dependent website using PyQt and Selenium. You’ll get a better understanding of how to submit forms on complex websites protected by CAPTCHA. You’ll find out how to automate these actions with Python packages such as mechanize. You’ll also learn how to create class-based scrapers with Scrapy libraries and implement your learning on real websites. By the end of the book, you will have explored testing websites with scrapers, remote scraping, best practices, working with images, and many other relevant topics. Style and approach This hands-on guide is full of real-life examples and solutions starting simple and then progressively becoming more complex. Each chapter in this book introduces a problem and then provides one or more possible solutions.

Over 100 recipes to help you overcome your difficulties with C++ programming and gain a deeper understanding of the working of modern C++ About This Book ? Explore the most important language and library features of C++17, including containers, algorithms, regular expressions, threads, and more, ? Get going with unit testing frameworks Boost.Test, Google Test and Catch, ? Extend your C++ knowledge and take your development skills to new heights by making your applications fast, robust, and scalable. Who This Book Is For If you want to overcome difficult phases of development with C++ and leverage its features using modern programming practices, then this book is for you. The book is designed for both experienced C++ programmers as well as people with strong knowledge of OOP concepts. What You Will Learn ? Get to know about the new core language features and the problems they were intended to solve ? Understand the standard support for threading and concurrency and know how to put them on work for daily basic tasks ? Leverage C++’s features to get increased robustness and performance ? Explore the widely-used testing frameworks for C++ and implement various useful patterns and idioms ? Work with various types of strings and look at the various aspects of compilation ? Explore functions and callable objects with a focus on modern features ? Leverage the standard library and work with containers, algorithms, and iterators ? Use regular expressions for find and replace string operations ? Take advantage of the new filesystem library to work with files and directories ? Use the new utility additions to the standard library to solve common problems developers encounter including string_view, any , optional and variant types In Detail C++ is one of the most widely used programming languages. Fast, efficient, and flexible, it is used to solve many problems. The latest versions of C++ have seen programmers change the way they code, giving up on the old-fashioned C-style programming and adopting modern C++ instead. Beginning with the modern language features, each recipe addresses a specific problem, with a discussion that explains the solution and offers insight into how it works. You will learn major concepts about the core programming language as well as common tasks faced while building a wide variety of software. You will learn about concepts such as concurrency, performance, meta-programming, lambda expressions, regular expressions, testing, and many more in the form of recipes. These recipes will ensure you can make your applications robust and fast. By the end of the book, you will understand the newer aspects of C++11/14/17 and will be able to overcome tasks that are time-consuming or would break your stride while developing. Style and approach This book follows a recipe-based approach, with examples that will empower you to implement the core programming language features and explore the newer aspects of C++.

Learn efficient Python coding within 7 days About This Book ? Make the best of Python features ? Learn the tinge of Python in 7 days ? Learn complex concepts using the most simple examples Who This Book Is For The book is aimed at aspiring developers and absolute novice who want to get started with the world of programming. We assume no knowledge of Python for this book. What You Will Learn ? Use if else statement with loops and how to break, skip the loop ? Get acquainted with python types and its operators ? Create modules and packages ? Learn slicing, indexing and string methods ? Explore advanced concepts like collections, class and objects ? Learn dictionary operation and methods ? Discover the scope and function of variables with arguments and return value In Detail Python is a great language to get started in the world of programming and application development. This book will help you to take your skills to the next level having a good knowledge of the fundamentals of Python. We begin with the absolute foundation, covering the basic syntax, type variables and operators. We'll then move on to concepts like statements, arrays, operators, string processing and I/O handling. You’ll be able to learn how to operate tuples and understand the functions and methods of lists. We’ll help you develop a deep understanding of list and tuples and learn python dictionary. As you progress through the book, you’ll learn about function parameters and how to use control statements with the loop. You’ll further learn how to create modules and packages, storing of data as well as handling errors. We later dive into advanced level concepts such as Python collections and how to use class, methods, objects in python. By the end of this book, you will be able to take your skills to the next level having a good knowledge of the fundamentals of Python. Style and approach Fast paced guide to get you up-to-speed with the language. Every chapter is followed by an exercise that focuses on building something with the language. The codes of the exercises can be found on the Packt website

Expand your boundaries by creating applications empowered with real-time data using RxJs without compromising performance About This Book ? Handle an infinite stream of incoming data using RxJs without going crazy ? Explore important RxJs operators that can help you improve your code readability ? Get acquainted with the different techniques and operators used to handle data traffic, which occurs when you receive data faster than you can process Who This Book Is For If you're a web developer with some basic JavaScript programming knowledge who wants to implement the reactive programming paradigm with JavaScript, then this book is for you. What You Will Learn ? Get to know the basics of functional reactive programming using RxJs ? Process a continuous flow of data with linear memory consumption ? Filter, group, and react to changes in your system ? Discover how to deal with data traffic ? Compose operators to create new operators and use them in multiple observables to avoid code repetition ? Explore transducers and see how they can improve your code readability ? Detect and recover from errors in observables using Retry and Catch operators ? Create your own reactive application: a real-time webchat In Detail If you’re struggling to handle a large amount of data and don’t know how to improve your code readability, then reactive programming is the right solution for you. It lets you describe how your code behaves when changes happen and makes it easier to deal with real-time data. This book will teach you what reactive programming is, and how you can use it to write better applications. The book starts with the basics of reactive programming, what Reactive Extensions is, and how can you use it in JavaScript along with some reactive code using Bacon. Next, you’ll discover what an Observable and an Observer are and when to use them.You'll also find out how you can query data through operators, and how to use schedulers to react to changes. Moving on, you’ll explore the RxJs API, be introduced to the problem of data traffic (backpressure), and see how you can mitigate it. You’ll also learn about other important operators that can help improve your code readability, and you’ll see how to use transducers to compose operators. At the end of the book, you’ll get hands-on experience of using RxJs, and will create a real-time web chat using RxJs on the client and server, providing you with the complete package to master RxJs. Style and approach This easy-to-follow guide is full of hands-on examples of reactive programming. Each topic is explained and placed in context, and for the more inquisitive there are more details of the concepts used, ending with an application using the concepts learned through the book.

Master the capabilities of PostgreSQL 9.6 to efficiently manage and maintain your database About This Book ? Your one-stop guide to mastering the advanced concepts in PostgreSQL with ease ? Master query optimization, replication, and high availability with PostgreSQL ? Extend the functionalities of PostgreSQL to suit your organizational needs with minimum effort Who This Book Is For If you are a PostgreSQL data architect or an administrator who wants to understand how to implement advanced functionalities and master complex administrative tasks with PostgreSQL, then this book is perfect for you. Prior experience of administrating a PostgreSQL database and a working knowledge of SQL is required to make the best use of this book. What You Will Learn ? Get to grips with the advanced features of PostgreSQL 9.6 and handle advanced SQL ? Make use of the indexing features in PostgreSQL and fine-tune the performance of your queries ? Work with the stored procedures and manage backup and recovery ? Master the replication and failover techniques ? Troubleshoot your PostgreSQL instance for solutions to the common and not-so-common problems ? Learn how to migrate your database from MySQL and Oracle to PostgreSQL without any hassle In Detail PostgreSQL is an open source database used for handling large datasets (Big Data) and as a JSON document database. It also has applications in the software and web domains. This book will enable you to build better PostgreSQL applications and administer databases more efficiently. We begin by explaining the advanced database design concepts in PostgreSQL 9.6, along with indexing and query optimization. You will also see how to work with event triggers and perform concurrent transactions and table partitioning, along with exploring SQL and server tuning. We will walk you through implementing advanced administrative tasks such as server maintenance and monitoring, replication, recovery and high availability, and much more. You will understand the common and not-so-common troubleshooting problems and how you can overcome them. By the end of this book, you will have an expert-level command of the advanced database functionalities and will be able to implement advanced administrative tasks with PostgreSQL. Style and Approach This book is a comprehensive guide covering all the concepts you need to master PostgreSQL. Packed with hands-on examples, tips and tricks, even the most advanced concepts are explained in a very easy-to-follow manner. Every chapter in the book does not only focus on how each task is performed, but also why.

Sharpen your DevOps knowledge with DevOps Bootcamp About This Book ? Improve your organization's performance to ensure smooth production of software and services. ? Learn how Continuous Integration and Continuous Delivery practices can be utilized to cultivate the DevOps culture. ? A fast-paced guide filled with illustrations and best practices to help you consistently ship quality software. Who This Book Is For The book is aimed at IT Developers and Operations—administrators who want to quickly learn and implement the DevOps culture in their organization. What You Will Learn ? Static Code Analysis using SOnarqube ? Configure a Maven-based JEE Web Application ? Perform Continuous Integration using Jenkins and VSTS ? Install and configure Docker ? Converge a Chef node using a Chef workstation ? Accomplish Continuous Delivery in Microsoft Azure VM and Microsoft Azure App Services (Azure Web Apps) using Jenkins ? Perform Load Testing using Apache JMeter ? Build and Release Automation using Visual Studio Team Services ? Monitor Cloud-based resources In Detail DevOps Bootcamp delivers practical learning modules in manageable chunks. Each chunk is delivered in a day, and each day is a productive one. Each day builds your competency in DevOps. You will be able to take the task you learn every day and apply it to cultivate the DevOps culture. Each chapter presents core concepts and key takeaways about a topic in DevOps and provides a series of hands-on exercises. You will not only learn the importance of basic concepts or practices of DevOps but also how to use different tools to automate application lifecycle management. We will start off by building the foundation of the DevOps concepts. On day two, we will perform Continuous Integration using Jenkins and VSTS both by configuring Maven-based JEE Web Application?. We will also integrate Jenkins and Sonar qube for Static Code Analysis. Further, on day three, we will focus on Docker containers where we will install and configure Docker and also create a Tomcat Container to deploy our Java based web application. On day four, we will create and configure the environment for application deployment in AWS and Microsoft Azure Cloud for which we will use Infrastructure as a Service and Open Source Configuration Management tool Chef. For day five, our focus would be on Continuous Delivery. We will automate application deployment in Docker container using Jenkins Plugin, AWS EC2 using Script, AWS Elastic Beanstalk using Jenkins Plugin, Microsoft Azure VM using *, and Microsoft Azure App Services Using Jenkins. We will also configure Continuous Delivery using VSTS. We will then learn the concept of Automated Testing on day six using Apache JMeter and URL-based tests in VSTS. Further, on day seven, we will explore various ways to automate application lifecycle management using orchestration. We will see how Pipeline can be created in Jenkins and VSTS, so the moment Continuous? Integration is completed successfully, Continuous Delivery will start and application will be deployed. On the final day, our focus would be on Security access to Jenkins and Monitoring of CI resources, and cloud-based resources in AWS and Microsoft Azure Platform as a Service. Style and Approach This book is all about fast and intensive learning. This means we don’t waste time in helping readers get started. The new content is basically about filling in with highly-effective examples to build new things, solving problems in newer and unseen ways, and solving real-world examples.

Say goodbye to unproductive Linux habits and switch to the express lane About This Book ? Improve your terminal and command-line productivity by using powerful tools ? Sharpen your existing command-line skills and achieve complex tasks faster ? Save time and money by creating customized commands that automate day-to-day tasks Who This Book Is For This book is for system administrators and developers who know the basics of Linux and want to brush up and sharpen their skills. Prior experience with Linux shell is required. What You Will Learn ? Optimize the power of Guake by integrating it with ClipIt ? Deep dive into the workings of the console editor—Vim ? Explore the advanced concepts and best practices of shell *ing ? Edit large amounts of data quickly using Sed ? Use pipes and subshells to create customized commands ? Get to know how you can speed up the software development and make the terminal a handy companion In Detail Websites, online services, databases, and pretty much every other computer that offers public services runs on Linux. From small servers to clusters, Linux is anywhere and everywhere. With such a broad usage, the demand for Linux specialists is ever growing. For the engineers out there, this means being able to develop, interconnect, and maintain Linux environments. This book will help you increase your terminal productivity by using Terminator, Guake and other tools. It will start by installing Ubuntu and will explore tools and techniques that will help you to achieve more work with less effort. Next, it will then focus on Terminator, the ultimate terminal, and vim, one of the most intelligent console editors. Futhermore, the readers will see how they can increase their command line productivity by using sed, find, tmux, network, autoenv. The readers will also see how they can edit files without leaving the terminal and use the screen space efficiently and copy-paste like a pro. Towards the end, we focus on network settings, Git hacks, and creating portable environments for development and production using Docker. Through this book, you will improve your terminal productivity by seeing how to use different tools. Style and Approach This book takes a step-by-step approach using examples that show you how to automate tasks using terminal commands. You’ll work through easy-to-follow instructions so you learn to use the various Linux commands and tools such as Terminator, Guake, and others.

Learn in easy stages how to rapidly build leading-edge web applications from scratch. About This Book ? Develop powerful web applications rapidly with WordPress ? Explore the significant features and improvements introduced in WordPress 4.7 by learning the numerous tips and techniques in this book. ? Unleash the power of REST API endpoints to make your interaction with websites new and innovative. Who This Book Is For This book is targeted at WordPress developers and designers who want to develop quality web applications within a limited time frame and maximize their profits. A prior knowledge of basic web development and design is assumed. What You Will Learn ? Develop extendable plugins with the use of WordPress features in core modules ? Develop pluggable modules to extend the core features of WordPress as independent modules ? Manage permissions for a wide range of content types in web applications based on different user types ? Follow WordPress coding standards to develop reusable and maintainable code ? Build and customize themes beyond conventional web layouts ? Explore the power of core database tables and understand the limitations when designing database tables for large applications ? Integrate open source modules into WordPress applications to keep up with the latest open source technologies ? Customize the WordPress admin section and themes to create the look and feel of a typical web application In Detail WordPress is one of the most rapidly expanding markets on the Web. Learning how to build complex and scalable web applications will give you the ability and knowledge to step into the future of WordPress. WordPress 4.7 introduces some exciting new improvements and several bug fixes, which further improve the entire development process.This book is a practical, scenario-based guide to expanding the power of the WordPress core modules to develop modular and maintainable real-world applications from scratch. This book consistently emphasizes adapting WordPress features into web applications. It will walk you through the advanced usages of existing features such as access controlling; database handling; custom post types; pluggable plugins; content restrictions; routing; translation; caching; and many more, while you build the backend of a forum management application. This book begins by explaining how to plan the development of a web application using WordPress' core features. Once the core features are explained, you will learn how to build an application by extending them through custom plugin development. Finally, you will explore advanced non-functional features and application integration. After reading this book, you will have the ability to develop powerful web applications rapidly within limited time frames. Style and approach An extensive, practical guide that explains how to adapt WordPress features, both conventional and trending, for web applications.

Exciting new capabilities to enable even easier DIY robotics with BeagleBone Blue About This Book ? Build powerful robots with the all new BeagleBone Blue ? Communicate with your robot and teach it to detect and respond to its environment ? Control walking, rolling, swimming, and flying robots with your iOS and Android mobile devices Who This Book Is For This book is for anyone who is curious about using new, low-cost hardware to create robotic projects and have previously been the domain of research labs, major universities, or defence departments. Some programming experience would be useful, but if you know how to use a personal computer, you can use this book to construct far more complex systems than you would have thought possible. What You Will Learn ? Power on and configure the BeagleBone Blue ? Get to know Simple programming techniques to enable the unique hardware capabilities of the BeagleBone Blue. ? Connect standard hardware to enable your projects to see, speak, hear, and move ? Build advanced capabilities into your projects, such as GPS and sonar sensors ? Build complex projects that can fly, or go under or on the water In Detail BeagleBone Blue is effectively a small, light, cheap computer in a similar vein to Raspberry Pi and Arduino. It has all of the extensibility of today’s desktop machines, but without the bulk, expense, or noise. This project guide provides step-by-step instructions that enable anyone to use this new, low-cost platform in some fascinating robotics projects. By the time you are finished, your projects will be able to see, speak, listen, detect their surroundings, and move in a variety of amazing ways. The book begins with unpacking and powering up the components. This includes guidance on what to purchase and how to connect it all successfully, and a primer on programming the BeagleBone Blue. You will add additional software functionality available from the open source community, including making the system see using a webcam, hear using a microphone, and speak using a speaker. You will then learn to use the new hardware capability of the BeagleBone Blue to make your robots move, as well as discover how to add sonar sensors to avoid or find objects. Later, you will learn to remotely control your robot through iOS and Android devices. At the end of this book, you will see how to integrate all of these functionalities to work together, before developing the most impressive robotics projects: Drone and Submarine. Style and approach Develop practical example projects with detailed explanations, combine the projects in a vast number of ways to create different robot designs, or work through them in sequence to discover the full capability of the BeagleBone Blue.

Real examples written in PHP showcasing DDD Architectural Styles, Tactical Design, and Bounded Context Integration About This Book ? Focuses on practical code rather than theory ? Full of real-world examples that you can apply to your own projects ? Shows how to build PHP apps using DDD principles Who This Book Is For This book is for PHP developers who want to apply a DDD mindset to their code. You should have a good understanding of PHP and some knowledge of DDD. This book doesn’t dwell on the theory, but instead gives you the code that you need. What You Will Learn ? Correctly design all design elements of Domain-Driven Design with PHP ? Learn all tactical patterns to achieve a fully worked-out Domain-Driven Design ? Apply hexagonal architecture within your application ? Integrate bounded contexts in your applications ? Use REST and Messaging approaches In Detail Domain-Driven Design (DDD) has arrived in the PHP community, but for all the talk, there is very little real code. Without being in a training session and with no PHP real examples, learning DDD can be challenging. This book changes all that. It details how to implement tactical DDD patterns and gives full examples of topics such as integrating Bounded Contexts with REST, and DDD messaging strategies. In this book, the authors show you, with tons of details and examples, how to properly design Entities, Value Objects, Services, Domain Events, Aggregates, Factories, Repositories, Services, and Application Services with PHP. They show how to apply Hexagonal Architecture within your application whether you use an open source framework or your own. Style and approach This highly practical book shows developers how to apply domain-driven design principles to PHP. It is full of solid code examples to work through.

Your one stop solution to create highly scalable enterprise grade Java applications with WildFly. About This Book ? Master Java EE development with the latest WildFly 10 application server. ? Integrate with JSF and JMS and use efficient load balancing techniques to create real-time apps ? Integrate your backend JavaScript code seamlessly into Java applications Who This Book Is For If you are a Java developer with at least basic knowledge of Java EE, then this book is for you. No previous knowledge of WildFly is required. What You Will Learn ? Configure the development environment along with native and cloud installation of WildFly ? Write a DB schema and the relative entities and how to use the relationships between the entities ? Analyze with examples all the java annotations to manage the EJB and the configuration to get better performances ? Write different REST services through the EJB ? Implement Web sockets 1.0 and know why and when use the web sockets ? Work with Active MQ and write JMS clients to manage the authentication and authorization in the clients ? Configure the mail server through the wildfly console ? Learn how and when to use a new feature JAX-RS 2.0, which is the asynchronous call through REST ? Use the new JSF features of Wildfly 10 such as Mojarra 2.2, JSF 2.2, Richfaces 4.5 In Detail Packed with rich assets and APIs, Wildfly 10 allows you to create state-of-the-art Java applications. This book will help you take your understanding of Java EE to the next level by creating distributed Java applications using Wildfly. The book begins by showing how to get started with a native installation of WildFly and it ends with a cloud installation. After setting up the development environment, you will implement and work with different WildFly features, such as implementing JavaServer Pages. You will also learn how you can use clustering so that your apps can handle a high volume of data traffic. You will also work with enterprise JavaBeans, solve issues related to failover, and implement Java Message Service integration. Moving ahead, you will be working with Java Naming and Directory Interface, Java Transaction API, and use ActiveMQ for message relay and message querying. This book will also show you how you can use your existing backend JavaScript code in your application. By the end of the book, you’ll have gained the knowledge to implement the latest Wildfly features in your Java applications. Style and approach Each part of this book shows you how to use different features of WildFly 10 to create enterprise grade Java applications as easily as possible.

Reactive Programming with Java and ReactiveX About This Book ? Explore the essential tools and operators RxJava provides, and know which situations to use them in ? Delve into Observables and Subscribers, the core components of RxJava used for building scalable and performant reactive applications ? Delve into the practical implementation of tools to effectively take on complex tasks such as concurrency and backpressure Who This Book Is For The primary audience for this book is developers with at least a fundamental mastery of Java. Some readers will likely be interested in RxJava to make programs more resilient, concurrent, and scalable. Others may be checking out reactive programming just to see what it is all about, and to judge whether it can solve any problems they may have. What You Will Learn ? Learn the features of RxJava 2 that bring about many significant changes, including new reactive types such as Flowable, Single, Maybe, and Completable ? Understand how reactive programming works and the mindset to "think reactively" ? Demystify the Observable and how it quickly expresses data and events as sequences ? Learn the various Rx operators that transform, filter, and combine data and event sequences ? Leverage multicasting to push data to multiple destinations, and cache and replay them ? Discover how concurrency and parallelization work in RxJava, and how it makes these traditionally complex tasks trivial to implement ? Apply RxJava and Retrolambda to the Android domain to create responsive Android apps with better user experiences ? Use RxJava with the Kotlin language to express RxJava more idiomatically with extension functions, data classes, and other Kotlin features In Detail RxJava is a library for composing asynchronous and event-based programs using Observable sequences for the JVM, allowing developers to build robust applications in less time. Learning RxJava addresses all the fundamentals of reactive programming to help readers write reactive code, as well as teach them an effective approach to designing and implementing reactive libraries and applications. Starting with a brief introduction to reactive programming concepts, there is an overview of Observables and Observers, the core components of RxJava, and how to combine different streams of data and events together. You will also learn simpler ways to achieve concurrency and remain highly performant, with no need for synchronization. Later on, we will leverage backpressure and other strategies to cope with rapidly-producing sources to prevent bottlenecks in your application. After covering custom operators, testing, and debugging, the book dives into hands-on examples using RxJava on Android as well as Kotlin. Style and approach This book will be different from other Rx books, taking an approach that comprehensively covers Rx concepts and practical applications.

Master the art of exploiting advanced web penetration techniques with Kali Linux 2016.2 About This Book ? Make the most out of advanced web pen-testing techniques using Kali Linux 2016.2 ? Explore how Stored (a.k.a. Persistent) XSS attacks work and how to take advantage of them ? Learn to secure your application by performing advanced web based attacks. ? Bypass internet security to traverse from the web to a private network. Who This Book Is For This book targets IT pen testers, security consultants, and ethical hackers who want to expand their knowledge and gain expertise on advanced web penetration techniques. Prior knowledge of penetration testing would be beneficial. What You Will Learn ? Establish a fully-featured sandbox for test rehearsal and risk-free investigation of applications ? Enlist open-source information to get a head-start on enumerating account credentials, mapping potential dependencies, and discovering unintended backdoors and exposed information ? Map, scan, and spider web applications using nmap/zenmap, nikto, arachni, webscarab, w3af, and NetCat for more accurate characterization ? Proxy web transactions through tools such as Burp Suite, OWASP's ZAP tool, and Vega to uncover application weaknesses and manipulate responses ? Deploy SQL injection, cross-site *ing, Java vulnerabilities, and overflow attacks using Burp Suite, websploit, and SQLMap to test application robustness ? Evaluate and test identity, authentication, and authorization schemes and sniff out weak cryptography before the black hats do In Detail You will start by delving into some common web application architectures in use, both in private and public cloud instances. You will also learn about the most common frameworks for testing, such as OWASP OGT version 4, and how to use them to guide your efforts. In the next section, you will be introduced to web pentesting with core tools and you will also see how to make web applications more secure through rigorous penetration tests using advanced features in open source tools. The book will then show you how to better hone your web pentesting skills in safe environments that can ensure low-risk experimentation with the powerful tools and features in Kali Linux that go beyond a typical *-kiddie approach. After establishing how to test these powerful tools safely, you will understand how to better identify vulnerabilities, position and deploy exploits, compromise authentication and authorization, and test the resilience and exposure applications possess. By the end of this book, you will be well-versed with the web service architecture to identify and evade various protection mechanisms that are used on the Web today. You will leave this book with a greater mastery of essential test techniques needed to verify the secure design, development, and operation of your customers' web applications. Style and approach An advanced-level guide filled with real-world examples that will help you take your web application’s security to the next level by using Kali Linux 2016.2.

The ultimate power-packed crash course in building Arduino-based projects in just 10 days! About This Book ? A carefully designed 10-day crash course, covering major project/device types, with 20+ unique hands-on examples ? Get easy-to-understand explanations of basic electronics fundamentals and commonly used C sketch functions ? This step-by-step guide with 90+ diagrams and 50+ important tips will help you become completely self-reliant and confident Who This Book Is For This book is a beginner’s crash course for professionals, hobbyists, and students who are tech savvy, have a basic level of C programming knowledge, and basic familiarity with electronics, be it for embedded systems or the Internet of Things. What You Will Learn ? Write Arduino sketches and understand the fundamentals of building prototype circuits using basic electronic components, such as resistors, transistors, and diodes ? Build simple, compound, and standalone devices with auxiliary storage (SD card), a DC battery, and AC power supplies ? Deal with basic sensors and interface sensor modules by using sensor datasheets ? Discover the fundamental techniques of prototyping with actuators ? Build remote-controlled devices with infrared (IR), radio frequency (RF), and telephony with GSM ? Learn IoT edge device prototyping (using ESP8266) and IoT cloud configuration In Detail This book is a quick, 10-day crash course that will help you become well acquainted with the Arduino platform. The primary focus is to empower you to use the Arduino platform by applying basic fundamental principles. You will be able to apply these principles to build almost any type of physical device. The projects you will work through in this book are self-contained micro-controller projects, interfacing with single peripheral devices (such as sensors), building compound devices (multiple devices in a single setup), prototyping standalone devices (powered from independent power sources), working with actuators (such as DC motors), interfacing with an AC-powered device, wireless devices (with Infrared, Radio Frequency and GSM techniques), and finally implementing the Internet of Things (using the ESP8266 series Wi-Fi chip with an IoT cloud platform). The first half of the book focuses on fundamental techniques and building basic types of device, and the final few chapters will show you how to prototype wireless devices. By the end of this book, you will have become acquainted with the fundamental principles in a pragmatic and scientific manner. You will also be confident enough to take up new device prototyping challenges. Style and approach This step-by- step guide will serve as a quick, 10-day crash course to help you become well acquainted with the Arduino platform.

Master Wireshark and discover how to analyze network packets and protocols effectively, along with engaging recipes to troubleshoot network problems About This Book ? Gain valuable insights into the network and application protocols, and the key fields in each protocol ? Use Wireshark’s powerful statistical tools to analyze your network and leverage its expert system to pinpoint network problems ? Master Wireshark and train it as your network sniffer Who This Book Is For This book is aimed at IT professionals who want to develop or enhance their packet analysis skills. A basic familiarity with common network and application services terms and technologies is assumed. What You Will Learn ? Discover how packet analysts view networks and the role of protocols at the packet level ? Capture and isolate all the right packets to perform a thorough analysis using Wireshark’s extensive capture and display filtering capabilities ? Decrypt encrypted wireless traffic ? Use Wireshark as a diagnostic tool and also for network security analysis to keep track of malware ? Find and resolve problems due to bandwidth, throughput, and packet loss ? Identify and locate faults in communication applications including HTTP, FTP, mail, and various other applications – Microsoft OS problems, databases, voice, and video over IP ? Identify and locate faults in detecting security failures and security breaches in the network In Detail This Learning Path starts off installing Wireshark, before gradually taking you through your first packet capture, identifying and filtering out just the packets of interest, and saving them to a new file for later analysis. You will then discover different ways to create and use capture and display filters. By halfway through the book, you'll be mastering Wireshark features, analyzing different layers of the network protocol, and looking for any anomalies.We then start Ethernet and LAN switching, through IP, and then move on to TCP/UDP with a focus on TCP performance problems. It also focuses on WLAN security. Then, we go through application behavior issues including HTTP, mail, DNS, and other common protocols. This book finishes with a look at network forensics and how to locate security problems that might harm the network.This course provides you with highly practical content explaining Metasploit from the following books: 1) Wireshark Essentials 2) Network Analysis Using Wireshark Cookbook 3) Mastering Wireshark Style and approach This step-by-step guide follows a practical approach, starting from the basic to the advanced aspects. Through a series of real-world examples, this learning path will focus on making it easy for you to become an expert at using Wireshark.

Leverage the power of Type* 2.0 using real-world examples About This Book ? Begin with the fundamentals of TypeScript and learn how to write better JavaScript code ? Build three amazing applications throughout the book ? Leverage the power of tools such as Angular 2 and NativeScript to build for the web as well as for mobile Who This Book Is For Web developers who would like to learn how to use TypeScript to build amazing applications will benefit from this book. What You Will Learn ? Design your first project in Visual Studio ? Learn about the different data types in TypeScript ? Create web applications in an object-oriented fashion using TypeScript ? Build a Trello application using TypeScript's complex features. ? Explore the tools available in a web application ecosystem to write unit test cases ? Deploy web applications to cloud and assign resources to the application In Detail The TypeScript language, compiler, and open source development toolset brings JavaScript development up to the enterprise level. It allows you to use ES5, ES6, and ES7 JavaScript language features today, including classes, interfaces, generics, modules, and more. Its simple typing syntax enables building large, robust applications using object-oriented techniques and industry-standard design principles. This book aims at teaching you how to get up and running with TypeScript development in the most practical way possible. Taking you through two exciting projects built from scratch, you will learn the basics of TypeScript, before progressing to functions, generics, promises, and callbacks. Then, you’ll get to implement object-oriented programming as well as optimize your applications with effective memory management. You’ll also learn to test and secure your applications, before deploying them. Starting with a basic SPA built using Angular, you will progress on to building, maybe, a Chat application or a cool application. You’ll also learn how to use NativeScript to build a cool mobile application. Each of these applications with be explained in detail, allowing you to grasp the concepts fast. By the end of this book, you will have not only built two amazing projects but you will also have the skills necessary to take your development to the next level. Style and approach Example-based approach to get you quickly started with Type*

Deliver end-to-end real-time distributed data processing solutions by leveraging the power of Elastic Stack 6.0 About This Book ? Get to grips with the new features introduced in Elastic Stack 6.0 ? Get valuable insights from your data by working with the different components of the Elastic stack such as Elasticsearch, Logstash, Kibana, X-Pack, and Beats ? Includes handy tips and techniques to build, deploy and manage your Elastic applications efficiently on-premise or on the cloud Who This Book Is For This book is for data professionals who want to get amazing insights and business metrics from their data sources. If you want to get a fundamental understanding of the Elastic Stack for distributed, real-time processing of data, this book will help you. A fundamental knowledge of JSON would be useful, but is not mandatory. No previous experience with the Elastic Stack is required. What You Will Learn ? Familiarize yourself with the different components of the Elastic Stack ? Get to know the new functionalities introduced in Elastic Stack 6.0 ? Effectively build your data pipeline to get data from terabytes or petabytes of data into Elasticsearch and Logstash for searching and logging ? Use Kibana to visualize data and tell data stories in real-time ? Secure, monitor, and use the alerting and reporting capabilities of Elastic Stack ? Take your Elastic application to an on-premise or cloud-based production environment In Detail The Elastic Stack is a powerful combination of tools for distributed search, analytics, logging, and visualization of data from medium to massive data sets. The newly released Elastic Stack 6.0 brings new features and capabilities that empower users to find unique, actionable insights through these techniques. This book will give you a fundamental understanding of what the stack is all about, and how to use it efficiently to build powerful real-time data processing applications. After a quick overview of the newly introduced features in Elastic Stack 6.0, you’ll learn how to set up the stack by installing the tools, and see their basic configurations. Then it shows you how to use Elasticsearch for distributed searching and analytics, along with Logstash for logging, and Kibana for data visualization. It also demonstrates the creation of custom plugins using Kibana and Beats. You’ll find out about Elastic X-Pack, a useful extension for effective security and monitoring. We also provide useful tips on how to use the Elastic Cloud and deploy the Elastic Stack in production environments. On completing this book, you’ll have a solid foundational knowledge of the basic Elastic Stack functionalities. You’ll also have a good understanding of the role of each component in the stack to solve different data processing problems. Style and approach This step-by-step guide will show you the Elastic Stack, covering all the components through interactive and easy-to-follow examples. It also includes handy tips.

Simplify real-time data processing by leveraging the power of Apache Kafka 1.0 About This Book ? Use Kafka 1.0 features such as Confluent platforms and Kafka streams to build efficient streaming data applications to handle and process your data ? Integrate Kafka with other Big Data tools such as Apache Hadoop, Apache Spark, and more ? Hands-on recipes to help you design, operate, maintain, and secure your Apache Kafka cluster with ease Who This Book Is For This book is for developers and Kafka administrators who are looking for quick, practical solutions to problems encountered while operating, managing or monitoring Apache Kafka. If you are a developer, some knowledge of Scala or Java will help, while for administrators, some working knowledge of Kafka will be useful. What You Will Learn ? Install and configure Apache Kafka 1.0 to get optimal performance ? Create and configure Kafka Producers and Consumers ? Operate your Kafka clusters efficiently by implementing the mirroring technique ? Work with the new Confluent platform and Kafka streams, and achieve high availability with Kafka ? Monitor Kafka using tools such as Graphite and Ganglia ? Integrate Kafka with third-party tools such as Elasticsearch, Logstash, Apache Hadoop, Apache Spark, and more In Detail Apache Kafka provides a unified, high-throughput, low-latency platform to handle real-time data feeds. This book will show you how to use Kafka efficiently, and contains practical solutions to the common problems that developers and administrators usually face while working with it. This practical guide contains easy-to-follow recipes to help you set up, configure, and use Apache Kafka in the best possible manner. You will use Apache Kafka Consumers and Producers to build effective real-time streaming applications. The book covers the recently released Kafka version 1.0, the Confluent Platform and Kafka Streams. The programming aspect covered in the book will teach you how to perform important tasks such as message validation, enrichment and composition.Recipes focusing on optimizing the performance of your Kafka cluster, and integrate Kafka with a variety of third-party tools such as Apache Hadoop, Apache Spark, and Elasticsearch will help ease your day to day collaboration with Kafka greatly. Finally, we cover tasks related to monitoring and securing your Apache Kafka cluster using tools such as Ganglia and Graphite. If you're looking to become the go-to person in your organization when it comes to working with Apache Kafka, this book is the only resource you need to have. Style and approach Following a cookbook recipe-based approach, we’ll teach you how to solve everyday difficulties and struggles you encounter using Kafka through hands-on examples.

Learn the importance of architectural and design patterns in producing and sustaining next-generation IT and business-critical applications with this guide. About This Book ? Use patterns to tackle communication, integration, application structure, and more ? Implement modern design patterns such as microservices to build resilient and highly available applications ? Choose between the MVP, MVC, and MVVM patterns depending on the application being built Who This Book Is For This book will empower and enrich IT architects (such as enterprise architects, software product architects, and solution and system architects), technical consultants, evangelists, and experts. What You Will Learn ? Understand how several architectural and design patterns work to systematically develop multitier web, mobile, embedded, and cloud applications ? Learn object-oriented and component-based software engineering principles and patterns ? Explore the frameworks corresponding to various architectural patterns ? Implement domain-driven, test-driven, and behavior-driven methodologies ? Deploy key platforms and tools effectively to enable EA design and solutioning ? Implement various patterns designed for the cloud paradigm In Detail Enterprise Architecture (EA) is typically an aggregate of the business, application, data, and infrastructure architectures of any forward-looking enterprise. Due to constant changes and rising complexities in the business and technology landscapes, producing sophisticated architectures is on the rise. Architectural patterns are gaining a lot of attention these days. The book is divided in three modules. You'll learn about the patterns associated with object-oriented, component-based, client-server, and cloud architectures. The second module covers Enterprise Application Integration (EAI) patterns and how they are architected using various tools and patterns. You will come across patterns for Service-Oriented Architecture (SOA), Event-Driven Architecture (EDA), Resource-Oriented Architecture (ROA), big data analytics architecture, and Microservices Architecture (MSA). The final module talks about advanced topics such as Docker containers, high performance, and reliable application architectures. The key takeaways include understanding what architectures are, why they're used, and how and where architecture, design, and integration patterns are being leveraged to build better and bigger systems. Style and Approach This book adopts a hands-on approach with real-world examples and use cases.

Implement your Business Intelligence solutions without any coding - by leveraging the power of the Alteryx platform About This Book ? Experience the power of codeless analytics using Alteryx, a leading Business Intelligence tool ? Uncover hidden trends and valuable insights from your data across different sources and make accurate predictions ? Includes real-world examples to put your understanding of the features in Alteryx to practical use Who This Book Is For This book is for aspiring data professionals who want to learn and implement self-service analytics from scratch, without any coding. Those who have some experience with Alteryx and want to gain more proficiency will also find this book to be useful. A basic understanding of the data science concepts is all you need to get started with this book. What You Will Learn ? Create efficient workflows with Alteryx to answer complex business questions ? Learn how to speed up the cleansing, data preparing, and shaping process ? Blend and join data into a single dataset for self-service analysis ? Write advanced expressions in Alteryx leading to an optimal workflow for efficient processing of huge data ? Develop high-quality, data-driven reports to improve consistency in reporting and analysis ? Explore the flexibility of macros by automating analytic processes ? Apply predictive analytics from spatial, demographic, and behavioral analysis and quickly publish, schedule ? Share your workflows and insights with relevant stakeholders In Detail Alteryx, as a leading data blending and advanced data analytics platform, has taken self-service data analytics to the next level. Companies worldwide often find themselves struggling to prepare and blend massive datasets that are time-consuming for analysts. Alteryx solves these problems with a repeatable workflow designed to quickly clean, prepare, blend, and join your data in a seamless manner. This book will set you on a self-service data analytics journey that will help you create efficient workflows using Alteryx, without any coding involved. It will empower you and your organization to take well-informed decisions with the help of deeper business insights from the data.Starting with the fundamentals of using Alteryx such as data preparation and blending, you will delve into the more advanced concepts such as performing predictive analytics. You will also learn how to use Alteryx’s features to share the insights gained with the relevant decision makers. To ensure consistency, we will be using data from the Healthcare domain throughout this book. The knowledge you gain from this book will guide you to solve real-life problems related to Business Intelligence confidently. Whether you are a novice with Alteryx or an experienced data analyst keen to explore Alteryx’s self-service analytics features, this book will be the perfect companion for you. Style and approach Comprehensive, step by step guide filled with real-world examples to step through the complex business questions using one of the leading data analytics platform.

A comprehensive guide to learning Cacti and using it to implement performance measurement and reporting within a Network Operations Center About This Book ? A complete Cacti book that focuses on the basics as well as the advanced concepts you need to know for implementing a Network Operations Center ? A step-by-step Beginner's Guide with detailed instructions on how to create and implement custom plugins ? Written by Thomas Urban – creator of the "Cereus" and "NMID" plugins for Cacti known as Phalek in the Cacti forum Who This Book Is For If you are a network operator and want to use Cacti for implementing performance measurement for trending, troubleshooting, and reporting purposes, then this book is for you. You only need to know the basics of network management and SNMP. What You Will Learn ? Setting up Cacti on Linux and Windows systems ? Extending the core functionality by using the plugin architecture ? Building your own custom plugins ? Creating your own custom data input method to retrieve data from your systems ? Using SNMP, SSH, and WMI to retrieve remote performance data ? Designing and create enterprise-class reports with the reporting plugins ? Implementing threshold-based alerting using the Thold plugin ? Automating common administrative tasks utilizing the command-line interface and the automate functionality ? Migrating Cacti to new servers ? Building a multi remote-poller environment In Detail Cacti is a performance measurement tool that provides easy methods and functions for gathering and graphing system data. You can use Cacti to develop a robust event management system that can alert on just about anything you would like it to. But to do that, you need to gain a solid understanding of the basics of Cacti, its plugin architecture, and automation concepts. Cacti Beginner's Guide will introduce you to the wide variety of features of Cacti and will guide you on how to use them for maximum effectiveness. Advanced topics such as the plugin architecture and Cacti automation using the command-line interface will help you build a professional performance measurement system. Designed as a beginner's guide, the book starts off with the basics of installing and using Cacti, and also covers the advanced topics that will show you how to customize and extend the core Cacti functionalities. The book offers essential tutorials for creating advanced graphs and using plugins to create enterprise-class reports to show your customers and colleagues. From data templates to input methods and plugin installation to creating your own customized plugins, this book provides you with a rich selection of step-by-step instructions to reach your goals. It covers all you need to know to implement professional performance measurement techniques with Cacti and ways to fully customize Cacti to fit your needs. You will also learn how to migrate Cacti to new servers. Lastly you will also be introduced to the latest feature of building a scalable remote poller environment. By the end of the book, you will be able to implement and extend Cacti to monitor, display, and report the performance of your network exactly the way you want. Style and approach Written for beginners to Cacti, this book contains step-by-step instructions and hands-on tutorials for network operators to learn how to implement and use the core Cacti functions.