Successfully scrape data from any website with the power of PythonAbout This BookA hands-on guide to web scraping with real-life problems and solutionsTechniques to download and extract data from complex websitesCreate a number of different web scrapers to extract information Who This Book Is For This book is aimed at developers who want to use web scraping for legitimate purposes. Prior programming experience with Python would be useful but not essential. Anyone with general knowledge of programming languages should be able to pick up the book and understand the principals involved.What You Will LearnExtract data from web pages with simple Python programmingBuild a threaded crawler to process web pages in parallelFollow links to crawl a websiteDownload cache to reduce bandwidthUse multiple threads and processes to scrape fasterLearn how to parse JavaScript-dependent websitesInteract with forms and sessionsSolve CAPTCHAs on protected web pagesDiscover how to track the state of a crawl In Detail The Internet contains the most useful set of data ever assembled, largely publicly accessible for free. However, this data is not easily reusable. It is embedded within the structure and style of websites and needs to be carefully extracted to be useful. Web scraping is becoming increasingly useful as a means to easily gather and make sense of the plethora of information available online. Using a simple language like Python, you can crawl the information out of complex websites using simple programming. This book is the ultimate guide to using Python to scrape data from websites. In the early chapters it covers how to extract data from static web pages and how to use caching to manage the load on servers. After the basics we'll get our hands dirty with building a more sophisticated crawler with threads and more advanced topics. Learn step-by-step how to use Ajax URLs, employ the Firebug extension for monitoring, and indirectly scrape data. Discover more scraping nitty-gritties such as using the browser renderer, managing cookies, how to submit forms to extract data from complex websites protected by CAPTCHA, and so on. The book wraps up with how to create high-level scrapers with Scrapy libraries and implement what has been learned to real websites.Style and approach This book is a hands-on guide with real-life examples and solutions starting simple and then progressively becoming more complex. Each chapter in this book introduces a problem and then provides one or more possible solutions.

Gain expertise in troubleshooting most common issues to implement vSphere environments with easeAbout This BookPlan, analyze, and design effective solutions for your vSphere environmentTroubleshoot problems related to vSphere performanceFamiliarize yourself with the advanced troubleshooting conceptsand become an xpert level administrator Who This Book Is For The books is intended for mid-level System Engineers and System Integrators who want to learn VMware power tools to troubleshoot and manage the vSphere infrastructure. Good knowledge level and understanding of virtualization is expected.What You Will LearnConfigure vSphere management assistant and troubleshooting toolsUse troubleshooting tools to monitor performance and troubleshoot different issuesLearn how to troubleshoot High Availability and other commonly known problems with clusters such as insufficient resources, failing heartbeatsUse Direct Console User Interface (DCUI) to verify configurationDiagnose storage issues including iSCSI, NFS and VMFS problemsManage vSphere Network Virtual and Distributed Switches, Trunks, VLANSMonitor and shape network traffic, configure routes and DNSQuickly resolve common day-to-day problems by analysing logs of VMware vSphere hosts and VMware vCenter ServerDebug and resolve commonly known vSphere Cluster problems In Detail VMware vSphere is the leading server virtualization platform with consistent management for virtual data centers. It enhances troubleshooting skills to diagnose and resolve day to day problems in your VMware vSphere infrastructure environment. This book will provide you practical hands-on knowledge of using different performance monitoring and troubleshooting tools to manage and troubleshoot the vSphere infrastructure. It begins by introducing systematic approach for troubleshooting different problems and show casing the troubleshooting techniques. You will be able to use the troubleshooting tools to monitor performance, and troubleshoot issues related to Hosts and Virtual Machines. Moving on, you will troubleshoot High Availability, storage I/O control problems, virtual LANS, and iSCSI, NFS, VMFS issues. By the end of this book, you will be able to analyze and solve advanced issues related to vShpere environment such as vcenter certificates, database problems, and different failed state errors.Style and approach A step-by-step guide full of real world scenarios that will enhance advanced knowledge, skills, and abilities to achieve competence in troubleshooting the VMware vSphere environment. Basic concepts of vSphere and the most common vSphere infrastructure problems are explained with practical solutions to resolve it.

Build real-world hybrid mobile applications using the robust PhoneGap development platformAbout This BookGet to grips with the usage of PhoneGap and its command-line interfaceLearn to use numerous plugins to access several hardware capabilitiesStep-by-step instructions on creating captivating mobile applications using popular frameworks Who This Book Is For If you are a developer who wants to get started with mobile application development using PhoneGap, then this book is for you. Previous experience with data mining libraries will help, but is not mandatory. A basic understanding of web technologies such as HTML, CSS, and JavaScript is a must.What You Will LearnSet up a development environment to develop PhoneGap applicationsGenerate, build, and run applications using the PhoneGap command-line interfaceInstall plugins from the command line to add native capabilities to your applicationCall the JavaScript API of plugins and hook into native eventsManipulate DOM using zepto and xuijsDevelop a user interface using jQuery Mobile and the Ionic frameworkGet accustomed to using the PhoneGap Build service In Detail Developing mobile applications often feels intimidating. Especially when building cross-platform application. We have to learn a specific programming language to build an application for each platform. PhoneGap makes cross-platform mobile application development faster and easier by using web technologies such as HTML5, CSS, and JavaScript. This book gives you practical lessons on how to build a world class mobile application using PhoneGap. Whether you are a brand new to mobile application development, a web developer expert, or a seasoned mobile application developer, this book will guide you through creating hybrid mobile applications. Starting with setting up a development environment, the book moves on to utilizing a new PhoneGap command-line tool, installing plugins, and designing your application. It then moves on to concepts such as file system, storage, and local database, the book effectively lays a solid base for advanced topics. By working through the steps in each chapter, you will quickly master the features of PhoneGap. By the end of the book, you will be able to successfully build a highly functional, real-world hybrid mobile application using PhoneGap.Style and approach And easy-to-follow guide full of practical examples of real-world mobile application. Each topic is explained step by step with detailed explanations on each concept.

Get started with Amazon S3 for virtually unlimited cloud and Internet storageAbout This BookFamiliarize yourself with the concepts of Amazon S3Understand basic operations of bucket, folders, and objects using Amazon S3 SDK JavaLeverage the power of Amazon S3 to effectively store and retrieve data Who This Book Is For This book is intended for System Engineers/ Developers, Software Architects, Project managers, and users who want to explore Amazon S3 SDK Java. If you want to learn about Amazon S3 quickly, then this book is for you. Basic knowledge of Java programming is expected.What You Will LearnStart with the basic concepts of Amazon S3 to get you goingUse Copy Object and Multipart Copy Object for objects of different sizesUnderstand how to use the amazon management console for Amazon S3Learn how to use the AWS SDK of Java and consume the Amazon S3Get to grips with managing the bucket life cycleConfigure CORS to share resources to a different domainDiscover how to develop and deploy the static website on Amazon S3 using different services of Amazon In Detail Amazon Simple Storage Service (Amazon S3), provides developers and IT teams with secure, durable, and highly-scalable object storage. Amazon S3 is easy to use, with a simple web services interface to store and retrieve any amount of data from anywhere on the web. S3 is automatically web scalable and responds to the requirements of your application and traffic, and therefore offers a key element to help companies deal dynamically with any spike in traffic for their application (such as a free e-book offer). This book starts with the basics of the Amazon S3 and its features, and you will quickly get an understanding how to use the Amazon Management Console for Amazon S3 which is the simplest way to manage Amazon S3. Next, we will cover basic operations on bucket, folder, objects. Once the basic operations are understood, you will know how to use Amazon S3 using Java SDK. Following that, you will learn about Copy Objects and Multipart copy objects for large objects size. You will also learn to manage the life cycle of bucket and how to share resources to the different domain by configuring CORS. The book will then guide you through the development and deployment of a static website on Amazon S3 using different services of Amazon. By the end of the book, you will be able to create a scalable application using Amazon S3.Style and approach This fast-paced book is a pragmatic guide to writing Amazon S3 applications. Each chapter is blended beautifully with lucid concepts and pertinent examples.

This book is targeted at expert programmers and architects wanting to learn AWS. Some familiarity with Spring, MySQL, and RESTful web services is assumed.

If you are a researcher or a machine learning enthusiast, or are working in the data science field and have a basic idea of Bayesian learning or probabilistic graphical models, this book will help you to understand the details of graphical models and use them in your data science problems.

If you are a systems or automation engineer who intends to automate common infrastructure tasks, deploy applications, and use orchestration to configure systems in a coordinated manner, then this book is for you. Some understanding of the Linux/Unix command-line interface is expected.

If you have some experience with App-V but are overwhelmed by the range of features on offer, then this book is for you. A basic understanding of App-V and common Windows Server technologies (Active Directory/Group Policy/PowerShell) is necessary.

This book is targeted at novice, intermediate, and proficient game developers coming from a different development platform and wanting to migrate to game development with the Sprite Kit engine. The reader does not need any knowledge of Sprite Kit and building games on the iOS platform.

This book is perfect for people who have never used Odoo and for those who would like to learn about more advanced concepts of Odoo. In order to get the most out of this book, you should be comfortable with understanding basic business concepts such as sales, purchasing, inventory management, and basic accounting.

The style and approach of the book is an easytoread SharePoint admin guide. This is not a stepbystep instruction book, but rather a guide on how to implement and execute a disaster recovery plan to your SharePoint environment.This book is great for both SharePoint and SQL administrators new to the SharePoint 2013 architecture, and who are looking to get a good grounding in how to use implement a solid disaster recoveryrecovery plan. It's assumed that you have some experience in SharePoint and Windows Server and, as well be familiar with SQL.

Filled with practical, step-by-step instructions and clear explanations for the most important and useful tasks. Instant PageSpeed Optimization is a hands-on guide that provides a number of clear, step-by-step exercises for optimizing your websites for better performance and improving their efficiency.Instant PageSpeed Optimization is aimed at website developers and administrators who wish to make their websites load faster without any errors and consume less bandwidth. It’s assumed that you will have some experience in basic web technologies like HTML, CSS3, JavaScript, and the basics of networking, as well as knowing how to edit Apache configuration.

A step-by-step tutorial approach which will teach the readers what responsive web design is and how it is used in designing a responsive web page.If you are a web-designer looking to expand your skill set by learning the quickly growing industry standard of responsive web design, this book is ideal for you. Knowledge of CSS is assumed.

Visualforce Development Cookbook is written in such a way that even complex concepts are explained in an easy-to-understand manner. Following a Cookbook structure, the book covers some essential technical scenarios and includes over 75 recipes focusing on real-world development problems. This book is packed with illustrations and also contains lots of code samples for the better understanding of the reader."Visualforce Development Cookbook" is aimed at developers who have already grasped the basics of Visualforce. Awareness of the standard component library and the purpose of controllers is expected.

If you're a Python, JavaScript, or C# developer and want to learn the basics of object-oriented programming with real-world examples, then this book is for you.

Programming ArcGIS with Python Cookbook, Second Edition, is written for GIS professionals who wish to revolutionize their ArcGIS workflow with Python. Whether you are new to ArcGIS or a seasoned professional, you almost certainly spend time each day performing various geoprocessing tasks. This book will teach you how to use the Python programming language to automate these geoprocessing tasks and make you a more efficient and effective GIS professional.

If you are a Yocto and Linux enthusiast who wants to build embedded Linux systems but do not have the knowledge to do it, this is the book for you. It will also help those of you who have a bit of knowledge about Linux and the embedded world and are keen on learning more about the technology. This book will provide you with the skills needed to successfully interact with the Yocto Project components regardless of the fact that you are new to embedded development or an expert.

This book is for developers or students who have a working knowledge of JavaScript and HTML, and want to learn how to quickly develop full-stack web applications using pure JavaScript.

If you are an intermediate-level Android developer who wants to create highly interactive and amazing games with the Android SDK, then this book is for you.

This book is for architects, architectural technicians, and construction professionals who are familiar with 2D CAD programs such as AutoCAD Lite, or have some exposure to a 3D BIM package such as Revit. No experience with ArchiCAD is required. If you want to learn the skills needed for architectural drawing production in the real world, then this book is for you.

This book is for Node.js developers who want a more in-depth knowledge of the platform to improve the performance of their applications. Whether you have a base Node.js background or you are an expert who knows the garbage collector and wants to leverage it to make applications more robust, the examples in this book will benefit you.