万本电子书0元读

万本电子书0元读

顶部广告

SAP Data Services 4.x Cookbook电子书

售       价:¥

17人正在读 | 0人评论 9.8

作       者:Ivan Shomnikov

出  版  社:Packt Publishing

出版时间:2015-12-03

字       数:272.0万

所属分类: 进口书 > 外文原版书 > 电脑/网络

温馨提示:数字商品不支持退换货,不提供源文件,不支持导出打印

为你推荐

  • 读书简介
  • 目录
  • 累计评论(0条)
  • 读书简介
  • 目录
  • 累计评论(0条)
Delve into the SAP Data Services environment to efficiently prepare, implement, and develop ETL processes About This Book Install and configure the SAP Data Services environment Develop ETL techniques in the Data Services environment Implement real-life examples of Data Services uses through step-by-step instructions to perform specific ETL development tasks Who This Book Is For This book is for IT technical engineers who want to get familiar with the EIM solutions provided by SAP for ETL development and data quality management. The book requires familiarity with basic programming concepts and basic knowledge of the SQL language. What You Will Learn Install, configure, and administer the SAP Data Services components Run through the ETL design basics Maximize the performance of your ETL with the advanced patterns in Data Services Extract methods from various databases and systems Get familiar with the transformation methods available in SAP Data Services Load methods into various databases and systems Code with the Data Services *ing language Validate and cleanse your data, applying the Data quality methods of the Information Steward In Detail Want to cost effectively deliver trusted information to all of your crucial business functionsSAP Data Services delivers one enterprise-class solution for data integration, data quality, data profiling, and text data processing. It boosts productivity with a single solution for data quality and data integration. SAP Data Services also enables you to move, improve, govern, and unlock big data. This book will lead you through the SAP Data Services environment to efficiently develop ETL processes. To begin with, you’ll learn to install, configure, and prepare the ETL development environment. You will get familiarized with the concepts of developing ETL processes with SAP Data Services. Starting from smallest unit of work- the data flow, the chapters will lead you to the highest organizational unit—the Data Services job, revealing the advanced techniques of ETL design.You will learn to import XML files by creating and implementing real-time jobs. It will then guide you through the ETL development patterns that enable the most effective performance when extracting, transforming, and loading data. You will also find out how to create validation functions and transforms.Finally, the book will show you the benefits of data quality management with the help of another SAP solution—Information Steward.Style and approach This book is an easy-to-follow guide with step-by-step instructions to perform specific ETL development tasks.
目录展开

SAP Data Services 4.x Cookbook

Table of Contents

SAP Data Services 4.x Cookbook

Credits

About the Author

About the Reviewers

www.PacktPub.com

Support files, eBooks, discount offers, and more

Why subscribe?

Free access for Packt account holders

Instant updates on new Packt books

Preface

What this book covers

What you need for this book

Who this book is for

Sections

Getting ready

How to do it…

How it works…

There's more…

See also

Conventions

Reader feedback

Customer support

Downloading the example code

Downloading the color images of this book

Errata

Piracy

Questions

1. Introduction to ETL Development

Introduction

Preparing a database environment

Getting ready

How to do it…

How it works…

Creating a source system database

How to do it…

How it works…

There's more…

Defining and creating staging area structures

How to do it…

Flat files

RDBMS tables

How it works…

Creating a target data warehouse

Getting ready

How to do it…

How it works…

There's more…

2. Configuring the Data Services Environment

Introduction

Creating IPS and Data Services repositories

Getting ready…

How to do it…

How it works…

See also

Installing and configuring Information Platform Services

Getting ready…

How to do it…

How it works…

Installing and configuring Data Services

Getting ready…

How to do it…

How it works…

Configuring user access

Getting ready…

How to do it…

How it works…

Starting and stopping services

How to do it…

How it works…

See also

Administering tasks

How to do it…

How it works…

See also

Understanding the Designer tool

Getting ready…

How to do it…

How it works…

Executing ETL code in Data Services

Validating ETL code

Template tables

Query transform basics

The HelloWorld example

3. Data Services Basics – Data Types, Scripting Language, and Functions

Introduction

Creating variables and parameters

Getting ready

How to do it…

How it works…

There's more…

Creating a script

How to do it…

How it works…

Using string functions

How to do it…

Using string functions in the script

How it works…

There's more…

Using date functions

How to do it…

Generating current date and time

Extracting parts from dates

How it works…

There's more…

Using conversion functions

How to do it…

How it works…

There's more…

Using database functions

How to do it…

key_generation()

total_rows()

sql()

How it works…

Using aggregate functions

How to do it…

How it works…

Using math functions

How to do it…

How it works…

There's more…

Using miscellaneous functions

How to do it…

How it works…

Creating custom functions

How to do it…

How it works…

There's more…

4. Dataflow – Extract, Transform, and Load

Introduction

Creating a source data object

How to do it…

How it works…

There's more…

Creating a target data object

Getting ready

How to do it…

How it works…

There's more…

Loading data into a flat file

How to do it…

How it works…

There's more…

Loading data from a flat file

How to do it…

How it works…

There's more…

Loading data from table to table – lookups and joins

How to do it…

How it works…

Using the Map_Operation transform

How to do it…

How it works…

Using the Table_Comparison transform

Getting ready

How to do it…

How it works…

Exploring the Auto correct load option

Getting ready

How to do it…

How it works…

Splitting the flow of data with the Case transform

Getting ready

How to do it…

How it works…

Monitoring and analyzing dataflow execution

Getting ready

How to do it…

How it works…

There's more…

5. Workflow – Controlling Execution Order

Introduction

Creating a workflow object

How to do it…

How it works…

Nesting workflows to control the execution order

Getting ready

How to do it

How it works…

Using conditional and while loop objects to control the execution order

Getting ready

How to do it…

How it works…

There is more…

Using the bypassing feature

Getting ready…

How to do it…

How it works…

There is more…

Controlling failures – try-catch objects

How to do it…

How it works…

Use case example – populating dimension tables

Getting ready

How to do it…

How it works…

Mapping

Dependencies

Development

Execution order

Testing ETL

Preparing test data to populate DimSalesTerritory

Preparing test data to populate DimGeography

Using a continuous workflow

How to do it…

How it works…

There is more…

Peeking inside the repository – parent-child relationships between Data Services objects

Getting ready

How to do it…

How it works…

Get a list of object types and their codes in the Data Services repository

Display information about the DF_Transform_DimGeography dataflow

Display information about the SalesTerritory table object

See the contents of the script object

6. Job – Building the ETL Architecture

Introduction

Projects and jobs – organizing ETL

Getting ready

How to do it…

How it works…

Hierarchical object view

History execution log files

Executing/scheduling jobs from the Management Console

Using object replication

How to do it…

How it works…

Migrating ETL code through the central repository

Getting ready

How to do it…

How it works…

Adding objects to and from the Central Object Library

Comparing objects between the Local and Central repositories

There is more…

Migrating ETL code with export/import

Getting ready

How to do it…

Import/Export using ATL files

Direct export to another local repository

How it works…

Debugging job execution

Getting ready…

How to do it…

How it works…

Monitoring job execution

Getting ready

How to do it…

How it works…

Building an external ETL audit and audit reporting

Getting ready…

How to do it…

How it works…

Using built-in Data Services ETL audit and reporting functionality

Getting ready

How to do it…

How it works…

Auto Documentation in Data Services

How to do it…

How it works…

7. Validating and Cleansing Data

Introduction

Creating validation functions

Getting ready

How to do it…

How it works…

Using validation functions with the Validation transform

Getting ready

How to do it…

How it works…

Reporting data validation results

Getting ready

How to do it…

How it works…

Using regular expression support to validate data

Getting ready

How to do it…

How it works…

Enabling dataflow audit

Getting ready

How to do it…

How it works…

There's more…

Data Quality transforms – cleansing your data

Getting ready

How to do it…

How it works…

There's more…

8. Optimizing ETL Performance

Introduction

Optimizing dataflow execution – push-down techniques

Getting ready

How to do it…

How it works…

Optimizing dataflow execution – the SQL transform

How to do it…

How it works…

Optimizing dataflow execution – the Data_Transfer transform

Getting ready

How to do it…

How it works…

Why we used a second Data_Transfer transform object

When to use Data_Transfer transform

There's more…

Optimizing dataflow readers – lookup methods

Getting ready

How to do it…

Lookup with the Query transform join

Lookup with the lookup_ext() function

Lookup with the sql() function

How it works…

Query transform joins

lookup_ext()

sql()

Performance review

Optimizing dataflow loaders – bulk-loading methods

How to do it…

How it works…

When to enable bulk loading?

Optimizing dataflow execution – performance options

Getting ready

How to do it…

Dataflow performance options

Source table performance options

Query transform performance options

lookup_ext() performance options

Target table performance options

9. Advanced Design Techniques

Introduction

Change Data Capture techniques

Getting ready

No history SCD (Type 1)

Limited history SCD (Type 3)

Unlimited history SCD (Type 2)

How to do it…

How it works…

Source-based ETL CDC

Target-based ETL CDC

Native CDC

Automatic job recovery in Data Services

Getting ready

How to do it…

How it works…

There's more…

Simplifying ETL execution with system configurations

Getting ready

How to do it…

How it works…

Transforming data with the Pivot transform

Getting ready

How to do it…

How it works…

10. Developing Real-time Jobs

Introduction

Working with nested structures

Getting ready

How to do it…

How it works…

There is more…

The XML_Map transform

Getting ready

How to do it…

How it works…

The Hierarchy_Flattening transform

Getting ready

How to do it…

Horizontal hierarchy flattening

Vertical hierarchy flattening

How it works…

Querying result tables

Configuring Access Server

Getting ready

How to do it…

How it works…

Creating real-time jobs

Getting ready

Installing SoapUI

How to do it…

How it works…

11. Working with SAP Applications

Introduction

Loading data into SAP ERP

Getting ready

How to do it…

How it works…

IDoc

Monitoring IDoc load on the SAP side

Post-load validation of loaded data

There is more…

12. Introduction to Information Steward

Introduction

Exploring Data Insight capabilities

Getting ready

How to do it…

Creating a connection object

Profiling the data

Viewing profiling results

Creating a validation rule

Creating a scorecard

How it works…

Profiling

Rules

Scorecards

There is more…

Performing Metadata Management tasks

Getting ready

How to do it…

How it works…

Working with the Metapedia functionality

How to do it…

How it works…

Creating a custom cleansing package with Cleansing Package Builder

Getting ready

How to do it…

How it works…

There is more…

Index

累计评论(0条) 0个书友正在讨论这本书 发表评论

发表评论

发表评论,分享你的想法吧!

买过这本书的人还买过

读了这本书的人还在读

回顶部