售 价:¥
温馨提示:数字商品不支持退换货,不提供源文件,不支持导出打印
为你推荐
SAP Data Services 4.x Cookbook
Table of Contents
SAP Data Services 4.x Cookbook
Credits
About the Author
About the Reviewers
www.PacktPub.com
Support files, eBooks, discount offers, and more
Why subscribe?
Free access for Packt account holders
Instant updates on new Packt books
Preface
What this book covers
What you need for this book
Who this book is for
Sections
Getting ready
How to do it…
How it works…
There's more…
See also
Conventions
Reader feedback
Customer support
Downloading the example code
Downloading the color images of this book
Errata
Piracy
Questions
1. Introduction to ETL Development
Introduction
Preparing a database environment
Getting ready
How to do it…
How it works…
Creating a source system database
How to do it…
How it works…
There's more…
Defining and creating staging area structures
How to do it…
Flat files
RDBMS tables
How it works…
Creating a target data warehouse
Getting ready
How to do it…
How it works…
There's more…
2. Configuring the Data Services Environment
Introduction
Creating IPS and Data Services repositories
Getting ready…
How to do it…
How it works…
See also
Installing and configuring Information Platform Services
Getting ready…
How to do it…
How it works…
Installing and configuring Data Services
Getting ready…
How to do it…
How it works…
Configuring user access
Getting ready…
How to do it…
How it works…
Starting and stopping services
How to do it…
How it works…
See also
Administering tasks
How to do it…
How it works…
See also
Understanding the Designer tool
Getting ready…
How to do it…
How it works…
Executing ETL code in Data Services
Validating ETL code
Template tables
Query transform basics
The HelloWorld example
3. Data Services Basics – Data Types, Scripting Language, and Functions
Introduction
Creating variables and parameters
Getting ready
How to do it…
How it works…
There's more…
Creating a script
How to do it…
How it works…
Using string functions
How to do it…
Using string functions in the script
How it works…
There's more…
Using date functions
How to do it…
Generating current date and time
Extracting parts from dates
How it works…
There's more…
Using conversion functions
How to do it…
How it works…
There's more…
Using database functions
How to do it…
key_generation()
total_rows()
sql()
How it works…
Using aggregate functions
How to do it…
How it works…
Using math functions
How to do it…
How it works…
There's more…
Using miscellaneous functions
How to do it…
How it works…
Creating custom functions
How to do it…
How it works…
There's more…
4. Dataflow – Extract, Transform, and Load
Introduction
Creating a source data object
How to do it…
How it works…
There's more…
Creating a target data object
Getting ready
How to do it…
How it works…
There's more…
Loading data into a flat file
How to do it…
How it works…
There's more…
Loading data from a flat file
How to do it…
How it works…
There's more…
Loading data from table to table – lookups and joins
How to do it…
How it works…
Using the Map_Operation transform
How to do it…
How it works…
Using the Table_Comparison transform
Getting ready
How to do it…
How it works…
Exploring the Auto correct load option
Getting ready
How to do it…
How it works…
Splitting the flow of data with the Case transform
Getting ready
How to do it…
How it works…
Monitoring and analyzing dataflow execution
Getting ready
How to do it…
How it works…
There's more…
5. Workflow – Controlling Execution Order
Introduction
Creating a workflow object
How to do it…
How it works…
Nesting workflows to control the execution order
Getting ready
How to do it
How it works…
Using conditional and while loop objects to control the execution order
Getting ready
How to do it…
How it works…
There is more…
Using the bypassing feature
Getting ready…
How to do it…
How it works…
There is more…
Controlling failures – try-catch objects
How to do it…
How it works…
Use case example – populating dimension tables
Getting ready
How to do it…
How it works…
Mapping
Dependencies
Development
Execution order
Testing ETL
Preparing test data to populate DimSalesTerritory
Preparing test data to populate DimGeography
Using a continuous workflow
How to do it…
How it works…
There is more…
Peeking inside the repository – parent-child relationships between Data Services objects
Getting ready
How to do it…
How it works…
Get a list of object types and their codes in the Data Services repository
Display information about the DF_Transform_DimGeography dataflow
Display information about the SalesTerritory table object
See the contents of the script object
6. Job – Building the ETL Architecture
Introduction
Projects and jobs – organizing ETL
Getting ready
How to do it…
How it works…
Hierarchical object view
History execution log files
Executing/scheduling jobs from the Management Console
Using object replication
How to do it…
How it works…
Migrating ETL code through the central repository
Getting ready
How to do it…
How it works…
Adding objects to and from the Central Object Library
Comparing objects between the Local and Central repositories
There is more…
Migrating ETL code with export/import
Getting ready
How to do it…
Import/Export using ATL files
Direct export to another local repository
How it works…
Debugging job execution
Getting ready…
How to do it…
How it works…
Monitoring job execution
Getting ready
How to do it…
How it works…
Building an external ETL audit and audit reporting
Getting ready…
How to do it…
How it works…
Using built-in Data Services ETL audit and reporting functionality
Getting ready
How to do it…
How it works…
Auto Documentation in Data Services
How to do it…
How it works…
7. Validating and Cleansing Data
Introduction
Creating validation functions
Getting ready
How to do it…
How it works…
Using validation functions with the Validation transform
Getting ready
How to do it…
How it works…
Reporting data validation results
Getting ready
How to do it…
How it works…
Using regular expression support to validate data
Getting ready
How to do it…
How it works…
Enabling dataflow audit
Getting ready
How to do it…
How it works…
There's more…
Data Quality transforms – cleansing your data
Getting ready
How to do it…
How it works…
There's more…
8. Optimizing ETL Performance
Introduction
Optimizing dataflow execution – push-down techniques
Getting ready
How to do it…
How it works…
Optimizing dataflow execution – the SQL transform
How to do it…
How it works…
Optimizing dataflow execution – the Data_Transfer transform
Getting ready
How to do it…
How it works…
Why we used a second Data_Transfer transform object
When to use Data_Transfer transform
There's more…
Optimizing dataflow readers – lookup methods
Getting ready
How to do it…
Lookup with the Query transform join
Lookup with the lookup_ext() function
Lookup with the sql() function
How it works…
Query transform joins
lookup_ext()
sql()
Performance review
Optimizing dataflow loaders – bulk-loading methods
How to do it…
How it works…
When to enable bulk loading?
Optimizing dataflow execution – performance options
Getting ready
How to do it…
Dataflow performance options
Source table performance options
Query transform performance options
lookup_ext() performance options
Target table performance options
9. Advanced Design Techniques
Introduction
Change Data Capture techniques
Getting ready
No history SCD (Type 1)
Limited history SCD (Type 3)
Unlimited history SCD (Type 2)
How to do it…
How it works…
Source-based ETL CDC
Target-based ETL CDC
Native CDC
Automatic job recovery in Data Services
Getting ready
How to do it…
How it works…
There's more…
Simplifying ETL execution with system configurations
Getting ready
How to do it…
How it works…
Transforming data with the Pivot transform
Getting ready
How to do it…
How it works…
10. Developing Real-time Jobs
Introduction
Working with nested structures
Getting ready
How to do it…
How it works…
There is more…
The XML_Map transform
Getting ready
How to do it…
How it works…
The Hierarchy_Flattening transform
Getting ready
How to do it…
Horizontal hierarchy flattening
Vertical hierarchy flattening
How it works…
Querying result tables
Configuring Access Server
Getting ready
How to do it…
How it works…
Creating real-time jobs
Getting ready
Installing SoapUI
How to do it…
How it works…
11. Working with SAP Applications
Introduction
Loading data into SAP ERP
Getting ready
How to do it…
How it works…
IDoc
Monitoring IDoc load on the SAP side
Post-load validation of loaded data
There is more…
12. Introduction to Information Steward
Introduction
Exploring Data Insight capabilities
Getting ready
How to do it…
Creating a connection object
Profiling the data
Viewing profiling results
Creating a validation rule
Creating a scorecard
How it works…
Profiling
Rules
Scorecards
There is more…
Performing Metadata Management tasks
Getting ready
How to do it…
How it works…
Working with the Metapedia functionality
How to do it…
How it works…
Creating a custom cleansing package with Cleansing Package Builder
Getting ready
How to do it…
How it works…
There is more…
Index
买过这本书的人还买过
读了这本书的人还在读
同类图书排行榜