微软商务智能ETL篇.pptxVIP

BI COE– SSIS Introduction议程ETL介绍SSIS介绍Control Flow Data FlowSSIS开发和管理ETL介绍数据集成DB2、Oracle等结构化数据转换SAP、用友等应用程序数据转换文档、邮件、网页等数据转换商流系统Office文档财务系统定单管理系统外部信息SAP系统Data IntegrationThe ability to transform corporate data into meaningful and actionable informationChallenges:Retrieve and merge data from multiple sourcesCleanse and transform the dataLoad the data into appropriate data stores for analysis and reportingEnterprises spend 60%–80% of their resources in the data-integration stageDW/BI架构Data Marts and cubesSourceSystemsClientsStagingAreaData WarehouseQuery ToolsReportingAnalysisData Mining1234 Design thePopulate Create Query Data Warehouse Data Warehouse OLAP Cubes Data基本术语ETL（Extract/Transform/Loading）是数据从业务系统抽取转化到数据仓库的过程Metadata可以理解成Data about data，关于数据的数据Staging Area是数据处理区域，为了实现ETL过程的临时存储ETL will cross an important threshold in 2005. Assuming the ETL market maintains 13.5% CAGR, it will pass $1 billion in 2005 at approximately $1.08 billion. Forrester Research Inc. ETL Market Size and ForecastETL Competitive LandscapeETL Magic Quadrant3 types of CompetitorsPureplay/Database/Business IntelligenceGeneral Data Integration is a new, growing market for ETL Twenty percent of ETL tool usage is for non-data warehouse projects (sometimes called general data integration), like database and application consolidation, migration, and synchronization. New business processes and practices will contribute to ETL market growth customer data integration, regulatory reporting, homeland security, master data management, change data capture, RFID dataThe fall of hand-coded ETL accelerates the rise of tool-based ETL The economics of ETL now favor tools over hand coding, thus increasing tool usage. Data warehousing is still the bread and butter of ETL Data warehousing and BI projects continue to drive approximately 80% of ETL usage. Vendors in the ETL, EAI, and EII (E3) spaces will continue consolidation through 2005, but the demand for true convergence will reach a crescendo from th