Building Data WareHouse
by Inmon
Chapter 09: Migration to the Architected Environment




                              http://it-slideshares.blogspot.com
9. Migration to the Architected
Environment
     1. A Migration Plan
     2.   The Feedback Loop
     3.   Strategic Considerations
     4.   Methodology and Migration
     5.   Summary




                             http://it-slideshares.blogspot.com
9.1 A Migration Plan
 Beginning point: Data Model -
  represents the information needs of
  the corporation.
 Data Model needs to identify at a
  minimum:
    ◦ Major subjects of the corporation
    ◦ Definition of the major subjects of the
      corporation
    ◦ Relationships between the major subjects
    ◦ Groupings of keys and attributes that
      more fully represent the major subjects
9.1 A Migration Plan (ct.)
 After having the corporate data
  model, the next activity is defining the
  system of record.
 It is nothing more than the identification
  of the “best” data that the corporation
  has:
    ◦   Most timely
    ◦   Most accurate
    ◦   Most complete
    ◦   Nearest to the external source
    ◦   Most structurally compatible
9.1 A Migration Plan (ct.)
9.1 A Migration Plan (ct.)
   Technological challenges in bringing
    the system-of-record data into the
    DW:
    ◦ A change in DBMS
    ◦ A change in operating systems
    ◦ The need to merge data from different
      DBMSs and operating systems
    ◦ The capture of the Web-based data in the
      Web logs
    ◦ A change in basic data formats
9.1 A Migration Plan (ct.)
 After the system of record is defined, the
  next step is to design the data
  warehouse.
 The following things need to be done:
    ◦ An element of time needs to be added to the
      key structure if one is not already present.
    ◦ All purely operational data needs to be
      eliminated.
    ◦ Referential integrity relationships need to be
      turned into artifacts.
    ◦ Derived data that is frequently needed is
      added to the design.
9.1 A Migration Plan (ct.)
9.1 A Migration Plan (ct.)
 After the data warehouse is
  designed, the next step is to design and
  build the interfaces between the system
  of record and the DW.
 Interfaces’ activities:
    ◦ Being an extract process
    ◦ Integration of data from the
      operational, application-oriented environment
    ◦ Alteration of the time basis of data
    ◦ Condensation of data
    ◦ Efficient scanning of the existing systems
      environment
9.1 A Migration Plan (ct.)
   Once the interface programs are
    designed and built, the next activity is
    to start the population of the first
    subject area:
    ◦ The first of the data is read in the legacy
      environment; and then it is captured and
      transported to the data warehouse
      environment.
    ◦ Directories are updated
    ◦ Metadata is created
    ◦ Indexes are made
                              http://it-slideshares.blogspot.com
9.1 A Migration Plan (ct.)


 Caution: If you
 wait for existing
 systems to be
 cleaned up, you
 will never build a
 data warehouse
9.2 The Feedback Loop
   At the heart of success in the long-term
    development of the data warehouse is the
    feedback loop between the data architect and
    the DSS analyst.
   The DSS analyst:
    ◦ uses the data warehouse as a basis for
      analysis
    ◦ conveys those requirements to the data
      architect
   The data architect:
    ◦ add data, delete data, alter data, and so forth
      based on the recommendations of the DSS
      analyst
                               http://it-slideshares.blogspot.com
9.2 The Feedback Loop
(ct.)




              http://it-slideshares.blogspot.com
9.3 Strategic
       Considerations
   The DW
    environment is
    designed and built
    for the purpose of
    supporting the DSS
    needs of the
    organization.




                         http://it-slideshares.blogspot.com
9.3 Strategic Considerations
     (ct.)
 Besides that, the
  corporation has
  operational needs
  as well.
 But the
  operational world
  is shown as being
  in a state of
  chaos.

                       http://it-slideshares.blogspot.com
9.3 Strategic Considerations
(ct.)
   The steps the data architect takes to
    restructure the operational
    environment:
    ◦   Create a ‘delta’ list
    ◦   The impact analysis
    ◦   Create the resource estimate
    ◦   All the preceding are packaged in a report
        that goes to information systems
        management.

                               http://it-slideshares.blogspot.com
9.3 Strategic Considerations
(ct.)
   Operation cleanup plan:
9.4 Methodology and Migration
 The methodology for the building of
  the data warehouse is called a spiral
  development methodology.
 The spiral methodology not only
  contains information about how to
  build a data warehouse, but also
  describes how to use the data
  warehouse.


                       http://it-slideshares.blogspot.com
9.4 Methodology and Migration
(ct.)
   The differences between the waterfall
    approach and the spiral approach:
9.5 Summary
 The starting point for the design of the data
  warehouse is the corporate data model,.
 The data warehouse is built iteratively.
 The development approach for the data
  warehouse environment is said to be an
  iterative or a spiral development approach.
 The feedback loop between the data
  architect and the end user is an important
  part of the migration process.


                           http://it-slideshares.blogspot.com

More Related Content

PPTX
SOA Course - SOA governance - Lecture 19
PPTX
Lecture 18 - Model-Driven Service Development
PPTX
Lecture 07 - Executive Information Systems and the Data Warehouse
PPT
Lecture 04 - Granularity in the Data Warehouse
PDF
IOUG93 - Technical Architecture for the Data Warehouse - Paper
PDF
Informatica push down optimization implementation
PPTX
Database design (conceptual, logical and physical design) unit 2 part 2
PPT
Architectural Design
SOA Course - SOA governance - Lecture 19
Lecture 18 - Model-Driven Service Development
Lecture 07 - Executive Information Systems and the Data Warehouse
Lecture 04 - Granularity in the Data Warehouse
IOUG93 - Technical Architecture for the Data Warehouse - Paper
Informatica push down optimization implementation
Database design (conceptual, logical and physical design) unit 2 part 2
Architectural Design

What's hot (20)

PPT
Database Life Cycle
PPTX
Database development progress(database)
PPT
Introduction to Data Management
PPT
PPTX
Week 7 Database Development Process
PPT
The Database Environment Chapter 2
PPS
Data Warehouse 102
PPT
The Database Environment Chapter 1
PDF
SOLIDWORKS reseller Whitepaper by Promedia Systems
PPT
Database
PPTX
Database design challenges conflicting goals
PDF
2 data warehouse life cycle golfarelli
PPT
Database 2 External Schema
PDF
Unit 5- Architectural Design in software engineering
PDF
Catalogic DPX: Dashboard Reporting with Microsoft Power BI
PPT
MicroStrategy - Effective Business Dashboards
PPTX
Architectural styles and patterns
DOC
Informatica and datawarehouse Material
PPT
PPTX
Database Life Cycle
Database development progress(database)
Introduction to Data Management
Week 7 Database Development Process
The Database Environment Chapter 2
Data Warehouse 102
The Database Environment Chapter 1
SOLIDWORKS reseller Whitepaper by Promedia Systems
Database
Database design challenges conflicting goals
2 data warehouse life cycle golfarelli
Database 2 External Schema
Unit 5- Architectural Design in software engineering
Catalogic DPX: Dashboard Reporting with Microsoft Power BI
MicroStrategy - Effective Business Dashboards
Architectural styles and patterns
Informatica and datawarehouse Material
Ad

Similar to Lecture 09 - Migration to the Architected Environment (20)

PDF
Database Systems Design Implementation And Management 13th Edition Coronel So...
PPTX
Modern data warehouse presentation
PDF
How to make your data count webinar, 26 Nov 2018
PDF
Database Systems Design Implementation And Management 13th Edition Coronel So...
PDF
Comprehensive Guide to Effective Database Application Development Principles
PPTX
Database Management Systems 2
PDF
Database Systems Design Implementation and Management 12th Edition Coronel So...
PPTX
Cloud migration presentation
PDF
Database Systems Design Implementation and Management 12th Edition Coronel So...
DOC
CV2015_06_30 -NG van Zyl
PDF
Database Systems Design Implementation And Management 13th Edition Coronel So...
PPTX
Agile Data Warehouse Modeling: Introduction to Data Vault Data Modeling
PDF
Database Systems Design Implementation and Management 12th Edition Coronel So...
PPTX
Database development life cycle unit 2 part 1
PDF
INF3703 - Chapter 10 Database Development Process
PPT
Basic and Introduction to DBMS Unit 1 of AU
PDF
Database Systems Design Implementation And Management 13th Edition Coronel So...
DOC
RESUME3
PDF
Data Engineer's Lunch #85: Designing a Modern Data Stack
PDF
Database Systems Design Implementation And Management 13th Edition Coronel So...
Database Systems Design Implementation And Management 13th Edition Coronel So...
Modern data warehouse presentation
How to make your data count webinar, 26 Nov 2018
Database Systems Design Implementation And Management 13th Edition Coronel So...
Comprehensive Guide to Effective Database Application Development Principles
Database Management Systems 2
Database Systems Design Implementation and Management 12th Edition Coronel So...
Cloud migration presentation
Database Systems Design Implementation and Management 12th Edition Coronel So...
CV2015_06_30 -NG van Zyl
Database Systems Design Implementation And Management 13th Edition Coronel So...
Agile Data Warehouse Modeling: Introduction to Data Vault Data Modeling
Database Systems Design Implementation and Management 12th Edition Coronel So...
Database development life cycle unit 2 part 1
INF3703 - Chapter 10 Database Development Process
Basic and Introduction to DBMS Unit 1 of AU
Database Systems Design Implementation And Management 13th Edition Coronel So...
RESUME3
Data Engineer's Lunch #85: Designing a Modern Data Stack
Database Systems Design Implementation And Management 13th Edition Coronel So...
Ad

More from phanleson (20)

PDF
Learning spark ch01 - Introduction to Data Analysis with Spark
PPT
Firewall - Network Defense in Depth Firewalls
PPT
Mobile Security - Wireless hacking
PPT
Authentication in wireless - Security in Wireless Protocols
PPT
E-Commerce Security - Application attacks - Server Attacks
PPT
Hacking web applications
PPTX
HBase In Action - Chapter 04: HBase table design
PPT
HBase In Action - Chapter 10 - Operations
PPT
Hbase in action - Chapter 09: Deploying HBase
PPTX
Learning spark ch11 - Machine Learning with MLlib
PPTX
Learning spark ch10 - Spark Streaming
PPTX
Learning spark ch09 - Spark SQL
PPT
Learning spark ch07 - Running on a Cluster
PPTX
Learning spark ch06 - Advanced Spark Programming
PPTX
Learning spark ch05 - Loading and Saving Your Data
PPTX
Learning spark ch04 - Working with Key/Value Pairs
PPTX
Learning spark ch01 - Introduction to Data Analysis with Spark
PPT
Hướng Dẫn Đăng Ký LibertaGia - A guide and introduciton about Libertagia
PPT
Lecture 1 - Getting to know XML
PPTX
Lecture 4 - Adding XTHML for the Web
Learning spark ch01 - Introduction to Data Analysis with Spark
Firewall - Network Defense in Depth Firewalls
Mobile Security - Wireless hacking
Authentication in wireless - Security in Wireless Protocols
E-Commerce Security - Application attacks - Server Attacks
Hacking web applications
HBase In Action - Chapter 04: HBase table design
HBase In Action - Chapter 10 - Operations
Hbase in action - Chapter 09: Deploying HBase
Learning spark ch11 - Machine Learning with MLlib
Learning spark ch10 - Spark Streaming
Learning spark ch09 - Spark SQL
Learning spark ch07 - Running on a Cluster
Learning spark ch06 - Advanced Spark Programming
Learning spark ch05 - Loading and Saving Your Data
Learning spark ch04 - Working with Key/Value Pairs
Learning spark ch01 - Introduction to Data Analysis with Spark
Hướng Dẫn Đăng Ký LibertaGia - A guide and introduciton about Libertagia
Lecture 1 - Getting to know XML
Lecture 4 - Adding XTHML for the Web

Recently uploaded (20)

PPTX
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
PDF
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
PDF
Weekly quiz Compilation Jan -July 25.pdf
PDF
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
DOCX
Cambridge-Practice-Tests-for-IELTS-12.docx
PDF
Complications of Minimal Access-Surgery.pdf
PDF
Environmental Education MCQ BD2EE - Share Source.pdf
PDF
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
PDF
Trump Administration's workforce development strategy
PDF
HVAC Specification 2024 according to central public works department
PPTX
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
PDF
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
PPTX
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
PDF
Paper A Mock Exam 9_ Attempt review.pdf.
PPTX
B.Sc. DS Unit 2 Software Engineering.pptx
PPTX
20th Century Theater, Methods, History.pptx
PDF
International_Financial_Reporting_Standa.pdf
PPTX
Share_Module_2_Power_conflict_and_negotiation.pptx
PPTX
History, Philosophy and sociology of education (1).pptx
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
Weekly quiz Compilation Jan -July 25.pdf
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
Cambridge-Practice-Tests-for-IELTS-12.docx
Complications of Minimal Access-Surgery.pdf
Environmental Education MCQ BD2EE - Share Source.pdf
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
Trump Administration's workforce development strategy
HVAC Specification 2024 according to central public works department
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
Paper A Mock Exam 9_ Attempt review.pdf.
B.Sc. DS Unit 2 Software Engineering.pptx
20th Century Theater, Methods, History.pptx
International_Financial_Reporting_Standa.pdf
Share_Module_2_Power_conflict_and_negotiation.pptx
History, Philosophy and sociology of education (1).pptx

Lecture 09 - Migration to the Architected Environment

  • 1. Building Data WareHouse by Inmon Chapter 09: Migration to the Architected Environment http://it-slideshares.blogspot.com
  • 2. 9. Migration to the Architected Environment 1. A Migration Plan 2. The Feedback Loop 3. Strategic Considerations 4. Methodology and Migration 5. Summary http://it-slideshares.blogspot.com
  • 3. 9.1 A Migration Plan  Beginning point: Data Model - represents the information needs of the corporation.  Data Model needs to identify at a minimum: ◦ Major subjects of the corporation ◦ Definition of the major subjects of the corporation ◦ Relationships between the major subjects ◦ Groupings of keys and attributes that more fully represent the major subjects
  • 4. 9.1 A Migration Plan (ct.)  After having the corporate data model, the next activity is defining the system of record.  It is nothing more than the identification of the “best” data that the corporation has: ◦ Most timely ◦ Most accurate ◦ Most complete ◦ Nearest to the external source ◦ Most structurally compatible
  • 5. 9.1 A Migration Plan (ct.)
  • 6. 9.1 A Migration Plan (ct.)  Technological challenges in bringing the system-of-record data into the DW: ◦ A change in DBMS ◦ A change in operating systems ◦ The need to merge data from different DBMSs and operating systems ◦ The capture of the Web-based data in the Web logs ◦ A change in basic data formats
  • 7. 9.1 A Migration Plan (ct.)  After the system of record is defined, the next step is to design the data warehouse.  The following things need to be done: ◦ An element of time needs to be added to the key structure if one is not already present. ◦ All purely operational data needs to be eliminated. ◦ Referential integrity relationships need to be turned into artifacts. ◦ Derived data that is frequently needed is added to the design.
  • 8. 9.1 A Migration Plan (ct.)
  • 9. 9.1 A Migration Plan (ct.)  After the data warehouse is designed, the next step is to design and build the interfaces between the system of record and the DW.  Interfaces’ activities: ◦ Being an extract process ◦ Integration of data from the operational, application-oriented environment ◦ Alteration of the time basis of data ◦ Condensation of data ◦ Efficient scanning of the existing systems environment
  • 10. 9.1 A Migration Plan (ct.)  Once the interface programs are designed and built, the next activity is to start the population of the first subject area: ◦ The first of the data is read in the legacy environment; and then it is captured and transported to the data warehouse environment. ◦ Directories are updated ◦ Metadata is created ◦ Indexes are made http://it-slideshares.blogspot.com
  • 11. 9.1 A Migration Plan (ct.)  Caution: If you wait for existing systems to be cleaned up, you will never build a data warehouse
  • 12. 9.2 The Feedback Loop  At the heart of success in the long-term development of the data warehouse is the feedback loop between the data architect and the DSS analyst.  The DSS analyst: ◦ uses the data warehouse as a basis for analysis ◦ conveys those requirements to the data architect  The data architect: ◦ add data, delete data, alter data, and so forth based on the recommendations of the DSS analyst http://it-slideshares.blogspot.com
  • 13. 9.2 The Feedback Loop (ct.) http://it-slideshares.blogspot.com
  • 14. 9.3 Strategic Considerations  The DW environment is designed and built for the purpose of supporting the DSS needs of the organization. http://it-slideshares.blogspot.com
  • 15. 9.3 Strategic Considerations (ct.)  Besides that, the corporation has operational needs as well.  But the operational world is shown as being in a state of chaos. http://it-slideshares.blogspot.com
  • 16. 9.3 Strategic Considerations (ct.)  The steps the data architect takes to restructure the operational environment: ◦ Create a ‘delta’ list ◦ The impact analysis ◦ Create the resource estimate ◦ All the preceding are packaged in a report that goes to information systems management. http://it-slideshares.blogspot.com
  • 17. 9.3 Strategic Considerations (ct.)  Operation cleanup plan:
  • 18. 9.4 Methodology and Migration  The methodology for the building of the data warehouse is called a spiral development methodology.  The spiral methodology not only contains information about how to build a data warehouse, but also describes how to use the data warehouse. http://it-slideshares.blogspot.com
  • 19. 9.4 Methodology and Migration (ct.)  The differences between the waterfall approach and the spiral approach:
  • 20. 9.5 Summary  The starting point for the design of the data warehouse is the corporate data model,.  The data warehouse is built iteratively.  The development approach for the data warehouse environment is said to be an iterative or a spiral development approach.  The feedback loop between the data architect and the end user is an important part of the migration process. http://it-slideshares.blogspot.com