SlideShare a Scribd company logo
3
Most read
4
Most read
http://informationaction.blogspot.com
Tw: @Alan_D_Duncan
Information Strategy | Data Governance | Analytics | Better Business Outcomes
Example Data Specifications &
Information Requirements Framework
TRANSFORMATION LOGIC TEMPLATE
(Source to Target Mapping)
Alan D. Duncan
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Transformation Logic Template (Source to Target Mapping)
http://informationaction.blogspot.com
Tw: @Alan_D_Duncan
Information Strategy | Data Governance | Analytics | Better Business Outcomes
1 Purpose
This document template defines an outline structure for the clear and unambiguous definition of
transmission of data between one data storage location to another.
This template forms part of example data specification & information requirements framework. The
framework offers a set of outline principles, standards and guidelines to describe and clarify the
semantic meaning of data terms in support of an Information Requirements Management process.
(See the Framework Overview for further details.)
Transformation Logic Template (Source to Target Mapping)
http://informationaction.blogspot.com
Tw: @Alan_D_Duncan
Information Strategy | Data Governance | Analytics | Better Business Outcomes
2 Transformation Logic (Source to Target Mapping)
 It is anticipates that at times, data will be transmitted from one data storage location (the
“source”) to another (the “target”).
 Similar specification is required for the mapping of such data transfer, regardless of the
mechanism used to execute the transmission (e.g. ETL, ELT and ESB transport
mechanisms.)
Specification Item Purpose
Source Table Name(s)
The database table name(s) of the data source (or file name in file-based
data stores)
(NB: Should also capture details of the access path.)
Source Column
Name(s)
The database column(s) of the source (or field name/positions in file-
based data stores)
Target Table Name(s)
The database table name(s) of the target data structure.
Should also capture details of the access path.
Target Column
Name(s)
The database column(s) of the target data structure
Transformation Logic
The logical expression of how the data will be transmitted from the
source to the target, including any transformation rules to be applied.
Recognise that multiple sources could be merged into one target, or vice
versa.
Source Output Timing
Cover Timing of extraction / Extraction Method Details (may in part be
covered at Data Store level)
 Good data management and data governance practices require that the Source to Target
mapping of any data solution align with the Enterprise Logical (Canonical) Model.
 Data designers must therefore clearly demonstrate that the data transformation logic within
any data system of business application map to and align with the Logical Model.
 Beyond this requirement, Data Governance is not concerned with the technical details of data
management implementation, and therefore takes no specific interest in the physical design
or technical structure of any data processing layers.
 Where a system exposes data structures that are not explicitly relational, documentation
should be structured as if the data was stored in a relational manner.
 Notwithstanding, the expectations of auditability, traceability and persistence must be
demonstrated.
Transformation Logic Template (Source to Target Mapping)
http://informationaction.blogspot.com
Tw: @Alan_D_Duncan
Information Strategy | Data Governance | Analytics | Better Business Outcomes
Appendix A: Column Domains – Candidate list
Name Definition
Amount A Monetary Amount. i.e. a Quantity of a CURRENCY
Code A character string or number which is used for identification purposes.
* has no explicit natural language meaning - i.e. not an English word
Cost/Revenue Amount An Amount of a Currency where:
* positive = Revenue
* negative = Cost
Count
Date
Date/Time specification of seconds ?
Day of Month
Day of Week
Days A number of days.
Description A brief text description.
Details Data with embedded meaning and of a complex format but for which the
meaning cannot be consistently interpreted by a computer system.
Direction Direction of an accounted balance.
DR/CR Amount An Amount of a Currency where:
* positive = DR
* negative = CR
Email Address
External Reference A code or reference for which the format is specified by an external party.
Factor A rate/proportion/ratio in the range 0 to a maximum value.
Frequency EXAMPLES Annual, Half Year, Quarterly, Monthly, Weekly, Daily, Ad Hoc
Indicator Binary Indicator - Yes or No.
Name A meaningful word or phrase used for identification purposes.
Notes Textual Notes.
Ordinal A number indicating a position within a sequence of numbers.
Phone International
Quantity A number of units.
Rate A rate/proportion/percentage.
Status A number or character string used to indicate a state which is likely to change
over time.
Time
Type A number or character string used for classification with a discrete set of
values per column.
* could be an English word or phrase
Year A calendar year. E.g. 2002
Year/Month A month in a specific year. E.g. November 2002
Transformation Logic Template (Source to Target Mapping)
http://informationaction.blogspot.com
Tw: @Alan_D_Duncan
Information Strategy | Data Governance | Analytics | Better Business Outcomes
About the author
Alan D. Duncan is an evangelist for information and analytics as
enablers of better business outcomes, and a member of the
Advisory Board for QFire Software.
An executive-level leader in the field of Information and Data
Management Strategy, Governance and Business Analytics, he
has over 20 years of international business experience, working
with blue-chip companies in a range of industry sectors. Alan
was named by Information-Management.com in their 2012 list of
“Top 12 Data Governance gurus you should be following on
Twitter”.
Twitter: @Alan_D_Duncan
Blog: http://informationaction.blogspot.com.au/
Transformation Logic Template (Source to Target Mapping)
http://informationaction.blogspot.com
Tw: @Alan_D_Duncan
Information Strategy | Data Governance | Analytics | Better Business Outcomes
Intellectual curiosity
Skeptical scrutiny
Critical thinking
http://www.informationaction.blogspot.com.au/
@Alan_D_Duncan
http://www.linkedin.com/in/alandduncan

More Related Content

DOCX
Example data specifications and info requirements framework OVERVIEW
DOCX
04. Logical Data Definition template
PPT
Gartner: Master Data Management Functionality
PDF
Enterprise Data Management
DOCX
02. Information solution outline template
PDF
Data Profiling, Data Catalogs and Metadata Harmonisation
DOCX
05. Physical Data Specification Template
PDF
Five Things to Consider About Data Mesh and Data Governance
Example data specifications and info requirements framework OVERVIEW
04. Logical Data Definition template
Gartner: Master Data Management Functionality
Enterprise Data Management
02. Information solution outline template
Data Profiling, Data Catalogs and Metadata Harmonisation
05. Physical Data Specification Template
Five Things to Consider About Data Mesh and Data Governance

What's hot (20)

ODP
Dimensional Modelling
PDF
Data Audit Approach To Developing An Enterprise Data Strategy
PDF
Data Catalog for Better Data Discovery and Governance
PDF
Data Warehouse or Data Lake, Which Do I Choose?
DOCX
03. Business Information Requirements Template
PDF
Data Modeling & Metadata Management
PPTX
Introduction to Data Engineering
PDF
Future of Data Engineering
PPTX
Data Governance
PPT
Data Governance in a big data era
PDF
Mdm: why, when, how
PPT
5 Level of MDM Maturity
PDF
Data Catalogues - Architecting for Collaboration & Self-Service
PPTX
How to Build & Sustain a Data Governance Operating Model
PPTX
Master Data Management methodology
PPTX
Data Vault Overview
PDF
Data Governance and Metadata Management
PDF
Data Marketplace and the Role of Data Virtualization
PDF
Data Catalog as a Business Enabler
PDF
Why data governance is the new buzz?
Dimensional Modelling
Data Audit Approach To Developing An Enterprise Data Strategy
Data Catalog for Better Data Discovery and Governance
Data Warehouse or Data Lake, Which Do I Choose?
03. Business Information Requirements Template
Data Modeling & Metadata Management
Introduction to Data Engineering
Future of Data Engineering
Data Governance
Data Governance in a big data era
Mdm: why, when, how
5 Level of MDM Maturity
Data Catalogues - Architecting for Collaboration & Self-Service
How to Build & Sustain a Data Governance Operating Model
Master Data Management methodology
Data Vault Overview
Data Governance and Metadata Management
Data Marketplace and the Role of Data Virtualization
Data Catalog as a Business Enabler
Why data governance is the new buzz?
Ad

Similar to 06. Transformation Logic Template (Source to Target) (20)

PPT
David Reeve - UKAD 2016 forum
PDF
Data Governance for the Executive
PPTX
NTEN Your Analytics doesn't have to be dramatic to be useful
PPTX
Data Governance That Drives the Bottom Line
PPTX
Foundation of information system
PDF
A Roadmap to Data Migration Success
PPTX
Master Data Management.pptx
PPTX
Hair_PPT_Ch02.pptx marketing analytics12
PPT
Databases
PPT
Databases
PPTX
Data Governance Goal Framework Alignment.pptx
PPTX
An Agile & Adaptive Approach to Addressing Financial Services Regulations and...
PDF
Mergers and acquisitions
PDF
Mergers and acquisitions for screen
PPTX
Managing Data For Efficiency.pptx and in
PPTX
Geek Sync | 5 Best Practices for Operationalizing Data Governance
PDF
Get started with data migration
PPTX
Data Governance Overview - Doreen Christian
David Reeve - UKAD 2016 forum
Data Governance for the Executive
NTEN Your Analytics doesn't have to be dramatic to be useful
Data Governance That Drives the Bottom Line
Foundation of information system
A Roadmap to Data Migration Success
Master Data Management.pptx
Hair_PPT_Ch02.pptx marketing analytics12
Databases
Databases
Data Governance Goal Framework Alignment.pptx
An Agile & Adaptive Approach to Addressing Financial Services Regulations and...
Mergers and acquisitions
Mergers and acquisitions for screen
Managing Data For Efficiency.pptx and in
Geek Sync | 5 Best Practices for Operationalizing Data Governance
Get started with data migration
Data Governance Overview - Doreen Christian
Ad

More from Alan D. Duncan (8)

PPTX
Igqie14 analytics and ethics 20141107
PDF
The one question you must never ask!" (Information Requirements Gathering for...
PDF
Data Quality in Data Warehouse and Business Intelligence Environments - Disc...
DOCX
07. Analytics & Reporting Requirements Template
PDF
LL Higher Ed BI 2014 Key BI Market Trends 20140513a
PDF
Managing for Effective Data Governance: workshop for DQ Asia Pacific Congress...
PDF
WHITE PAPER: Distributed Data Quality
PDF
The ABC of Data Governance: driving Information Excellence
Igqie14 analytics and ethics 20141107
The one question you must never ask!" (Information Requirements Gathering for...
Data Quality in Data Warehouse and Business Intelligence Environments - Disc...
07. Analytics & Reporting Requirements Template
LL Higher Ed BI 2014 Key BI Market Trends 20140513a
Managing for Effective Data Governance: workshop for DQ Asia Pacific Congress...
WHITE PAPER: Distributed Data Quality
The ABC of Data Governance: driving Information Excellence

Recently uploaded (20)

PPTX
1_Introduction to advance data techniques.pptx
PDF
Foundation of Data Science unit number two notes
PDF
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
PDF
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
PDF
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
PPTX
MODULE 8 - DISASTER risk PREPAREDNESS.pptx
PPTX
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
PDF
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
PPTX
Moving the Public Sector (Government) to a Digital Adoption
PPTX
Data_Analytics_and_PowerBI_Presentation.pptx
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
PPTX
Business Acumen Training GuidePresentation.pptx
PDF
.pdf is not working space design for the following data for the following dat...
PDF
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
PDF
Lecture1 pattern recognition............
PPTX
Introduction-to-Cloud-ComputingFinal.pptx
PDF
Fluorescence-microscope_Botany_detailed content
PPTX
IB Computer Science - Internal Assessment.pptx
PPTX
Computer network topology notes for revision
1_Introduction to advance data techniques.pptx
Foundation of Data Science unit number two notes
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
MODULE 8 - DISASTER risk PREPAREDNESS.pptx
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
Moving the Public Sector (Government) to a Digital Adoption
Data_Analytics_and_PowerBI_Presentation.pptx
Acceptance and paychological effects of mandatory extra coach I classes.pptx
Business Acumen Training GuidePresentation.pptx
.pdf is not working space design for the following data for the following dat...
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
Lecture1 pattern recognition............
Introduction-to-Cloud-ComputingFinal.pptx
Fluorescence-microscope_Botany_detailed content
IB Computer Science - Internal Assessment.pptx
Computer network topology notes for revision

06. Transformation Logic Template (Source to Target)

  • 1. http://informationaction.blogspot.com Tw: @Alan_D_Duncan Information Strategy | Data Governance | Analytics | Better Business Outcomes Example Data Specifications & Information Requirements Framework TRANSFORMATION LOGIC TEMPLATE (Source to Target Mapping) Alan D. Duncan This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
  • 2. Transformation Logic Template (Source to Target Mapping) http://informationaction.blogspot.com Tw: @Alan_D_Duncan Information Strategy | Data Governance | Analytics | Better Business Outcomes 1 Purpose This document template defines an outline structure for the clear and unambiguous definition of transmission of data between one data storage location to another. This template forms part of example data specification & information requirements framework. The framework offers a set of outline principles, standards and guidelines to describe and clarify the semantic meaning of data terms in support of an Information Requirements Management process. (See the Framework Overview for further details.)
  • 3. Transformation Logic Template (Source to Target Mapping) http://informationaction.blogspot.com Tw: @Alan_D_Duncan Information Strategy | Data Governance | Analytics | Better Business Outcomes 2 Transformation Logic (Source to Target Mapping)  It is anticipates that at times, data will be transmitted from one data storage location (the “source”) to another (the “target”).  Similar specification is required for the mapping of such data transfer, regardless of the mechanism used to execute the transmission (e.g. ETL, ELT and ESB transport mechanisms.) Specification Item Purpose Source Table Name(s) The database table name(s) of the data source (or file name in file-based data stores) (NB: Should also capture details of the access path.) Source Column Name(s) The database column(s) of the source (or field name/positions in file- based data stores) Target Table Name(s) The database table name(s) of the target data structure. Should also capture details of the access path. Target Column Name(s) The database column(s) of the target data structure Transformation Logic The logical expression of how the data will be transmitted from the source to the target, including any transformation rules to be applied. Recognise that multiple sources could be merged into one target, or vice versa. Source Output Timing Cover Timing of extraction / Extraction Method Details (may in part be covered at Data Store level)  Good data management and data governance practices require that the Source to Target mapping of any data solution align with the Enterprise Logical (Canonical) Model.  Data designers must therefore clearly demonstrate that the data transformation logic within any data system of business application map to and align with the Logical Model.  Beyond this requirement, Data Governance is not concerned with the technical details of data management implementation, and therefore takes no specific interest in the physical design or technical structure of any data processing layers.  Where a system exposes data structures that are not explicitly relational, documentation should be structured as if the data was stored in a relational manner.  Notwithstanding, the expectations of auditability, traceability and persistence must be demonstrated.
  • 4. Transformation Logic Template (Source to Target Mapping) http://informationaction.blogspot.com Tw: @Alan_D_Duncan Information Strategy | Data Governance | Analytics | Better Business Outcomes Appendix A: Column Domains – Candidate list Name Definition Amount A Monetary Amount. i.e. a Quantity of a CURRENCY Code A character string or number which is used for identification purposes. * has no explicit natural language meaning - i.e. not an English word Cost/Revenue Amount An Amount of a Currency where: * positive = Revenue * negative = Cost Count Date Date/Time specification of seconds ? Day of Month Day of Week Days A number of days. Description A brief text description. Details Data with embedded meaning and of a complex format but for which the meaning cannot be consistently interpreted by a computer system. Direction Direction of an accounted balance. DR/CR Amount An Amount of a Currency where: * positive = DR * negative = CR Email Address External Reference A code or reference for which the format is specified by an external party. Factor A rate/proportion/ratio in the range 0 to a maximum value. Frequency EXAMPLES Annual, Half Year, Quarterly, Monthly, Weekly, Daily, Ad Hoc Indicator Binary Indicator - Yes or No. Name A meaningful word or phrase used for identification purposes. Notes Textual Notes. Ordinal A number indicating a position within a sequence of numbers. Phone International Quantity A number of units. Rate A rate/proportion/percentage. Status A number or character string used to indicate a state which is likely to change over time. Time Type A number or character string used for classification with a discrete set of values per column. * could be an English word or phrase Year A calendar year. E.g. 2002 Year/Month A month in a specific year. E.g. November 2002
  • 5. Transformation Logic Template (Source to Target Mapping) http://informationaction.blogspot.com Tw: @Alan_D_Duncan Information Strategy | Data Governance | Analytics | Better Business Outcomes About the author Alan D. Duncan is an evangelist for information and analytics as enablers of better business outcomes, and a member of the Advisory Board for QFire Software. An executive-level leader in the field of Information and Data Management Strategy, Governance and Business Analytics, he has over 20 years of international business experience, working with blue-chip companies in a range of industry sectors. Alan was named by Information-Management.com in their 2012 list of “Top 12 Data Governance gurus you should be following on Twitter”. Twitter: @Alan_D_Duncan Blog: http://informationaction.blogspot.com.au/
  • 6. Transformation Logic Template (Source to Target Mapping) http://informationaction.blogspot.com Tw: @Alan_D_Duncan Information Strategy | Data Governance | Analytics | Better Business Outcomes Intellectual curiosity Skeptical scrutiny Critical thinking http://www.informationaction.blogspot.com.au/ @Alan_D_Duncan http://www.linkedin.com/in/alandduncan