Data-Ed Online: Structuring Your Unstructured Data Document & Content Management

Welcome!
TITLE

Your Documents and Other Content:
Managing Unstructured Data

Date: August 14,
2012
Time: 2:00 PM ET
Presented by: Dr. Peter Aiken

PRODUCED
BY CLASSIFICATION DATE SLIDE
DATA BLUEPRINT 10124-C W. BROAD ST, GLEN ALLEN, VA 23060 EDUCATION 8/14/2012 1
1/26/2010 © Copyright this and previous years by Data Blueprint - all rights reserved!

TITLE
Commonly Asked Questions
1) Will I get copies of the slides after the
event?

YES*

2) Is this being recorded so I can view it
afterwards?
YES*

PRODUCED

Get Social With Us!
TITLE

Live Twitter Feed Like Us on Facebook Join the Group
Join the conversation! www.facebook.com/ Data Management &
Follow us: datablueprint Business Intelligence
@datablueprint Post questions and Ask questions, gain insights
comments and collaborate with fellow
@paiken
Find industry news, insightful data management
Ask questions and submit
content professionals
your comments: #dataed
and event updates.

PRODUCED

TITLE
Meet Your Presenter: Dr. Peter Aiken
• Internationally recognized thought-leader in the
data management field with more than 30 years of
experience
• Recipient of the 2010 International Stevens Award
• Founding Director of Data Blueprint
(http://datablueprint.com)
• Associate Professor of Information Systems at
Virginia Commonwealth University
(http://vcu.edu)

• President of DAMA International
(http://dama.org)
• DoD Computer Scientist, Reverse
Engineering Program Manager/
Office of the Chief Information Officer
• Visiting Scientist, Software Engineering
Institute/Carnegie Mellon University
• 7 books and dozens of articles
• Experienced w/ 500+ data management
practices in 20 countries #dataed
PRODUCED

Your Documents &
Other Content:
Managing
Unstructured Data

Managing non-tabular Data: Document & Content Management
DATA BLUEPRINT 10124-C W. BROAD ST, GLEN ALLEN, VA 23060 EDUCATION 8/14/2012

TITLE
Outline
1. Data Management Overview
2. What is document & content
management and why is it
important?
3. Planning and implementing
document & content management
4. Levels of control
5. Additional considerations
6. Content management building
blocks
7. Guiding Principles Tweeting now:
#dataed
8. Take Aways, References and Q&A
PRODUCED

TITLE
The DAMA Guide to the Data Management Body of Knowledge
Published by
DAMA International
• The professional
association for
Data Managers (40
chapters
worldwide)
DMBoK organized
around
• Primary data
management
functions focused
around data
delivery to the
organization
• Organized around
environmental Data
elements Management
Functions
PRODUCED

TITLE
The DAMA Guide to the Data Management Body of Knowledge

Amazon:
http://
www.amazon.com/
DAMA-Guide-
Management-
Knowledge-DAMA-
DMBOK/dp/
0977140083
Or enter the terms
"dama dm bok" at the
Amazon search
engine

Environmental Elements
PRODUCED

TITLE
Data Management

PRODUCED

TITLE
Data Management
Manage data coherently.

Data Program
Coordination
Share data across boundaries.
Organizational
Data Integration

Data Stewardship Data Development

Assign responsibilities for data.
Engineer data delivery systems.

Data Support
Operations

Maintain data availability.

PRODUCED

TITLE
Data Management

PRODUCED

TITLE
Overview: Document & Content Management

from The DAMA Guide to the Data Management Body of Knowledge © 2009 by DAMA International
PRODUCED

TITLE
Outline
important?
blocks
#dataed
PRODUCED

TITLE
Increasing Scope & Volume of Data Management

5
X
Tabular
and
Non-‐Tabular
Data

1
X
Tabular
Data

PRODUCED

TITLE
Data Management Technology Research

PRODUCED

TITLE
Definition: Document & Content Management
• The control over capture, storage,
access, and use of data and
information stored outside relational
databases
• Focus on integrity and access; roughly
equivalent to data operations
management for relational databases
• Looks beyond the purely operational
focus
• Strategic and tactical focus overlaps with other data
management functions in addressing the need for data
governance, architecture, security, managed meta-
data, and data quality for unstructured data
PRODUCED

TITLE
Definition, cont’d
Two sub-functions of document and content mgmt:
1. Document management:
• The storage, inventory, and control of
electronic and paper documents
• Encompasses the processes,
techniques, and technologies for
controlling and organizing documents
and records (stored electronically and
on paper)
2. Content management:
• The organization, categorization and
structure of data/resources so that they
can be stored, published and reused in
multiple ways
• Sometimes referred to as Enterprise
Content Management (ECM), implying
the scope of content management is
across the entire enterprise
PRODUCED

TITLE
Unstructured (or preferred) Non-tabular Data
• Any document, file, graphic,
image, text, report, form, video,
or sound recording that has not
been tagged or otherwise
structured into rows and
columns or records
• Found in different kinds of
electronic formats, including
word processing, email, flat
files, spreadsheets, XML files,
etc.
• Enormous amount of
unstructured data also exists in
paper files from The DAMA Guide to the Data Management Body of Knowledge © 2009 by DAMA International
PRODUCED

TITLE
Polling Question #2
According to researchers at IDC, 80% of
enterprise data today is unstructured data.
What do you think is the exponential annual
rate at which it is growing?

a) 30%
b) 50%
c) 60+%

d) 90+%

PRODUCED

TITLE
Document/Record Management
• Lifecycle management of the designated
significant documents of the organization
• Records can be physical, electronic or hybrid
• 90%+ of today’s records are electronic:
growth in email and IM has made the
management of electronic records critical to
organizations
• Compliance regulations and statutes:
– U.S. Sarbanes-Oxley Act
– E-Discovery Amendments
– Canada’s Bill 198
PRODUCED

TITLE
Outline
important?
blocks
#dataed
PRODUCED

TITLE
Document/Record Management Lifecycle
Activities:
• Identify existing and
Identify
newly created
documents/records Preserve Create,
and approve,
• Create, approve, and dispose enforce
enforce documents/
records policies
• Classify documents/ Retrieve
records and Classify
circulate
• Retention policy
• Short and long-term
storage Store Retain
• Retrieval and circulation
• Preserve and dispose
PRODUCED

TITLE
Plan for Managing Documents/Records
• Documents management involves planning at
different levels of a document’s lifecycle:

(1) (2) (4)
(3)
Crea(on
or
Organiza(on
Archiving
or

Distribu(on
Receipt
for
Retrieval Disposi(on

• Develop classification/indexing systems and
taxonomies so that documents retrieval is easy
• Create planning and policy around documents and
records on the value of the data to the organization
• Establish, communicate, and enforce policies,
procedures and best practices for documents
PRODUCED

TITLE
Implementing Document/Records Management Systems
• Electronic documents must be
indexed during the capture process
so that they can be found
• A document repository enables
check-in and check-out features,
versioning, collaboration,
comparison, archiving, status
state(s), migration from one
storage media to another, and disposition
• Document storage includes document management
• Documents can be categorized for retrieval
• Reports are delivered through a number of tools, e.g. printers,
email, website, etc.
• Many document management systems include digital asset
management: management of digital assets (audio, video,
music and digital photographs)
PRODUCED

TITLE
Outline
important?
blocks
#dataed
PRODUCED

TITLE

Three Levels of Control
• Levels are based on the criticality of the data and the perceived
harm that would occur if data were corrupted or otherwise
unavailable
• ANSI Standard 859:
1. Formal (most rigid)
• requires formal change initiation
• thorough change evaluation for impact
• decision by a change authority
• Full status accounting of implementation and validation to
stakeholders
2. Revision
• Less formal
• Notify stakeholders and increment versions when a change is
required
3. Custody (least rigid)
• Least formal
• Merely requiring safe storage and a means of retrieval
PRODUCED

TITLE
Three Levels of Control: Example

Sample list of
data assets and
possible control
levels

PRODUCED

TITLE
Determining Levels of Control
• ANSI 859 recommends the following
criteria:
– Cost of providing and updating the asset
– Project impact, when the change has
significant cost or schedule consequences
– Other consequences of change to the
enterprise or project
– Need to reuse the asset or earlier
versions of the asset
– Maintenance of a history of change
PRODUCED

TITLE
Outline
important?
blocks
#dataed
PRODUCED

TITLE
Polling Question #3
What percentage of providers of unstructured
data retain it forever?

a) 25%
b) 45%
c) 65%

d) 85%

PRODUCED

TITLE
Backup and Recovery Plans and Procedures
• The document and content management system needs to be
included as part of the overall corporate backup and recovery
activities for all data and information
• Documents/records manager needs to be involved
• A business continuity plan (Disaster
Recovery Plan) contains written policies,
procedures, and information designed to
mitigate the impact of threats to all media
and to recover them in a minimum amount
of time and disruption
• This requires:
– Identification of vital records
– Development of plans for protection and
recovery
– Maintenance of these plans
PRODUCED

TITLE
Retention and Disposition Programs
A document/records retention
and disposition program:
• Defines the period of time
during which documents/
records must be maintained
• Defines when the documents/
records are not active any
more and can be transferred
to a secondary storage facility
• Specifies the processes for
compliance and the methods
and schedules for the
disposition of documents/
records
PRODUCED

Audits: Example
TITLE

Document/records
management
requires auditing
on a periodic basis
to ensure that the
right information is
getting to the right
people at the right
time for decision
making or performing
operational activities

PRODUCED

TITLE
Audits: Components
• Defining organizational drivers and
identifying the stakeholders that comprise
the “why” of document/records management
• Gathering data on the process (the “how”),
once it is determined what to
examine/measure and what
tools to use
• Reporting the outcomes
• Developing a plan of action
for next steps and timeframes
PRODUCED

TITLE
Outline
important?
blocks
#dataed
PRODUCED

TITLE
Document & Content Management

ü ü ü ü ü ü ü
ü ü ü ü ü ü ü
ü ü ü ü ü ü ü
ü ü ü ü ü ü ü
ü ü ü ü ü ü ü
ü ü ü ü ü ü ü

ü ü ü ü ü ü ü

PRODUCED

TITLE

Goals and Principles
1. To safeguard and ensure the
availability of data assets stored in
less structured formats.
2. To enable effective and efficient
retrieval and use of data and
information in unstructured
formats.
3. To comply with legal obligations
and customer expectations.
4. To ensure business continuity
through retention, recovery, and
conversion.
5. To control document storage
operating costs.
PRODUCED

TITLE
Activities
1. Document/Records Management
– Plan for Managing Documents/Records
– Backup and Recover Documents/Records
– Retain and Dispose of Documents/Records
– Audit Document/Records Management
– Implement Document/Records Management Systems for
Acquisition, Storage, Access, and Security Controls
2. Content Management
– Define and Maintain Enterprise taxonomies
– Document/Index Information Content Metadata
– Provide Content Access and Retrieval
– Govern for Quality Content
PRODUCED

TITLE
Primary Deliverables
• E-discovery records
• Outgoing letters and emails
• Policies and procedures
• Audit trails and logs
• Meeting minutes
• Format reports
• Significant memoranda
• Contracts and financial documents
• Managed records in many media formats
PRODUCED

TITLE
Roles and Responsibilities
Participants: Suppliers:
• All employees • Employees
• Data Stewards
• External parties
• DM Professionals
• Records Management Staff
• Other IT Professionals Consumers:
• Data Management • Business and IT users
Executives
• Government regulatory
• Other IT Managers
agencies
• Chief Information Officer
• Senior management
• Chief Knowledge Officer
• External customers

PRODUCED

TITLE
Technology
• Stored Documents
• Office Productivity Tools
• Records Management Tools
• XML Development Tools
• Collaboration Tools
• Internet
• Email Systems
• Image and Workflow Management Tools

PRODUCED

TITLE
Outline
important?
blocks
#dataed
PRODUCED

Guiding Principles
TITLE

• Everyone in the organization
must create, use, retrieve,
and dispose of records in
accordance with the
established policies and procedures
• Experts in the handling of records and content
should be fully engaged in policy and planning
• Even if records management professionals are
not available to the organization, everyone can
be trained and have an understanding of the
issues. Once trained, business stewards and
others can collaborate on an effective approach
to records management from The DAMA Guide to the Data Management Body of Knowledge © 2009 by DAMA International
PRODUCED

TITLE
Outline
important?
blocks
#dataed
PRODUCED

TITLE
Overview: Document & Content Management

PRODUCED

TITLE
References

PRODUCED

TITLE
References, cont’d

PRODUCED

TITLE
Questions?

+ =

It’s your turn!
Use the chat feature or Twitter (#dataed) to submit
your questions to Peter now.

PRODUCED

TITLE
Upcoming Events
September Webinar:
Let’s Talk Metadata:
Strategies and Successes
September 11, 2012 @ 2:00 PM – 3:30 PM ET
(11:00 AM-12:30 PM PT)
October Webinar:
Engineering Solutions to Data Quality Challenges
October 9, 2012 @ 2:00 PM – 3:30 PM ET
(11:00 AM-12:30 PM PT)
Sign up here:
• www.datablueprint.com/webinar-schedule
• www.Dataversity.net
Brought to you by:

PRODUCED

Data-Ed Online: Structuring Your Unstructured Data Document & Content Management

More Related Content

What's hot (8)

Viewers also liked (7)

Similar to Data-Ed Online: Structuring Your Unstructured Data Document & Content Management (20)

More from DATAVERSITY (20)

Recently uploaded (20)

Data-Ed Online: Structuring Your Unstructured Data Document & Content Management