Taxonomy and tagging – manual tagging does not work!
1 like581 views
Concept Searching, founded in 2002, specializes in managing structured and unstructured information through its advanced technology platforms, delivering automated metadata generation, content tagging, and taxonomy management. The company emphasizes the inadequacies of manual tagging, which often leads to poor searchability and compliance issues, advocating for its automated solutions that enhance productivity and reduce costs. They serve a diverse client base, including Fortune 500 companies and government agencies, providing innovative tools that streamline content governance and improve information retrieval.
Taxonomy and tagging – manual tagging does not work!
- 1. © Concept Searching 2016 Taxonomy and Tagging – Manual Tagging Does Not Work Paul Billingham Director of Sales, Europe Concept Searching paulb@conceptsearching.com www.conceptsearching.com marketing@conceptsearching.com Twitter @conceptsearch
- 2. © Concept Searching 2016 • Company founded in 2002 • Product launched in 2003 • Focus on management of structured and unstructured information • Profitable, debt free • Technology Platform • Delivered as a web service • Automatic concept identification, content tagging, auto-classification, taxonomy management • Only statistical vendor that can extract conceptual metadata • 9 years KMWorld ‘100 Companies that Matter in Knowledge Management’ 7 years KMWorld ‘Trend Setting Product’ • Authority to Operate enterprise wide US Air Force, NETCON US Army, and Canadian SLSA • Locations: US, UK, and South Africa • Client base: Fortune 500/1000 organizations • Microsoft Gold Certification in Application Development, Microsoft Business-Critical SharePoint program partner • Smart Content Framework™ for Information Governance comprising • conceptClassifier for SharePoint and conceptClassifier for Office 365 • Concept Searching Technology Platform and conceptClassifier Platform • Add on – conceptTaxonomyWorkflow and conceptClassifier for OneDrive for Business The Global Leader in Managed Metadata Solutions
- 3. © Concept Searching 2016 Agenda • What is the problem with metadata? • Unique concept-based approach • The manual approach to tagging • Business benefits and customer examples • Demonstration of conceptTaxonomyManager • Adding clues • Adding sub nodes • Summary
- 4. © Concept Searching 2016 What Problem Do We Solve? It’s all about metadata…. “The metadata infrastructure provides the critical glue that binds the information infrastructure to the underlying IT infrastructure. Sound information governance practices would take advantage of the metadata infrastructure to ensure that content and data are managed consistently and adhere to written policies, across on-premise and cloud based environments.” 2010 IDC Digital Universe Study
- 5. © Concept Searching 2016 Concept Searching’s technology platforms deliver semantic metadata generation, auto-classification and taxonomy management, and taxonomy workflow What Do We Do? The resulting classification metadata is used by clients to deliver ‘intelligent metadata solutions’ in areas such as enhanced search, migration, data privacy, records management, policy enforcement, compliance, text analytics, and business and social collaboration The platform is based on an open architecture with all APIs based on XML and Web Services. It integrates with content repositories, search engines and file shares, enabling our clients to add structure and manage their enterprise content, regardless of environment
- 6. © Concept Searching 2016 • Concept Searching’s unique statistical concept identification underpins all technologies • Multi-word suggestion is explicitly more valuable than single term suggestion algorithms Concept Searching has a unique approach to ensure success • conceptClassifier for SharePoint will generate conceptual metadata by extracting multi-word terms that identify ‘triple heart bypass’ as a concept as opposed to single keywords • Metadata can be used by any search engine index or any application/process that uses metadata Concept Searching provides Automatic Concept Term Extraction Triple Baseball Three Heart Organ Center Bypass Highway Avoid Unique Approach
- 7. © Concept Searching 2016 Manual Tagging is a Behavior Modification Problem conceptClassifier automates the tagging process to remove the behavior modification problem of manual tagging for governance, findability and migration • Increases productivity, improves ‘findability’, automates ‘governance’, and migrates content • Organizes intellectual assets and provides a factor of improvement for end users to find company information with an automated tagging approach for any search platform • Improves ability to target content through EMM/TS with SharePoint • Improves SharePoint Portal Adoption • Aligns content with governance polices and federally mandated requirements • Intelligently migrates content into and out of SharePoint • Mitigates risk • Reduces federal governance, corporate information policy, and personally identifiable information exposures while improving eDiscovery audit capabilities and ensuring alignment with content retention policies • Lowers cost of administration • Leverages native integration to Microsoft stack, manages migration of GUIDs • Lowers cost of ownership to build out and administer EMM/Term Store • Intelligent content migration • Intuitive user interface for easy product adoption
- 8. © Concept Searching 2016 93% of Organizations Still Use Manual Tagging Issue Organizational Impact Inconsistent Less than 50% of content is correctly indexed, meta-tagged or efficiently searchable rendering it unusable to the organization (IDC) Subjective Highly trained information specialists will agree on meta tags between 33%-50% of the time (C. Cleverdon) Cumbersome – expensive Average cost of manually tagging one item runs from $4 - $7 per document and does not factor in the accuracy of the meta tags nor the repercussions from mistagged content (Hoovers) Malicious compliance End users select first value in list (Perspectives on Metadata, Sarah Courier) No perceived value for end user What’s in it for me? End user creates document, does not see value for organization nor risks associated with litigation and non-conformance to policies What you have seen Metadata will continue to be a problem due to inconsistent human behavior Manual Approach Leads to Failure
- 9. © Concept Searching 2016 • Upload documents • Automatic classification (IPSV Taxonomy) • Routing based on the classification (FOUO, PII, ITAR, RM) Office 365 Screen Shot
- 10. © Concept Searching 2016 USAF Human Performance Clearinghouse GOAL: Leverage Existing USAF, AFDW, and AFMS License Agreements to Enable IM, RM, and Privacy and Security Compliance Requirements • DoDD 8320 (Data Sharing in a Net-Centric DoD) • DoDD 5015 (Records Management) • USAF Privacy Act Program & HIPAA • Freedom of Information Act (FOIA) Distribution Statement A: Approved for public release; distribution is unlimited. 311 ABG/PA No. 09-488, 16 Oct 2009 MigrationMigration Data Privacy Records Management Search eDiscovery & FOIA Distribution Statement A: Approved for public release; distribution is unlimited. 311 ABG/PA No. 09-488, 16 Oct 2009
- 11. © Concept Searching 2016 Business Drivers Achieved • Three areas • Business Impact • IT Impact • Process Impact • Most enterprises will see highest ROI from Process Impact Business Impact (Money, Agility, Strategy) IT Impact (Solution) Process Impact (Time)
- 12. © Concept Searching 2016 Metadata Enabled Solution Deployments Deploying Metadata Tags for Security, Retention, PII, and Intelligent Migration • NATO • Metadata driven intelligent search • Metadata driven document security • US Air Force – on APL with current ATO Enterprise Deployment NIPR and SIPR – DoD • AFMS Knowledge Exchange (2005) PII Identification • 711th Human Performance Wing (Air Force Research Lab) (2004) Metadata driven program Management • 88th Medical Group (Wright-Patterson AFB) Metadata driven PII 7 PHI identification for JCAHO compliance • Enterprise Information Services PEO/ Metadata driven Records identification and tagging • OppenheimerFunds • Legacy data cleansing • Metadata driven intelligent migration and routing of content • Metadata enabled intelligent search • eDiscovery and compliance • EY – Professional Services • Metadata driven intelligent search • Intelligent migration • Metadata driven sensitive information identification • Government Communications Security Bureau (NZ) Intelligence Community • Metadata driven intelligent migration and routing of content to analysts from web and file Share sources • Metadata enabled intelligent search • Metadata driven document security • Southern Union Company – Oil and Gas • Metadata driven intelligent migration of content • Metadata driven Records identification and tagging • Metadata driven PII “Concept Searching’s ability to identify concepts, as opposed to traditional single word classification, creates more accurate metadata and can be deployed in a variety of business scenarios based on the needs of the enterprise.” Jared Spataro, General Manager, Microsoft Office
- 13. © Concept Searching 2016 conceptTaxonomyManager Demonstration • Review how the clues classify documents (fuzzy phrase matching) • Add a new node, add new clues (automatic clue suggestion) • Build additional sub nodes that are relevant to the business
- 14. © Concept Searching 2016 Situation: • Global development organisation • Key information in multiple places in multiple systems - in over 93,000 records and library entries • Corporate portal, built on a SharePoint platform, needed to be a window onto the data to enable up to 1,500 employees access to information Challenge: • An efficient way of capturing and compiling information throughout the lifecycle of the business • From market intelligence to proposal development to project implementation Solution: • conceptSearch and conceptClassifier for SharePoint • Integrated solution with partner PPC Benefits: • Improved search results • Increased findability • Global data sharing • Time saving “Forty years, thousands of projects and proposals, and tens of thousands of contacts means that lots of information resides in lots of different places. Access to this information is key. While no system will write a proposal for us, conceptClassifier for SharePoint is helping us to aggregate and focus on the data that is most relevant to the task at hand, pointing staff in the right direction and helping them identify ‘what we know and how we know it.’” Steven O’Connor, Director of Communications, DAI Read the Case Study Building Blocks Metadata, Insight, Governance
- 15. © Concept Searching 2016 Situation: • Internet based market intelligence products and services • Reports from over 720 top publishers to deliver instant online access to the most complete, current database of expert insights • Research specialists have in-depth knowledge of publishers, types of reports, and industries Challenge: • Reports classified manually • Poor classification and search capabilities • Numerous reports and categories • Complicated, resource intensive, and time consuming processes Solution: • conceptSearch and conceptTaxonomyManager Benefits: • Increased efficiency • Reduced costs • Improved search quality • Automation “Concept Searching offered a very compelling solution based on taxonomy tools, clue-based suggestions, and the capability of integrating within our own existing framework. And the introduction of their tools with our architecture greatly increased both the quality and quantity of reports for our clients.” Valerio Zanini, VP of Technology, MarketResearch.com Read the Case Study Building Blocks Metadata, Insight, Governance
- 16. © Concept Searching 2016 Situation: • Not-for-profit organization that contributes to the prevention and cure of cancer • More than 30,000 users • Outpatient treatment programs that record more than 328,300 visits a year Challenge: • Portal to enable patients to access information relevant to their specific health situations • Accurate, medically sound, and secure information necessary Solution: • conceptClassifier, conceptTaxonomyManager, Microsoft FAST Search • Integrated solution with partner Aeturnum Benefits: • Accuracy of search • Relevance of results • Confidence in data • Control and trust “With more than 30,000 current users, the MyMoffitt Patient Portal has seen significant growth, and of the new patients that come to Moffitt, 87% register for a patient portal account. All developments and enhancements are about improving the patient experience.” Jennifer Camps, Director of Portal Technologies and Data Management, Moffitt Cancer Center Read the Case Study Building Blocks Metadata, Insight, Governance
- 17. © Concept Searching 2016 Situation: • 23,000 registered users • 800 virtual workspaces and communities of practice • Share and disseminate mission critical information and technical excellence • Collaboration Challenge: • Poor search results • No collaboration capabilities • Security and control of content assets for each end user Solution: • Partner Triune Group provided the collaboration platform • conceptSearch embedded into the solution Benefits: • Accuracy of search and relevant results • Confidence in data • Increase in quality of decision making “With the integration of the Concept Searching intelligent search capability, Triune Group was able to provide us with a robust and scalable collaboration tool that delivers not only powerful advanced searching capabilities, but also a controlled and secure environment.” Brian Follen NASA Safety Center (NSC) KnowledgeNow Program Manager Read the Case Study Building Blocks Metadata, Insight, Policy, Governance
- 18. © Concept Searching 2016 Situation: • RMDA provides oversight and program management for the Army’s Records management program • Post Traumatic Stress Disorder Case support Challenge: • Large workload and backlog • Content spread across databases, file systems, embedded emails, TIFF files, etc. • Ability to control classified and un-classified information Solution: • Integrated solution by partner COMPU-DATA International • Combined their DAF product with Concept Searching technology suite • conceptSearch, conceptClassifier, conceptTaxonomyManager Benefits: • Terabyte size data store support • Scalable architecture to meet future needs • Increased productivity • Centralized data standardization “The RMDA can now easily load millions of records and automatically classify these against multiple taxonomies simultaneously, while having the ability to easily expand the system configuration through its modular and scalable architecture.” Read the Case Study Building Blocks Metadata, Insight, Governance
- 19. © Concept Searching 2016 Situation: • One of the largest and most respected investment management companies • $163 billion in assets and over 11 million shareholder accounts • Highly regulated industry Challenge: • Standardize on SharePoint 2010 and FAST • Automatically tag unstructured content • Manage content through taxonomies • Native integration with SharePoint 2010 • FAST integration • Assist with migration from MOSS Solution: • conceptClassifier for SharePoint Benefits: • Cleanse content existing in multiple repositories during migration to SharePoint 2010 • Eliminate subjective end user tagging • Improve search results • Native integration with the SharePoint 2010 Term Store Building Blocks Metadata, Insight, Policy, Governance
- 20. © Concept Searching 2016 Situation: • Business and technology service company headquartered in the UK • 41,000 users (now 70,000) • Now CGI Challenge: • Inability to find and re-use content • Eliminate manual tagging • Improve search results Solution: • conceptClassifier for SharePoint Benefits: • Competitive advantages • Ability to find relevant information • Ability to re-use published information • Eliminate end-user tagging to improve consistency • Content automatically classified to one or more taxonomies “The ‘Logica Library’ is Logica’s global publishing repository. It’s organised into different sections, e.g. Marketing Collateral, Reference Stories, Bid Knowledge etc, and allows staff to publish documents for re-use. Concept Searching automatically classifies content using Logica’s global taxonomies. This provides non-subjective tagging of content using standard terms, and means that when Logica changes its taxonomy structure (e.g. to add emerging markets or technologies), there’s no need to manually re-visit/re-tag content.” Pete Blundson, Group KM Programme Manager, Logica Building Blocks Metadata, Insight, Enterprise 2.0
- 21. © Concept Searching 2016 Thanks to the Sponsors!
- 22. © Concept Searching 2016 Thank You Paul Billingham Director of Sales, Europe Concept Searching paulb@conceptsearching.com www.conceptsearching.com marketing@conceptsearching.com Twitter @conceptsearch