User Experiences of Enterprise Semantic Content Management
Download as PPT, PDF0 likes356 views
The document discusses the challenges of managing disparate information in enterprise semantic content management, particularly in contexts like flight safety and passenger information analysis. It details how semantic technologies, such as Voquette, enable quick access to actionable insights by aggregating and correlating diverse data sources, enhancing decision-making processes for various user types, including end users and enterprise developers. Additionally, it outlines the need for dynamic content enhancement and automatic classification to improve user experiences in navigating vast amounts of information.
User Experiences of Enterprise Semantic Content Management
- 1. User Experiences of Enterprise Semantic Content Management Amit Sheth Panel at Symposium on the User Experience of Business Intelligence & Knowledge Management, IBM Almaden Research Center, San Jose, March 18, 2000. University of Georgia
- 2. The Problem: Massive, disparate information everywhere Multiple isolated sources of information that are not shared or integrated Large variety of open source, partner, proprietary and extranet information Multiple formats (Text, HTML, XML, PDF, etc.) Diverse structure (structured, semi-structured, unstructured) Multiple media (Text, Audio, Video, Images, etc.) Diverse Communication Channels (FTP, extraction for source, etc.) The Difficulty & Challenges: Inability to have timely actionable information Overwhelming amount of information -> in-context, relevant information Timely, accurate, personalized & actionable decisions Advanced Content Management Challenges
- 3. Knowledge Discovery/Management Requirements The Problem: Aggregation and corelation of passenger/flight information Correlate/link huge volumes of information Integrated knowledge applications with diverse response to different end users Response in near real-time The Challenge: To build a knowledge linking and discovery system that automatically detects hidden relationships Intelligent analysis of multiple available sources of information Customized knowledge applications targeting diverse needs of different users Intelligent analysis of valuable information to provide actionable insight Scalable and near real-time system
- 4. Visionics AcSys Security Portal Check-in Interrogation Boarding Gate Airport Airspace Voquette Knowledgebase Metabase Threat Scoring Gov’t Watchlists News Media Web Info LexisNexis RiskWise Passenger Records Reservation Data Airline Data Airport Data Airline and Airport Data Future and Current Risks Airport LEO ARC AvSec Manager Data Management Data Mining IPG User Class 1: End Users Different types of users have different information needs
- 5. Voquette’s Semantic Technology enables flight authorities to : - take a quick look at the passenger’s history - check quickly if the passenger is on any official watchlist - interpret and understand passenger’s links to other organizations (possibly terrorist) - verify if the passenger has boarded the flight from a “high risk” region - verify if the passenger originally belongs to a “high risk” region - check if the passenger’s name has been mentioned in any news article along with the name of a known bad guy Voquette’s Solution for NASA Smith John
- 6. Threat Score Components of APITAS (APITAS=Airline Passenger Identification and Threat Assessment System) Smith John WATCHLIST ANALYSIS Action : Voquette’s rich knowledgebase is automatically searched for the possible appearance of this name on any of the watchlists Ability Proven : Ability to automatically aggregate relevant rich domain knowledge and automatically co-relate it and rank the threat factors to indicate threat level of the passenger on the watchlist front METABASE SEARCH Action : Voquette’s rich metabase is searched for this name and associated content stories mentioning the passenger’s name are retrieved Ability Proven : Ability to automatically aggregate and retrieve relevant content stories, field reports, etc. about the passenger that can be used by flight officials to determine if the passenger has any connections with known bad people or organizations appearsOn watchList : FBI KNOWLEDGEBASE SEARCH Action : Voquette’s rich knowledgebase is searched for this name and associated information like position, aliases, relationships (past or present) of this name to other organizations, watchlists, country, etc. are retrieved Ability Proven : Ability to automatically aggregate relevant rich domain knowledge about a passenger and automatically co-relate it with other data in the knowledgebase to present a visual association picture to the flight official LEXIS NEXIS ANNOTATION Action : Information about or related to the passenger returned by Lexis Nexis is enhanced by linking important entities to Voquette’s rich knowledgebase Ability Proven : Ability to automatically aggregate relevant rich domain knowledge, recognize entities in a piece of text and further automatically co-relate it with other data in the knowledgebase to present a clear picture about the passenger to the flight official Flight Country Check 45 0.15 Person Country Check 25 0.15 Nested Organizations Check 75 0.8 Aggregate Link Analysis Score: 17.7 LINK ANALYSIS Action : Semantic analysis of the various components (watchlist, Lexis Nexis, knowledgebase search, metabase search, etc.) to come up with an aggregate threat score for the passenger Ability Proven : Ability to automatically aggregate relevant rich domain knowledge, recognize entities in a piece of text, automatically co-relate it with other data in the knowledgebase, search for relevant content to present an overall idea of the threat level fo the passenger, allowing him to take quick action
- 7. Intelligence Analysis Browsing Scenario Knowledge Browser Demo Automatic Content Enhancement Demo
- 8. Semantic Application Example – Financial Research Dashboard Voquette Research Dashboard: http://www.voquette.com/demo Focused relevant content organized by topic ( semantic categorization ) Automatic Content Aggregation from multiple content providers and feeds Related relevant content not explicitly asked for (semantic associations) Competitive research inferred automatically Automatic 3 rd party content integration
- 9. Innovations that affect User Experience BSBQ: Blended Semantic Browsing and Querying Ability to query and browse relevant desired content in a highly contextual manner Seamless access/processing of Content, Metadata and Knowledge Ability to retrieve relevant content, view related metadata, access relevant knowledge and switch between all the above, allowing user to follow his train of thought dACE: dynamic Automatic Content Enhancement Ability to provide enhanced annotation features, allowing the user to retrieve relevant knowledge about significant pieces of content during content consumption Semantic Engine APIs with XML output Ability to create customized APIs for the Semantic Engine involving Semantic Associations with XML output to cater to any user application
- 10. SCORE System Architecture Knowledge Browser Analyst WB Dashboard Search Personalization Metadata Extractor Agents Knowledge Extractor Agents C C A S Semantic Engine (Automated Maintenance) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . KnowledgeBase Metabase (Database of Richly Indexed Metadata) WorldModel Knowledge Toolkit Extractor Toolkit Extractor Toolkit Analysis Reports Mining XML XML Documents Web Sites Corporate Repositories Structured & Semi-Structured Content - - - - - - - - - - - - Email Word Documents PowerPoint Presentations Unstructured Content Proprietary Content Corporate Web Sites Public Domain Web Sites Subscription Content Trusted Knowledge Sources Content Enhancement Domain Experts Metadata Enhanced Metadata ENTERPRISE USERS Custom Content and Knowledge APIs Std. Content APIs
- 11. Related Stock News Semantic Web – Intelligent Content Industry News Technology Products COMPANY EPA Regulations Competition COMPANIES in Same or Related INDUSTRY COMPANIES in INDUSTRY with Competing PRODUCTS Impacting INDUSTRY or Filed By COMPANY Important to INDUSTRY or COMPANY Intelligent Content = What You Asked for + What you need to know! SEC
- 12. User Class 2: Enterprise Application Developer Automation: KnowledgeBase (creation and maintenance) Dynamic content (metadata extraction and scheduled updates) Multiple techniques/technologies (DB, machine learning, knowledgebase, lexical/NLP, statistical, etc.) Content Enhancement (value-added metatagging and indexing) Toolkits About 30 integrated tools for content/knowledge creation, processing, maintenance and management
- 13. Discussion/Questions? Case Studies available http://www.voquette.com/demo
- 14. Voquette SCORE Technology Architecture Distributed agents that automatically extract relevant semantic metadata from structured and unstructured content Fast main-memory based query engine with APIs and XML output CACS provides automatic classification (w.r.t. WorldModel) from unstructured text and extracts contextually relevant metadata Distributed agents that automatically extract/mine knowledge from trusted sources Toolkit to design and maintain the Knowledgebase Knowledgebase represents the real-world instantiation (entities and relationships) of the WorldModel WorldModel specifies enterprise’s normalized view of information (ontology)
- 15. Content Enhancement Workflow Semantic Metadata Syntax Metadata
- 16. Content Asset Index Evolution Extractor Agent for Bloomberg Scans text for analysis Metadata extracted automatically Asset Syntax Metadata Producer: BusinessWire Source: Bloomberg Date: Sept. 10 2001 Location: San Jose, CA URL: http://bloomberg.com/1.htm Media: Text Semantic Metadata Company: Cisco Systems, Inc. Creates asset (index) out of extracted metadata Asset Syntax Metadata Producer: BusinessWire Source: Bloomberg Date: Sept. 10 2001 Location: San Jose, CA URL: http://bloomberg.com/1.htm Media: Text Semantic Metadata Company: Cisco Systems, Inc. Topic: Company News Categorization & Auto-Cataloging System (CACS) Scans text for analysis Classifies document into pre-defined category/topic Appends topic metadata to asset Cisco Systems CSCO NASDAQ Company Ticker Exchange Industry Sector Executives John Chambers Telecomm. Computer Hardware Competition Nortel Networks Knowledge Base CEO of Competes with Syntax Metadata Asset Producer: BusinessWire Source: Bloomberg Date: Sept. 10 2001 Location: San Jose, CA URL: http://bloomberg.com/1.htm Media: Text Semantic Metadata Company: Cisco Systems, Inc. Topic: Company News Ticker: CSCO Exchange: NASDAQ Industry: Telecomm. Sector: Computer Hardware Executive: John Chambers Competition: Nortel Networks Headquarters: San Jose, CA Leverages knowledge to enhance metatagging Enhanced Content Asset Indexed Headquarters San Jose XML Feed Semantic Engine
- 17. Content which does contain the words the user asked for Extractor Agents Content which does not contain the words the user asked for, but is about what he asked for. Value-added Metadata Content the user did not think to ask for , but which he needs to know . Semantic Associations + + Intelligent Content End-User Intelligent Content Empowers the User