NLP2RDF Wortschatz and Linguistic LOD draft
- 1. NLP2RDFIntegration of Data, Tools andApplicationswith RDF/OWL in the Areas of Textmining andLinguisticsPhD Thesis, Sebastian Hellmann
- 2. Extensive Topic – Whatisthecore?Features forMachine LearningWhichfeatures do I needfor a certain Textmining task?An introductoryexample :Resources: Face Recognition Tool thatdetectscoloroftheeyes(brown, green, blue) andtype ofhaircut(Vo-ku-hi-la, Mullet, GI Joe)
- 3. Database withAgeandOccupationGoal: predictincomeofpersonsYoung studentsearnlessthanoldCEO‘s. => Color ofeyesandhaircutprobably irrelevant!
- 4. Basic idea: a benchmarkingframeworkInput: Task specification
- 5. Text
- 6. Training/testdataOutput:Tools anddatarequiredtosolvethetaskDo I need POS tags toclassifyTourismdocuments?Prerequisites:Tools andapplicationsneed a standardizedinterface
- 7. Data needs a standardizedformatBasic idea: a benchmarkingframeworkNLP2RDF stack
- 8. Basic idea: a benchmarkingframeworkGoogle Code project was createdStanford parser was integrated
- 12. SomeresultswereachievedBut…Architecture not flexible enough (Pipeline)
- 14. Data sourceswere not sufficient
- 16. Speed ofintegrationtooslowPrerequisitesOnestep back:Creationofdatasets in RDFData integrationandlinkingofdatasetsLicencesStandardizedformatfortoolintegrationAcquisitionof additional knowledge
- 17. Why RDF and OWL ?RDF makesdataintegration easy: URIref, LinkedDataOWL isbased on Description Logics (Guarded Fragment)Availabilityof open datasets (accessandlicence)Diverse serializationsforannotations: XML, Turtle, RDFa+XHTMLScalabletoolsupport (Databases, Reasoning)6. Iftheonlytoolyouhaveis a hammer, everythinglookslike a nail.
- 18. LOD Cloud - over 26 Billion FactsDBpediaiscentral:Cross-domain
- 19. Crystalizationpoint (earlybird)Linking Open Data clouddiagram, by Richard CyganiakandAnja Jentzsch. http://lod-cloud.net/
- 21. Links areHTTP-Foreign KeysLinkedDatahttp://www4.wiwiss.fu-berlin.de/rdf_browser/?browse_uri=http%3A%2F%2Fdata.nytimes.com%2FN12930380387917339601ResemblesdatabasetableKey-Value pairsValues canbe:Datatypes (Strings, Integers)
- 22. URIs pointingtosubjects in the same table
- 23. URIs pointingtosubjects in anyothertableSPARQL – optimizationsfortablejoinsAll soccer players, who played as goalkeeper for a club that has a stadium with more than 40.000 seats and who are born in a country with more than 10 million inhabitantshttp://tinyurl.com/2uhuow9
- 27. Total of 10 millionpages
- 28. 900.000 users
- 29. RDF Dump will increasenumberofeditors
- 30. Same propertiesas Wikipedia (stableidentifiers)
- 32. Information istrapped in theWiki
- 33. Structurechangesmakesoftware obsoleteWhytryitagain?DBpediaExtraction Framework isverymature (5 years, 15 developers)
- 34. Configurationover Code, Templates will allowWiktionariansto update Parsers
- 35. Early contactwiththecommunityCreationofdatasets: WortschatzConverted in 2009:Matthias Quasthoff, Sebastian Hellmann und Konrad Höffner:StandardizedMultilingual Language Resources forthe Web of Data:http://corpora.uni-leipzig.de/rdf 3rd prizeatthe LOD Triplification Challenge, Graz, 2009What was missing?Research questions
- 36. Usecases
- 37. Other datasetsto link to!
- 38. Wikipedia as a linkingpartner not suited
- 39. NoserversWiktionary, Wortschatz, OLiAcanbecometheCrystallizationpointfor a LinguisticLinked Data WebFourmajortypes:LexicalSemantic Resources
- 40. Dictionaries
- 41. Corporas
- 42. Schemas/OntologiesInterlinking Wortschatz: Research andUse CaseIterated Co-occurencescanbedonewith SPARQLWiktionaryand Wortschatz canbeloaded in the same databaseInterestingquestions:Whatistheoverlapandcoverage?
- 45. Wiktionary links Words acrosslanguages. Are thereanysimilarpatterns?
- 46. Can wevalidatetheWiktionary RDF dumpwith Wortschatz?Open Licences – Focus of LOD2 and OKFNhttp://ckan.net/CKAN is an open registry of data and content packages. Harnessing the CKAN software, this site makes it easy to find, share and reuse content and data, especially in ways that are machine automatable.Working Group on Open Data in Linguisticshttp://wiki.okfn.org/wg/linguisticsFounded on Nov 2010
- 47. 6-7 Members
- 48. Membership open, pleasejoinStandardized Formats: Part 1 – Corporahttp://www.sfb632.uni-potsdam.de/~d1/paula/doc/PAULA XML is the PotsdamerAustauschformatfürlinguistische Annotation ("Potsdam Interchange Format for Linguistic Annotation"). It is an XML-based standoff representation format, which has been designed to represent data with heterogeneous annotation layers produced by different tools. For visualization and querying of PAULA XML data, the database ANNIS can be used. Christian Chiarcosatwork: PAULA will become POWLA and will beusedforrepresentationofcorporaannotations.
- 49. Standardized Formats: Part 2 – the WebBottomlayerofthe NLP2RDF stackcanbereused:An ontologytorepresent Strings (formerlythe SSO).In hislatestbook, Wikinomics, Don Tapscottexplainsdeepchanges in technology, demographicsandbusiness. URIs torepresent Strings e.g. http://nlp2rdf.org/example/Don_Tapscott
- 50. Relation betweenStrings: previous, next, sub, super
- 51. http://nlp2rdf.org/example/Don isa subStringoftheaboveStandardized Formats: Part 2 – the WebRDFaallowsfor flexible in-lineannotations
- 52. Multiple servicescanbe ad-hoc integrated
- 56. Ontology LearningJohanna Völker – Learning Expressive Ontologies(LExO)# Example:# A fishisanyaquaticvertebrateanimalthatiscoveredwithscales,# andequippedwithtwosetsofpairedfinsandseveralunpairedfins.## [fish] subClassOf [anyaquaticvertebrateanimalthatiscovered…]#Construct {?subrdfs:subClassOf ?super} {Construct {?subowl:equivalentClass ?super} {?is a penn:BePresentTense .?isnlp:superToken ?is_any_aquatic_.?is_any_aquatic_ a olia:VerbPhrase .?is_any_aquatic_ nlp:syntacticSubToken [ nlp:normUri ?super] .?animalnlp:cop ?is .?animalnlp:nsubj ?fish .?fishnlp:superToken [ nlp:normUri ?sub] .}
- 57. Standing on theshouldersofgiantsChristian ChiarcosSFB632 - Uni PotsdamJohanna VölkerUni MannheimMarkus Strohmaier,TU GrazThankyouforyourattentionJens LehmannUni LeipzigSören AuerUni Leipzig