Making mapping real: experience and thoughts from National Library of Scotland
0 likes968 views
The document discusses challenges in mapping local data instances to a global graph. It describes extracting triples from a local database and assigning URIs using templates. Mappings from local to global identifiers are stored separately and can be added over time. String and statistical matching are used to match local instances to global concepts, with the goal of unique matches but humans sometimes needed for resolution.
Making mapping real: experience and thoughts from National Library of Scotland
- 1. making mapping real experiences & thoughts from Na#onal Library of Scotland gill hamilton digital access manager g.hamilton@nls.uk and introducing …. Le Chef
- 2. agenda • introduction(s) • background to the DODLOD@NLS • The Big Issue : mapping local instances to the global graph • practical techniques • discussion
- 4. my glamourous assistant ..….
- 5. For lossless triples, create local element set based on RDBMS structure
- 6. ExtracGng triples • Extract a collecGon from the operaGonal database (SQL Server) • Upload into MySQL database • Run PHP script against MySQL – Create URIs using design templates – Base domain + enGty/authority type + local/table record/row number • Script outputs triples in TTL format
- 7. “Authority” strings assigned local things (URIs) local:rowNum “stuff” local:hasKeywordLabel global:URI Local things can then be matched to global things
- 8. External mappings • Mappings from local to global things stored as turtle files – Separate from extracted local triples • New mappings can be added ad hoc – When resources available – PrioriGsed by local usage/focus/context • E.g. “Haig, Douglas, Sir, 1861-‐1928” • E.g. “Ypres, 3rd Badle of, Ieper, Belgium, 1917” – dbPedia “Badle of Passchendaele”
- 9. for NLS (and everyone else probably) is the mapping of historical strings to their modern day things or URIs … that we would have used if we were starGng now. What IS the URI for “Spud” anyway?
- 10. LoC(h) Gedy not Loch Gelly Thesaurus of Geographic Names (place) go Art & Architecture Thesaurus (keyword) go Name Authority File (names) go Subject Authority File (keyword) go Thesaurus for Graphic Materials (keyword) go
- 11. subjects D74548618 Keyword D1790 D1790 Keyword-‐keyword “Kilts” D1790 exactMatch sh85072341 þ hdp://digital.nls.uk/74548618 þ ?
- 12. D74548618 tWhoType-‐Depicted D9886 D9886 tWho-‐who “Great BriGain. Army. Women’s Army Auxiliary Corps” D9886 exactMatch no2006000034 þ hdp://digital.nls.uk/74548618 þ ? names
- 13. places D74549224 tPlaceType-‐Placedepicted D575 D575 tPlace-‐place “Cambrai” D575 exactMatch _________ þ hdphdp://digital.nls.uk/74549224 þ ý
- 14. art & architecture D74546504 Keyword D1234 D1234 Keyword-‐keyword “War photography” D1234 exactMatch _________ þ þ ý hdp://digital.nls.uk/74546504
- 15. LoC(h) Gedy Thesaurus of Geographic Names go The Art and Architecture Thesaurus go Name Authority File go Subject Authority File go Thesaurus for Graphic Materials go þ ý
- 16. the extended graph hdp://www.math.uh.edu/~tomforde/images/UniverseAndMan.jpg
- 17. once for all Gme! LCSH:sh85072341 exactMatch hproductontology.org/doc/Kilt exactMatch dbPedia:Kilt DOD:D575 exactMatch geoNames:3029030
- 18. matching local to global staGsGcal literals humans influences
- 19. staGsGcal the law of large numbers staGsGcal matching DDC to LCSH Monsieur Le Chef will explain (he’s a mathema#cal physicist too dontcha know)
- 20. literals String matching …. Yeah baby! What do we want? UNIQUE MATCHES! When do we want them? NOW! NOW! NOW! OH NO!!! hang on a minute ….
- 21. literals String matching …. DAMN YOU! means no URI needs humans Not hits MulGple hits EXACT MATCH String matching …. WOO-‐HOO! means we’ve goda URI no need for humans but can you really REALLY trust it?
- 22. an aside …. the innumerate Scots The Forth neither the Fourth nor the 4th The first bridge is the Forth bridge The 2nd bridge is the Forth Road bridge
- 23. an aside …. the innumerate Scots Third Forth bridge Fourth Forth bridge
- 24. an aside …. the innumerate Scots The FIFTH Forth bridge Did I tell you about Firths yet? The First Bridge on the Firth of Forth is the Forth bridge The 2nd Bridge on the Firth of Forth is the Forth Road bridge There’s a third Forth Bridge on the Firth And on the Firth of Forth there’s a Fourth bridge but it’s not the Forth bridge And Finally, there’s the Firh Forth bridge on the Firth of Forth
- 25. humans hdp://www.inboundmarkeGngagents.com/Portals/160334/images/ID-‐10025253-‐resized-‐600.jpg individuals groups crowds
- 28. groups keyword LCSH Match Wikipedia Match keywordAuthor ity DODid keywordID Earls hdp://en.wikipedia.org/wiki/Earls exact AAT 74465029 1048 Earth (soil) sh85124396 close hdp://en.wikipedia.org/wiki/Soil close AAT 74549258 3723 Earthworks (engineering works) sh85040505 exact hdp://en.wikipedia.org/wiki/Earthworks_(engineering) exact AAT 74546044 4844 EaGng & drinking TGMI 74548320 1055 Editors hdp://id.loc.gov/ authoriGes/subjects/ sh85040976.html close hdp://en.wikipedia.org/wiki/EdiGng broad AAT 74546674 4352 Edwardian hdp://en.wikipedia.org/wiki/Edwardian close AAT 74549696 1071 Egg sh85041248 close hdp://en.wikipedia.org/wiki/Egg_(biology) close AAT 74549016 4351 Elderly tgm007221 close hdp://en.wikipedia.org/wiki/Elderly close AAT 74549556 1079 Electricity sh85042065 close hdp://en.wikipedia.org/wiki/Electricity close AAT 74547020 3744 Embankments sh85042664 exact hdp://en.wikipedia.org/wiki/Embankments exact AAT 74548178 1087 Emblems sh85042693 exact hdp://en.wikipedia.org/wiki/Emblems close AAT 74546714 1088 Emergency medical services sh85042747 exact hdp://en.wikipedia.org/wiki/ Emergency_medical_services close TGMI 74545806 4807 Enemies sh95005954 close hdp://en.wikipedia.org/wiki/Enemies broad AAT 74549382 1104 Engineers sh85043249 close hdp://en.wikipedia.org/wiki/Engineers close AAT 74549498 1106 Engines (power producing equipment) sh85043258 close hdp://en.wikipedia.org/wiki/Engines close AAT 74549310 4895 Entertainers sh85044098 exact hdp://en.wikipedia.org/wiki/Entertainers broad TGMI 74548888 1115 Entertaining sh85044107 close hdp://en.wikipedia.org/wiki/Entertaining broad AAT 74546398 1116 Entertainment sh96009616 broad hdp://en.wikipedia.org/wiki/Entertainers exact TGMI 74548150 5191 Entrances ? hdp://en.wikipedia.org/wiki/Entrance exact AAT 74549258 1117 Epaulets -‐ hdp://en.wikipedia.org/wiki/Epaulede exact AAT 74546740 1118 Equestrians sh85062154 close hdp://en.wikipedia.org/wiki/Equestrianism broad AAT 74549594 1123 Equipment sh85085299 ? broad hdp://en.wikipedia.org/wiki/Military_equipment close AAT 74545814 1124 Equipment & supplies sh85085299 close hdp://en.wikipedia.org/wiki/Military_equipment broad TGMI 74549442 3782 Ethnic groups sh85045172 exact hdp://en.wikipedia.org/wiki/Ethnic_group exact AAT 74548678 1139 Events sh96009616 close hdp://en.wikipedia.org/wiki/CompeGGon close AAT 74547864 1148 ExcavaGon (process) sh85046104 broad hdp://en.wikipedia.org/wiki/ExcavaGon_(archaeology) related AAT 74549618 4850 ExhibiGng sh85046354 close hdp://en.wikipedia.org/wiki/ExhibiGon broad AAT 74548718 5038 ExhibiGons (events) sh85046354 close hdp://en.wikipedia.org/wiki/ExhibiGon exact AAT 74546188 1163 Explosions sh85046465 exact hdp://en.wikipedia.org/wiki/Explosion close AAT 74549252 3750 Keyword LCSH Match Wikipedia Match OriginaGng voc EaGng & drinking TGMI Editors sh85040976 close hdp://en.wikipedia.org/wiki/EdiGng broad AAT Edwardian hdp://en.wikipedia.org/wiki/Edwardian close AAT Egg sh85041248 close hdp://en.wikipedia.org/wiki/Egg_(biology) close AAT Elderly tgm007221 close hdp://en.wikipedia.org/wiki/Elderly close AAT Electricity sh85042065 close hdp://en.wikipedia.org/wiki/Electricity close AAT Embankments sh85042664 exact hdp://en.wikipedia.org/wiki/Embankments exact AAT
- 29. crowds Order to Capt. Campbell by Maj. Duncanson You are hereby ordered to fall upon the rebells, the McDonalds of Glencoe, and put all to the sword under seventy. you are to have a speciall care that the old Fox and his sones doe upon no account escape your hands hdp://en.wikipedia.org/wiki/Massacre_of_Glencoe <name> McDonalds </name> <name> Maj Duncanson </name> `<name> Capt. Campbell </name> <name> old Fox </name> <place> Glencoe </place> Which person is Old Fox? Is Glencoe here?
- 30. crowds & geonames We think this is Cambrai … Do you think this Cambrai is here? Or do you think it’s here? it
- 31. crowds & dbPedia Is the horse in this picture … it none of these
- 32. crowds & LCSH Would you describe this horse in any of these ways? it Show jumpers (horses) Horses in moGon pictures Toy Horses Horses War horses Travel with horses none of these
- 33. influences -‐ when 1 loch becomes 2
- 34. The Elusive Loch of Shandon
- 35. discussion • using a voc without URIs? – should we change? • are there good ways to string match? – are they trustworthy? • are crowds helpful? • what vocs are mapped to what other vocs? – can/should we help map vocs beyond our domain? • should we alter the global to match the local?