SlideShare a Scribd company logo
Catmandu/LibreCat
Playmobil for playing               Legos for building




As child you had two ways to build up your world....
Search



                                                              OAI             Cataloging                     Handle




                                                                                  Sword


                                                                       WOS                           METS

In contemporary repository development you have the same choices... choose a specialized turn-the-key solution
OAI           SOAP             REST      HTML



                                                         Management                Security         Access




                                                            Datastreams                         Objects




...or choose a generic building-block on which you implement your own repository
BUT, WHAT WE WANT...
Mixing of metadata schemas and different workflows

LUND




                                                           Different front-ends for articles and grey literature




But in reality we would like to repositories that combine features of different products...
Image search engine + backend for high res scans and transformations
GENT
Digital archive with cataloging in place....




Some parts which work nice on one system. we would love to see on other systems...
Embeddable front-ends, tunable for every researcher, research
                           group, department or faculty
BIELEFELD




  We didn’t find a repository environment which provided this kind of flexibility ...
WHAT WE ACTUALLY GOT...
3 institutions : 11 systems : 8 platforms
Kahn-Wilensky
OAIS
Kahn-Wilensky & OAIS seem to produce repositories that need
to be very integrated with common metadata, protocols....
                                                                  Handle




                         Deposit                              Harvest    Service
                                                                        Provider



                                   Repositories in a network
                                   Messages about resources
Kahn-Wilensky
OAIS                                                             I search a
Kahn-Wilensky & OAIS seem to produce repositories that need     paper about
to be very integrated with common metadata, protocols....
                                                                  Handle




                         Deposit                              Harvest    Service
                                                                        Provider



                                   Repositories in a network
                                   Messages about resources
In our local environment the messages are very fragmented,
requiring many local adaptions...




                                                                 DNS

       LDAP                                                  HTML

        PROJECT
                                                                       Google
                             ETL                             Excel

        WOS

         Catalog
                                   Repository as local hub             Researcher
                                  Messages about researchers           Department
In our local environment the messages are very fragmented,
requiring many local adaptions...
                                                             Dr. Peeters

                                                                 DNS

       LDAP                                                  HTML

        PROJECT
                                                                           Google
                             ETL                             Excel

        WOS

         Catalog
                                   Repository as local hub                 Researcher
                                  Messages about researchers               Department
Project Catmandu
“Linked Data”
Subject   Predicate   Object       Guard
 312        title     “abc”^en
 312      versionOf     75
 685      deptCode    “WE03”     <2011-09-01

 685      deptCode    “WE04”
Anatomy of Search
database   export
                       index def   fix def


           convert     filter/map    fix


                       index       store


            field def   display
Import

                   Atom   CSV   DBI
  importer                            JSON

$obj->each({})
$obj->first()      MARC   OAI   SRU
$obj->rest()
$obj->select({})
$obj->any({})
$obj->many({})
Store

                          DBI     Solr     Elastic
                                           Search
    JSON                                                 store

                                                     $obj->add({})
                         Mongo      ...              $obj->search()
                          DB



   record.title:“rabbit” and record.author.firstName:“peter”

record.title any “rabbit” and record.author.firstName any “peter”
ETL
           upcase('job');

           capitalize('first');
importer   capitalize('last');
           capitalize('my.deep.nested.0');

  fix       upcase('my.deep.nested.0');
           downcase('my.deep.nested.0');
           substring('my.deep.nested.0',0,2);

  fix       add_field('test');
           add_field('income',0);
           add_field('a.0.0.0',1);

 store     copy_field('first','init');
           copy_field('first','my.deep.nested2');
           substring('init',0,1);

           join_field('colors.0','/');
Project LibreCat
Catmandu / LibreCat Project
Catmandu / LibreCat Project
Catmandu / LibreCat Project
Catmandu / LibreCat Project
Catmandu / LibreCat Project
http://librecat.org

More Related Content

PPT
Catmandu Librecat
PDF
Polyglot Persistence
PDF
wtf is in Java/JDK/wtf7?
PDF
Cloudera Impala, updated for v1.0
PPTX
UKOUG 2011 - Drag, Drop and other Stuff. Using your Database as a File Server
KEY
An introduction to CouchDB
PDF
Simple search with elastic search
PDF
Rupy2012 ArangoDB Workshop Part1
Catmandu Librecat
Polyglot Persistence
wtf is in Java/JDK/wtf7?
Cloudera Impala, updated for v1.0
UKOUG 2011 - Drag, Drop and other Stuff. Using your Database as a File Server
An introduction to CouchDB
Simple search with elastic search
Rupy2012 ArangoDB Workshop Part1

What's hot (20)

PPT
Hive Object Model
KEY
OSCON 2011 Learning CouchDB
PPTX
PPT
Tthornton code4lib
PDF
Riak from Small to Large
PDF
Querying Riak Just Got Easier - Introducing Secondary Indices
PPTX
Solr vs. Elasticsearch - Case by Case
PDF
Apache cassandra in 2016
PPTX
BGOUG 2012 - Drag & drop and other stuff - Using your database as a file server
PDF
Lightning fast analytics with Spark and Cassandra
PDF
d3sparql.js demo at SWAT4LS 2014 in Berlin
PDF
아파트 정보를 이용한 ELK stack 활용 - 오근문
PDF
OrientDB introduction - NoSQL
PDF
XQuery Design Patterns
PDF
Webinar: What's new in the .NET Driver
PPT
2011 Mongo FR - MongoDB introduction
PPTX
NoSQL Introduction
PPT
Introduction to MongoDB
PDF
Hive jdbc
PDF
Building Apps with MongoDB
Hive Object Model
OSCON 2011 Learning CouchDB
Tthornton code4lib
Riak from Small to Large
Querying Riak Just Got Easier - Introducing Secondary Indices
Solr vs. Elasticsearch - Case by Case
Apache cassandra in 2016
BGOUG 2012 - Drag & drop and other stuff - Using your database as a file server
Lightning fast analytics with Spark and Cassandra
d3sparql.js demo at SWAT4LS 2014 in Berlin
아파트 정보를 이용한 ELK stack 활용 - 오근문
OrientDB introduction - NoSQL
XQuery Design Patterns
Webinar: What's new in the .NET Driver
2011 Mongo FR - MongoDB introduction
NoSQL Introduction
Introduction to MongoDB
Hive jdbc
Building Apps with MongoDB
Ad

Viewers also liked (20)

PPT
用户体验设计
PPT
20091120 Vlengel Maastricht
PDF
Users Guide 272 345
PPT
Hadassah Ppt Early Jewish Display
PPTX
Research Steps 2016
PDF
Twice As Much Incentive - Sales and Marketing Mag 2002
PPT
Jeff Dalton David Carrithers V2 Member Recognition Start With The End In...
PPTX
Question Four & Five
KEY
About Innerwealth100%Spirit
PDF
20100306 Datasalon 4 : code4lib
PPTX
KEY
Women Of Algiers 3
PPT
Wireless Transmission Of Spirometric… By Stephen A. Raymond, Ph D
DOC
Project Achangle - One Stored-Value Platform Many Brands
PPT
صور من معرض الرسوم السادس للأطفال
PPT
Human Factor in Project Management
PPT
San Mateo County Fair Overview
 
PPT
GREP - Ghent University Repository
PPTX
Presenatation for evaluation ciara harry george megan
PDF
20090319 OñOndivemi Sm
用户体验设计
20091120 Vlengel Maastricht
Users Guide 272 345
Hadassah Ppt Early Jewish Display
Research Steps 2016
Twice As Much Incentive - Sales and Marketing Mag 2002
Jeff Dalton David Carrithers V2 Member Recognition Start With The End In...
Question Four & Five
About Innerwealth100%Spirit
20100306 Datasalon 4 : code4lib
Women Of Algiers 3
Wireless Transmission Of Spirometric… By Stephen A. Raymond, Ph D
Project Achangle - One Stored-Value Platform Many Brands
صور من معرض الرسوم السادس للأطفال
Human Factor in Project Management
San Mateo County Fair Overview
 
GREP - Ghent University Repository
Presenatation for evaluation ciara harry george megan
20090319 OñOndivemi Sm
Ad

Similar to Catmandu / LibreCat Project (20)

PPT
If we build it will they come? BOSC2012 Keynote Goble
KEY
LibreCat::Catmandu
PDF
Scientific Social Objects
PPTX
OpenSearchLab and the Lucene Ecosystem
PDF
Data repositories -- Xiamen University 2012 06-08
PPT
If we build it will they come?
PPTX
Embedding Services: Linking from Google Scholar to Discover
PDF
Publishing Linked Data from RDB
KEY
Mark ramm To relate or not to relate
PDF
EclipseConEurope2012 SOA - Models As Operational Documentation
PDF
Interoperability Requirements for a Sustainable Component to Support Manageme...
PDF
CRX 2 Content Application Platform
PPT
Metadata-powered dissemination of content
PDF
Part 2 OCLC Strategic Presentation Bruce Crocco ACURIL 2011
KEY
Get ready for web3.0! Open up your app!
PDF
Datos enlazados BNE and MARiMbA
PPTX
Libraries, OA research and OER: towards symbiosis?
PDF
MongoDB @ SourceForge
PDF
Open Chemistry: Realizing Open Data, Open Standards, and Open Source
PPTX
Inside Wordnik's Architecture
If we build it will they come? BOSC2012 Keynote Goble
LibreCat::Catmandu
Scientific Social Objects
OpenSearchLab and the Lucene Ecosystem
Data repositories -- Xiamen University 2012 06-08
If we build it will they come?
Embedding Services: Linking from Google Scholar to Discover
Publishing Linked Data from RDB
Mark ramm To relate or not to relate
EclipseConEurope2012 SOA - Models As Operational Documentation
Interoperability Requirements for a Sustainable Component to Support Manageme...
CRX 2 Content Application Platform
Metadata-powered dissemination of content
Part 2 OCLC Strategic Presentation Bruce Crocco ACURIL 2011
Get ready for web3.0! Open up your app!
Datos enlazados BNE and MARiMbA
Libraries, OA research and OER: towards symbiosis?
MongoDB @ SourceForge
Open Chemistry: Realizing Open Data, Open Standards, and Open Source
Inside Wordnik's Architecture

More from Patrick Hochstenbach (17)

PDF
Processing Linked Data with Catmandu
PDF
The Library in 2050
PDF
20130308 webstrategie
KEY
PDF
UGent Datacenter of waarom we 140TB kopen
PDF
देवनागरी Devanāgarī
PDF
Informatie Aan Zee - TTT E-Research
PDF
Informatie Aan Zee - TTT Digital Architecture
PDF
ELAG2011 Bootcamp
PDF
Gent_M 2011-04-26
PDF
Open | Linked | Open Linked data
PPT
20100831 igelu mobilise_ugent
PPT
20100618 Datasalon5 Vooruit Gent
PPTX
Data Salon 3 - Ghent
PPT
20081007 Workshop BOM-VL WP3
Processing Linked Data with Catmandu
The Library in 2050
20130308 webstrategie
UGent Datacenter of waarom we 140TB kopen
देवनागरी Devanāgarī
Informatie Aan Zee - TTT E-Research
Informatie Aan Zee - TTT Digital Architecture
ELAG2011 Bootcamp
Gent_M 2011-04-26
Open | Linked | Open Linked data
20100831 igelu mobilise_ugent
20100618 Datasalon5 Vooruit Gent
Data Salon 3 - Ghent
20081007 Workshop BOM-VL WP3

Recently uploaded (20)

PDF
KodekX | Application Modernization Development
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPT
Teaching material agriculture food technology
PPTX
A Presentation on Artificial Intelligence
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Empathic Computing: Creating Shared Understanding
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
Approach and Philosophy of On baking technology
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Electronic commerce courselecture one. Pdf
PPTX
Cloud computing and distributed systems.
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Encapsulation theory and applications.pdf
KodekX | Application Modernization Development
Diabetes mellitus diagnosis method based random forest with bat algorithm
Teaching material agriculture food technology
A Presentation on Artificial Intelligence
Spectral efficient network and resource selection model in 5G networks
Empathic Computing: Creating Shared Understanding
Per capita expenditure prediction using model stacking based on satellite ima...
Chapter 3 Spatial Domain Image Processing.pdf
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
“AI and Expert System Decision Support & Business Intelligence Systems”
Review of recent advances in non-invasive hemoglobin estimation
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
CIFDAQ's Market Insight: SEC Turns Pro Crypto
Approach and Philosophy of On baking technology
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Electronic commerce courselecture one. Pdf
Cloud computing and distributed systems.
Mobile App Security Testing_ A Comprehensive Guide.pdf
Encapsulation theory and applications.pdf

Catmandu / LibreCat Project

  • 2. Playmobil for playing Legos for building As child you had two ways to build up your world....
  • 3. Search OAI Cataloging Handle Sword WOS METS In contemporary repository development you have the same choices... choose a specialized turn-the-key solution
  • 4. OAI SOAP REST HTML Management Security Access Datastreams Objects ...or choose a generic building-block on which you implement your own repository
  • 5. BUT, WHAT WE WANT...
  • 6. Mixing of metadata schemas and different workflows LUND Different front-ends for articles and grey literature But in reality we would like to repositories that combine features of different products...
  • 7. Image search engine + backend for high res scans and transformations GENT Digital archive with cataloging in place.... Some parts which work nice on one system. we would love to see on other systems...
  • 8. Embeddable front-ends, tunable for every researcher, research group, department or faculty BIELEFELD We didn’t find a repository environment which provided this kind of flexibility ...
  • 10. 3 institutions : 11 systems : 8 platforms
  • 11. Kahn-Wilensky OAIS Kahn-Wilensky & OAIS seem to produce repositories that need to be very integrated with common metadata, protocols.... Handle Deposit Harvest Service Provider Repositories in a network Messages about resources
  • 12. Kahn-Wilensky OAIS I search a Kahn-Wilensky & OAIS seem to produce repositories that need paper about to be very integrated with common metadata, protocols.... Handle Deposit Harvest Service Provider Repositories in a network Messages about resources
  • 13. In our local environment the messages are very fragmented, requiring many local adaptions... DNS LDAP HTML PROJECT Google ETL Excel WOS Catalog Repository as local hub Researcher Messages about researchers Department
  • 14. In our local environment the messages are very fragmented, requiring many local adaptions... Dr. Peeters DNS LDAP HTML PROJECT Google ETL Excel WOS Catalog Repository as local hub Researcher Messages about researchers Department
  • 16. “Linked Data” Subject Predicate Object Guard 312 title “abc”^en 312 versionOf 75 685 deptCode “WE03” <2011-09-01 685 deptCode “WE04”
  • 17. Anatomy of Search database export index def fix def convert filter/map fix index store field def display
  • 18. Import Atom CSV DBI importer JSON $obj->each({}) $obj->first() MARC OAI SRU $obj->rest() $obj->select({}) $obj->any({}) $obj->many({})
  • 19. Store DBI Solr Elastic Search JSON store $obj->add({}) Mongo ... $obj->search() DB record.title:“rabbit” and record.author.firstName:“peter” record.title any “rabbit” and record.author.firstName any “peter”
  • 20. ETL upcase('job'); capitalize('first'); importer capitalize('last'); capitalize('my.deep.nested.0'); fix upcase('my.deep.nested.0'); downcase('my.deep.nested.0'); substring('my.deep.nested.0',0,2); fix add_field('test'); add_field('income',0); add_field('a.0.0.0',1); store copy_field('first','init'); copy_field('first','my.deep.nested2'); substring('init',0,1); join_field('colors.0','/');