WebLab, open source media mining platform, OW2con'12, Paris
3 likes906 views
The document discusses an open source media mining platform aimed at transforming unstructured data into structured, actionable knowledge. It highlights the importance of integrating human expertise in various processes like information evaluation and knowledge synthesis, while providing a workflow for data collection and analysis. A project called 'Weblab' is presented as a mature application that supports local data collection and simple information extraction using a range of technical services.
![Thanks for your attention
Take away [weblab.ow2.org]
Logos and names of the tools presented are the property of their respective providers and are here only as
illustration purposes on the already integrated technology in WebLab. Neither CASSIDIAN, nor EADS,
claims any paternity on these external tools.
HERITRIX - http://crawler.archive.org GOOGLE TRANSLATE - http://translate.google.com/
FFMPEG - http://ffmpeg.org/ GATE - http://gate.ac.uk/
SPHINX - http://cmusphinx.sourceforge.net/sphinx4/ JENA - http://jena.apache.org/
OW2Con'12, November 28-29, 2012
Orange Labs, Paris. www.ow2.org.](https://image.slidesharecdn.com/weblabow2con12paris-121217025036-phpapp02/85/WebLab-open-source-media-mining-platform-OW2con-12-Paris-15-320.jpg)
WebLab, open source media mining platform, OW2con'12, Paris
- 1. Open source media mining platform Gérard Dupont Research engineer – COEDS2 – Advanced studies OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 2. Media mining platform From unstructured data from any sources... … to structured and actionable knowledge OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 3. OW2Con'12, November 28-29, 2012 2005 - http://www.opte.org Orange Labs, Paris. www.ow2.org.
- 4. OSINT challenges Some activities need to be automated: Search/Sources assessment Data Acquisition Classification, Screening, Indexing Information retrieval Knowledge capitalisation Visualization Summary Some activities cannot be automated : Alert - experts analysis of content ; - linking and mapping heterogenous information ; - evaluating reliability and assessing information ; - report and synthesis of information. → Tools can provide support but keep human in the loop. OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 5. A processing workflow Vidéo Audio Audio vocal Collect Traduction Segmentation Epuration Audio audio Traduction extraction vidéo Transcription Texte annoté Texte traduit audio Transcription Audio Enriched text Translated text audio Transcription Texte Sphinx An international Greenpeace An international Greenpeace alpine team delivers alpine team delivers Text messages of support and messages of support and 国際グリーンピース高山チームは富 hope for the victims of the hope for the victims of the 士山の頂上への支援と福島第一 nuclear disaster at nuclear disaster at に原子力災害の被害者のための希望 Fukushima Daiichi to the Fukushima Daiichi to the Extraction のメッセージを配信します。 summit of Mt Fuji. Collected information Extraction Traduction summit of Mt Fuji. Collected Translation Alert from thousands of d’information Traduction 日本と世界中の何千人もの人々から people in d Extraction ’information from thousands of people in Japan and all over the Japan and all over the 収集した、グリーンピースは、 world, Greenpeace hopes world, Greenpeace hopes これらのメッセージは、原子力発電 that these messages will that these messages will に反対する日本の人々を団結に役立 help unite the people of help unite the people of つ、 Japan in opposition to Japan in opposition to 日本当局はそれらに耳を傾けること nuclear power. nuclear power. を奨励することを期待しています。 OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 6. Integration approach A platform providing "plug & play" functionalities for the integration of tools for collection, processing, analysis and communication... OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 7. Technology pile Java Application Server Apache Tomcat Enterprise Service Bus Portail/Portlets SOA ESB JBI JSR168 Content store BPEL OWL WSDL SPARQL RDFS Database SOAP XSD XPath XQuery RDF XML Namespaces Portal URI UTF-8 Maps server OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 8. Standard model & interfaces OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 9. Standard model & interfaces OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 10. Application per domain OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 11. Application per domain OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 12. Application per domain OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 13. WebLab: a mature project Sample application – Local data collection – Simple information extraction – Text index/search 24 components including – 8 technical services – 9 services – 7 portlets Core plateform including – Data model – ESB – Portal – Ochestrator OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 14. WebLab: a mature project Technical stuff : – code (SVN) ; – bug tracking (JIRA) ; – daily build (BAMBOO) ; – code quality (SONAR) ; – mailing list (8 guys). Available tools : – Maven plugin ; – Eclipse wizard ; – SOAPui test librarie; – CLI test tools ; – Complete Bundle ; – ... OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.
- 15. Thanks for your attention Take away [weblab.ow2.org] Logos and names of the tools presented are the property of their respective providers and are here only as illustration purposes on the already integrated technology in WebLab. Neither CASSIDIAN, nor EADS, claims any paternity on these external tools. HERITRIX - http://crawler.archive.org GOOGLE TRANSLATE - http://translate.google.com/ FFMPEG - http://ffmpeg.org/ GATE - http://gate.ac.uk/ SPHINX - http://cmusphinx.sourceforge.net/sphinx4/ JENA - http://jena.apache.org/ OW2Con'12, November 28-29, 2012 Orange Labs, Paris. www.ow2.org.