SlideShare a Scribd company logo
Apache Solr
for Newbies
Olivier Dobberkau
dkd Internet Service GmbH
Certifuncation 2018
Agenda 1/2
● What is Apache Solr?
● How TYPO3 got its Solr Extension?
● What is in the Box?
● Beyond Search
2
Agenda 2/2
● Demo
β—‹ Install and Index
β—‹ Search Box
β—‹ Results List
β—‹ Facets
● Q & A
3
Solr is the popular, blazing-fast,
open source enterprise search
platform built on Apache Luceneβ„’.
http://lucene.apache.org/solr/
4
What is Apache Solr?
● Solr is highly reliable, scalable and fault tolerant,
● It provides distributed indexing, replication and load-
balanced querying
● Offering automated failover and recovery, centralized
configuration and more
● Solr powers the search and navigation features of many of
the world's largest internet sites
5
Apache Solr Features
● Advanced Full-Text Search Capabilities
● Faceted Search and Filtering
● Advanced Configurable Text Analysis
● Query Suggestions, Spelling and More
● Rich Document Parsing
● Flexible and Adaptable with easy configuration
● Standards Based Open Interfaces - XML, JSON and HTTP
● and much more
6
How TYPO3 got its Apache Solr
Extension?
● In 2009 we at dkd hit the limits of TYPO3 built-in search
Indexed Search
● Servers kept stopping responding while users using the
search
● Customers complaining about not finding the right stuff
● We investigated different options and found Apache Solr
7
How TYPO3 got its Apache Solr
Extension?
● The idea to program a TYPO3 Extension was born
● So we started to ask around? Who would join us?
● We collected funds to integrate a first version
● Goal: Act as Indexed Search, but using a Solr Index
● We wrote white paper and a calculation for a first MVP
● Can you believe how far we got?
8
EXT:solr Facts
● over 50 Releases
● over 400 Partners financing
● 96 Contributors
● 97 Github Stars
● 105 801 Installations via packagist
● 31,587 Installations via TER
9
EXT:solr Facts
Total Physical Source Lines of Code (SLOC) = 38,174
Development Effort Estimate, Person-Years (Person-Months) = 9.16 (109.92)
(Basic COCOMO model, Person-Months = 2.4 * (KSLOC**1.05))
Schedule Estimate, Years (Months) = 1.24 (14.91)
(Basic COCOMO model, Months = 2.5 * (person-months**0.38))
Estimated Average Number of Developers (Effort/Schedule) = 7.37
Total Estimated Cost to Develop = $ 1,237,365
(average salary = $56,286/year, overhead = 2.40).
SLOCCount, Copyright (C) 2001-2004 David A. Wheeler
10
EXT:solr Facts
● Current Version
β—‹ EXT:solr 8.1 for TYPO3 v 8
β—‹ EXT:solr 6.5 for TYPO3 v 7
● We support the two latest LTS Versions
β—‹ TYPO3 v 7 LTS
β—‹ TYPO3 v 8 LTS
● Developer friendliness
β—‹ Master should work with latest and greatest
11
EXT:solr Facts
● Every quarter we release either a Feature or Bugfix
release
● Great Community of Developers helping us
● Around 500 Solr Friends on Slack #ext-solr
● Over 400 Partners in more than 9 years
● Around 100 Partners per Year
● 800 hours of sponsored development
12
The Apache Solr Team @dkd_de
● Timo Hund (Developer)
● Rafael KΓ€hm (Developer)
● Markus Friedrich (Developer)
● Thomas Janke (Management / Sales / Support)
● Olivier Dobberkau (Management / Sales)
● Ingo Renner (The first Developer, Friendly Ghost, Living
the American Dream)
13
What is in the box?
TYPO3
EXT:solr
- Indexing of pages and records into Apache Solr
- Highly integrated into TYPO3
- Powerful FLUID based Frontend
- Search
- Faceting
- Sorting
- Highlighting
14
Beyond Search
TYPO3
EXT:solr
EXT:solrfal EXT:solrfluidgrouping EXT:solrconsole EXT:solrdebugtools EXT:tikaEXT:solrmlt
- Several public and private addons
- Allowing to build solr based web applications. e.g.:
- Solr based list views
- Downloadcenter (file search with EXT:solr and solrfal)
- Did you know that extensions.typo3.org is powered by ext:solr?
15
Demo
● How to configure solr?
● How to add the search into your TYPO3 system?
● How to index content?
● (Manager Alert! I am not a dev!)
16
17
Demo: Setup
● Create domain record
● Include default TypoScript & configure Solr server
● Enable indexing & configure search markers
● Initialize β€œSolr Connections”
● Check the TYPO3 report
18
19
Demo: Add search plugin
● Add the Solr Search Box to a β€œSearch Page”
20
21
Demo: Indexing & Results
● Initialize the index queue
● Run indexer
● Check results in Frontend
22
23
Tidbits
You can use our dev-box
https://github.com/TYPO3-Solr/solr-typo3-devbox
Need a Solr Docker box?
https://github.com/TYPO3-Solr/ext-
solr/blob/master/Dockerfile
Roadmap:
https://blog.dkd.de/apache-solr-for-typo3-roadmap-2018/
24
Questions
& Answers
25
Thank you!
We would like to thank you!
Additionally we would thanks our Sponsors that make the
development, maintenance and motivation happen!
Please find them here:
https://www.typo3-solr.com/en/sponsors/our-sponsors/
26
Contact
Olivier Dobberkau <olivier.dobberkau@dkd.de>
Twitter: @T3RevNeverEnd
Our Website: https://www.typo3-solr.com
dkd Internet Service GmbH
Kaiserstrasse 73
D-60329 Frankfurt am Main
Tel: +49 69 2475218-0
27

More Related Content

PPTX
Introduction to Lucene and Solr - 1
PPTX
Andrzej bialecki lr-2013-dublin
PDF
Apache Solr for TYPO3 CMS 101
PDF
Whats new-in-solr-8-typo3-camp
PDF
Apache Solr for TYPO3 what's new 2018
PDF
Use FLUID templating for your TYPO3 search
PDF
Apache Solr for TYPO3 Components & Review 2016
PPT
Building Intelligent Search Applications with Apache Solr and PHP5
Introduction to Lucene and Solr - 1
Andrzej bialecki lr-2013-dublin
Apache Solr for TYPO3 CMS 101
Whats new-in-solr-8-typo3-camp
Apache Solr for TYPO3 what's new 2018
Use FLUID templating for your TYPO3 search
Apache Solr for TYPO3 Components & Review 2016
Building Intelligent Search Applications with Apache Solr and PHP5

Similar to 2018 - CertiFUNcation - Olivier Dobberka: Apache Solr for Newbies (20)

PDF
Meet Solr For The Tirst Again
PDF
FLUID Templating in EXT:solr
PDF
Apache Solr for TYPO3 at TYPO3 Usergroup Day Netherlands
PPTX
Apache solr
PDF
Solr Masterclass Bangkok, June 2014
PDF
Open Source Enterprise Search meets Open Source Enterprise CMS - Apache Solr ...
PPTX
Apache Solr-Webinar
PDF
Status & Outlook on EXT:solr for TYPO3 CMS
PDF
Apace Solr Web Development.pdf
PDF
Introduction to Solr
PPTX
Apache Solr Workshop
Β 
PDF
Introduction to Apache Solr
PDF
Basics of Solr and Solr Integration with AEM6
PDF
Apache Solr
PDF
Apache Solr Workshop
KEY
Apache Solr - Enterprise search platform
DOCX
Apache solr tech doc
PPTX
20130310 solr tuorial
PPTX
Drupal 7 and SolR
PDF
Suche mit Apache Lucene & Co.
Meet Solr For The Tirst Again
FLUID Templating in EXT:solr
Apache Solr for TYPO3 at TYPO3 Usergroup Day Netherlands
Apache solr
Solr Masterclass Bangkok, June 2014
Open Source Enterprise Search meets Open Source Enterprise CMS - Apache Solr ...
Apache Solr-Webinar
Status & Outlook on EXT:solr for TYPO3 CMS
Apace Solr Web Development.pdf
Introduction to Solr
Apache Solr Workshop
Β 
Introduction to Apache Solr
Basics of Solr and Solr Integration with AEM6
Apache Solr
Apache Solr Workshop
Apache Solr - Enterprise search platform
Apache solr tech doc
20130310 solr tuorial
Drupal 7 and SolR
Suche mit Apache Lucene & Co.
Ad

More from TYPO3 CertiFUNcation (20)

PDF
2019-certiFUNcation-Headless-Cms
PDF
2019-CertiFUNcation-UX-relationship_matters
PDF
2019-CertiFUNcation-update-seo-dashboard-initiative-certifuncation2019
PDF
2019-CertiFUNcation-Hacking-Agile-not-a-tech-talk
PDF
2019-CertiFUNcation-GDPR_12072019-typo3
PDF
2019-CertiFUNcation-DDEV-for-TYPO3
PDF
2019-CertiFUNcation-Whats_New
PDF
2018 - CertiFUNcation - Jonas Weber: SEO Keynote
PDF
2018 - CertiFUNcation - Fabian vor dem Esche: GDPR updated
PDF
2018 - CertiFUNcation - Armin Vieweg: phpstorm in a nutshell
PDF
2018 - CertiFUNcation - Mathias Schreiber: What's new in TYPO3 v9
PDF
2018 - CertiFUNcation - Richard Haeser: SEO with TYPO3
PDF
2018 - CertiFUNcation - Marcus Schwemer: TYPO3 Performance
PDF
2018 - CertiFUNcation - Jurian Janssen: Marketing Automation Mautic
PDF
2018 - CertiFUNcation - Helmut Hummel: Hardening TYPO3
PDF
2018 - CertiFUNcation - Marc Haunschild: Economic aspects of web accessibility
PDF
2018 - CertiFUNcation - Nicole Cordes - Content Elements
PPTX
2017 - TYPO3 CertiFUNcation: Scott Helme - The Encrypted Web Is Coming
PDF
2017 - TYPO3 CertiFUNcation: Peter Kraume - What's new for Editors and in th...
PDF
2017 - TYPO3 CertiFUNcation: Peter Kraume - Showing a useful TYPO3 Backend
2019-certiFUNcation-Headless-Cms
2019-CertiFUNcation-UX-relationship_matters
2019-CertiFUNcation-update-seo-dashboard-initiative-certifuncation2019
2019-CertiFUNcation-Hacking-Agile-not-a-tech-talk
2019-CertiFUNcation-GDPR_12072019-typo3
2019-CertiFUNcation-DDEV-for-TYPO3
2019-CertiFUNcation-Whats_New
2018 - CertiFUNcation - Jonas Weber: SEO Keynote
2018 - CertiFUNcation - Fabian vor dem Esche: GDPR updated
2018 - CertiFUNcation - Armin Vieweg: phpstorm in a nutshell
2018 - CertiFUNcation - Mathias Schreiber: What's new in TYPO3 v9
2018 - CertiFUNcation - Richard Haeser: SEO with TYPO3
2018 - CertiFUNcation - Marcus Schwemer: TYPO3 Performance
2018 - CertiFUNcation - Jurian Janssen: Marketing Automation Mautic
2018 - CertiFUNcation - Helmut Hummel: Hardening TYPO3
2018 - CertiFUNcation - Marc Haunschild: Economic aspects of web accessibility
2018 - CertiFUNcation - Nicole Cordes - Content Elements
2017 - TYPO3 CertiFUNcation: Scott Helme - The Encrypted Web Is Coming
2017 - TYPO3 CertiFUNcation: Peter Kraume - What's new for Editors and in th...
2017 - TYPO3 CertiFUNcation: Peter Kraume - Showing a useful TYPO3 Backend
Ad

Recently uploaded (20)

PDF
Sims 4 Historia para lo sims 4 para jugar
PDF
SASE Traffic Flow - ZTNA Connector-1.pdf
PDF
The Internet -By the Numbers, Sri Lanka Edition
Β 
PDF
πŸ’° π”πŠπ“πˆ πŠπ„πŒπ„ππ€ππ†π€π πŠπˆππ„π‘πŸ’πƒ π‡π€π‘πˆ 𝐈𝐍𝐈 πŸπŸŽπŸπŸ“ πŸ’°
Β 
PDF
The New Creative Director: How AI Tools for Social Media Content Creation Are...
PDF
Tenda Login Guide: Access Your Router in 5 Easy Steps
PDF
RPKI Status Update, presented by Makito Lay at IDNOG 10
Β 
PDF
Best Practices for Testing and Debugging Shopify Third-Party API Integrations...
PDF
Decoding a Decade: 10 Years of Applied CTI Discipline
PPTX
Introduction to Information and Communication Technology
PPTX
INTERNET------BASICS-------UPDATED PPT PRESENTATION
PPTX
Internet___Basics___Styled_ presentation
PPTX
presentation_pfe-universite-molay-seltan.pptx
PPTX
artificial intelligence overview of it and more
PPTX
Introuction about ICD -10 and ICD-11 PPT.pptx
PPTX
QR Codes Qr codecodecodecodecocodedecodecode
PPTX
Introduction about ICD -10 and ICD11 on 5.8.25.pptx
PDF
WebRTC in SignalWire - troubleshooting media negotiation
PPT
tcp ip networks nd ip layering assotred slides
PPTX
innovation process that make everything different.pptx
Sims 4 Historia para lo sims 4 para jugar
SASE Traffic Flow - ZTNA Connector-1.pdf
The Internet -By the Numbers, Sri Lanka Edition
Β 
πŸ’° π”πŠπ“πˆ πŠπ„πŒπ„ππ€ππ†π€π πŠπˆππ„π‘πŸ’πƒ π‡π€π‘πˆ 𝐈𝐍𝐈 πŸπŸŽπŸπŸ“ πŸ’°
Β 
The New Creative Director: How AI Tools for Social Media Content Creation Are...
Tenda Login Guide: Access Your Router in 5 Easy Steps
RPKI Status Update, presented by Makito Lay at IDNOG 10
Β 
Best Practices for Testing and Debugging Shopify Third-Party API Integrations...
Decoding a Decade: 10 Years of Applied CTI Discipline
Introduction to Information and Communication Technology
INTERNET------BASICS-------UPDATED PPT PRESENTATION
Internet___Basics___Styled_ presentation
presentation_pfe-universite-molay-seltan.pptx
artificial intelligence overview of it and more
Introuction about ICD -10 and ICD-11 PPT.pptx
QR Codes Qr codecodecodecodecocodedecodecode
Introduction about ICD -10 and ICD11 on 5.8.25.pptx
WebRTC in SignalWire - troubleshooting media negotiation
tcp ip networks nd ip layering assotred slides
innovation process that make everything different.pptx

2018 - CertiFUNcation - Olivier Dobberka: Apache Solr for Newbies

  • 1. Apache Solr for Newbies Olivier Dobberkau dkd Internet Service GmbH Certifuncation 2018
  • 2. Agenda 1/2 ● What is Apache Solr? ● How TYPO3 got its Solr Extension? ● What is in the Box? ● Beyond Search 2
  • 3. Agenda 2/2 ● Demo β—‹ Install and Index β—‹ Search Box β—‹ Results List β—‹ Facets ● Q & A 3
  • 4. Solr is the popular, blazing-fast, open source enterprise search platform built on Apache Luceneβ„’. http://lucene.apache.org/solr/ 4
  • 5. What is Apache Solr? ● Solr is highly reliable, scalable and fault tolerant, ● It provides distributed indexing, replication and load- balanced querying ● Offering automated failover and recovery, centralized configuration and more ● Solr powers the search and navigation features of many of the world's largest internet sites 5
  • 6. Apache Solr Features ● Advanced Full-Text Search Capabilities ● Faceted Search and Filtering ● Advanced Configurable Text Analysis ● Query Suggestions, Spelling and More ● Rich Document Parsing ● Flexible and Adaptable with easy configuration ● Standards Based Open Interfaces - XML, JSON and HTTP ● and much more 6
  • 7. How TYPO3 got its Apache Solr Extension? ● In 2009 we at dkd hit the limits of TYPO3 built-in search Indexed Search ● Servers kept stopping responding while users using the search ● Customers complaining about not finding the right stuff ● We investigated different options and found Apache Solr 7
  • 8. How TYPO3 got its Apache Solr Extension? ● The idea to program a TYPO3 Extension was born ● So we started to ask around? Who would join us? ● We collected funds to integrate a first version ● Goal: Act as Indexed Search, but using a Solr Index ● We wrote white paper and a calculation for a first MVP ● Can you believe how far we got? 8
  • 9. EXT:solr Facts ● over 50 Releases ● over 400 Partners financing ● 96 Contributors ● 97 Github Stars ● 105 801 Installations via packagist ● 31,587 Installations via TER 9
  • 10. EXT:solr Facts Total Physical Source Lines of Code (SLOC) = 38,174 Development Effort Estimate, Person-Years (Person-Months) = 9.16 (109.92) (Basic COCOMO model, Person-Months = 2.4 * (KSLOC**1.05)) Schedule Estimate, Years (Months) = 1.24 (14.91) (Basic COCOMO model, Months = 2.5 * (person-months**0.38)) Estimated Average Number of Developers (Effort/Schedule) = 7.37 Total Estimated Cost to Develop = $ 1,237,365 (average salary = $56,286/year, overhead = 2.40). SLOCCount, Copyright (C) 2001-2004 David A. Wheeler 10
  • 11. EXT:solr Facts ● Current Version β—‹ EXT:solr 8.1 for TYPO3 v 8 β—‹ EXT:solr 6.5 for TYPO3 v 7 ● We support the two latest LTS Versions β—‹ TYPO3 v 7 LTS β—‹ TYPO3 v 8 LTS ● Developer friendliness β—‹ Master should work with latest and greatest 11
  • 12. EXT:solr Facts ● Every quarter we release either a Feature or Bugfix release ● Great Community of Developers helping us ● Around 500 Solr Friends on Slack #ext-solr ● Over 400 Partners in more than 9 years ● Around 100 Partners per Year ● 800 hours of sponsored development 12
  • 13. The Apache Solr Team @dkd_de ● Timo Hund (Developer) ● Rafael KΓ€hm (Developer) ● Markus Friedrich (Developer) ● Thomas Janke (Management / Sales / Support) ● Olivier Dobberkau (Management / Sales) ● Ingo Renner (The first Developer, Friendly Ghost, Living the American Dream) 13
  • 14. What is in the box? TYPO3 EXT:solr - Indexing of pages and records into Apache Solr - Highly integrated into TYPO3 - Powerful FLUID based Frontend - Search - Faceting - Sorting - Highlighting 14
  • 15. Beyond Search TYPO3 EXT:solr EXT:solrfal EXT:solrfluidgrouping EXT:solrconsole EXT:solrdebugtools EXT:tikaEXT:solrmlt - Several public and private addons - Allowing to build solr based web applications. e.g.: - Solr based list views - Downloadcenter (file search with EXT:solr and solrfal) - Did you know that extensions.typo3.org is powered by ext:solr? 15
  • 16. Demo ● How to configure solr? ● How to add the search into your TYPO3 system? ● How to index content? ● (Manager Alert! I am not a dev!) 16
  • 17. 17
  • 18. Demo: Setup ● Create domain record ● Include default TypoScript & configure Solr server ● Enable indexing & configure search markers ● Initialize β€œSolr Connections” ● Check the TYPO3 report 18
  • 19. 19
  • 20. Demo: Add search plugin ● Add the Solr Search Box to a β€œSearch Page” 20
  • 21. 21
  • 22. Demo: Indexing & Results ● Initialize the index queue ● Run indexer ● Check results in Frontend 22
  • 23. 23
  • 24. Tidbits You can use our dev-box https://github.com/TYPO3-Solr/solr-typo3-devbox Need a Solr Docker box? https://github.com/TYPO3-Solr/ext- solr/blob/master/Dockerfile Roadmap: https://blog.dkd.de/apache-solr-for-typo3-roadmap-2018/ 24
  • 26. Thank you! We would like to thank you! Additionally we would thanks our Sponsors that make the development, maintenance and motivation happen! Please find them here: https://www.typo3-solr.com/en/sponsors/our-sponsors/ 26
  • 27. Contact Olivier Dobberkau <olivier.dobberkau@dkd.de> Twitter: @T3RevNeverEnd Our Website: https://www.typo3-solr.com dkd Internet Service GmbH Kaiserstrasse 73 D-60329 Frankfurt am Main Tel: +49 69 2475218-0 27