Which SharePoint Search is Right for You?
- 1. SharePoint 101:Which SharePoint Search is Right for You?Miles KehoeNew Idea Engineering Inc.miles.kehoe@ideaeng.com
- 2. SharePoint and FAST SearchIntroductionThe Products Grand Tour Tech Details What Really countsMapping Business Requirements to Technology Data Capacities PriceSearch Resources
- 3. New Idea Engineering Inc.Company BackgroundFounded in 1996Headquarters: Santa Clara, CaliforniaCustomers in Europe and North AmericaVendor neutral approach to searchFocus is on what is best for our clientsProducts and Consulting Services:Evaluation/Selection/Implementing Enterprise SearchSearch Best PracticesSearchTrack Reporting & AnalyticsSearch Data Quality ToolkitEnterprise Search Newsletter3
- 4. The BookPublished Fall 2010Covers Search:BusinessSharePointFS4SPESP 5.3Trends
- 5. SharePoint Search Products:The Grand Tour
- 6. Naming ConventionsBusiness Productivity(server/(e)CAL licensing)Internet Business(Server licensing)FAST Search Server 2010 for SharePointSharePoint Server 2010 for Internet Sites, EnterpriseHigh EndSharePoint Server 2010SharePoint Server 2010 for Internet Sites, StandardIntegrated with SharePointInfrastructureSharePoint Foundation 2010Entry LevelFAST Search Server 2010 for Internal ApplicationsFAST Search Server 2010for Internet SitesHigh EndMicrosoft Search Server 2010Stand-AloneInfrastructureMicrosoft Search Server 2010, ExpressEntry Level
- 7. The ‘SharePoint’ CodebaseBusiness Productivity(server/(e)CAL licensing)Internet Business(Server licensing)FAST Search Server 2010 for SharePointSharePoint Server 2010 for Internet Sites, EnterpriseHigh EndSharePoint Server 2010SharePoint Server 2010 for Internet Sites, StandardIntegrated with SharePointInfrastructureSharePoint Foundation 2010Entry LevelFAST Search Server 2010 for Internal ApplicationsFAST Search Server 2010for Internet SitesHigh EndMicrosoft Search Server 2010Stand-AloneInfrastructureMicrosoft Search Server 2010, ExpressEntry Level
- 9. Solutions for Internet BusinessSolutions for Business ProductivityThe Marketing FantasyFAST Search for SharePoint Internet SitesFAST Search for SharePointIntegrated with SharePointSharePoint Server for Internet SitesSharePoint ServerFAST Search For Internet SitesFAST Search for Internal ApplicationsStand-aloneSearch ServerSearch Server ExpressEntry-LevelSolutionsSharePoint Foundation
- 10. In SummaryTwo entry level (SPF, MSS-X), three infrastructure-tier (SP, SP_FIS, MSS), four high end (FS4SP, FS4SP-IS, FSIA, FSIS)
- 11. Four stand-alone (MSS-X, MSS, FSIA, FSIS), five integrated with SharePoint) SPF, SP, SP-FIS, FS4SP, FS4SP-IS)
- 12. Three intended/licensed for internally facing applications (SP, FSIA, FS4SP), three intended/licensed for externally facing applications (SP-FIS, FS4SP-IS, FSIS)
- 13. Six different images/media sets (SPF, MSS/MSS-X, SP/SP-FIS/SP/FIS-E, FS4SP/FS4SP/FS4SP-IS. FSIA, FSIS)Confused Yet?
- 14. The ProductsSP and FS4SP Platforms
- 15. High Level Overview: SP vs FS4SP
- 16. SharePoint Server and FS4SPFS/FS4SP: Two different codebases united by (mostly) common featuresSharePoint environment
- 17. PowerShell
- 18. iFilters
- 19. OOB experienceFS4SP addsIndex Pipeline
- 20. Deep facets
- 23. Deep facets
- 24. Predictable scalability …SP and FS4SP: End users
- 25. SP and FS4SP: IT
- 26. SP and FS4SP: Developers
- 27. Powerful FS4SP FeaturesITContent Processing pipeline Entity extractionTunable relevance rankingDevelopersAdd custom property extractorsExtend content processingInclude external data in relevanceBuild multiple relevance profilesUSERDeep refiners with countsContext based user profileMultiple relevance profilesSorting on any propertySimilarity SearchBroader, better language support Richer query language
- 28. Indexing Pipeline…FS4SPStages coded in .NetConfigure via UI or PowerShellCustom stages before ‘Mapper’Runs in sandbox w/ timeoutMapperFS4SP IndexLanguageDetectionFormatConversionEntityExtractionLemmatizationFS4SPStages coded in Python (any CLI language OK)Configure via XML config fileCustom stages allowed anywhereRuns in-line
- 29. Typical Content Pipeline StagesDefaultOptionalFormat Conversion
- 30. Language and encoding detection
- 31. Lemmatizer
- 32. Tokenizer
- 35. Vectorizer
- 36. WebAnalyzer
- 37. PropertiesMapper
- 41. Verbatim (whole word) extractor Loads dictionary for custom extraction, e.g. product namesField Collapsing
- 43. The Role of the PipelineThe Content PipelineProcessing & refinementDateLookasideLocationCompanyREDMOND, Wash., andOSLO, Norway — Jan. 8, 2008Microsoft Corp. (Nasdaq “MSFT”) today announced that it will make an offer to acquire Fast Search & Transfer ASA (OSE: “FAST”), a leading provider of enterprise search solutions, through a cash tender offer for 19.00 Norwegian kroner (NOK) per share. This offer represents a 42 percent premium to the closing share price on Jan. 4, 2008 (the last trading day prior to this announcement), …Mapper…ConfigurableStagesEntityExtractionLanguageDetectionFormatConversion
- 44. The ‘Virtual Document’The initial document text content plus:Explicit metadata (Title/Author/etc.)
- 46. Look-aside content from pipeline(synonyms/taxonomies/other mark-up)Anything you can add to ‘make the needle bigger’Entity ExtractionFS4SPCreate/Edit Config Files
- 48. Wait for system to update (5 minutes)
- 50. Compile dictionary w/ ‘dictupdate’
- 51. Names, Companies, Job titles
- 52. Samples provided in many languages
- 57. Uses top 50 results to populate refinersFS4SPProvides document counts with refiners
- 58. All refiners shown (based on config)FS4SP Result List
- 59. ESP Platforms
- 60. FAST ESP FAST ESP 5.3 Multiple Platform Support
- 63. >10K QPSFSIA = ESPIdentical to FAST ESP 5.3
- 65. License based on ECAL + ServerFSIS = FAST ESP 5.3 + IMS / CTSIMS/CTS - Windows only (Visual Studio)
- 66. ‘Internet Sites’
- 67. License based on serversESP PlatformSearch development environment‘Some assembly required’
- 68. Not based on SharePoint
- 69. Connectors and WebParts available
- 70. No OOB end-user UI
- 71. Separate user and IT consoles
- 72. Fully customizable pipelineDevelopment ToolsJava/Python/PostgreSQL
- 73. GUI and CLI (no PowerShell support)
- 75. 10K+ QPSESP Admin Console
- 76. ESP Search Business Console
- 79. Search View: Debug Output
- 80. New FSIS ProductsContent Transformation Services: CTSDesign workflows for indexing from multiple sourcesInteraction Management Services: IMSManage query/results processingCTS and IMS:Based on Visual Studio: Windows Only!
- 81. Licensed/Intended for FSIS ONLY (for now)Content Transformation Services
- 83. ESP Customer: Best Buy
- 84. ESP Customer: Financial Times
- 85. But…. What’s really important..What does your customer expect?
- 86. Mapping Business Requirements to the Technology
- 87. Identify business rules for facets/refinersIf refiners are a business need:Choose to index the appropriate metadata fields; or
- 88. Upgrade your dataIf refiners are not a business need:Push the business rules into the 21st century
- 89. Use what you have; or
- 90. Update your contentThe Data AuditUnderstand the dataRepositories Where does the content live Is there security involvedDocuments & document structure Do documents have good metadata? Do you need to extract data Are there recognizable blocks of content?Lightweight publishing content Look at email/wikis/blogs/support calls…
- 91. Great search doesn’t just happen..Do search owners understand?Staffing ExpectationsIs there a search manager? An SCOE? How many people will be involved day to day?How to manage search?Review activity logs Update and manage best bets, new content EvangelizeUser SkillsAre users knowledge workers or casual searchers? Is search business critical?
- 92. So what is the right answer?It dependsInternal or external facing search? SharePoint or stand-alone? Casual users or Knowledge workers? Resources for managing search? Search box or search derived application? What’s the risk of missing content?That’s why your customer needs you!
- 93. ResourcesSearch Dev Newsgroup:www.SearchDev.orgNewsletter & Whitepapers:www.ideaeng.com/currentwww.ideaeng.com/wpBlog:EnterpriseSearchBlog.com
Editor's Notes
- #20: Opportunity to fix up bad/missing metadataFS4SP: Custom stage just before mapper; C# default.. Safe, has timeout..ESP: any CLI code – sdtin/stdout; even Bat file (newsletter example)Why a pipeline: Mark up documents w/ look-aside data (stock quotes); extend with sentiment analysis, auto-classification, etc. Very powerful capability for fixing content problems
- #21: Format: Filters, OutsideInVector: Similarity searching