![Custom skills
For bring-your-own APIs
POST /api/count HTTP/1.1
Host: https://<my-api-app>.azurewebsites.net
Content-Type: application/json
x-functions-key: <my-api-key>
{
"values": [
{
"recordId": "0",
"data": {
"text": "Este es un contrato en Inglés",
"language": "es",
"countOf": "words"
}
}
]
}
HTTP/1.1 200 OK
Content-Length: 153
Content-Type: application/json
{
"values": [
{
"recordId": "0",
"data": {
"count": 6
},
"errors": [],
"warnings": []
}
]
}
POST or
PUT https
only
The batch
size
Any HTTP
headers
Data can
be shaped](https://image.slidesharecdn.com/usingazurecognitivesearchtodiveintotheciaarchives-globalazurebootcamp2019melbourne-190428083847/85/Using-Azure-Cognitive-Search-to-Dive-into-the-CIA-Archives-6-320.jpg)
![Example: President’s Daily Reports
Cracked
documents
OCR
skill
Entity Recognition
skill
Enriched
documents
Image
(.TIFF)
per
page
{
"categories": [
"locations",
"organizations",
"persons"
]
}
{
“algorithm":"printed“
}
Custom
skill
metadata_storage_path
content
merged_text
hocr_data
locations
organizations
persons
PDF documents PDF pages
Index
Query
Custom
skill
PDF pages
hOCRJPEGPDF](https://image.slidesharecdn.com/usingazurecognitivesearchtodiveintotheciaarchives-globalazurebootcamp2019melbourne-190428083847/85/Using-Azure-Cognitive-Search-to-Dive-into-the-CIA-Archives-7-320.jpg)
Using Azure Cognitive Search to Dive into the CIA Archives
- 2. Azure AI + Data • Azure Bot Service • Azure Cognitive Services Intelligent Apps + Agents • Azure Databricks • Azure Machine Learning Machine Learning • Azure Cognitive SearchKnowledge Mining
- 3. Knowledge mining + Azure Cognitive Search • The intelligent act of creating actionable, structured information from unstructured, large data such as text, media and images • Use of AI to help with automating processes, ensuring safety or improving search Knowledge Mining • The AI features for knowledge mining in Azure Search • Enrichment of content in the indexing pipeline through skills such as image analysis, OCR and text analysis Azure Cognitive Search
- 4. How Azure Cognitive Search works 2 Enrich1 Ingest 3 Explore Cracked documents Enriched documentsSkillsData source Indexer Query Index Query Blob Storage TableStorage Cosmos DB SQL DB Built-in Custom Searchable Orderable Filterable Facetable Azure Search SDK Azure SearchAPI CSV, Office, EML, HTML, JSON, PDF, RTF,TXT,XML, ZIP
- 5. Built-in skills For preset models • Image analysis • Printed OCR • Handwritten OCR • Language detection • Entity linking • Named entity recognition • Key phrase analysis • Sentiment analysis • Merger • Splitter • Shaper Cognitive skills Utility skills
- 6. Custom skills For bring-your-own APIs POST /api/count HTTP/1.1 Host: https://<my-api-app>.azurewebsites.net Content-Type: application/json x-functions-key: <my-api-key> { "values": [ { "recordId": "0", "data": { "text": "Este es un contrato en Inglés", "language": "es", "countOf": "words" } } ] } HTTP/1.1 200 OK Content-Length: 153 Content-Type: application/json { "values": [ { "recordId": "0", "data": { "count": 6 }, "errors": [], "warnings": [] } ] } POST or PUT https only The batch size Any HTTP headers Data can be shaped
- 7. Example: President’s Daily Reports Cracked documents OCR skill Entity Recognition skill Enriched documents Image (.TIFF) per page { "categories": [ "locations", "organizations", "persons" ] } { “algorithm":"printed“ } Custom skill metadata_storage_path content merged_text hocr_data locations organizations persons PDF documents PDF pages Index Query Custom skill PDF pages hOCRJPEGPDF
- 8. Pricing • A preview feature of the Azure Search service in 15 regions including Australia East • Free for a small workload • Can attach to an Azure Cognitive Services resource for a larger workload • Built-in skills are charged at the Azure Cognitive Search pay-as-you-go price
- 9. Resources • JFK Files https://www.ailab.microsoft.com/experiments/jfk-files Demos • Knowledge Mining Bootcamp https://azure.github.io/LearnAI-KnowledgeMiningBootcamp/ Labs • AI and Azure Search for knowledge mining https://azure.microsoft.com/en- gb/resources/videos/azuresearchcognitivesearchmicrosoftignite2018/ Videos