SlideShare a Scribd company logo
SPUnite17 Large Lists in SharePoint
SharePoint & Large lists
Albert-Jan Schot @appieschot
SharePoint lists & libraries
“You can store up to 30 million items
or documents in a SharePoint list or
library.”
List View Threshold
1. A view returns a total of more than 5,000 items
or
2. Evaluate more than 5,000 items to determine if they match
• Items in the recycle bin count towards your List View Threshold
• Items are grouped per folder unless you specify otherwise
• Sorting a view re-evaluates the items by executing a query
Announcements at Ignite 2017
A single list can contain up to 30 million items.
The modern lists and libraries user experience is
ready for the largest enterprise content
collaboration scenarios.
The modern UI has been tuned to take better
advantage of indices to handle user queries.
Predictive Indexing
Feature Capability Availability
Synchronous indexing
Lists of size 2,500 – 19,999 items
Create indices on demand, when they’re
needed
Create indices for ad-hoc user sorts inside lists NOW!
Create indices for filtered and sorted columns inside
views, when views are created or saved
NOW!
Create indices for more ad-hoc actions: filters, API calls,
Group Bys, etc.
Evaluating for CY2018
Priority based on usage data, feedback
Background Indexing
Lists of size 2,500 – 19,999 items
Go through and create indices for old
views that were created a long time ago
Create indices for filtered and sorted columns inside
views
NOW!
Predictive indexing for very large lists of
size 20,000+ items
All of the above capabilities continue to work when lists
become very large
Evaluating for CY2018
Priority based on usage data, feedback
Robust User Experience
Feature Current Availability Evaluating for CY2018
Smart Sorts
Queries that specify a sort, but no filter, can take advantage of
indices.
Paging feature works when your sort
is specified on one of these field
types:
• Single line of text
• Multiple lines of text
• Date/Time
• Single value choice
• Multi-value choice
• Number
• Currency
Paging feature works when your sort is
specified on one of these field types:
• Person
• Lookup
• Managed Metadata
Users Don’t Get Throttled
Users can page through items along the specified sort order,
when that query would normally be throttled.
Requires a sort on a supported indexed field
Ignite 2017 takeaways
1. While SharePoint Lists and Libraries can support up to 30M items you
should do up-front planning.
2. Predictive indexing works in classic, but smart sort is modern-only
3. Let predictive indexing work for you
• Set up your indexes before migrating your whole list if you have
more than 20K items
• Set up views (or indices) to mirror API calls that will be made
Options when hitting the
List View Threshold
1. Move documents into folders
2. Column indexing
3. Metadata Navigation
4. Content Organizer
5. 3th Party Solutions or Custom
Development
Documents into Folders
1. Folder versus Metadata
2. Move items to a folder and create a structure where there no
more than 5000 documents in a folder
3. Document sets are a folder
Column Indexing
1. Maximum of 20 indexes per list, and not all columns can be
indexed
▪ Not supported: Multiple lines of text, Choice (multi-valued), Calculated,
Hyperlink or Picture, Custom Columns, Person or Group (multi-valued),
External data
2. Only used by the first filter
3. Cannot be created once a list is + 20.000 items
4. ID & Name are indexed by default, any column set to be unique
is indexed as well.
Metadata Navigation
1. Compound Indexes: Combine filters on indexed columns
instead of one
2. Fall back to return a subset of less than 5000 instead of ‘error’
3. Requires configuration on the list, and should be turned on
before hitting the +5000 items.
Content Organizer
1. Move documents in folders for you, based on rules
2. Manage folder size, thus making sure no more than 2500 items will be put in a
folder
How to deal with large lists
1. Plan large lists before being confronted
2. Consider alternatives like 3th party apps or search
3. Just because you can doesn’t mean you should
4. Provide feedback https://sharepoint.uservoice.com
SPUnite17 Large Lists in SharePoint

More Related Content

PPTX
Managing lists and libraries with more than 5000 items
PPTX
ORCID at Crossref LIVE Indonesia
PPTX
The Global reach of Crossref metadata
PPTX
Working with Crossref and registering content
PDF
Correcting and Updating the Scholarly Record through CrossMark
PPTX
NISO Patron Privacy VM#3-Richard Entlich: user-based information offered by p...
PPTX
Reference linking and Cited-by
PDF
Checking for Originality thorough Crossref Similarity Check
Managing lists and libraries with more than 5000 items
ORCID at Crossref LIVE Indonesia
The Global reach of Crossref metadata
Working with Crossref and registering content
Correcting and Updating the Scholarly Record through CrossMark
NISO Patron Privacy VM#3-Richard Entlich: user-based information offered by p...
Reference linking and Cited-by
Checking for Originality thorough Crossref Similarity Check

Viewers also liked (18)

PDF
SPUnite17 Getting up to Speed with React
PDF
SPUnite17 SharePoint and Data Loss Prevention
PDF
SPUnite17 Introduction to the Office Dev PnP Core Libraries
PDF
SPUnite17 Timer Jobs Event Handlers
PDF
SPUnite17 Building Great Client Side Web Parts with SPFx
PDF
SPUnite17 5 More Query Rules
PDF
Spunite17 Converting your CEWP Customisations
PDF
SPUnite17 TypeScript for SharePoint Developers
PDF
SPUnite17 Modern NewsPublishing with SharePoint
PDF
SPUnite17 Successful SharePoint Projects and User eXperience
PDF
SPUnite17 Who Are You and What Do You Want
PDF
SPUnite17 Migrating your Customizations from On-prem to SharePoint Online
PDF
SPUnite17 Introducing Logic Apps
PDF
SpUnite17 Exploring Identity Management Options in Office 365
PDF
SPUnite17 Deep Dive Building Solutions
PDF
SPUnite17 Making Sense of the SharePoint Framework
PDF
SPUnite17 Getting Notified by SharePoint with WebHooks
PDF
SPUnite17 External Sharing in SharePoint Online
SPUnite17 Getting up to Speed with React
SPUnite17 SharePoint and Data Loss Prevention
SPUnite17 Introduction to the Office Dev PnP Core Libraries
SPUnite17 Timer Jobs Event Handlers
SPUnite17 Building Great Client Side Web Parts with SPFx
SPUnite17 5 More Query Rules
Spunite17 Converting your CEWP Customisations
SPUnite17 TypeScript for SharePoint Developers
SPUnite17 Modern NewsPublishing with SharePoint
SPUnite17 Successful SharePoint Projects and User eXperience
SPUnite17 Who Are You and What Do You Want
SPUnite17 Migrating your Customizations from On-prem to SharePoint Online
SPUnite17 Introducing Logic Apps
SpUnite17 Exploring Identity Management Options in Office 365
SPUnite17 Deep Dive Building Solutions
SPUnite17 Making Sense of the SharePoint Framework
SPUnite17 Getting Notified by SharePoint with WebHooks
SPUnite17 External Sharing in SharePoint Online
Ad

Similar to SPUnite17 Large Lists in SharePoint (20)

PPTX
Qualitem - Large List Support - SharePoint Saturday
PPTX
Optimizing SharePoint for Transactional Content Management
PPT
deep dive data management sharepoint apps.ppt
PDF
Sps durham james_h
PPTX
SharePoint Fest - Document Management with Content Types, Taxonomy and Search
PPTX
Playing Tag: Managed Metadata and Taxonomies in SharePoint 2010
PPT
Lucene basics
PPTX
SharePoint Fest Chicago - Document Management with Content Types, Taxonomy an...
PPTX
WSPDC June 2013: Working with Large Lists in SharePoint 2010 by Zewdi Solomon
PPTX
IA& Taxonomy Planning for SharePoint Online & Office 365
PDF
Content classification & organization in SharePoint
PPTX
SPSNYC 2016 - Big data in SharePoint and the 5,000 Item List View Threshold
PPTX
SPS Dayton Content Types
PPTX
Building Product Centric sites using Cross-Site publishing and Search [Swiss ...
PPTX
Design a share point topology 1 1
PPTX
Information architecture search_bettertogether
PPTX
MMS2010
PPTX
Notey's talk 20160923
PPTX
DWCNZ - Content Types: Love Them or Lose It
PDF
MarcEdit Tools and Workflows
Qualitem - Large List Support - SharePoint Saturday
Optimizing SharePoint for Transactional Content Management
deep dive data management sharepoint apps.ppt
Sps durham james_h
SharePoint Fest - Document Management with Content Types, Taxonomy and Search
Playing Tag: Managed Metadata and Taxonomies in SharePoint 2010
Lucene basics
SharePoint Fest Chicago - Document Management with Content Types, Taxonomy an...
WSPDC June 2013: Working with Large Lists in SharePoint 2010 by Zewdi Solomon
IA& Taxonomy Planning for SharePoint Online & Office 365
Content classification & organization in SharePoint
SPSNYC 2016 - Big data in SharePoint and the 5,000 Item List View Threshold
SPS Dayton Content Types
Building Product Centric sites using Cross-Site publishing and Search [Swiss ...
Design a share point topology 1 1
Information architecture search_bettertogether
MMS2010
Notey's talk 20160923
DWCNZ - Content Types: Love Them or Lose It
MarcEdit Tools and Workflows
Ad

More from NCCOMMS (20)

PDF
O365Con19 - UI:UX 101 Learn How to Design Custom Experiences for SharePoint -...
PDF
O365Con19 - Model-driven Apps or Canvas Apps? - Rick Bakker
PDF
O365Con19 - Office 365 Groups Surviving the Real World - Jasper Oosterveld
PDF
O365Con19 - Developing Timerjob and Eventhandler Equivalents - Adis Jugo
PDF
O365Con19 - Sharepoint with (Artificial) Intelligence - Adis Jugo
PDF
O365Con19 - What Do You Mean 90 days Isn't Enough - Paul Hunt
PDF
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
PDF
O365Con19 - Start Developing Teams Tabs and SharePoint Webparts with SPFX - O...
PDF
O365Con19 - Start Your Journey from Skype for Business to Teams - Sasja Beere...
PDF
O365Con19 - Lets Get Started with Azure Container Instances - Jussi Roine
PDF
O365Con19 - Azure Blackbelt - Jussi Roine
PDF
O365Con19 - Customise the UI in Modern SharePoint Workspaces - Corinna Lins
PDF
O365Con19 - Be The Protagonist of Your Modern Workplace - Corinna Lins
PDF
O365Con19 - How to Really Manage all your Tasks Across Microsoft 365 - Luise ...
PDF
O365Con19 - Sharing Code Efficiently in your Organisation - Elio Struyf
PDF
O365Con19 - Things I've Learned While Building a Product on SharePoint Modern...
PDF
O365Con19 - Keep Control of Your Data with AIP and CA - Bram de Jager
PDF
O365Con19 - Kaizala a Dive Into the Unknown - Rick van Rousselt
PDF
O365Con19 - How to Inspire Users to Unstick from Email - Luise Freese
PDF
O365Con19 - O365 Identity Management and The Golden Config - Chris Goosen
O365Con19 - UI:UX 101 Learn How to Design Custom Experiences for SharePoint -...
O365Con19 - Model-driven Apps or Canvas Apps? - Rick Bakker
O365Con19 - Office 365 Groups Surviving the Real World - Jasper Oosterveld
O365Con19 - Developing Timerjob and Eventhandler Equivalents - Adis Jugo
O365Con19 - Sharepoint with (Artificial) Intelligence - Adis Jugo
O365Con19 - What Do You Mean 90 days Isn't Enough - Paul Hunt
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Start Developing Teams Tabs and SharePoint Webparts with SPFX - O...
O365Con19 - Start Your Journey from Skype for Business to Teams - Sasja Beere...
O365Con19 - Lets Get Started with Azure Container Instances - Jussi Roine
O365Con19 - Azure Blackbelt - Jussi Roine
O365Con19 - Customise the UI in Modern SharePoint Workspaces - Corinna Lins
O365Con19 - Be The Protagonist of Your Modern Workplace - Corinna Lins
O365Con19 - How to Really Manage all your Tasks Across Microsoft 365 - Luise ...
O365Con19 - Sharing Code Efficiently in your Organisation - Elio Struyf
O365Con19 - Things I've Learned While Building a Product on SharePoint Modern...
O365Con19 - Keep Control of Your Data with AIP and CA - Bram de Jager
O365Con19 - Kaizala a Dive Into the Unknown - Rick van Rousselt
O365Con19 - How to Inspire Users to Unstick from Email - Luise Freese
O365Con19 - O365 Identity Management and The Golden Config - Chris Goosen

Recently uploaded (20)

PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PPTX
Big Data Technologies - Introduction.pptx
PDF
Empathic Computing: Creating Shared Understanding
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPT
Teaching material agriculture food technology
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
NewMind AI Weekly Chronicles - August'25 Week I
Building Integrated photovoltaic BIPV_UPV.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Digital-Transformation-Roadmap-for-Companies.pptx
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Big Data Technologies - Introduction.pptx
Empathic Computing: Creating Shared Understanding
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
20250228 LYD VKU AI Blended-Learning.pptx
Spectral efficient network and resource selection model in 5G networks
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Dropbox Q2 2025 Financial Results & Investor Presentation
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Teaching material agriculture food technology
Understanding_Digital_Forensics_Presentation.pptx
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf

SPUnite17 Large Lists in SharePoint

  • 2. SharePoint & Large lists Albert-Jan Schot @appieschot
  • 3. SharePoint lists & libraries “You can store up to 30 million items or documents in a SharePoint list or library.”
  • 4. List View Threshold 1. A view returns a total of more than 5,000 items or 2. Evaluate more than 5,000 items to determine if they match • Items in the recycle bin count towards your List View Threshold • Items are grouped per folder unless you specify otherwise • Sorting a view re-evaluates the items by executing a query
  • 5. Announcements at Ignite 2017 A single list can contain up to 30 million items. The modern lists and libraries user experience is ready for the largest enterprise content collaboration scenarios. The modern UI has been tuned to take better advantage of indices to handle user queries.
  • 6. Predictive Indexing Feature Capability Availability Synchronous indexing Lists of size 2,500 – 19,999 items Create indices on demand, when they’re needed Create indices for ad-hoc user sorts inside lists NOW! Create indices for filtered and sorted columns inside views, when views are created or saved NOW! Create indices for more ad-hoc actions: filters, API calls, Group Bys, etc. Evaluating for CY2018 Priority based on usage data, feedback Background Indexing Lists of size 2,500 – 19,999 items Go through and create indices for old views that were created a long time ago Create indices for filtered and sorted columns inside views NOW! Predictive indexing for very large lists of size 20,000+ items All of the above capabilities continue to work when lists become very large Evaluating for CY2018 Priority based on usage data, feedback
  • 7. Robust User Experience Feature Current Availability Evaluating for CY2018 Smart Sorts Queries that specify a sort, but no filter, can take advantage of indices. Paging feature works when your sort is specified on one of these field types: • Single line of text • Multiple lines of text • Date/Time • Single value choice • Multi-value choice • Number • Currency Paging feature works when your sort is specified on one of these field types: • Person • Lookup • Managed Metadata Users Don’t Get Throttled Users can page through items along the specified sort order, when that query would normally be throttled. Requires a sort on a supported indexed field
  • 8. Ignite 2017 takeaways 1. While SharePoint Lists and Libraries can support up to 30M items you should do up-front planning. 2. Predictive indexing works in classic, but smart sort is modern-only 3. Let predictive indexing work for you • Set up your indexes before migrating your whole list if you have more than 20K items • Set up views (or indices) to mirror API calls that will be made
  • 9. Options when hitting the List View Threshold 1. Move documents into folders 2. Column indexing 3. Metadata Navigation 4. Content Organizer 5. 3th Party Solutions or Custom Development
  • 10. Documents into Folders 1. Folder versus Metadata 2. Move items to a folder and create a structure where there no more than 5000 documents in a folder 3. Document sets are a folder
  • 11. Column Indexing 1. Maximum of 20 indexes per list, and not all columns can be indexed ▪ Not supported: Multiple lines of text, Choice (multi-valued), Calculated, Hyperlink or Picture, Custom Columns, Person or Group (multi-valued), External data 2. Only used by the first filter 3. Cannot be created once a list is + 20.000 items 4. ID & Name are indexed by default, any column set to be unique is indexed as well.
  • 12. Metadata Navigation 1. Compound Indexes: Combine filters on indexed columns instead of one 2. Fall back to return a subset of less than 5000 instead of ‘error’ 3. Requires configuration on the list, and should be turned on before hitting the +5000 items.
  • 13. Content Organizer 1. Move documents in folders for you, based on rules 2. Manage folder size, thus making sure no more than 2500 items will be put in a folder
  • 14. How to deal with large lists 1. Plan large lists before being confronted 2. Consider alternatives like 3th party apps or search 3. Just because you can doesn’t mean you should 4. Provide feedback https://sharepoint.uservoice.com