NetApp Fabric Pool Deck

Session 1143-2
FabricPool Deep Dive
Use cases and best practices when tiering to the cloud
John Lantz
Technical Marketing Engineer

The information in this presentation is confidential and proprietary to NetApp
and may not be disclosed without the written permission of NetApp.
The information is intended to outline our general product direction. It is
intended for information purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any material, code, or functionality,
and should not be relied upon in making purchasing decisions. NetApp makes
no warranties, expressed or implied, on future functionality and timeline. The
development, release, and timing of any features or functionality described for
NetApp’s products remains at the sole discretion of NetApp. NetApp's strategy
and possible future developments, products and or platforms directions and
functionality are all subject to change without notice. NetApp has no obligation
to pursue any course of business outlined in this document or any related
presentation, or to develop or release any functionality mentioned therein.
Confidentiality Notice
Data Driven
2 NetApp Insight © 2018 NetApp, Inc. All rights reserved. NetApp Confidential – Limited Use Only

Agenda
1) What’s FabricPool?
2) Primary use cases
3) What’s new?
4) Best practices
5) Getting started
6) Q&A

NetApp Insight © 2018 NetApp, Inc. All rights reserved. NetApp Confidential – Limited Use Only4
What’s FabricPool?

Getting Here from There: The Last Five Years
HDD SSD
Flash Pool®, Hybrid Flash

HDD SSD
CLOUD
Cloud Volumes ONTAP®

HDD SSD
CLOUD
FabricPool
Multiple Cloud Providers
Cloud Volumes ONTAP®

FabricPool Today
After
 Automatic tiering
 Zero-touch management
 Preserves file system
 Total cost of ownership
On-PremisesFootprint
FabricPool
Inactive
Data
Object Storage
Performance
Tier
Cloud
Tier
80%
Before
Active Data Inactive Data
8
NetApp Insight © 2018 NetApp, Inc. All rights reserved. NetApp Confidential – Limited Use Only

Data blocks are written with temperature value: hot ( )
Blocks, Not Files
1
9
NetApp® FlexVol® Volume

Blocks, Not Files
1
2
10
Temperature scan monitors the activity of each block and
decreases the temperature value during every scan until it
becomes cold ( ) (263 days)
Default is 2 days for the Snapshot-Only tiering policy
Default is 31 days for the Auto tiering policy

Blocks, Not Files
1
2
3 Tiering scan collects cold blocks ( ) and packages them into 4MB
objects (1,024 4K blocks)
11

Blocks, Not Files
Objects are PUT into the cloud tier
12
1
2
3
4
Tiering scan collects cold blocks ( ) and packages them into 4MB
objects (1,024 4K blocks)

• No stubs
• No agents or intermediaries
• No complex file-policy engines
FabricPool GETs cold blocks ( ) and writes them to the
performance tier, making them hot ( )
GET operations fetch blocks (4K256K), not necessarily the
entire 4MB object.
Blocks, Not files
13
Faster, more efficient, and less expensive

 Deduplication
Storage Efficiency

 Deduplication, compression
Storage Efficiency

 Deduplication, compression, and compaction
carry over to the cloud tier
Storage Efficiency

 Deduplication, compression, and compaction
carry over to the cloud tier
 Reducing object storage and transport cost
 NetApp® ActiveIQ®, NetApp OnCommand® System Manager,
storage aggregate show-efficiency
 TR-4476: Data Compression, Deduplication, and Compaction
Storage Efficiency
4.7:1

It’s Happening Now
What’s FabricPool
0.0 PB
0.5 PB
1.0 PB
1.5 PB
2.0 PB
2.5 PB
3.0 PB
3.5 PB
4.0 PB
Q3CY17 Q4CY17 Q1CY18 Q2CY18 Q3CY18 Q4CY18
CapacityTiered
9.4
9.3
9.2

Primary Use Cases

FabricPool with Primary Data
 Snapshot-Only
2-day default; NetApp ONTAP® 9.2
~15%
 Auto
31-day default; ONTAP 9.4
>50%
 Adjustable cooling period
2 to 63 days; ONTAP 9.4
Primary use cases
20
Primary Cluster
After
Primary Cluster
Before
S3
Provisioned storage
Active data
NetApp® Snapshot™ copies
Inactive data

FabricPool with Secondary Data
Primary use cases
Secondary ClusterPrimary Cluster  Backup tiering policy
 No temperature scan
 No tiering scan
 Data-protection volumes
 Source -> destination
21
NetApp®
SnapMirror®
NetApp
SnapVault®
S3
Provisioned storage
Active data
Inactive data

FabricPool with Secondary Data
Primary use cases
Secondary ClusterPrimary Cluster  Cloud Volumes ONTAP®
 ONTAP Select
22
NetApp®
SnapMirror®
NetApp
SnapVault®
S3
Provisioned storage
Active data
Inactive data

Primary use cases
 www.evaluatorgroup.com/FabricPool
 Capacity
 Growth
 Snapshot copies
 Cold data
 Multi-year TCO
Total Cost of Ownership

What’s New?

Auto Volume Tiering Policy
 Auto tiering policy
 Tiers all inactive (cold) primary data
 Default cooling period: 31 days
 Cooling period is adjustable: 2 to 63 days
ONTAP 9.4
S3
Provisioned storage
Active data
Snapshot copies
Inactive data

Microsoft Azure Blob Storage
 Support for Hot and Cool access tiers
 Archive access tier not supported
 Azure ExpressRoute (10Gbps) recommended
ONTAP 9.4

ONTAP Select
 ONTAP anywhere
 ONTAP
 Cloud Volumes ONTAP
 ONTAP Select
ONTAP 9.4
S3

Inactive Data Reporting
 NetApp® OnCommand® System Manager displays
inactive data that can be tiered
from the aggregate’s performance tier
ONTAP 9.4

Object-Store Profiler
Test latency and throughput performance of object stores before
you attach them to FabricPool aggregates
ONTAP 9.4
Op Size Total Failed Latency(ms) Throughput
min max avg
-------------------------------------------------------------------------------
PUT 4MB 50000 0 273 9500 719 277.3MB
GET 4KB 5000000 0 4 9591 38 48.46MB
GET 8KB 5000000 0 5 9121 37 123.3MB
GET 32KB 5000000 0 7 7889 60 475.3MB
GET 256KB 2125276 0 21 7838 450 530.7MB

FlexGroup Volumes
NetApp® FlexVol® volumes
 Single node, single aggregate
 2 billion files
 100TB
ONTAP 9.5
FlexGroup volumes
 Multiple nodes, multiple aggregates
 50 billion files per HA pair
 20PB
Cloud
+

Client-Side Encryption
ONTAP 9.5
 NetApp® Volume Encryption (NVE)
 NetApp Storage Encryption (NSE)
 AES-256 encryption
 Server-side encryption
 Client-side encryption
 TLS 1.2

New Object-Store Providers
 IBM Cloud Object Storage (ICOS)
 Cleversafe (private cloud)
 SoftLayer (public cloud)
 Amazon Commercial Cloud Services (C2S)
 Air-gapped cloud environment
 Governments, public sectors, intelligence communities
ONTAP 9.5

Best Practices

 Traditional aggregate
Data Protection
Best practices
Aggregate
Vol1
Vol2
Vol3

 FabricPool aggregate
Data Protection
Best practices
Vol1
Cloud
Vol2
Vol3
Aggregate
+

 FabricPool aggregate + data protection
Data Protection
Best practices
Vol1
Cloud
Vol2
Vol3
Aggregate
+ NetApp®
SnapMirror®
Source Destination

Capacity
Best practices
 Sizing
 Hot data
 Cold data’s metadata
 Cold data that is made hot
 Cold data until it is tiered to the cloud tier
 Limits
 5% reserved for metadata
 800TB  16PB aggregates
1:10
1:20

Capacity
Best practices
 NetApp® Cloud Volumes ONTAP® is different
 Capacity does not grow to include additional tiered capacity
 Capacity limits are spread across performance and cloud tiers
 ONTAP
 Cloud Volumes ONTAP
Cloud
+10TB 200TB
Performance
Performance Object
10TB 86TB
+

Performance
Best practices
 NetApp® StorageGRID®
 More nodes = more CPU
 More CPU = more IOPS
 More IOPS = more GETs
 Public Clouds
 IOPS limited by provider
 Number of concurrent sessions
 Constrained at the bucket level ? 1000*

Write-Backs
Best practices
 Cold blocks are fetched using a GET operation, written to the performance tier, and
made hot … but not in all circumstances:
 Snapshot-Only (default)
Read: cold blocks are made hot and written to the performance tier
 Auto
Random read: cold blocks are made hot and written to the performance tier
Sequential read: cold blocks stay cold; blocks are not written to the performance tier
 Backup
Read: cold blocks stay cold; blocks are not written to the performance tier
 >70% capacity on performance tier
Read: cold blocks stay cold; blocks are not written to the performance tier

Temperature and Tiering Scans
Best practices
 Custom cooling periods
 Snapshot-Only (2-days), Auto (31-days)
 2-63 days
 NetApp SnapMirror®
 Background storage efficiency processes are more efficient than inline processes
 Schedule mirror and vault processes before data is tiered
 Please don’t cascade from volumes using the backup tiering policy
 Tiering scans
 Once per day
 Manually force tiering by taking the volume offline/online, volume move
 Backup tiering policy ignores temperature and tiering scans

Get Started

Supported Systems
 NetApp® ONTAP® 9.2+
 SSD aggregates
 ONTAP Select
 NetApp Cloud Volumes ONTAP
 Amazon
 Microsoft Azure
 Object stores
 Amazon C2S
 Amazon S3
 IBM Cloud Object Storage
 Microsoft Azure Blob Storage
 NetApp StorageGRID®
Get started

Inactive Data Reporting
 NetApp® OnCommand® System Manager displays
inactive (cold) data that can be tiered from the
aggregate’s performance tier
 FabricPool aggregates default: True
 Non-FabricPool aggregates default: False
 Cannot be enabled where FabricPool cannot be enabled
(HDD, root, NetApp MetroCluster™, etc.)
 Enable through CLI
storage aggregate modify
-aggregate <name>
-is-inactive-data-reporting-enabled true
 View through CLI
volume show –fields
performance-tier-inactive-user-data,
performance-tier-inactive-user-data-percent
Get started

Object Store Profiler
 Test latency and throughput performance of object stores before you attach them to
FabricPool aggregates
 storage aggregate object-store profiler start/show
Get started
Op Size Total Failed Latency(ms) Throughput
min max avg
-------------------------------------------------------------------------------
PUT 4MB 50000 0 273 9500 719 277.3MB
GET 4KB 5000000 0 4 9591 38 48.46MB
GET 8KB 5000000 0 5 9121 37 123.3MB
GET 32KB 5000000 0 7 7889 60 475.3MB
GET 256KB 2125276 0 21 7838 450 530.7MB
Note: Advanced privilege level is required to use object-store profiler.

Key Takeaways
 Understand what's new in FabricPool
 Understand how to get the most value out FabricPool
 Understand how to use inactive data reporting and the object store profiler

Related Sessions and Resources
 TR-4598: FabricPool Best Practices
 1106-2: Rethinking VMware Data Protection with FabricPool
 Monday 10:00 AM Tuesday 11:00 AM
 1161-2: Oracle and ONTAP: Beyond Best Practices
 Monday 3:00 PM Tuesday 3:15 PM
 1132-1: ONTAP Hybrid Cloud Data Protection and Services Application
Tuesday 11:00 Wednesday 2:00

Insight
Stay Connected
Follow NetApp Insight on Facebook and Twitter
https://www.facebook.com/NetAppInsight
https://twitter.com/NetAppInsight
#NetAppInsight
Insight

Tell Us What You Thought
Take an Insight survey
on your mobile device.
Completed surveys are entered
into a drawing to win prizes.
Don’t have the app? Download the Insight Mobile App
at the Apple Store and on Google Play.

Thank You
© 2018 NetApp, Inc. All rights reserved. No portions of this presentation may be reproduced without prior written consent of NetApp, Inc. Specifications are subject to change without notice. NetApp and
the NetApp logo are registered trademarks of NetApp, Inc. in the United States and/or other countries. All other brands or products are trademarks or registered trademarks of their respective holders.

Questions?

NetApp Fabric Pool Deck

More Related Content

What's hot (20)

Similar to NetApp Fabric Pool Deck (20)

Recently uploaded (20)

NetApp Fabric Pool Deck

Editor's Notes