SlideShare a Scribd company logo
A Dell Technical White Paper
Express Flash NVMe PCIe SSD Monitoring,
Inventory and Configuring in Dell
PowerEdge 13th Generation Servers
This Dell Technical white paper provides detailed information about Express Flash
NVMe PCIe SSD device Monitoring and Inventory using various interfaces such as
WS-Man, RACADM and GUI.
Dell Engineering
August 2014
Authors:
Anish Kurunthil
Anis Ahmed
Texas Roemer
A Dell Technical White Paper
3 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
Revisions
Date Description
June 2014 Initial release
THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND
TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED AS IS, WITHOUT EXPRESS OR IMPLIED WARRANTIES OF
ANY KIND.
© 2014 Dell Inc. All rights reserved. Reproduction of this material in any manner whatsoever without the express
written permission of Dell Inc. is strictly forbidden. For more information, contact Dell.
Dell, the DELL logo, and the DELL badge are trademarks of Dell Inc. Symantec, NetBackup, and Backup Exec are
trademarks of Symantec Corporation in the U.S. and other countries. Microsoft, Windows, and Windows Server are
registered trademarks of Microsoft Corporation in the United States and/or other countries. Other trademarks and
trade names may be used in this document to refer to either the entities claiming the marks and names or their
products. Dell disclaims any proprietary interest in the marks and names of others.
Dell™, Dell Express Flash NVMe ,the Dell logo, Dell Boomi™, Dell Precision™ ,OptiPlex™, Latitude™, PowerEdge™,
PowerVault™, PowerConnect™, OpenManage™, EqualLogic™, Compellent™, KACE™, FlexAddress™, Force10™ and
Vostro™ are trademarks of Dell Inc. Other Dell trademarks may be used in this document. Cisco Nexus®, Cisco
MDS®, Cisco NX-0S®, and other Cisco Catalyst® are registered trademarks of Cisco System Inc. EMC VNX®, and EMC
Unisphere® are registered trademarks of EMC Corporation. Intel®, Pentium®, Xeon®, Core® and Celeron® are
registered trademarks of Intel Corporation in the U.S. and other countries. AMD® is a registered trademark and AMD
Opteron™, AMD Phenom™ and AMD Sempron™ are trademarks of Advanced Micro Devices, Inc. Microsoft®,
Windows®, Windows Server®, Internet Explorer®, MS-DOS®, Windows Vista® and Active Directory® are either
trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Red Hat®
and Red Hat® Enterprise Linux® are registered trademarks of Red Hat, Inc. in the United States and/or other countries.
Novell® and SUSE® are registered trademarks of Novell Inc. in the United States and other countries. Oracle® is a
registered trademark of Oracle Corporation and/or its affiliates. Citrix®, Xen®, XenServer® and XenMotion® are either
registered trademarks or trademarks of Citrix Systems, Inc. in the United States and/or other countries. VMware®,
Virtual SMP®, vMotion®, vCenter® and vSphere® are registered trademarks or trademarks of VMware, Inc. in the United
4 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
States or other countries. IBM® is a registered trademark of International Business Machines Corporation. Broadcom®
and NetXtreme® are registered trademarks of Broadcom Corporation. Qlogic is a registered trademark of QLogic
Corporation. Other trademarks and trade names may be used in this document to refer to either the entities claiming
the marks and/or names or their products and are the property of their respective owners. Dell disclaims proprietary
interest in the marks and names of others.
5 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
Contents
Revisions............................................................................................................................................................................................. 3
Executive Summary .......................................................................................................................................................................... 7
1 Introduction................................................................................................................................................................................8
1.1 Existing Solution..............................................................................................................................................................8
1.2 PCIe SSD Inventory , Monitoring and Configuration................................................................................................8
1.3 Prerequisites.....................................................................................................................................................................8
2 PCIe SSD Inventory and Monitoring.....................................................................................................................................10
2.1 PCIe SSD Controllers....................................................................................................................................................10
2.1.1 Using WS–Man...............................................................................................................................................................10
2.1.2 Using RACADM...............................................................................................................................................................11
2.1.3 Using GUI.........................................................................................................................................................................11
2.2 PCIe SSD Enclosure...................................................................................................................................................... 12
2.2.1 Using WS–Man............................................................................................................................................................... 12
2.2.2 Using RACADM.............................................................................................................................................................. 13
2.2.3 Using GUI........................................................................................................................................................................ 13
2.3 PCIe SSD Physical Disks............................................................................................................................................... 14
2.3.1 Using WS–Man............................................................................................................................................................... 14
2.3.2 Using RACADM.............................................................................................................................................................. 15
2.3.3 Using GUI........................................................................................................................................................................ 16
3 PCIe SSD Configuration.......................................................................................................................................................... 17
3.1 Blink/UnBlink for PCIe SSD ........................................................................................................................................ 17
3.1.1 Using WS–Man............................................................................................................................................................... 17
3.1.2 Using RACADM.............................................................................................................................................................. 18
3.1.3 Using GUI........................................................................................................................................................................ 19
3.2 Prepare to Remove for PCIe SSD............................................................................................................................... 19
3.2.1 Using WS–Man...............................................................................................................................................................20
3.2.2 Using RACADM.............................................................................................................................................................. 21
3.2.3 Using GUI........................................................................................................................................................................22
3.3 Secure erase for PCIe SSD...........................................................................................................................................23
3.3.1 Using WS–Man...............................................................................................................................................................23
3.3.2 Using RACADM..............................................................................................................................................................24
6 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
3.3.3 Using GUI........................................................................................................................................................................24
4 Error Codes...............................................................................................................................................................................26
5 Common Issues .......................................................................................................................................................................26
6 TroubleShooting ......................................................................................................................................................................27
7 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
Executive Summary
This white paper provides information about monitoring, inventory and configuration, using iDRAC
interfaces such as WS–Man, RACADM and the GUI. These devices include the Dell Express Flash NVMe
PCIe SSD, backplane, extender, and drives.
8 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
1 Introduction
This Dell Technical white paper provides detailed information about the capabilities of integrated Dell
Remote Access Controller (iDRAC8) for Monitoring , Inventory and Configuring Express Flash NVMe PCIe
SSDs on 13th generation servers and later of Dell.
1.1 Existing Solution
The PowerEdge R920 server has sideband support for NVMe PCIe SSD Device discovery. But it does not
support the advanced configuration options available in 13G systems.
1.2 Dell Express Flash NVMe PCIe SSD Inventory , Monitoring and
Configuration
This Document describes the monitoring , inventory and configuration functionality of Express Flash
NVMPCIe SSD s that is implemented in Dell 13th generation server platforms. This feature provides the
users to Inventory and remotely monitor the health of PCIe SSD devices in the server.
The PCIe SSD subsystem consists of the Backplane, PCIe Extender card which is attached to the backplane
of the system (while 13G Blades will use an extender card that does not physically connect to the
backplane ( M630 , M830)) and provides PCIe at the front of the connectivity for up to four or eight PCIe
SSD ( Only in R920 12G)devices chassis and the PCIe SSD devices.
The following are the list of features that are supported by WSMAN , RACADM and GUI as part Express
Flash NVMe PCIe SSD in 13G.
 Inventory and Monitoring of Express Flash NVMe PCIe SSD
 Configuring PCIe SSD
o Blink/UnBlink LED
o Prepare to remove
o Secure Erase
1.3 Prerequisites
Make sure that the following prerequisites are met :
 A software license for 13th generation Dell PowerEdge and later servers. For more information
about managing licenses using iDRAC Web interface, click Overview  Server  Licenses. In the
upper-right corner, click Help to view the iDRAC Online Help.
 All Dell Express Flash NVMe PCIe SSDs are NVMe 1.0c compliant and should have the latest Dell
Firmware.
 13G Platform must be fully enabled for Express Flash NVMe PCIe SSD support.
 iDRAC Service Module (iSM) should be installed in the Operating System for PrepareToRemove
Operation.
9 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
o For more information about iSM, reference www.delltechcentercom/iDRAC (manuals)
10 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
2 PCIe SSD Inventory and Monitoring
Comprehensive view of PCIe SSD Subsystem will be provided by using WSMAN , RACADM and GUI
interface layers . Complete monitoring and inventory is available only for the device which has sideband
support. PCIeSubsystem consists of following objects.
 PCIe SSD BackPlane
 PCIe Extender card
 PCIe SSD Drive ( Each PCIe SSD has its own independent controller )
Hardware Inventory:
 PCIe SSD Ext card.
 PCIe SSD Backplane
 PCIe SSDs 2.5” form factor
 PCIe SSD card form factor
Hardware Monitoring:
 PCIe SSDs 2.5” form factor
 PCIe SSD card form factor
The card form factor devices are PCIe SSDs connected directly to the PCIe slot. The card form factor does
not support hot-plug, blink/unblink and prepare to remove operations.
Software Inventory:
 Firmware Version
2.1 PCIe SSD Extenders
2.1.1 Using WS–Man
To get the list of PCIe SSD Extenders , use the below WSMAN command .
winrm e http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/root/dcim/DCIM_PCIeSSDExtenderView
-u:<UserName> -p:<Password> -r:https://<Ip-Address>/wsman -SkipCNcheck -SkipCAcheck -
SkipRevocationCheck -encoding:utf-8 -a:basic
Example : Result after running the above command
11 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
DCIM_PCIeSSDExtenderView
DeviceDescription = PCIe Extender in PCIe Slot 3
FQDD = PCIeExtender.Slot.3
InstanceID = PCIeExtender.Slot.3
PrimaryStatus = 1
RollupStatus = 1
2.1.2 Using RACADM
To get the list of controllers and PCIe SSD Extenders, run the following command
/admin1-> racadm storage get controllers
RAID.Integrated.1-1
PCIeExtender.Slot.3
To get the properties of PCIe SSD Extender, use the following command format
Syntax: racadm storage get controllers:<PcieSSD Extender FQDD>
Example:
/admin1-> racadm storage get controllers:PCIeExtender.Slot.3
PCIeExtender.Slot.3
RollupStatus = Ok
DeviceDescription = PCIe Extender in PCIe Slot 3
Status = Ok
Name = PCIeExtender 3 (PCI Slot 3)
2.1.3 Using GUI
To get the list of Controllers and PCIe SSD Extenders , use the below navigation.
12 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
2.2 PCIe SSD Enclosure
2.2.1 Using WS–Man
To get the list of Enclosure , Use the below WSMAN command.
winrm e http://schemas.dmtf.org/wbem/wscim/1/cim-
schema/2/root/dcim/DCIM_PCIeSSDBackPlaneView -u:<Username> -p:< Password> -r:https://<IP-
Address>/wsman -SkipCNcheck -SkipCAcheck -SkipRevocationCheck -encoding:utf-8 -a:basic
Example : Result after running the above command
DCIM_PCIeSSDBackPlaneView
DeviceDescription = Enclosure.Internal.0-1:PCIeExtender.Slot.3
FQDD = Enclosure.Internal.0-1:PCIeExtender.Slot.3
FirmwareVersion= 0.80
InstanceID = Enclosure.Internal.0-1:PCIeExtender.Slot.3
MediaType = 0
ProductName = PCIe Backplane
RollupStatus = 1
13 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
SlotCount = 4
2.2.2 Using RACADM
To get the list of enclosures, run the following command
/admin1-> racadm storage get enclosures
Enclosure.Internal.0-1:RAID.Integrated.1-1
Enclosure.Internal.0-1:PCIeExtender.Slot.3
To get the properties of PCIe SSD Enclosure, use the following command format
syntax: racadm storage get enclosures:<PcieSSD Enclosure FQDD>
Example:
/admin1-> racadm storage get enclosures:Enclosure.Internal.0-1:PCIeExtender.Slot.3
Enclosure.Internal.0-1:PCIeExtender.Slot.3
RollupStatus = Ok
DeviceDescription = Enclosure.Internal.0-1:PCIeExtender.Slot.3
Name = PCIe SSD BP 1
SlotCount = 4
FirmwareVersion = 0.80
2.2.3 Using GUI
To get the list of enclosures in GUI , use the below navigation
14 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
2.3 PCIe SSD Physical Disks
2.3.1 Using WS–Man
To get the list ofExpress Flash NVMe devices, use the below WSMAN command.
winrm e http://schemas.dmtf.org/wbem/wscim/1/cim-
schema/2/DCIM_PCIeSSDView?__cimnamespace=root/dcim -u: <UserName> -p:<Password> -
r:https://<Ip Address>/wsman -encoding:utf-8 -a:basic -SkipCNcheck -SkipCAcheck
Example : Result after running the above command.
DCIM_PCIeSSDView
BusProtocol = 7
DeviceDescription = PCIe Solid-State Drive in Slot 6 in Bay 1
DeviceProtocol = NVMe 1.0
DriveFormFactor = 2
FQDD = Disk.Bay.6:Enclosure.Internal.0-1:PCIeExtender.Slot.3
FailurePredicted = NO
InstanceID = Disk.Bay.6:Enclosure.Internal.0-1:PCIeExtender.Slot.3
Manufacturer = SAMSUNG
MaxCapableSpeed = 8 GT/s
MediaType = 1
15 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
Model = Dell Express Flash NVMe 800GB
NegotiatedSpeed = 8 GT/s
PCIeCapableLinkWidth = x4
PCIeNegotiatedLinkWidth = x4
PrimaryStatus = 1
ProductID = a820
RemainingRatedWriteEndurance = 100
Revision = IPM0ED35
SerialNumber = S1J1NYAD90018
SizeInBytes = 0
State = 1
2.3.2 Using RACADM
To get the list of physical disks and Express Flash NVMe PCIe SSD devices, run the following command
/admin1-> racadm storage get pdisks
Disk.Bay.0:Enclosure.Internal.0-1:RAID.Integrated.1-1
Disk.Bay.1:Enclosure.Internal.0-1:RAID.Integrated.1-1
Disk.Bay.2:Enclosure.Internal.0-1:RAID.Integrated.1-1
Disk.Bay.3:Enclosure.Internal.0-1:RAID.Integrated.1-1
Disk.Bay.4:Enclosure.Internal.0-1:RAID.Integrated.1-1
Disk.Bay.5:Enclosure.Internal.0-1:RAID.Integrated.1-1
Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3
Disk.Bay.6:Enclosure.Internal.0-1:PCIeExtender.Slot.3
Disk.Bay.7:Enclosure.Internal.0-1:PCIeExtender.Slot.3
Disk.Bay.9:Enclosure.Internal.0-1:PCIeExtender.Slot.3
To get the properties of Express Flash NVMe PCIe SSD devices, use the following command format
syntax: racadm storage get pdisks:<PcieSSD FQDD>
Example:
/admin1-> racadm storage get pdisks:Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3
Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3
Status = Ok
DeviceDescription = PCIe Solid-State Drive in Slot 8 in Bay 1
Name = Physical Device 8
State = Ready
Size = 745.21 GB
16 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
BusProtocol = PCIe
MediaType = SSD
Model = Dell Express Flash NVMe 800GB
ProductId = a820
SerialNumber = S1J1NYAD90019
DeviceProtocol = NVMe1.0
Manufacturer = SAMSUNG
PCIeNegotiatedLinkWidth = x4
PCIeCapableLinkWidth = x4
MaxCapableSpeed = 8 GT/s
NegotiatedSpeed = 8 GT/s
FormFactor = 2.5 Inch
Revision = IPM0ED35SAM SAMSUNG MZWEI800HAGM 000D3
RemainingRatedWriteEndurance = 100 %
FailurePredicted = NO
2.3.3 Using GUI
To get the list of physical disks and Express Flash NVMe PCIe SSD devices , use the below navigation
17 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
3 PCIe SSD Configuration
Configuration support for Express Flash NVMe PCIe SSD devices Storage Subsystem is introduced in 13Th
Generation release onwards. In this case , the configurations do not require a reboot . Configurations can
still be done through staged ( Scheduled and it requires reboot to see the effect ) based on the request
from the interface layer.
During a job creation , If a new optional parameter ( apply now with out reboot – RealTime , apply now
with reboot – Staged ) is specified from the interface layer , based on the new parameter , operations (
Real or Staged ) would be performed.
In order to apply the pending values , one has to create a job which can be real time or staged as
mentioned earlier.
If Real time only operation is pending, no staged only operations allowed, but operations that could be
done either ways (staged or real time) will be allowed to be set, but done via real time .
If Staged only operation is pending, no real time only operations allowed, but operations that could be
done either ways( staged or real time) will be allowed , but done via staged .
3.1 Blink/UnBlink for PCIe SSD
This Blink operation blinks one of the LED in the disk and is performed to locate a disk with in a system.
Unblink operation unblinks the LED in the disk. This operation is real time and do not require a job to
create. It is an immediate operation.
3.1.1 Using WS–Man
In order to blink the PCIe SSD , use the following WSMAN command.
winrm i BlinkTarget
cimv2/root/dcim/DCIM_RAIDService?SystemCreationClassName=DCIM_ComputerSystem+CreationClass
Name=DCIM_RAIDService+SystemName=DCIM:ComputerSystem+Name=DCIM:RAIDService -
u:<UserName> -p:<Password> -r:https://< IP-Adress>/wsman -SkipCNcheck -SkipCAcheck -
encoding:utf-8 -a:basic @{Target=< FQDD of the PCIeSSD>}
Example : After running the above command , output looks like below upon successful .
BlinkTarget_OUTPUT
RebootRequired = NO
ReturnValue = 0
18 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
In order to unblink the PCIe SSD , use the following WSMAN command.
winrm i UnBlinkTarget
cimv2/root/dcim/DCIM_RAIDService?SystemCreationClassName=DCIM_ComputerSystem+CreationClass
Name=DCIM_RAIDService+SystemName=DCIM:ComputerSystem+Name=DCIM:RAIDService -
u:<UserName> -p:<Password> -r:https://< IP-Adress>/wsman -SkipCNcheck -SkipCAcheck -
encoding:utf-8 -a:basic @{Target=< FQDD of the PCIeSSD>}
Example : After running the above command , output looks like below upon successful .
UnBlinkTarget_OUTPUT
RebootRequired = NO
ReturnValue = 0
3.1.2 Using RACADM
In order to blink the PCIe SSD, use the below command format
syntax: racadm storage blink:<PCIeSSD FQDD>
Example:
/admin1-> racadm storage blink:Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3
STOR095 : Storage operation is successfully completed.
In order to unblink the PCIe SSD, use the below command format
syntax: racadm storage unblink:<PCIeSSD FQDD>
Example:
/admin1-> racadm storage unblink:Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3
STOR095 : Storage operation is successfully completed
19 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
3.1.3 Using GUI
In order to blink/unblink the PCIe SSD , use the below navigation
3.2 Prepare to Remove for PCIe SSD
The Prepare to Remove operation shall be used to safely remove a PCIe SSD drive from the system. This
operation stops any background activity and any ongoing I/O activity so that device can be removed
safely.
After the drive is removed, it can be replaced by either another PCIe SSD drive or SAS/SATA drive.
20 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
This operation causes the status LEDs on the device to blink. The drive can be safely removed from the
system under the following conditions after the Prepare to Remove operation:
 The PCIe SSD is blinking the safe to remove LED pattern.
 The PCIe SSD is no longer accessible by the system.
This feature is supported only at run-time. Since there is no support through sideband for this operation
currently, the ISM infrastructure will be used for this operation.
NOTE: The Supporting Operating system should have NVMe driver loaded for this operation.
NOTE: If linux fails to boot and prompts for the root password, see below:
A stale volume mount point is still present after a device removal or cryptographic erase.
Perform the following steps to recover from this situation:
1. Enter the root password to enter maintenance mode.
2. Remount the root filesystem as read-write using the following command:
 mount -orw,remount/
Or
Manually edit /etc/fstab to remove the non-existent device entry.
3.2.1 Using WS–Man
To prepare the Express Flash NVMe PCIe SSD devices for removal, use the below WSMAN command
winrm i PrepareToRemove
cimv2/root/dcim/DCIM_RAIDService?SystemCreationClassName=DCIM_ComputerSystem+CreationClass
Name=DCIM_RAIDService+SystemName=DCIM:ComputerSystem+Name=DCIM:RAIDService -
u:<UserName> -p:<Password> -r:https://< IP-Adress>/wsman -SkipCNcheck -SkipCAcheck -
encoding:utf-8 -a:basic @{Target=< FQDD of the PCIeSSD>}
Job is Created by using DCIM_RAIDService .CreateTargetedConfigJob( ) method to apply the pending
values . To create a RealTime job which does not require reboot use the below WSMAN command.
winrm i CreateTargetedConfigJob http://schemas.dell.com/wbem/wscim/1/cim-
schema/2/root/dcim/DCIM_RAIDService?__cimnamespace=root/dcim+SystemCreationClassName=DCI
M_ComputerSystem+SystemName=DCIM:ComputerSystem+CreationClassName=DCIM_RAIDService+N
ame=DCIM:RAIDService -u:<UserName> -p:<Password> -r:https://<ip-address>/wsman -SkipCNcheck -
SkipCAcheck -encoding:utf-8 -a:basic @{Target="<PCIeSSD Drive
FQDD>";ScheduledStartTime="TIME_NOW";RealTime="1"}
Check the status of the job and wait until Job completes.
Example : After running the PrepareToRemove command , output looks like below upon successful .
21 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
SecureErase_OUTPUT
RebootRequired = NO
ReturnValue = 0
3.2.2 Using RACADM
To prepare the Express Flash NVMe PCIe SSD devicefor removal, use the below command format
syntax: racadm storage preparetoremove:<PCIeSSD FQDD>
Example:
/admin->racadm storage preparetoremove: Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3
STOR089 : Successfully accepted the storage configuration operation.
To apply the configuration operation, create a configuration job with --realtime option.
To create the required commit jobs, run the jobqueue command.
For more information about the jobqueue command, enter the RACADM command "racadm help
jobqueue”
/admin->racadm jobqueue create Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 --realtime
RAC1024 : Successfully scheduled a job
Verify the job status using “racadm jobqueue view –i JID_xxxxx” command.
Commit JID = JID_996741411337
/admin->racadm jobqueue view -i JID_996741411337
-------------------------------------JOB-----------------------------------
[Job ID = JID_996741411337]
Job Name=Configure: Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3
Status= New
Start Time=[Now]
22 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
Expiration Time=[Not Applicable]
Message=[JCP000: New]
Percent Complete=[0]
-----------------------------------------------------------------------------
3.2.3 Using GUI
To prepare the Express Flash NVMe PCIe SSD devicefor removal in GUI ,
23 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
3.3 Secure erase for PCIe SSD
Secure erase is instant cryptographic erase of data on PCIe SSD devices and all the data on the PCIe SSD
device will be permanently lost.During Secure Erase, the device is not accessible.
While trying from WSMAN , RACADM and GUI interfaces , User should have iDRAC Server control privilege to
perform this operation.There is no sideband support for this operation currently.Hence this operation is
supported only in staged mode and not run-time.
The device will not execute the command immediately. A host reboot is required for the command to take
effect.
3.3.1 Using WS–Man
To Perform the Secure Erase operation on PCIe SSD drive, use the below command.
winrm i SecureErase
cimv2/root/dcim/DCIM_RAIDService?SystemCreationClassName=DCIM_ComputerSystem+CreationClass
Name=DCIM_RAIDService+SystemName=DCIM:ComputerSystem+Name=DCIM:RAIDService -
u:<UserName> -p:<Password> -r:https://< IP-Adress>/wsman -SkipCNcheck -SkipCAcheck -
encoding:utf-8 -a:basic @{Target=< FQDD of the PCIeSSD DRIVE>}
Example : After running the SecureErase command , output looks like below upon successful .
SecureErase_OUTPUT
RebootRequired = YES
ReturnValue = 0
Job is Created by using DCIM_RAIDService .CreateTargetedConfigJob( ) method to apply the pending
values . It supports only staged job. In order to create Staged job , Use the below WSMAN command.
winrm i CreateTargetedConfigJob http://schemas.dell.com/wbem/wscim/1/cim-
schema/2/root/dcim/DCIM_RAIDService?__cimnamespace=root/dcim+SystemCreationClassName=DCI
M_ComputerSystem+SystemName=DCIM:ComputerSystem+CreationClassName=DCIM_RAIDService+N
ame=DCIM:RAIDService -u:<UserName> -p:<Password> -r:https://<IP address>/wsman -SkipCNcheck -
SkipCAcheck -encoding:utf-8 -a:basic @{Target=" FQDD of the PCIeSSD DRIVE
";RebootJobType="1";ScheduledStartTime="TIME_NOW"}
24 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
3.3.2 Using RACADM
To peform a secure erase on PCIe SSD drive, use the below command format
syntax: racadm storage secureerase:<PCIeSSD FQDD DRIVE>
Example:
/admin->racadm storage secureerase: Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3
RAC1040 : Successfully accepted the storage configuration operation.
To apply the configuration operation, create a configuration job, and then restart the host.
To create the required commit and reboot jobs, run the jobqueue command.
For more information about the jobqueue command, enter the RACADM command "racadm help
jobqueue”
/admin->racadm jobqueue create Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3
RAC1024 : Successfully scheduled a job
Verify the job status using “racadm jobqueue view –i JID_xxxxx” command.
Commit JID = JID_996741414444
/admin->racadm jobqueue view -i JID_996741414444
-------------------------------------JOB-----------------------------------
[Job ID = JID_996741414444]
Job Name=Configure: Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3
Status= Scheduled
Start Time=[Now]
Expiration Time=[Not Applicable]
Message=[JCP000: Task successfully scheduled.]
Percent Complete=[0]
-----------------------------------------------------------------------------
3.3.3 Using iDRAC GUI
To peform a secure erase on PCIe SSD drive(s) in GUI ,
25 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
26 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
4 Error Codes
STOR029: Physical disk not found
STOR072: iDRAC Service Module (ISM) is either not present or not running on the server OS.
STOR073: The iDRAC Service Module version present on the server OS does not support the requested
PCIe SSD (NVMe) device operation.
STOR078: The requested operation requires a reboot type that does not match the reboot type required
for pending operations
STOR079: The controller does not support this operation or is in a state that does not allow this operation
STOR0103 : No physical disks are displayed. Check if the server has power, physical disks are available,
and physical disks are connected to the enclosure or backplane.
5
27 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
5 TroubleShooting
Some common problems and possible solutions are mentioned below.
 If Configuration is not successful .
o Check if LC is disabled .
o ISM is not installed or Host OS is not up.
 what log files can be helpful for troubleshooting
o LCLog will have the log details – RAC500 & RAC690
 How to identify a failed component or configuration
o Check the job queue for Job status.
o Timeout of a command and error will be logged in LC Log.

More Related Content

PDF
Dell VLT reference architecture v2 0
PDF
Manual service optiplex 990
PDF
Dell PowerEdge Deployment Guide
PDF
Dell VMware Virtual SAN Ready Nodes
PDF
Dell Precision 3530: Workstation giá rẻ hiệu năng cao
PDF
Dell Precision 7530 Laptops Trần Phát
PDF
Dell Vostro 5470 Laptops Trần Phát
PDF
Đánh giá chi tiết laptop Dell Vostro 3490
Dell VLT reference architecture v2 0
Manual service optiplex 990
Dell PowerEdge Deployment Guide
Dell VMware Virtual SAN Ready Nodes
Dell Precision 3530: Workstation giá rẻ hiệu năng cao
Dell Precision 7530 Laptops Trần Phát
Dell Vostro 5470 Laptops Trần Phát
Đánh giá chi tiết laptop Dell Vostro 3490

What's hot (14)

PDF
HP Spectre 13t
PDF
Dell Vostro 5471 Laptop giá rẻ dành cho sinh viên, văn phòng
PDF
Dell Precision 3540: Laptop Văn Phòng cấu hình cao
PPTX
Webinář: Provozujte datacentrum v kanceláři (Dell VRTX) / 5.9.2013
PDF
Dell Inspiron 15 7000 - Laptops Trần Phát
PDF
Dell g7 7500
PDF
Alienware 15 R3 Service Manual
PDF
Dell Precision 3520: Workstation Hiệu Năng Mạnh Mẽ Đến Bây Giờ
PDF
Dell latitude 5510 - Laptops Trần Phát
PDF
E29632
PDF
Dell Vostro 5581 Laptop giá rẻ chất lượng của Dell
PDF
Oracle database gateway 11g r2 installation and configuration guide
PDF
Configuring a highly available Microsoft Exchange Server 2013 environment on ...
PDF
Dell Inspiron 15 3000 Series Service Manual PDF (English) / User Guide
HP Spectre 13t
Dell Vostro 5471 Laptop giá rẻ dành cho sinh viên, văn phòng
Dell Precision 3540: Laptop Văn Phòng cấu hình cao
Webinář: Provozujte datacentrum v kanceláři (Dell VRTX) / 5.9.2013
Dell Inspiron 15 7000 - Laptops Trần Phát
Dell g7 7500
Alienware 15 R3 Service Manual
Dell Precision 3520: Workstation Hiệu Năng Mạnh Mẽ Đến Bây Giờ
Dell latitude 5510 - Laptops Trần Phát
E29632
Dell Vostro 5581 Laptop giá rẻ chất lượng của Dell
Oracle database gateway 11g r2 installation and configuration guide
Configuring a highly available Microsoft Exchange Server 2013 environment on ...
Dell Inspiron 15 3000 Series Service Manual PDF (English) / User Guide
Ad

Viewers also liked (20)

PPTX
DOC
CURRICULUM VITAE
PPTX
oer power point presentation
PPTX
10 λόγοι για να επισκεφτείτε την αλμωπία!
PDF
Cora Benzie – PORTFOLIO
PDF
Your devices are deployed slideshare
PDF
Whitepaper-ManagingBackplaneSplitMode
PDF
13UnivofMN
PDF
Webinar Series - Customer Facing Devices: Putting the Pieces Together
PDF
CURRICULUM VITAE MR MOTHIBEDI
PDF
How to turn your tablet into a customer facing device moki slideshare
PPTX
How to Make your Gaming App a Success
PDF
7 deadly game insights: Webinar slides July 2015
PPTX
Double Game Revenue & Engagement:10 Killer Insights
PPTX
Automation
PDF
GIAF UK: Spring 2015
PPTX
UK GIAF: Summer 2015
PPTX
UK GIAF: Winter 2015
PDF
GIAF USA Winter 2015
PPTX
GIAF USA: Summer 2015
CURRICULUM VITAE
oer power point presentation
10 λόγοι για να επισκεφτείτε την αλμωπία!
Cora Benzie – PORTFOLIO
Your devices are deployed slideshare
Whitepaper-ManagingBackplaneSplitMode
13UnivofMN
Webinar Series - Customer Facing Devices: Putting the Pieces Together
CURRICULUM VITAE MR MOTHIBEDI
How to turn your tablet into a customer facing device moki slideshare
How to Make your Gaming App a Success
7 deadly game insights: Webinar slides July 2015
Double Game Revenue & Engagement:10 Killer Insights
Automation
GIAF UK: Spring 2015
UK GIAF: Summer 2015
UK GIAF: Winter 2015
GIAF USA Winter 2015
GIAF USA: Summer 2015
Ad

Similar to PCIeSSD (20)

PPTX
22by7 and DellEMC Tech Day July 20 2017 - Power Edge
PDF
040724 Dell University - Server Slide.pdf
PDF
VMworld 2013: Dell Solutions for VMware Virtual SAN
PDF
DellEMC PowerEdge R740xd Rack Server - Sinteza Co
PPTX
Powesizer9200.------------------------------------------------
PDF
Dell poweredge-r730-spec-sheet
PDF
840 specs dell
PDF
MT25 Server technology trends, workload impacts, and the Dell Point of View
PDF
PowerEdge-R310-Tech-Guide-rev1.pdf
PDF
Dell Technologies Dell EMC ISG Storage, CI, HCI and Data Protection Portfolio...
PDF
DataT320 spec sheet
PDF
Dell openmanage-essentials-v2.1 reference guide-en-us
PDF
T310 spec sheet
PDF
Fasg02 mr
PDF
Modernizing your data center with Dell and AMD
PDF
Dell Technologies - The Complete ISG Hardware Portfolio
PPTX
Virtualize with Confidence
PDF
Dell opti plex_3010_spec_sheet (1)
PPTX
Webinář: Dell VRTX - datacentrum vše-v-jednom za skvělou cenu / 7.10.2013
PDF
Storage user cases
22by7 and DellEMC Tech Day July 20 2017 - Power Edge
040724 Dell University - Server Slide.pdf
VMworld 2013: Dell Solutions for VMware Virtual SAN
DellEMC PowerEdge R740xd Rack Server - Sinteza Co
Powesizer9200.------------------------------------------------
Dell poweredge-r730-spec-sheet
840 specs dell
MT25 Server technology trends, workload impacts, and the Dell Point of View
PowerEdge-R310-Tech-Guide-rev1.pdf
Dell Technologies Dell EMC ISG Storage, CI, HCI and Data Protection Portfolio...
DataT320 spec sheet
Dell openmanage-essentials-v2.1 reference guide-en-us
T310 spec sheet
Fasg02 mr
Modernizing your data center with Dell and AMD
Dell Technologies - The Complete ISG Hardware Portfolio
Virtualize with Confidence
Dell opti plex_3010_spec_sheet (1)
Webinář: Dell VRTX - datacentrum vše-v-jednom za skvělou cenu / 7.10.2013
Storage user cases

PCIeSSD

  • 1. A Dell Technical White Paper Express Flash NVMe PCIe SSD Monitoring, Inventory and Configuring in Dell PowerEdge 13th Generation Servers This Dell Technical white paper provides detailed information about Express Flash NVMe PCIe SSD device Monitoring and Inventory using various interfaces such as WS-Man, RACADM and GUI. Dell Engineering August 2014 Authors: Anish Kurunthil Anis Ahmed Texas Roemer
  • 2. A Dell Technical White Paper
  • 3. 3 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers Revisions Date Description June 2014 Initial release THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED AS IS, WITHOUT EXPRESS OR IMPLIED WARRANTIES OF ANY KIND. © 2014 Dell Inc. All rights reserved. Reproduction of this material in any manner whatsoever without the express written permission of Dell Inc. is strictly forbidden. For more information, contact Dell. Dell, the DELL logo, and the DELL badge are trademarks of Dell Inc. Symantec, NetBackup, and Backup Exec are trademarks of Symantec Corporation in the U.S. and other countries. Microsoft, Windows, and Windows Server are registered trademarks of Microsoft Corporation in the United States and/or other countries. Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products. Dell disclaims any proprietary interest in the marks and names of others. Dell™, Dell Express Flash NVMe ,the Dell logo, Dell Boomi™, Dell Precision™ ,OptiPlex™, Latitude™, PowerEdge™, PowerVault™, PowerConnect™, OpenManage™, EqualLogic™, Compellent™, KACE™, FlexAddress™, Force10™ and Vostro™ are trademarks of Dell Inc. Other Dell trademarks may be used in this document. Cisco Nexus®, Cisco MDS®, Cisco NX-0S®, and other Cisco Catalyst® are registered trademarks of Cisco System Inc. EMC VNX®, and EMC Unisphere® are registered trademarks of EMC Corporation. Intel®, Pentium®, Xeon®, Core® and Celeron® are registered trademarks of Intel Corporation in the U.S. and other countries. AMD® is a registered trademark and AMD Opteron™, AMD Phenom™ and AMD Sempron™ are trademarks of Advanced Micro Devices, Inc. Microsoft®, Windows®, Windows Server®, Internet Explorer®, MS-DOS®, Windows Vista® and Active Directory® are either trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Red Hat® and Red Hat® Enterprise Linux® are registered trademarks of Red Hat, Inc. in the United States and/or other countries. Novell® and SUSE® are registered trademarks of Novell Inc. in the United States and other countries. Oracle® is a registered trademark of Oracle Corporation and/or its affiliates. Citrix®, Xen®, XenServer® and XenMotion® are either registered trademarks or trademarks of Citrix Systems, Inc. in the United States and/or other countries. VMware®, Virtual SMP®, vMotion®, vCenter® and vSphere® are registered trademarks or trademarks of VMware, Inc. in the United
  • 4. 4 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers States or other countries. IBM® is a registered trademark of International Business Machines Corporation. Broadcom® and NetXtreme® are registered trademarks of Broadcom Corporation. Qlogic is a registered trademark of QLogic Corporation. Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and/or names or their products and are the property of their respective owners. Dell disclaims proprietary interest in the marks and names of others.
  • 5. 5 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers Contents Revisions............................................................................................................................................................................................. 3 Executive Summary .......................................................................................................................................................................... 7 1 Introduction................................................................................................................................................................................8 1.1 Existing Solution..............................................................................................................................................................8 1.2 PCIe SSD Inventory , Monitoring and Configuration................................................................................................8 1.3 Prerequisites.....................................................................................................................................................................8 2 PCIe SSD Inventory and Monitoring.....................................................................................................................................10 2.1 PCIe SSD Controllers....................................................................................................................................................10 2.1.1 Using WS–Man...............................................................................................................................................................10 2.1.2 Using RACADM...............................................................................................................................................................11 2.1.3 Using GUI.........................................................................................................................................................................11 2.2 PCIe SSD Enclosure...................................................................................................................................................... 12 2.2.1 Using WS–Man............................................................................................................................................................... 12 2.2.2 Using RACADM.............................................................................................................................................................. 13 2.2.3 Using GUI........................................................................................................................................................................ 13 2.3 PCIe SSD Physical Disks............................................................................................................................................... 14 2.3.1 Using WS–Man............................................................................................................................................................... 14 2.3.2 Using RACADM.............................................................................................................................................................. 15 2.3.3 Using GUI........................................................................................................................................................................ 16 3 PCIe SSD Configuration.......................................................................................................................................................... 17 3.1 Blink/UnBlink for PCIe SSD ........................................................................................................................................ 17 3.1.1 Using WS–Man............................................................................................................................................................... 17 3.1.2 Using RACADM.............................................................................................................................................................. 18 3.1.3 Using GUI........................................................................................................................................................................ 19 3.2 Prepare to Remove for PCIe SSD............................................................................................................................... 19 3.2.1 Using WS–Man...............................................................................................................................................................20 3.2.2 Using RACADM.............................................................................................................................................................. 21 3.2.3 Using GUI........................................................................................................................................................................22 3.3 Secure erase for PCIe SSD...........................................................................................................................................23 3.3.1 Using WS–Man...............................................................................................................................................................23 3.3.2 Using RACADM..............................................................................................................................................................24
  • 6. 6 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 3.3.3 Using GUI........................................................................................................................................................................24 4 Error Codes...............................................................................................................................................................................26 5 Common Issues .......................................................................................................................................................................26 6 TroubleShooting ......................................................................................................................................................................27
  • 7. 7 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers Executive Summary This white paper provides information about monitoring, inventory and configuration, using iDRAC interfaces such as WS–Man, RACADM and the GUI. These devices include the Dell Express Flash NVMe PCIe SSD, backplane, extender, and drives.
  • 8. 8 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 1 Introduction This Dell Technical white paper provides detailed information about the capabilities of integrated Dell Remote Access Controller (iDRAC8) for Monitoring , Inventory and Configuring Express Flash NVMe PCIe SSDs on 13th generation servers and later of Dell. 1.1 Existing Solution The PowerEdge R920 server has sideband support for NVMe PCIe SSD Device discovery. But it does not support the advanced configuration options available in 13G systems. 1.2 Dell Express Flash NVMe PCIe SSD Inventory , Monitoring and Configuration This Document describes the monitoring , inventory and configuration functionality of Express Flash NVMPCIe SSD s that is implemented in Dell 13th generation server platforms. This feature provides the users to Inventory and remotely monitor the health of PCIe SSD devices in the server. The PCIe SSD subsystem consists of the Backplane, PCIe Extender card which is attached to the backplane of the system (while 13G Blades will use an extender card that does not physically connect to the backplane ( M630 , M830)) and provides PCIe at the front of the connectivity for up to four or eight PCIe SSD ( Only in R920 12G)devices chassis and the PCIe SSD devices. The following are the list of features that are supported by WSMAN , RACADM and GUI as part Express Flash NVMe PCIe SSD in 13G.  Inventory and Monitoring of Express Flash NVMe PCIe SSD  Configuring PCIe SSD o Blink/UnBlink LED o Prepare to remove o Secure Erase 1.3 Prerequisites Make sure that the following prerequisites are met :  A software license for 13th generation Dell PowerEdge and later servers. For more information about managing licenses using iDRAC Web interface, click Overview  Server  Licenses. In the upper-right corner, click Help to view the iDRAC Online Help.  All Dell Express Flash NVMe PCIe SSDs are NVMe 1.0c compliant and should have the latest Dell Firmware.  13G Platform must be fully enabled for Express Flash NVMe PCIe SSD support.  iDRAC Service Module (iSM) should be installed in the Operating System for PrepareToRemove Operation.
  • 9. 9 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers o For more information about iSM, reference www.delltechcentercom/iDRAC (manuals)
  • 10. 10 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 2 PCIe SSD Inventory and Monitoring Comprehensive view of PCIe SSD Subsystem will be provided by using WSMAN , RACADM and GUI interface layers . Complete monitoring and inventory is available only for the device which has sideband support. PCIeSubsystem consists of following objects.  PCIe SSD BackPlane  PCIe Extender card  PCIe SSD Drive ( Each PCIe SSD has its own independent controller ) Hardware Inventory:  PCIe SSD Ext card.  PCIe SSD Backplane  PCIe SSDs 2.5” form factor  PCIe SSD card form factor Hardware Monitoring:  PCIe SSDs 2.5” form factor  PCIe SSD card form factor The card form factor devices are PCIe SSDs connected directly to the PCIe slot. The card form factor does not support hot-plug, blink/unblink and prepare to remove operations. Software Inventory:  Firmware Version 2.1 PCIe SSD Extenders 2.1.1 Using WS–Man To get the list of PCIe SSD Extenders , use the below WSMAN command . winrm e http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/root/dcim/DCIM_PCIeSSDExtenderView -u:<UserName> -p:<Password> -r:https://<Ip-Address>/wsman -SkipCNcheck -SkipCAcheck - SkipRevocationCheck -encoding:utf-8 -a:basic Example : Result after running the above command
  • 11. 11 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers DCIM_PCIeSSDExtenderView DeviceDescription = PCIe Extender in PCIe Slot 3 FQDD = PCIeExtender.Slot.3 InstanceID = PCIeExtender.Slot.3 PrimaryStatus = 1 RollupStatus = 1 2.1.2 Using RACADM To get the list of controllers and PCIe SSD Extenders, run the following command /admin1-> racadm storage get controllers RAID.Integrated.1-1 PCIeExtender.Slot.3 To get the properties of PCIe SSD Extender, use the following command format Syntax: racadm storage get controllers:<PcieSSD Extender FQDD> Example: /admin1-> racadm storage get controllers:PCIeExtender.Slot.3 PCIeExtender.Slot.3 RollupStatus = Ok DeviceDescription = PCIe Extender in PCIe Slot 3 Status = Ok Name = PCIeExtender 3 (PCI Slot 3) 2.1.3 Using GUI To get the list of Controllers and PCIe SSD Extenders , use the below navigation.
  • 12. 12 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 2.2 PCIe SSD Enclosure 2.2.1 Using WS–Man To get the list of Enclosure , Use the below WSMAN command. winrm e http://schemas.dmtf.org/wbem/wscim/1/cim- schema/2/root/dcim/DCIM_PCIeSSDBackPlaneView -u:<Username> -p:< Password> -r:https://<IP- Address>/wsman -SkipCNcheck -SkipCAcheck -SkipRevocationCheck -encoding:utf-8 -a:basic Example : Result after running the above command DCIM_PCIeSSDBackPlaneView DeviceDescription = Enclosure.Internal.0-1:PCIeExtender.Slot.3 FQDD = Enclosure.Internal.0-1:PCIeExtender.Slot.3 FirmwareVersion= 0.80 InstanceID = Enclosure.Internal.0-1:PCIeExtender.Slot.3 MediaType = 0 ProductName = PCIe Backplane RollupStatus = 1
  • 13. 13 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers SlotCount = 4 2.2.2 Using RACADM To get the list of enclosures, run the following command /admin1-> racadm storage get enclosures Enclosure.Internal.0-1:RAID.Integrated.1-1 Enclosure.Internal.0-1:PCIeExtender.Slot.3 To get the properties of PCIe SSD Enclosure, use the following command format syntax: racadm storage get enclosures:<PcieSSD Enclosure FQDD> Example: /admin1-> racadm storage get enclosures:Enclosure.Internal.0-1:PCIeExtender.Slot.3 Enclosure.Internal.0-1:PCIeExtender.Slot.3 RollupStatus = Ok DeviceDescription = Enclosure.Internal.0-1:PCIeExtender.Slot.3 Name = PCIe SSD BP 1 SlotCount = 4 FirmwareVersion = 0.80 2.2.3 Using GUI To get the list of enclosures in GUI , use the below navigation
  • 14. 14 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 2.3 PCIe SSD Physical Disks 2.3.1 Using WS–Man To get the list ofExpress Flash NVMe devices, use the below WSMAN command. winrm e http://schemas.dmtf.org/wbem/wscim/1/cim- schema/2/DCIM_PCIeSSDView?__cimnamespace=root/dcim -u: <UserName> -p:<Password> - r:https://<Ip Address>/wsman -encoding:utf-8 -a:basic -SkipCNcheck -SkipCAcheck Example : Result after running the above command. DCIM_PCIeSSDView BusProtocol = 7 DeviceDescription = PCIe Solid-State Drive in Slot 6 in Bay 1 DeviceProtocol = NVMe 1.0 DriveFormFactor = 2 FQDD = Disk.Bay.6:Enclosure.Internal.0-1:PCIeExtender.Slot.3 FailurePredicted = NO InstanceID = Disk.Bay.6:Enclosure.Internal.0-1:PCIeExtender.Slot.3 Manufacturer = SAMSUNG MaxCapableSpeed = 8 GT/s MediaType = 1
  • 15. 15 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers Model = Dell Express Flash NVMe 800GB NegotiatedSpeed = 8 GT/s PCIeCapableLinkWidth = x4 PCIeNegotiatedLinkWidth = x4 PrimaryStatus = 1 ProductID = a820 RemainingRatedWriteEndurance = 100 Revision = IPM0ED35 SerialNumber = S1J1NYAD90018 SizeInBytes = 0 State = 1 2.3.2 Using RACADM To get the list of physical disks and Express Flash NVMe PCIe SSD devices, run the following command /admin1-> racadm storage get pdisks Disk.Bay.0:Enclosure.Internal.0-1:RAID.Integrated.1-1 Disk.Bay.1:Enclosure.Internal.0-1:RAID.Integrated.1-1 Disk.Bay.2:Enclosure.Internal.0-1:RAID.Integrated.1-1 Disk.Bay.3:Enclosure.Internal.0-1:RAID.Integrated.1-1 Disk.Bay.4:Enclosure.Internal.0-1:RAID.Integrated.1-1 Disk.Bay.5:Enclosure.Internal.0-1:RAID.Integrated.1-1 Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 Disk.Bay.6:Enclosure.Internal.0-1:PCIeExtender.Slot.3 Disk.Bay.7:Enclosure.Internal.0-1:PCIeExtender.Slot.3 Disk.Bay.9:Enclosure.Internal.0-1:PCIeExtender.Slot.3 To get the properties of Express Flash NVMe PCIe SSD devices, use the following command format syntax: racadm storage get pdisks:<PcieSSD FQDD> Example: /admin1-> racadm storage get pdisks:Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 Status = Ok DeviceDescription = PCIe Solid-State Drive in Slot 8 in Bay 1 Name = Physical Device 8 State = Ready Size = 745.21 GB
  • 16. 16 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers BusProtocol = PCIe MediaType = SSD Model = Dell Express Flash NVMe 800GB ProductId = a820 SerialNumber = S1J1NYAD90019 DeviceProtocol = NVMe1.0 Manufacturer = SAMSUNG PCIeNegotiatedLinkWidth = x4 PCIeCapableLinkWidth = x4 MaxCapableSpeed = 8 GT/s NegotiatedSpeed = 8 GT/s FormFactor = 2.5 Inch Revision = IPM0ED35SAM SAMSUNG MZWEI800HAGM 000D3 RemainingRatedWriteEndurance = 100 % FailurePredicted = NO 2.3.3 Using GUI To get the list of physical disks and Express Flash NVMe PCIe SSD devices , use the below navigation
  • 17. 17 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 3 PCIe SSD Configuration Configuration support for Express Flash NVMe PCIe SSD devices Storage Subsystem is introduced in 13Th Generation release onwards. In this case , the configurations do not require a reboot . Configurations can still be done through staged ( Scheduled and it requires reboot to see the effect ) based on the request from the interface layer. During a job creation , If a new optional parameter ( apply now with out reboot – RealTime , apply now with reboot – Staged ) is specified from the interface layer , based on the new parameter , operations ( Real or Staged ) would be performed. In order to apply the pending values , one has to create a job which can be real time or staged as mentioned earlier. If Real time only operation is pending, no staged only operations allowed, but operations that could be done either ways (staged or real time) will be allowed to be set, but done via real time . If Staged only operation is pending, no real time only operations allowed, but operations that could be done either ways( staged or real time) will be allowed , but done via staged . 3.1 Blink/UnBlink for PCIe SSD This Blink operation blinks one of the LED in the disk and is performed to locate a disk with in a system. Unblink operation unblinks the LED in the disk. This operation is real time and do not require a job to create. It is an immediate operation. 3.1.1 Using WS–Man In order to blink the PCIe SSD , use the following WSMAN command. winrm i BlinkTarget cimv2/root/dcim/DCIM_RAIDService?SystemCreationClassName=DCIM_ComputerSystem+CreationClass Name=DCIM_RAIDService+SystemName=DCIM:ComputerSystem+Name=DCIM:RAIDService - u:<UserName> -p:<Password> -r:https://< IP-Adress>/wsman -SkipCNcheck -SkipCAcheck - encoding:utf-8 -a:basic @{Target=< FQDD of the PCIeSSD>} Example : After running the above command , output looks like below upon successful . BlinkTarget_OUTPUT RebootRequired = NO ReturnValue = 0
  • 18. 18 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers In order to unblink the PCIe SSD , use the following WSMAN command. winrm i UnBlinkTarget cimv2/root/dcim/DCIM_RAIDService?SystemCreationClassName=DCIM_ComputerSystem+CreationClass Name=DCIM_RAIDService+SystemName=DCIM:ComputerSystem+Name=DCIM:RAIDService - u:<UserName> -p:<Password> -r:https://< IP-Adress>/wsman -SkipCNcheck -SkipCAcheck - encoding:utf-8 -a:basic @{Target=< FQDD of the PCIeSSD>} Example : After running the above command , output looks like below upon successful . UnBlinkTarget_OUTPUT RebootRequired = NO ReturnValue = 0 3.1.2 Using RACADM In order to blink the PCIe SSD, use the below command format syntax: racadm storage blink:<PCIeSSD FQDD> Example: /admin1-> racadm storage blink:Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 STOR095 : Storage operation is successfully completed. In order to unblink the PCIe SSD, use the below command format syntax: racadm storage unblink:<PCIeSSD FQDD> Example: /admin1-> racadm storage unblink:Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 STOR095 : Storage operation is successfully completed
  • 19. 19 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 3.1.3 Using GUI In order to blink/unblink the PCIe SSD , use the below navigation 3.2 Prepare to Remove for PCIe SSD The Prepare to Remove operation shall be used to safely remove a PCIe SSD drive from the system. This operation stops any background activity and any ongoing I/O activity so that device can be removed safely. After the drive is removed, it can be replaced by either another PCIe SSD drive or SAS/SATA drive.
  • 20. 20 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers This operation causes the status LEDs on the device to blink. The drive can be safely removed from the system under the following conditions after the Prepare to Remove operation:  The PCIe SSD is blinking the safe to remove LED pattern.  The PCIe SSD is no longer accessible by the system. This feature is supported only at run-time. Since there is no support through sideband for this operation currently, the ISM infrastructure will be used for this operation. NOTE: The Supporting Operating system should have NVMe driver loaded for this operation. NOTE: If linux fails to boot and prompts for the root password, see below: A stale volume mount point is still present after a device removal or cryptographic erase. Perform the following steps to recover from this situation: 1. Enter the root password to enter maintenance mode. 2. Remount the root filesystem as read-write using the following command:  mount -orw,remount/ Or Manually edit /etc/fstab to remove the non-existent device entry. 3.2.1 Using WS–Man To prepare the Express Flash NVMe PCIe SSD devices for removal, use the below WSMAN command winrm i PrepareToRemove cimv2/root/dcim/DCIM_RAIDService?SystemCreationClassName=DCIM_ComputerSystem+CreationClass Name=DCIM_RAIDService+SystemName=DCIM:ComputerSystem+Name=DCIM:RAIDService - u:<UserName> -p:<Password> -r:https://< IP-Adress>/wsman -SkipCNcheck -SkipCAcheck - encoding:utf-8 -a:basic @{Target=< FQDD of the PCIeSSD>} Job is Created by using DCIM_RAIDService .CreateTargetedConfigJob( ) method to apply the pending values . To create a RealTime job which does not require reboot use the below WSMAN command. winrm i CreateTargetedConfigJob http://schemas.dell.com/wbem/wscim/1/cim- schema/2/root/dcim/DCIM_RAIDService?__cimnamespace=root/dcim+SystemCreationClassName=DCI M_ComputerSystem+SystemName=DCIM:ComputerSystem+CreationClassName=DCIM_RAIDService+N ame=DCIM:RAIDService -u:<UserName> -p:<Password> -r:https://<ip-address>/wsman -SkipCNcheck - SkipCAcheck -encoding:utf-8 -a:basic @{Target="<PCIeSSD Drive FQDD>";ScheduledStartTime="TIME_NOW";RealTime="1"} Check the status of the job and wait until Job completes. Example : After running the PrepareToRemove command , output looks like below upon successful .
  • 21. 21 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers SecureErase_OUTPUT RebootRequired = NO ReturnValue = 0 3.2.2 Using RACADM To prepare the Express Flash NVMe PCIe SSD devicefor removal, use the below command format syntax: racadm storage preparetoremove:<PCIeSSD FQDD> Example: /admin->racadm storage preparetoremove: Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 STOR089 : Successfully accepted the storage configuration operation. To apply the configuration operation, create a configuration job with --realtime option. To create the required commit jobs, run the jobqueue command. For more information about the jobqueue command, enter the RACADM command "racadm help jobqueue” /admin->racadm jobqueue create Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 --realtime RAC1024 : Successfully scheduled a job Verify the job status using “racadm jobqueue view –i JID_xxxxx” command. Commit JID = JID_996741411337 /admin->racadm jobqueue view -i JID_996741411337 -------------------------------------JOB----------------------------------- [Job ID = JID_996741411337] Job Name=Configure: Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 Status= New Start Time=[Now]
  • 22. 22 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers Expiration Time=[Not Applicable] Message=[JCP000: New] Percent Complete=[0] ----------------------------------------------------------------------------- 3.2.3 Using GUI To prepare the Express Flash NVMe PCIe SSD devicefor removal in GUI ,
  • 23. 23 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 3.3 Secure erase for PCIe SSD Secure erase is instant cryptographic erase of data on PCIe SSD devices and all the data on the PCIe SSD device will be permanently lost.During Secure Erase, the device is not accessible. While trying from WSMAN , RACADM and GUI interfaces , User should have iDRAC Server control privilege to perform this operation.There is no sideband support for this operation currently.Hence this operation is supported only in staged mode and not run-time. The device will not execute the command immediately. A host reboot is required for the command to take effect. 3.3.1 Using WS–Man To Perform the Secure Erase operation on PCIe SSD drive, use the below command. winrm i SecureErase cimv2/root/dcim/DCIM_RAIDService?SystemCreationClassName=DCIM_ComputerSystem+CreationClass Name=DCIM_RAIDService+SystemName=DCIM:ComputerSystem+Name=DCIM:RAIDService - u:<UserName> -p:<Password> -r:https://< IP-Adress>/wsman -SkipCNcheck -SkipCAcheck - encoding:utf-8 -a:basic @{Target=< FQDD of the PCIeSSD DRIVE>} Example : After running the SecureErase command , output looks like below upon successful . SecureErase_OUTPUT RebootRequired = YES ReturnValue = 0 Job is Created by using DCIM_RAIDService .CreateTargetedConfigJob( ) method to apply the pending values . It supports only staged job. In order to create Staged job , Use the below WSMAN command. winrm i CreateTargetedConfigJob http://schemas.dell.com/wbem/wscim/1/cim- schema/2/root/dcim/DCIM_RAIDService?__cimnamespace=root/dcim+SystemCreationClassName=DCI M_ComputerSystem+SystemName=DCIM:ComputerSystem+CreationClassName=DCIM_RAIDService+N ame=DCIM:RAIDService -u:<UserName> -p:<Password> -r:https://<IP address>/wsman -SkipCNcheck - SkipCAcheck -encoding:utf-8 -a:basic @{Target=" FQDD of the PCIeSSD DRIVE ";RebootJobType="1";ScheduledStartTime="TIME_NOW"}
  • 24. 24 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 3.3.2 Using RACADM To peform a secure erase on PCIe SSD drive, use the below command format syntax: racadm storage secureerase:<PCIeSSD FQDD DRIVE> Example: /admin->racadm storage secureerase: Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 RAC1040 : Successfully accepted the storage configuration operation. To apply the configuration operation, create a configuration job, and then restart the host. To create the required commit and reboot jobs, run the jobqueue command. For more information about the jobqueue command, enter the RACADM command "racadm help jobqueue” /admin->racadm jobqueue create Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 RAC1024 : Successfully scheduled a job Verify the job status using “racadm jobqueue view –i JID_xxxxx” command. Commit JID = JID_996741414444 /admin->racadm jobqueue view -i JID_996741414444 -------------------------------------JOB----------------------------------- [Job ID = JID_996741414444] Job Name=Configure: Disk.Bay.8:Enclosure.Internal.0-1:PCIeExtender.Slot.3 Status= Scheduled Start Time=[Now] Expiration Time=[Not Applicable] Message=[JCP000: Task successfully scheduled.] Percent Complete=[0] ----------------------------------------------------------------------------- 3.3.3 Using iDRAC GUI To peform a secure erase on PCIe SSD drive(s) in GUI ,
  • 25. 25 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers
  • 26. 26 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 4 Error Codes STOR029: Physical disk not found STOR072: iDRAC Service Module (ISM) is either not present or not running on the server OS. STOR073: The iDRAC Service Module version present on the server OS does not support the requested PCIe SSD (NVMe) device operation. STOR078: The requested operation requires a reboot type that does not match the reboot type required for pending operations STOR079: The controller does not support this operation or is in a state that does not allow this operation STOR0103 : No physical disks are displayed. Check if the server has power, physical disks are available, and physical disks are connected to the enclosure or backplane. 5
  • 27. 27 PCIeSSD Inventory,Monitoring & Configuration in Dell PowerEdge 13th Generation Servers 5 TroubleShooting Some common problems and possible solutions are mentioned below.  If Configuration is not successful . o Check if LC is disabled . o ISM is not installed or Host OS is not up.  what log files can be helpful for troubleshooting o LCLog will have the log details – RAC500 & RAC690  How to identify a failed component or configuration o Check the job queue for Job status. o Timeout of a command and error will be logged in LC Log.