IBM storage installation
Back to storage installation home.
In case of usage of
Virtual Appliance
- Use local account lpar2rrd for hosting of STOR2RRD on the virtual appliance
- Use /home/stor2rrd/stor2rrd as the product home
- Use lpar2rrd account on storage as it is configured in /home/stor2rrd/stor2rrd/etc/stor2rrd.cfg (STORAGE_USER)
- Replace lpar2rrd by stor2rrd user in all examples below.
Install the storage API (DSCLI)
- Under root user
- Download it from here: ftp://ftp.software.ibm.com/storage/ds8000/updates/DS8K_Customer_Download_Files/CLI/
- Follow IBM doc for installation: DSCLI installation
- Use following cmds for mounting ISO image into /mnt:
AIX: # loopmount -i dscli.iso -o "-V cdrfs -o ro" -m /mnt
Linux: # mount dscli.iso /mnt -o loop,ro
- Snapshot from DSCLI installation:
# umask 022
# tar xvf dscli.tar
x .
x ./HMC
x ./HMC/Disk1
x ./HMC/Disk1/InstData
....
# ./HMC/Disk1/InstData/AIX/NoVM/dsclisetup.bin -i console
Preparing to install...
Extracting the installation resources from the installer archive...
Configuring the installer for this system's environment...
Congratulations. IBM System Storage DS Command Line Interface has been
.......
successfully installed to:
/opt/ibm/dscli
# chmod 755 /opt/ibm/dscli/dscli
Create a user on the storage with restricted rights
- Under stor2rrd Unix user identification do following
- Assure you have execution rights on : /opt/ibm/dscli/dscli
- Log as administrator into DSCLI
(you might create stor2rrd user on the storage even from the other admin api like TPC ..)
Note there must be allowed LAN communication to the storage on ports 1750 and 1751
If you get following error then it is probably a firewall issue:
$ /opt/ibm/dscli/dscli -hmc1 172.28.7.22 -user admin
CMUN00018E Unable to connect to the management console server
-
Log as storage administrator and create user stor2rrd under monitor role:
$ /opt/ibm/dscli/dscli -hmc1 172.28.7.22 -user admin
dscli> mkuser -pw PASSWORD -group monitor stor2rrd
-
Store storage stor2rrd password in DSCLI (/home/stor2rrd/dscli/security.dat):
$ /opt/ibm/dscli/dscli managepwfile -action add -mc1 172.28.7.22 -name stor2rrd -pw PASSWORD
-
Connection check, it should not ask for a password:
$ /opt/ibm/dscli/dscli -hmc1 <HMC1 ip addr> 172.28.7.22 -user stor2rrd ver -l
Date/Time: December 10, 2013 3:01:43 PM CET IBM DSCLI Version: 7.7.10.317
DS: -
DSCLI 7.7.10.317
StorageManager 7.7.5.0.20121203.1
================Version=================
Storage Image LMC
===========================
IBM.2107-75CXXXX 7.7.10.294
STOR2RRD storage configuration
- Configure storage in etc/storage-list.cfg
Under stor2rrd account create config entry. Uncomment (remove the hash) example line and adjust it:
$ vi /home/stor2rrd/stor2rrd/etc/storage-list.cfg
#
# IBM DS8000
#
# Storage name alias:DS8K:DEVID:HMC1:HMC2:VOLUME_AGG_DATA_LIM:VOLUME_AGG_IO_LIM:SAMPLE_RATE_MINS
# When there is only HMC1 IP then place same IP into HMC2 field as well
DS8100:DS8K:IBM.2107-75ABXXX:172.28.7.22:172.28.7.23:
You can get DEVID from DSCLI:
$ /opt/ibm/dscli/dscli -hmc1 172.28.7.22 -user stor2rrd
Date/Time: April 18, 2013 2:55:36 PM CEST IBM DSCLI Version: 7.6.31.165 DS: -
dscli> lssi -s
ID
================
IBM.2107-75VG681
When you get this error:
dscli> lssi -s
Date/Time: April 18, 2013 3:04:25 PM CEST IBM DSCLI Version: 7.6.31.165 DS: -
CMUC00201E lssi:: You are logged in with an expired password and limited
authorization. Use the chuser command to changer password and restore normal authorization.
Then change the password for stor2rrd user
dscli>chuser -pw PASSWORD1 stor2rrd
and refresh stored password as well
$ /opt/ibm/dscli/dscli managepwfile -action remove -mc1 172.28.7.22 -name stor2rrd
$ /opt/ibm/dscli/dscli managepwfile -action add -mc1 172.28.7.22 -name stor2rrd -pw PASSWORD1
-
Let run the storage agent for 15 - 20 minutes to get data, then:
$ cd /home/stor2rrd/stor2rrd
$ ./load.sh
- Go to the web GUI: http://<your web server>/stor2rrd/
Use Ctrl-F5 to refresh the web browser cache.
The latest available code 1.35-1 does not support new SV1 models of SVC/Storwize/FlashSystem.
Use
this patch to make it work.
Create a user on the storage for download of perf data
- Create ssh-keys on STOR2RRD host under stor2rrd user if do not exist yet.
Type enter instead of passphrase
# su - stor2rrd # (use lpar2rrd user on the Appliance)
$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/home/stor2rrd/.ssh/id_rsa):
...
$ ls -l ~/.ssh/id_rsa.pub
- Copy ssh-key into the storage under storage superuser
In case of IBM Storwize V7000 Unified use one of "Control Enclosure" IPs (definitelly not "File Module" IP).
Detailed description of IBM Storwize V7000 Unified.
$ scp ~/.ssh/id_rsa.pub superuser@[svc/storwize control enclosure IP]:/tmp/123tmp
- Create new user "stor2rrd" on the storage (lpar2rrd in case of Virtual Appliance)
$ ssh superuser@[svc|storwize control enclosure IP address] "svctask mkuser -name stor2rrd -usergrp Administrator -keyfile /tmp/123tmp"
Unfortunately "Administrator" role is the lowest role which allows retrieve of statistics data from the storage.
Read this for explanation.
If stor2rrd user already exists on the storage then assign him new ssh-keys:
$ ssh superuser@[svc|storwize control enclosure IP address] "svctask chuser -keyfile /tmp/123tmp stor2rrd"
- Check if that works:
$ ssh -i ~/.ssh/id_rsa stor2rrd@[svc|storwize control enclosure IP address] "svcinfo lssystem"
id 00000100C0906BAA
name SVC
location local
partnership
bandwidth
...
STOR2RRD storage configuration
- Configure storage in etc/storage-list.cfg
Under stor2rrd account create config entry. Uncomment (remove the hash) example line and adjust it:
$ vi /home/stor2rrd/stor2rrd/etc/storage-list.cfg
#
# IBM STORWIZE, IBM SVC and IBM FlashSystem
#
# Storage name alias:SWIZ:control enclosure IP/hostname:ssh_key_file:VOLUME_AGG_DATA_LIM:VOLUME_AGG_IO_LIM:SAMPLE_RATE_MINS
#
#storwize01:SWIZ:storwize_host.example.com:/home/stor2rrd/.ssh/id_rsa
#svc01:SWIZ:svc_host.example.com:/home/stor2rrd/.ssh/id_rsa:2048:512:5
#svc02:SWIZ:__storage_IP__:
storwize01:SWIZ:192.168.1.1:
Above shows Storwize/SVC storage with IP 192.168.1.1 which will be visible in the GUI as storwize01
-
Let run the storage agent for 15 - 20 minutes to get data, then:
$ cd /home/stor2rrd/stor2rrd
$ ./load.sh
- Go to the web GUI: http://<your web server>/stor2rrd/
Use Ctrl-F5 to refresh the web browser cache.
Troubleshooting
Create a user on the storage and check the storage connectivity
- When you use the XIV GUI then create stor2rrd use in category readonly
- XIV command line:
# export XIV_XCLIUSER=admin
# export XIV_XCLIPASSWORD=<admin password>
# /opt/ibm/XIVGUI/xcli -m <xiv ip> user_define user=stor2rrd password=<password> password_verify=<password> category=readonly
-
Assure there is open network connection to the storage on its port 5989
# telnet <XIV IP> 5989
Connected to <xiv ip>.
Escape character is '^]'.
Install prerequisites
Skip that in case of Virtual Appliance
- Linux:
Install sblim-wbemcli package:
# yum list |grep sblim-wbemcli
sblim-wbemcli.x86_64 1.6.2-9.el7 base
# yum install sblim-wbemcli # RedHat
# apt-get install sblim-wbemcli # Debian based (Ubuntu etc)
# /usr/bin/wbemcli -noverify -nl ei https://__storage_IP__:5989/root/ibm:test
*
* ./wbemcli: Https Exception: Username/password required.
*
If you get error "SSL connect error" then you might hit into a problem where SSL on the storage has disabled SSLv3 protocol;.
Install version below which contains this patch 0002742-wbemcli-support-configurable-SSL-version
Test the package:
# /usr/bin/wbemcli -v
* wbemcli Version 1.6.3
# /usr/bin/wbemcli -noverify -nl ei https://__storage_IP__:5989/root/ibm:test
*
* ./wbemcli: Https Exception: Username/password required.
*
- AIX:
Download and install
# rpm -Uvh libffi-3.1-1.aix5.1.ppc.rpm --nodeps
# rpm -Uvh libiconv-1.14-2.aix5.1.ppc.rpm --nodeps
# rpm -Uvh libidn-1.29-1.aix5.1.ppc.rpm --nodeps
# rpm -Uvh libssh2-1.4.3-2.aix5.1.ppc.rpm --nodeps
# rpm -Uvh openssl-1.0.1j-1.aix5.1.ppc.rpm
# rpm -Uvh openldap-2.4.23-0.3.aix5.1.ppc.rpm
# rpm -Uvh curl-7.27.0-1.aix5.1.ppc.rpm
# rpm -Uvh wbemcli-1.6.3-1.aix5.1.ppc.rpm
# LIBPATH=/opt/freeware/lib; export LIBPATH
# /opt/freeware/bin/wbemcli -noverify -nl ei https://__storage_IP__:5989/root/ibm:test
*
* ./wbemcli: Https Exception: Username/password required.
*
Test storage connection
- replace "stor2rrd password" and "__storage_IP__" by yours (use /usr/bin/wbemcli path on Linux)
$ LIBPATH=/opt/freeware/lib; export LIBPATH
$ /opt/freeware/bin/wbemcli -noverify -nl ei https://stor2rrd:<stor2rrd password>@__storage_IP__:5989/root/ibm:IBMTSDS_StorageSystem
STOR2RRD storage configuration
- Configure storage in etc/storage-list.cfg
Under stor2rrd account create config entry. Uncomment (remove the hash) example line and adjust it:
vi /home/stor2rrd/stor2rrd/etc/storage-list.cfg
#
# IBM XIV
#
# Storage name alias:XIV:storage ip/hostname:password:VOLUME_AGG_DATA_LIM:VOLUME_AGG_IO_LIM:SAMPLE_RATE_MINS
#
#xiv01:XIV:xiv_host01.example.com:password
#xiv02:XIV:xiv_host02.example.com:password:2048:512:10
XIV01:XIV:192.168.1.1:passw0rd
Password above is for stor2rrd user on the storage.
- If you use Active Directory on your XIV then you will have a problem with wbemcli package.
Use this link to resolve it.
-
Let run the storage agent for 15 - 20 minutes to get data, then:
$ cd /home/stor2rrd/stor2rrd
$ ./load.sh
- Go to the web GUI: http://<your web server>/stor2rrd/
Use Ctrl-F5 to refresh the web browser cache.
Supported devices
- IBM DS 3000
- IBM DS 4000
- IBM DS 5000
- IBM DCS 3700
- NetApp E-Series
- LSI / Engenio based storage
SMcli installation
-
Download SMcli package from the IBM site (you need to know storage serial and have IBM ID free account)
Go to IBM fix central and follow this:
Product Group [System Storage] ➡
Select from System Storage [Disk systems] ➡
Select from Entry level disk systems [DS3000] ➡
  Release [All] ➡
Platform [AIX/Linux ...]
Download only *SMIA* package like:
SM10.86_Linux_64bit_x86-64_SMIA-10.86.x5.43.tgz
SM10.86_AIX_SMIA-10.86.x5.43.tgz
-
Note actual IBM page does not seem to contain SMIA package, use Storage manager which should contain SMCli: Disk-SM-AIX-Dec-2013-version-10.86.x5.43
-
AIX prerequisites:
Install X11 packages from your AIX install media:
- X11.adt
- X11.base
- X11.motif
# lslpp -L |egrep "X11.adt|X11.base|X11.motif"
X11.adt.bitmaps 6.1.0.0 C F AIXwindows Application
X11.adt.ext 6.1.6.0 C F AIXwindows Application
X11.adt.imake 6.1.6.0 C F AIXwindows Application
X11.adt.include 6.1.4.0 C F AIXwindows Application
X11.adt.lib 6.1.2.0 C F AIXwindows Application
X11.adt.motif 6.1.6.0 C F AIXwindows Application
X11.base.common 6.1.0.0 C F AIXwindows Runtime Common
X11.base.lib 6.1.6.0 C F AIXwindows Runtime Libraries
X11.base.rte 6.1.6.0 C F AIXwindows Runtime Environment
X11.base.smt 6.1.6.0 C F AIXwindows Runtime Shared
X11.base.xpconfig 6.1.0.0 C F Xprint Configuration Files
X11.motif.lib 6.1.6.0 C F AIXwindows Motif Libraries
X11.motif.mwm 6.1.6.0 C F AIXwindows Motif Window
-
Install SMcli under root user
# umask 022
# gunzip SM10.86_AIX_SMIA-10.86.x5.43.tgz
# tar xvf SM10.86_AIX_SMIA-10.86.x5.43.tar
# cd AIX10p86/AIX
# sh SMIA-AIX-10.86.0605.0043.bin -i console
(accept the license agreement, type "enter" many times )
Please choose the Install Set to be installed by this installer.
1- Typical (Full Installation)
--> 2- Management Station
3- Host
4- Customize...
ENTER THE NUMBER FOR THE INSTALL SET, OR PRESS <ENTER> TO ACCEPT THE DEFAULT
: 2
......
Congratulations. IBM System Storage DS Storage Manager 10 has been successfully installed to:
/opt/IBM_DS
# lslpp -L|grep SMclient
SMclient.aix.rte 10.86.6543.0 C F IBM DS Storage Manager Client
# ls -l /usr/SMclient/SMcli
-r-x------ 1 root system 1008 Oct 10 2013 /usr/SMclient/SMcli
Check install log below for errors if you do not see "Congratulations ..." message after the installation.
/opt/IBM_DS/IBM_System_Storage_DS_Storage_Manager_10_InstallLog.log
-
Note: you might hit into the IBM installer bug during rpm install of SMclient-10.86.0G05.0043-1.noarch. Below is the workaround.
Then try installation again.
# ln -s /opt/IBM_DS/ia/jre/ /opt/IBM_DS/jre
-
When you have Debian based Linux (Ubuntu etc) which does not support rpm packaging then you will find uninstalled packages in /opt/IBM_DS
Convert them in debian packages and install them as root:
# cd /opt/IBM_DS
# alien SMclient.rpm
# alien SMesm.rpm
# alien SMruntime.rpm
# dpkg -i smclient_10.86.0G05.0043-2_all.deb
# dpkg -i smesm_10.86.0G05.0007-2_all.deb
# dpkg -i smruntime_10.86.0A05.0001-2_amd64.deb
# ls -l /usr/SMclient/SMcli
-r-x------ 1 root system 1008 Oct 10 2013 /usr/SMclient/SMcli
-
Stop SMmonitor service
AIX:
# SMmonitor stop
# rmitab smmonitor
Linux:
# /opt/SMgr/client/SMmonitor stop
# chkconfig --list SMmonitor
# chkconfig --level 2345 SMmonitor off
alternatively:
# rm -f /etc/rc2.d/S99SMmonitor /etc/rc.d/init.d/SMmonitor
Linux systemd:
# systemctl stop smmonitor.service
# systemctl disable smmonitor.service
- Allow user stor2rrd run SMcli API (lpar2rrd user on Virtual Appliance)
Under root execute following:
# rm -f /var/opt/SM/emwdata_v04_bin.lock /var/opt/SM/pref_01_bin.lock
# chown stor2rrd /opt/IBM_DS/client/SMcli /var/opt/SM/prefbackup_01.bin
# chown stor2rrd /var/opt/SM/emwback_v04.bin /var/opt/SM /var/opt/SM/emwdata_v04.bin
# chown stor2rrd /var/opt/SM /var/opt/SM/pref_01.bin
# chmod -f 755 /opt/IBM_DS/client/lib/*
If you do not do it then you get such error by running it under someone else than root:
(Do not forget to deactivate SMmonitor as above as it can change file rights back to root itself)
# su - stor2rrd
$ SMcli -d
An internal error, error code 12, has occurred. This is possibly due to
initialization problems when loading the necessary internal files. Please check
your installation of the storage management client. If problems continue
to persist, re-install the storage management client.
Storage configuration
-
Open TCP port 2463 to the storage if there is firewall between (your host ➞ storage:2463 )
- Connect new storage
# su - stor2rrd
$ SMcli -d
There are currently no storage subsystems listed in the configuration file. Add
storage subsystems using the Add Storage Subsystem option in the storage management
software or by command line.
$ SMcli -A 1.1.1.2 1.1.1.3
New storage subsystem was discovered at address 1.1.1.2
New storage subsystem was discovered at address 1.1.1.3
SMcli completed successfully
$ SMcli -d
DS5020_01 ControlerA_hostname ControlerB_hostname
Use "DS5020_01" further for etc/storage-list.cfg configuration
-
Check if the storage needs user authorization (new firmwares allows to specify password for monitor user role):
$ SMcli -n DS5020_01 -e -c "show storageSubsystem summary;"
When it fails then use "monitor" role credetials (password can be set in the storage GUI):
$ SMcli -n DS5020_01 -e -c "show storageSubsystem summary;"
The operation needs either the 'Administrator' or 'Monitor' password to be set.
$ SMcli -n DS5020_01 -p <password> -R monitor -e -c "show storageSubsystem summary;"
Use that credentials in future etc/storage-list.cfg configuration
STOR2RRD storage configuration
-
Let run the storage agent for 15 - 20 minutes to get data, then:
$ cd /home/stor2rrd/stor2rrd
$ ./load.sh
- Go to the web GUI: http://<your web server>/stor2rrd/
Use Ctrl-F5 to refresh the web browser cache.