Free SAN and storage performance and capacity monitoring

HPE storage installation

Back to storage installation home.

In case of usage of Virtual Appliance
  • Use local account lpar2rrd for hosting of STOR2RRD on the virtual appliance
  • Use /home/stor2rrd/stor2rrd as the product home
  • Use lpar2rrd account on storages as it is configured in /home/stor2rrd/stor2rrd/etc/stor2rrd.cfg (STORAGE_USER)
  • Replace lpar2rrd by stor2rrd user in all examples below.
The product uses 3PAR CLI interface over SSH protocol.
Only what you need is allow ssh LAN access from the host to the storage.

Storage connectivity

  • Create user stor2rrd on the storage with browse role and allow it for all domains.
    $ ssh 3paradm@3par_storage
      3paradm's password: ******
      createuser -c testpw stor2rrd all browse 
      exit
    $ ssh stor2rrd@3par_storage
      showuser
      Username Domain    Role   Default
      stor2rrd    all    browse N
    
  • Create a key pair using the ssh-keygen utility in case you do not have a one in /home/stor2rrd/.ssh
    Type enter instead of passphrase.
    # su - stor2rrd # (use lpar2rrd user on the Appliance)
    $ ssh-keygen -t rsa
      Generating public/private rsa key pair.
      Enter file in which to save the key (/home/stor2rrd/.ssh/id_rsa):
      ...
    $ cat ~/.ssh/id_rsa.pub
    
  • Exchange the ssh public key (import it on the storage under stor2rrd account)
    $ ssh stor2rrd@3par_storage
      stor2rrd@3par_storage password: testpw
      setsshkey
    
    Enter the SSH public key below. When finished, press enter twice. The key is usually long.
    It's better to copy it from inside an editor and paste it here. (Please make sure there is no extra blanks.)
     sshrsa AF5afPdciUTJ0PYzB6msRxFrCuDSqDwPshqWS5tGCFSoSZdE= stor2rrd pubic key
     SSH public key successfully set!
    
  • Check the storage connection, you should log in without password prompt
    $ ssh -i ~/.ssh/id_rsa stor2rrd@3par_storage
    

STOR2RRD storage configuration

  • Under stor2rrd account create config entry. Uncomment (remove the hash) example line and adjust it:
    $ vi /home/stor2rrd/stor2rrd/etc/storage-list.cfg
    
    #
    # HP 3PAR
    #
    # Storage name alias:3PAR:storage IP/hostname:ssh_key_file:VOLUME_AGG_DATA_LIM:VOLUME_AGG_IO_LIM:SAMPLE_RATE_MINS
    #
    #3PAR01-alias:3PAR:3par_host.example.com:/home/stor2rrd/.ssh/id_rsa:2048:512:5
    #3PAR02-alias:3PAR:3par_host.example.com:/home/stor2rrd/.ssh/id_rsa
    #3PAR02-alias:3PAR:storage_IP:
    3par01:3PAR:192.168.1.1:
    
    Above shows 3PAR storage with IP 192.168.1.1 which will be visible in the GUI as 3par01

  • Assure you have enough of disk space on the filesystem where is STOR2RRD installed
    Roughly you might count 2 - 30 GB per a storage (it depends on number of volumes, 30GB for 5000 volumes)
    $ df -g /home   # AIX
    $ df -h /home   # Linux
    
  • Check storage connectivity
    $ cd /home/stor2rrd/stor2rrd
    $ ./bin/config_check.sh 
      =====================
      STORAGE: 3par01: 3PAR
      =====================
      ssh -o ConnectTimeout=15 -i /home/stor2rrd/.ssh/id_rsa  stor2rrd@192.168.1.1  "showuser"
      connection ok
    
  • Schedule to run storage agent from stor2rrd crontab (lpar2rrd on Virtual Appliance)
    $ crontab -e
    
    # HPE 3PAR storage agent
    0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/stor2rrd/stor2rrd/load_3parperf.sh > /home/stor2rrd/stor2rrd/load_3parperf.out
    
    Assure there is already an entry with the GUI creation running once an hour in crontab
    $ crontab -e
    
    # STOR2RRD GUI
    0 * * * * /home/stor2rrd/stor2rrd/load.sh > /home/stor2rrd/stor2rrd/load.out 2>&1
    
  • Let run the storage agent for 15 - 20 minutes to get data, then:
    $ cd /home/stor2rrd/stor2rrd
    $ ./load.sh
    
  • Go to the web GUI: http://<your web server>/stor2rrd/
    Use Ctrl-F5 to refresh the web browser cache.

HPE XP7 is re-branded Hitachi VSP-G.

Allow TCP/IP communication from STOR2RRD host to all storages on port 1099,31001 and 51100

The program uses two APIs. You have to install both of them.
  • Command Control Interface (CCI)
  • Export tool

Installation of CCI

Obtain CCI installation package from your HPE representatives.
  1. Insert the installation media into the proper I/O device. Move to the desired directory for CCI (under root)
    # mkdir /opt
    # cpio -idmu < /dev/XXXX    # where XXXX = I/O device with install media
    # ln -s /opt/HORCM /HORCM
    
  2. Execute the CCI installation command:
    # /HORCM/horcminstall.sh
    
  3. Verify installation of the proper version using the raidqry command:
    # raidqry -h
      Model: RAID-Manager/HP-UX
      Ver&Rev: 01-29-03/05
      Usage: raidqry [options]
    
  4. Assure that everything is executable and writeable by stor2rrd user (it will be started under stor2rrd).
    This is a must! Under root identification execute this:
    # touch /HORCM/etc/USE_OLD_IOCT 
    # chown -R stor2rrd /HORCM/log* /HORCM/.uds /HORCM/usr
    # chmod 755 /HORCM/usr/bin /HORCM/usr/bin/* /HORCM/log /HORCM/etc/horcmgr /HORCM/etc/*conf /HORCM/.uds/ /HORCM/.uds/*
    

Configuration of CCI

  • CCI communication with storage can be done either via LAN (it is something described below) or via command device (SAN attached volume from the storage). When you have many storages in place 40+ then use rather command device as LAN communication might not be reliable enough
  • Each storage must have its own config file /etc/horcmXX.conf
  • Check if local ports 10001 and 10002 are not used (nothing is listening there)
    # netstat -an|grep -i listen| egrep "11001|11002"
    
  • storage with IP 192.168.1.1, conf file /etc/horcm1.conf will use local port 11001 (UDP)
    Use storage node IP. SVP IP must be used in etc/storage-list.cfg further.
    # vi /etc/horcm1.conf
    
    HORCM_MON
    # ip_address service poll(10ms) timeout(10ms)
    localhost    11001   1000       3000
    HORCM_CMD
    # dev_name dev_name dev_name
    \\.\IPCMD-192.168.1.1-31001
    
  • storage with IP 192.168.1.10, conf file /etc/horcm2.conf
    change localhost port to 11002 (from 11001 which is used above)
    # vi /etc/horcm2.conf
    
    HORCM_MON
    # ip_address service poll(10ms) timeout(10ms)
    localhost    11002   1000       3000
    HORCM_CMD
    # dev_name dev_name dev_name
    \\.\IPCMD-192.168.1.10-31001
    
  • Start it under stor2rrd account (definitelly not under root!). Use lpar2rrd account on the Virtual Appliance
    This starts HORM instance 1 (/etc/horcm1.conf)
    # su - stor2rrd
    $ /HORCM/usr/bin/horcmstart.sh 1
    
  • Start HORM instance 1 & 2 (/etc/horcm1.conf & /etc/horcm2.conf)
    # su - stor2rrd
    $ /HORCM/usr/bin/horcmstart.sh 1 2
    
  • Check if they are running
    $ ps -ef | grep horcm
      stor2rrd 19660912 1 0 Feb 26 - 0:03 horcmd_02
      stor2rrd 27590770 1 0 Feb 26 - 0:09 horcmd_01
    
  • Place it into operating system start/stop scripts
    # su - stor2rrd -c "/HORCM/usr/bin/horcmstart.sh 1 2"
    # su - stor2rrd -c "/HORCM/usr/bin/horcmshutdown.sh 1 2"
    

Installation of Export Tool

    It is typically located on a CD that comes packaged with the Service Processor on the HPE XP7 Array. The Export Tool can also be obtained by contacting HPE support. (CD location: /ToolsPack/ExportTool)
    There is a new Export Tool build for each release of the firmware. Unless you make sure all of the storages are running on the same firmware version then you will need to obtain the appropriate version of the Export Tool to meet the firmware version you are running at the site.

    Find our firmware release of your storage (83-01-28/00) identified by /etc/horcm1.conf (-I1):
    Under stor2rrd account!
    # su - stor2rrd
    $ raidcom -login $login $paswd -I1
    $ raidqry -l -I1 
      No  Group    Hostname     HORCM_ver   Uid   Serial#   Micro_ver     Cache(MB)
       1    ---   localhost   01-35-03-08     0   471234    83-01-28/00      320000
    $ raidcom -logout -I1
    
    Install each version of the Export Tool into separate directory named as firmware of your storage (just 6 numbers like in this example firmware 83-01-28) under root user:
    # mkdir /opt/hds
    # mkdir /opt/hds/83-01-28
    # cd /opt/hds/83-01-28
    # tar xvf export-tool.tar
    # chown -R stor2rrd /opt/hds
    
    Directory /opt/hds is optional, it is configurable in /home/stor2rrd/stor2rrd/etc/sto2rrd.cfg : VSP_CLIDIR=/opt/hds
    The HPE Performance Monitor License must exist for each array and monitoring must be enabled.
    Storage configuration example

STOR2RRD storage configuration

  • Configure Export Tool installation directory in /home/stor2rrd/stor2rrd/etc/stor2rrd.cfg
     VSP_CLIDIR=/opt/hds
    
  • Create user stor2rrd on the storage, read only access
  • Encrypt password used for storage access (stor2rrd)
    $ perl ./bin/spasswd.pl
      Encode password for storage authentication:
      -------------------------------------------
      Enter password:
      Re-enter password:
      Copy the following string to the password field of the corresponding line in etc/storage-list.cfg:
        IT5gYGAK
    
  • Configure storages in etc/storage-list.cfg
    Roughly you might count 2 - 30 GB per a storage (it depends on number of volumes, 30GB for 5000 volumes)
    $ df -g /home   # AIX
    $ df -h /home   # Linux
    
  • Test the storage connectivity under stor2rrd user:
    $ cd /home/stor2rrd/stor2rrd
    $ ./bin/config_check.sh 
      ======================
      STORAGE: XP7-01 : VSPG
      =======================
      connection ok
    
      ======================
      STORAGE: XP7-02 : VSPG
      =======================
      connection ok
    
  • Schedule to run storage agent from stor2rrd crontab (lpar2rrd on Virtual Appliance)
    $ crontab -e
    
    # HPE XP7 (use Hitachi VSPG scipt load_vspgperf.sh)
    0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/stor2rrd/stor2rrd/load_vspgperf.sh > /home/stor2rrd/stor2rrd/load_vspgperf.out
    
    Assure there is already an entry with the GUI creation running once an hour in crontab
    $ crontab -e
    
    # STOR2RRD GUI
    0 * * * * /home/stor2rrd/stor2rrd/load.sh > /home/stor2rrd/stor2rrd/load.out 2>&1
    
  • Let run the storage agent for 15 - 20 minutes to get data, then:
    $ cd /home/stor2rrd/stor2rrd
    $ ./load.sh
    
  • Go to the web GUI: http://<your web server>/stor2rrd/
    Use Ctrl-F5 to refresh the web browser cache.

Note this will be supported since version 1.40 (Apr 2017).
Beta testers are welcome, contact us at: support@stor2rrd.com.

The product uses SMI-S and XML API interfaces natively provided by the storage.
We do not support G2 and older models which do not have SMI-S and XML API interfaces.

Storage connectivity

  • Assure that SMI-S 5988 and HTTP protocols are enabled on the storage
    $ ssh -l manage <storage_hostname>
    # show protocols
      Service and Security Protocols
      ------------------------------
      Web Browser Interface (HTTP): Enabled
      Secure Web Browser Interface (HTTPS): Enabled
      Command Line Interface (Telnet): Disabled
      Secure Command Line Interface (SSH): Enabled
      Storage Management Initiative Specification (SMI-S): Disabled
      Unsecure Storage Management Initiative Specification (SMI-S 5988): Enabled
      ...
    
    If SMI-S 5988 or HTTP is not enabled:
    # set protocols usmis enabled
    # set protocols http enabled
    
  • Create user stor2rrd on the storage with monitor role and allow SMI-S and XML API.
    Adjust password to your prefered one from used Test1234.
    $ ssh -l manage <storage_hostname>
    # create user interfaces smis,wbi locale English password Test1234 roles monitor stor2rrd
    
  • Allow access from the STOR2RRD host to the storage on ports 443 and 5989.
    # telnet <storage_hostname> 5988
      Connected to <storage_hostname>.
      Escape character is '^]'.
    # telnet <storage_hostname> 80
      Connected to <storage_hostname>.
      Escape character is '^]'.
    

Install prerequisites

Skip that in case of Virtual Appliance
  • Linux:
    Install sblim-wbemcli package:
    # yum list |grep sblim-wbemcli
      sblim-wbemcli.x86_64                       1.6.2-9.el7                 base
    # yum install sblim-wbemcli     # RedHat
    # apt-get install sblim-wbemcli # Debian based (Ubuntu etc)
    # /usr/bin/wbemcli -noverify -nl ei https://<storage_hostname>:5988/root/hpq:cim_computersystem
      *
      * ./wbemcli: Http Exception: Username/password required.
      *
    
    If you prefere to use https on port 5989 and get error "SSL connect error" then you might hit into a problem where SSL on the storage has disabled SSLv3 protocol.
    Install version below which contains this patch 0002742-wbemcli-support-configurable-SSL-version
    Test the package:
    # /usr/bin/wbemcli -v
      * wbemcli Version 1.6.3
    # /usr/bin/wbemcli -noverify -nl ei http://<storage_hostname>:5988/root/hpq:cim_computersystem
      *
      * ./wbemcli: Http Exception: Username/password required.
      *
    
  • AIX:
    Download and install
    # rpm -Uvh libffi-3.1-1.aix5.1.ppc.rpm --nodeps
    # rpm -Uvh libiconv-1.14-2.aix5.1.ppc.rpm --nodeps
    # rpm -Uvh libidn-1.29-1.aix5.1.ppc.rpm --nodeps
    # rpm -Uvh libssh2-1.4.3-2.aix5.1.ppc.rpm --nodeps
    # rpm -Uvh openssl-1.0.1j-1.aix5.1.ppc.rpm
    # rpm -Uvh openldap-2.4.23-0.3.aix5.1.ppc.rpm
    # rpm -Uvh curl-7.27.0-1.aix5.1.ppc.rpm
    # rpm -Uvh wbemcli-1.6.3-1.aix5.1.ppc.rpm
    
    # LIBPATH=/opt/freeware/lib; export LIBPATH
    # /opt/freeware/bin/wbemcli -noverify -nl ei http://<storage_hostname>:5988/root/hpq:cim_computersystem
      *
      * ./wbemcli: Http Exception: Username/password required.
      *
    

STOR2RRD storage configuration

  • Under stor2rrd account create config entry. Uncomment (remove the hash) example line and adjust it:
    $ vi /home/stor2rrd/stor2rrd/etc/storage-list.cfg
    
    #
    # Dot Hill AssuredSAN and its rebrands like Lenovo S2200 or HPE MSA2000/P2000
    #
    # Storage Alias:DOTHILL:Controller_A IP address or hostname:Controller_B IP address or hostname:[http|https]:storage user:passwd:VOLUME_AGG_DATA_LIM:VOLUME_AGG_IO_LIM:SAMPLE_RATE_MINS
    # to encrypt password use: perl ./bin/spasswd.pl
    #DOTHILL_AssuredSAN-alias01:DOTHILL:192.168.15.155:192.168.15.156:http:stor2rrd:IT5gYGAK
    #LENOVO_S2000-alias01:DOTHILL:192.168.15.155:192.168.15.156:http:stor2rrd:IT5gYGAK
    #HPE_MSA2000-alias01:DOTHILL:192.168.15.155:192.168.15.156:http:stor2rrd:IT5gYGAK
    #HPE_P2000-alias01:DOTHILL:192.168.15.155:192.168.15.156:http:stor2rrd:IT5gYGAK
    
    MSA2000-alias01:DOTHILL:192.168.1.1:192.168.1.2:http:stor2rrd:IT5gYGAK
    
    
    Above shows storage with IP 192.168.1.1 which will be visible in the GUI as MSA2000-alias01

  • Assure you have enough of disk space on the filesystem where is STOR2RRD installed
    Roughly you might count 2 - 30 GB per a storage (it depends on number of volumes, 30GB for 5000 volumes)
    $ df -g /home   # AIX
    $ df -h /home   # Linux
    
  • Check storage connectivity
    $ cd /home/stor2rrd/stor2rrd
    $ ./bin/config_check.sh 
      =====================
      STORAGE: MSA2000-alias01 : HPE MSA
      =====================
      connection ok
    
    If you use HTTPS and do not have installed Perl SSL support then you get an error:
    Request error LWP will support https URLs if the LWP::Protocol::https module
    
    Either install Perl https support (Linux: # yum install perl-LWP-Protocol-https) or switch to HTTP on the storage line in etc/storage-list.cfg.

  • Schedule to run storage agent from stor2rrd crontab (lpar2rrd on Virtual Appliance)
    $ crontab -e
    
    # DotHill AssuredSAN and its rebrands like Lenovo S2200 or HPE MSA2000/P2000
    0,5,10,15,20,25,30,35,40,45,50,55 * * * * /home/stor2rrd/stor2rrd/load_dothillperf.sh > /home/stor2rrd/stor2rrd/load_dothillperf.out
    
    Assure there is already an entry with the GUI creation running once an hour in crontab
    $ crontab -e
    
    # STOR2RRD GUI
    0 * * * * /home/stor2rrd/stor2rrd/load.sh > /home/stor2rrd/stor2rrd/load.out 2>&1
    
  • Let run the storage agent for 15 - 20 minutes to get data, then:
    $ cd /home/stor2rrd/stor2rrd
    $ ./load.sh
    
  • Go to the web GUI: http://<your web server>/stor2rrd/
    Use Ctrl-F5 to refresh the web browser cache.

Troubleshooting

  • Assure SMI-S is working for user stor2rrd. Adjust password and storage_hostname in example below:
    $ /usr/bin/wbemcli -nl -t -noverify ein 'http://stor2rrd:<password>@<storage_hostnamew>:5988/root/hpq:SMI_Controller'
      192.168.1.1:5988/root/smis:SMI_Controller.Name="208000c0ff261f53:A",CreationClassName="SMI_Controller"
      192.168.1.2:5988/root/smis:SMI_Controller.Name="208000c0ff261f53:B",CreationClassName="SMI_Controller"
    
    When it does not work then check user rights of stor2rrd user (must have "smis"), network visibility (firewall), user/password combination.

 

Links

Download

Others

Contact