Saturday, January 17, 2015

Set up LVMiSCSI cinder backend for RDO Juno on Fedora 21 for Two Node Cluster (Controller&&Network and Compute)

UPATE 11/17/2015
See Storage Node (LVMiSCSI) deployment for RDO Liberty on CentOS 7.1
END UPDATE

During RDO Juno set up on Fedora 21 Workstation service target is deactivated
on boot up, and tgtd is started (versus CentOS 7 installation procedure) , what
requires some additional efforts to tune LVMiSCSI cinder back end on newest Fedora release. Actually, RDO Juno packstack multi node setup follows procedure posted here http://lxer.com/module/newswire/view/207415/index.html

Service tgtd should be stopped and disabled on Controller
Service target should be enabled and started on Controller

[root@juno1f21 ~(keystone_admin)]# service target status
Redirecting to /bin/systemctl status  target.service
● target.service - Restore LIO kernel target configuration
   Loaded: loaded (/usr/lib/systemd/system/target.service; enabled)
   Active: active (exited) since Sat 2015-01-17 15:45:44 MSK; 12min ago
  Process: 1512 ExecStart=/usr/bin/targetctl restore (code=exited, status=0/SUCCESS)
 Main PID: 1512 (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/target.service

In general - here is a summary of the iSCSI fabric objects hierarchy (see also the underlying configFS layout) . View http://linux-iscsi.org/wiki/Targetcli : -


+-targetcli
  |
  +-Targets
    | Identified by their WWNs or IQN (for iSCSI).
    | Targets identify a group of Endpoints.
    |
    +-TPGs (Target Portal Groups, iSCSI only)
      | The TPG is identified by its numerical Tag, starting at 1. It
      | groups several Network Portals, and caps LUNs and Node ACLs.
      | For fabrics other than iSCSI, targetcli masks the TPG level.
      |
      +-Network Portals (iSCSI only)
      |   A Network Portal adds an IP address and a port. Without at
      |   least one Network Portal, the Target remains disabled.
      |
      +-LUNs
      |   LUNs point at the Storage Objects, and are numbered 0-255.
      |
      +-ACLs
        | Identified by initiator WWNs/IQNs, ACLs group permissions
        | for that specific initiator. If ACLs are enabled, one
        | NodeACL is required per authorized initiator.
        |
        + Mapped LUNs
            Determine which LUNs an initiator will see. E.g., if
            Mapped LUN 1 points at LUN 0, the initiator referenced
            by the NodeACL will see LUN 0 as LUN 1.


In targetcli environment follow procedure described here http://www.server-world.info/en/note?os=Fedora_21&p=iscsi
create  ACL iqn.1994-05.com.redhat:28205be4fa2c just matching InitiatorName
in file /etc/iscsi/initiatorname.iscsi on Compute Node


   On  Compute Node follow http://www.server-world.info/en/note?os=Fedora_21&p=iscsi&f=2

*************************************************
Update /etc/iscsi/iscsid.conf  to match :-
*************************************************

  node.session.auth.username = username
  node.session.auth.password = password

  assigned in targetcli set up on Controller , then run on Compute node

  # systemctl  start iscsid
  # systemctl  enable iscsid

*****************************************************************************
 Update /etc/cinder/cinder.conf on Controller as follows in DEFAULT section
******************************************************************************

  enabled_backends = lvm001

  Then  place in bottom of cinder.conf:

   [lvm001]
   iscsi_helper=lioadm
   volume_group=cinder-volumes001
   iscsi_ip_address=192.168.1.127
   volume_driver=cinder.volume.drivers.lvm.LVMISCSIDriver
   volume_backend_name=LVM_iSCSI001

   ****************
   Now run :-
   ****************

   [root@juno1f21 ~(keystone_admin)]#  cinder type-create lvms

   [root@juno1f21 ~(keystone_admin)]#  cinder type-key lvms set    volume_backend_name=LVM_iSCSI001

   [root@juno1f21 ~(keystone_admin)]# for i in api scheduler volume ; do service openstack-cinder-${i} restart ; done

*******************************************************************************
  Via drop down menu "volume type" create VF21LVMS01 with lvms type :-
*******************************************************************************



 
 and launch instance of Fedora 21 via LVMiSCSI volume created

 Compute node will report :-

[root@juno2f21 ~]# iscsiadm -m discovery -t sendtargets -p 192.168.1.127
192.168.1.127:3260,1 iqn.2010-10.org.openstack:volume-d96a5ad7-bd0b-438a-8ffb-4cb631ed8752


[root@juno2f21 ~]# service iscsid status

Redirecting to /bin/systemctl status  iscsid.service
● iscsid.service - Open-iSCSI
   Loaded: loaded (/usr/lib/systemd/system/iscsid.service; enabled)
   Active: active (running) since Sat 2015-01-17 15:24:12 MSK; 1h 4min ago
     Docs: man:iscsid(8)
           man:iscsiadm(8)
  Process: 27674 ExecStop=/sbin/iscsiadm -k 0 2 (code=exited, status=0/SUCCESS)
  Process: 27680 ExecStart=/usr/sbin/iscsid (code=exited, status=0/SUCCESS)
 Main PID: 27682 (iscsid)
   CGroup: /system.slice/iscsid.service
           ├─27681 /usr/sbin/iscsid
           └─27682 /usr/sbin/iscsid

Jan 17 15:44:57 juno2f21.localdomain iscsid[27681]: connect to 192.168.1.127:3260 failed (No...t)
Jan 17 15:45:03 juno2f21.localdomain iscsid[27681]: connect to 192.168.1.127:3260 failed (No...t)
Jan 17 15:45:39 juno2f21.localdomain iscsid[27681]: connect to 192.168.1.127:3260 failed (No...t)
Jan 17 15:45:43 juno2f21.localdomain iscsid[27681]: connect to 192.168.1.127:3260 failed (Co...d)
Jan 17 15:45:46 juno2f21.localdomain iscsid[27681]: connection1:0 is operational after recov...s)
Jan 17 15:45:43 juno2f21.localdomain iscsid[27681]: connect to 192.168.1.127:3260 failed (Co...d)

Jan 17 15:45:46 juno2f21.localdomain iscsid[27681]: connection1:0 is 
operational after recov...s)
Hint: Some lines were ellipsized, use -l to show in full.

**********************************************************************
 Verify  volume-id shown it targetcli>ls report :
**********************************************************************

[root@juno1f21 ~(keystone_admin)]# nova list --all-tenants
+--------------------------------------+------------------+-----------+------------+-------------+---------------------------------------+
| ID                                   | Name             | Status    | Task State | Power State | Networks                              |
+--------------------------------------+------------------+-----------+------------+-------------+---------------------------------------+
| 3f06cb34-797d-45d1-989e-cba14e902b6c | UbuntuUtopicRX01 | SUSPENDED | -          | Shutdown    | demo_network=40.0.0.17, 192.168.1.154 |
| 7fcbcf6f-67a7-4603-9c09-6e725d403a04 | VF21GLX01        | SUSPENDED | -          | Shutdown    | demo_network=40.0.0.16, 192.168.1.153 |
| a731443e-1355-44c0-811b-97cf9eab987e | VF21LVX001       | ACTIVE    | -          | Running     | demo_network=40.0.0.18, 192.168.1.155 |
+--------------------------------------+------------------+-----------+------------+-------------+---------------------------------------+
[root@juno1f21 ~(keystone_admin)]# nova show a731443e-1355-44c0-811b-97cf9eab987e
+--------------------------------------+----------------------------------------------------------+
| Property                             | Value                                                    |
+--------------------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig                    | AUTO                                                     |
| OS-EXT-AZ:availability_zone          | nova                                                     |
| OS-EXT-SRV-ATTR:host                 | juno2f21.localdomain                                     |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | juno2f21.localdomain                                     |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000008                                        |
| OS-EXT-STS:power_state               | 1                                                        |
| OS-EXT-STS:task_state                | -                                                        |
| OS-EXT-STS:vm_state                  | active                                                   |
| OS-SRV-USG:launched_at               | 2015-01-17T12:33:50.000000                               |
| OS-SRV-USG:terminated_at             | -                                                        |
| accessIPv4                           |                                                          |
| accessIPv6                           |                                                          |
| config_drive                         |                                                          |
| created                              | 2015-01-17T12:33:38Z                                     |
| demo_network network                 | 40.0.0.18, 192.168.1.155                                 |
| flavor                               | m1.small (2)                                             |
| hostId                               | 40dba45d18a87067afdd4187c4467eed967a11c3b59df8b921f6b16e |
| id                                   | a731443e-1355-44c0-811b-97cf9eab987e                     |
| image                                | Attempt to boot from volume - no image supplied          |
| key_name                             | oskey57                                                  |
| metadata                             | {}                                                       |
| name                                 | VF21LVX001                                               |
| os-extended-volumes:volumes_attached | [{"id": "d96a5ad7-bd0b-438a-8ffb-4cb631ed8752"}]         |
| progress                             | 0                                                        |
| security_groups                      | default                                                  |
| status                               | ACTIVE                                                   |
| tenant_id                            | 25f74c1d135c4727b1406cb35f9df70a                         |
| updated                              | 2015-01-17T12:52:06Z                                     |
| user_id                              | 0025c17969f64708a886d4bb1fa354cc                         |
+--------------------------------------+---------------------------------------------------------

[root@juno1f21 ~(keystone_admin)]# targetcli
targetcli shell version 2.1.fb38
Copyright 2011-2013 by Datera, Inc and others.
For help on commands, type 'help'.

/> ls
o- / ...................................................................................... [...]
  o- backstores ........................................................................... [...]
  | o- block ............................................................... [Storage Objects: 1]
  | | o- iqn.2010-10.org.openstack:volume-d96a5ad7-bd0b-438a-8ffb-4cb631ed8752  [/dev/cinder-volumes001/volume-d96a5ad7-bd0b-438a-8ffb-4cb631ed8752 (5.0GiB) write-thru activated]


Creating volume for Ubuntu Utopic


    
   

    Reporting from Compute side :-

    [root@juno1f21 ~(keystone_admin)]# ssh 192.168.1.137
Last login: Sat Jan 17 16:24:44 2015 from juno1f21.localdomain
[root@juno2f21 ~]# service iscsid status
Redirecting to /bin/systemctl status  iscsid.service
● iscsid.service - Open-iSCSI
   Loaded: loaded (/usr/lib/systemd/system/iscsid.service; enabled)
   Active: active (running) since Sat 2015-01-17 15:24:12 MSK; 1h 53min ago
     Docs: man:iscsid(8)
           man:iscsiadm(8)
  Process: 27674 ExecStop=/sbin/iscsiadm -k 0 2 (code=exited, status=0/SUCCESS)
  Process: 27680 ExecStart=/usr/sbin/iscsid (code=exited, status=0/SUCCESS)
 Main PID: 27682 (iscsid)
   CGroup: /system.slice/iscsid.service
           ├─27681 /usr/sbin/iscsid
           └─27682 /usr/sbin/iscsid


Jan 17 15:45:03 juno2f21.localdomain iscsid[27681]: connect to 192.168.1.127:3260 failed (No...t)
Jan 17 15:45:09 juno2f21.localdomain iscsid[27681]: connect to 192.168.1.127:3260 failed (No...t)
Jan 17 15:45:43 juno2f21.localdomain iscsid[27681]: connect to 192.168.1.127:3260 failed (Co...d)
Jan 17 15:45:46 juno2f21.localdomain iscsid[27681]: connection1:0 is operational after recov...s)
Jan 17 17:05:38 juno2f21.localdomain iscsid[27681]: Connection2:0 to [target: iqn.2010-10.or...ow

Hint: Some lines were ellipsized, use -l to show in full.

[root@juno2f21 ~]# iscsiadm -m discovery -t sendtargets -p 192.168.1.127

192.168.1.127:3260,1 iqn.2010-10.org.openstack:volume-d96a5ad7-bd0b-438a-8ffb-4cb631ed8752
192.168.1.127:3260,1 iqn.2010-10.org.openstack:volume-e87a3ee8-fa04-4bab-aedc-31bd2f4d4c02