#################
UPDATE 06/17/2016
#################
In meantime undercloud-install,undercloud-post-install (openstack undercloud install, openstack overcloud image upload ) are supposed to be performed during original run `bash quickstart.sh --config /path-to/ha.yml $VIRTHOST`. Neutron networks deployment on undercloud and HA Server's configuration has been significantly rebuilt during the last weeks. I believe current design is close to proposed in https://remote-lab.net/rdo-manager-ha-openstack-deployment
However , attempt to reproduce http://docs.openstack.org/developer/tripleo-docs/installation/installation.html
results hanging on `openstack undercloud install`, wheh it attempts to start
openstack-nova-compute on undercloud. Nova-compute.log report failure
to connect 127.0.0.1:5672. Verification via `netstat -antp | grep 5672` reports
port 5672 bind only to 192.0.2.1 ( ctlplane IP address ).
See also https://www.redhat.com/archives/rdo-list/2016-March/msg00171.html
Quoting ( complaints are not mine) :-
By the way, I'd love to see and help to have an complete installation guide for TripleO powered by RDO on the RDO site (the instack virt setup without quickstart . . . .
Then start on workstation :-
$ git clone https://github.com/openstack/tripleo-quickstart
$ cd tripleo-quickstart
$ sudo bash quickstart.sh --install-deps
$ sudo yum -y install redhat-rpm-config
$ export VIRTHOST=192.168.1.75 #put your own IP here
$ ssh-keygen
$ ssh-copy-id root@$VIRTHOST
$ ssh root@$VIRTHOST uname -a # no root login prompt
Then run under tripleo-quickstart
$ bash quickstart.sh --config ./config/general_config/ha.yml $VIRTHOST
During this run the most important is to reach this point on VIRTHOST
[stack@undercloud ~]$ neutron net-list
[stack@undercloud ~]$ heat stack-list
[stack@undercloud ~]$ nova list
Kernel IP routing table
[root@undercloud ~]# ovs-vsctl show
cc957f71-47e7-4fdd-a32b-26b31de42cd0
Bridge br-ctlplane
Port "vlan10"
tag: 10
Interface "vlan10"
type: internal
Port phy-br-ctlplane
Interface phy-br-ctlplane
type: patch
options: {peer=int-br-ctlplane}
Port br-ctlplane
Interface br-ctlplane
type: internal
Port "eth1"
Interface "eth1"
Bridge br-int
fail_mode: secure
Port "tap2138f24c-cf"
tag: 1
Interface "tap2138f24c-cf"
type: internal
Port int-br-ctlplane
Interface int-br-ctlplane
type: patch
options: {peer=phy-br-ctlplane}
Port br-int
Interface br-int
type: internal
ovs_version: "2.5.0"
[root@undercloud ~]# ifconfig
br-ctlplane: flags=4163 mtu 1500
inet 192.0.2.1 netmask 255.255.255.0 broadcast 192.0.2.255
inet6 fe80::251:8eff:fed1:cae1 prefixlen 64 scopeid 0x20
ether 00:51:8e:d1:ca:e1 txqueuelen 0 (Ethernet)
RX packets 3525063 bytes 282216789 (269.1 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 5194629 bytes 24689319446 (22.9 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth0: flags=4163 mtu 1500
inet 192.168.23.24 netmask 255.255.255.0 broadcast 192.168.23.255
inet6 fe80::251:8eff:fed1:cadf prefixlen 64 scopeid 0x20
ether 00:51:8e:d1:ca:df txqueuelen 1000 (Ethernet)
RX packets 317765 bytes 583156188 (556.1 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 207058 bytes 40922620 (39.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth1: flags=4163 mtu 1500
inet6 fe80::251:8eff:fed1:cae1 prefixlen 64 scopeid 0x20
ether 00:51:8e:d1:ca:e1 txqueuelen 1000 (Ethernet)
RX packets 3546320 bytes 289792462 (276.3 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 5219521 bytes 24981243189 (23.2 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73 mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 0 (Local Loopback)
RX packets 3891442 bytes 26647179103 (24.8 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 3891442 bytes 26647179103 (24.8 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099 mtu 1500
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:60:59:f7 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan10: flags=4163 mtu 1500
inet 10.0.0.1 netmask 255.255.255.0 broadcast 10.0.0.255
inet6 fe80::3049:b4ff:fe89:f348 prefixlen 64 scopeid 0x20
ether 32:49:b4:89:f3:48 txqueuelen 0 (Ethernet)
RX packets 20613 bytes 7441258 (7.0 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 24083 bytes 291745696 (278.2 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
Option "notification_driver" from group "DEFAULT" is deprecated. Use option "driver" from group "oslo_messaging_notifications".
Option "notification_topics" from group "DEFAULT" is deprecated. Use option "topics" from group "oslo_messaging_notifications".
13.0.1-0.20160611000828.c8ec9eb.el7.centos
[root@overcloud-controller-0 ~(keystone_admin)]# pcs status
Cluster name: tripleo_cluster
Last updated: Fri Jun 17 18:19:25 2016 Last change: Fri Jun 17 17:24:54 2016 by root via cibadmin on overcloud-controller-0
Stack: corosync
Current DC: overcloud-controller-2 (version 1.1.13-10.el7_2.2-44eb2dd) - partition with quorum
3 nodes and 127 resources configured
Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Full list of resources:
ip-192.0.2.6 (ocf::heartbeat:IPaddr2): Started overcloud-controller-0
ip-172.16.2.5 (ocf::heartbeat:IPaddr2): Started overcloud-controller-1
ip-172.16.3.4 (ocf::heartbeat:IPaddr2): Started overcloud-controller-2
Clone Set: haproxy-clone [haproxy]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Master/Slave Set: galera-master [galera]
Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: memcached-clone [memcached]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
ip-10.0.0.4 (ocf::heartbeat:IPaddr2): Started overcloud-controller-0
ip-172.16.2.4 (ocf::heartbeat:IPaddr2): Started overcloud-controller-1
ip-172.16.1.4 (ocf::heartbeat:IPaddr2): Started overcloud-controller-2
Clone Set: rabbitmq-clone [rabbitmq]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-core-clone [openstack-core]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Master/Slave Set: redis-master [redis]
Masters: [ overcloud-controller-0 ]
Slaves: [ overcloud-controller-1 overcloud-controller-2 ]
Clone Set: mongod-clone [mongod]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-evaluator-clone [openstack-aodh-evaluator]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-scheduler-clone [openstack-nova-scheduler]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-l3-agent-clone [neutron-l3-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-netns-cleanup-clone [neutron-netns-cleanup]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-ovs-cleanup-clone [neutron-ovs-cleanup]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
openstack-cinder-volume (systemd:openstack-cinder-volume): Started overcloud-controller-0
Clone Set: openstack-heat-engine-clone [openstack-heat-engine]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-api-clone [openstack-ceilometer-api]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-listener-clone [openstack-aodh-listener]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-metadata-agent-clone [neutron-metadata-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-gnocchi-metricd-clone [openstack-gnocchi-metricd]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-notifier-clone [openstack-aodh-notifier]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-clone [openstack-heat-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-collector-clone [openstack-ceilometer-collector]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-glance-api-clone [openstack-glance-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-cinder-scheduler-clone [openstack-cinder-scheduler]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-api-clone [openstack-nova-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-consoleauth-clone [openstack-nova-consoleauth]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-sahara-api-clone [openstack-sahara-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-cloudwatch-clone [openstack-heat-api-cloudwatch]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-sahara-engine-clone [openstack-sahara-engine]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-glance-registry-clone [openstack-glance-registry]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-gnocchi-statsd-clone [openstack-gnocchi-statsd]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-notification-clone [openstack-ceilometer-notification]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-cinder-api-clone [openstack-cinder-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-dhcp-agent-clone [neutron-dhcp-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-openvswitch-agent-clone [neutron-openvswitch-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-novncproxy-clone [openstack-nova-novncproxy]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: delay-clone [delay]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-server-clone [neutron-server]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-central-clone [openstack-ceilometer-central]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: httpd-clone [httpd]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-cfn-clone [openstack-heat-api-cfn]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-conductor-clone [openstack-nova-conductor]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Failed Actions:
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-0 'not running' (7): call=96, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:21:27 2016', queued=0ms, exec=0ms
* openstack-gnocchi-metricd_monitor_60000 on overcloud-controller-0 'not running' (7): call=364, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 18:16:34 2016', queued=0ms, exec=0ms
* openstack-gnocchi-statsd_start_0 on overcloud-controller-0 'not running' (7): call=262, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:22:36 2016', queued=0ms, exec=2216ms
* openstack-ceilometer-central_start_0 on overcloud-controller-0 'not running' (7): call=325, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:25:56 2016', queued=0ms, exec=2088ms
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-2 'not running' (7): call=90, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:21:32 2016', queued=0ms, exec=0ms
* openstack-gnocchi-metricd_monitor_60000 on overcloud-controller-2 'not running' (7): call=345, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 18:16:30 2016', queued=0ms, exec=0ms
* openstack-gnocchi-statsd_start_0 on overcloud-controller-2 'not running' (7): call=302, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:24:27 2016', queued=0ms, exec=2203ms
* openstack-ceilometer-central_start_0 on overcloud-controller-2 'not running' (7): call=304, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:24:32 2016', queued=0ms, exec=2102ms
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-1 'not running' (7): call=95, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:21:29 2016', queued=0ms, exec=0ms
* openstack-gnocchi-metricd_monitor_60000 on overcloud-controller-1 'not running' (7): call=350, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 18:16:32 2016', queued=0ms, exec=0ms
* openstack-gnocchi-statsd_start_0 on overcloud-controller-1 'not running' (7): call=309, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:24:37 2016', queued=0ms, exec=2206ms
* openstack-ceilometer-central_start_0 on overcloud-controller-1 'not running' (7): call=287, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:24:07 2016', queued=0ms, exec=2126ms
PCSD Status:
overcloud-controller-0: Online
overcloud-controller-1: Online
overcloud-controller-2: Online
Daemon Status:
corosync: active/enabled
pacemaker: active/enabled
pcsd: active/enabled
[heat-admin@overcloud-controller-0 ~]$ sudo cat /etc/os-net-config/config.json | jq '.[]'
[
{
"dns_servers": [
"8.8.8.8",
"8.8.4.4"
],
"name": "br-ex",
"members": [
{
"type": "interface",
"name": "nic1",
"primary": true
},
{
"routes": [
{
"default": true,
"next_hop": "10.0.0.1"
}
],
"type": "vlan",
"addresses": [
{
"ip_netmask": "10.0.0.7/24"
}
],
"vlan_id": 10
},
{
"type": "vlan",
"addresses": [
{
"ip_netmask": "172.16.2.8/24"
}
],
"vlan_id": 20
},
{
"type": "vlan",
"addresses": [
{
"ip_netmask": "172.16.1.8/24"
}
],
"vlan_id": 30
},
{
"type": "vlan",
"addresses": [
{
"ip_netmask": "172.16.3.6/24"
}
],
"vlan_id": 40
},
{
"type": "vlan",
"addresses": [
{
"ip_netmask": "172.16.0.7/24"
}
],
"vlan_id": 50
}
],
"routes": [
{
"ip_netmask": "169.254.169.254/32",
"next_hop": "192.0.2.1"
}
],
"use_dhcp": false,
"type": "ovs_bridge",
"addresses": [
{
"ip_netmask": "192.0.2.9/24"
}
]
}
]
[heat-admin@overcloud-controller-0 ~]$ sudo route -n
[root@overcloud-controller-0 ~(keystone_admin)]# ifconfig
br-ex: flags=4163 mtu 1500
inet 192.0.2.9 netmask 255.255.255.0 broadcast 192.0.2.255
inet6 fe80::292:beff:fe94:32f9 prefixlen 64 scopeid 0x20
ether 00:92:be:94:32:f9 txqueuelen 0 (Ethernet)
RX packets 32540 bytes 74708595 (71.2 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 32034 bytes 3733716 (3.5 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth0: flags=4163 mtu 1500
inet6 fe80::292:beff:fe94:32f9 prefixlen 64 scopeid 0x20
ether 00:92:be:94:32:f9 txqueuelen 1000 (Ethernet)
RX packets 1252373 bytes 973500960 (928.4 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1226276 bytes 584049729 (556.9 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73 mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 0 (Local Loopback)
RX packets 342429 bytes 576234034 (549.5 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 342429 bytes 576234034 (549.5 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan10: flags=4163 mtu 1500
inet 10.0.0.7 netmask 255.255.255.0 broadcast 10.0.0.255
inet6 fe80::fcb9:82ff:fe2b:4785 prefixlen 64 scopeid 0x20
ether fe:b9:82:2b:47:85 txqueuelen 0 (Ethernet)
RX packets 18161 bytes 284359113 (271.1 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 16451 bytes 5011950 (4.7 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan20: flags=4163 mtu 1500
inet 172.16.2.8 netmask 255.255.255.0 broadcast 172.16.2.255
inet6 fe80::345b:85ff:fec9:1a58 prefixlen 64 scopeid 0x20
ether 36:5b:85:c9:1a:58 txqueuelen 0 (Ethernet)
RX packets 1130946 bytes 290484989 (277.0 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1112747 bytes 214163892 (204.2 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan30: flags=4163 mtu 1500
inet 172.16.1.8 netmask 255.255.255.0 broadcast 172.16.1.255
inet6 fe80::1892:70ff:febe:6fa5 prefixlen 64 scopeid 0x20
ether 1a:92:70:be:6f:a5 txqueuelen 0 (Ethernet)
RX packets 51203 bytes 51062473 (48.6 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 49854 bytes 311860707 (297.4 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan40: flags=4163 mtu 1500
inet 172.16.3.6 netmask 255.255.255.0 broadcast 172.16.3.255
inet6 fe80::4858:c5ff:fe85:dca5 prefixlen 64 scopeid 0x20
ether 4a:58:c5:85:dc:a5 txqueuelen 0 (Ethernet)
RX packets 18746 bytes 267835013 (255.4 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 14631 bytes 44417807 (42.3 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan50: flags=4163 mtu 1500
inet 172.16.0.7 netmask 255.255.255.0 broadcast 172.16.0.255
inet6 fe80::80d1:c1ff:fe06:a095 prefixlen 64 scopeid 0x20
ether 82:d1:c1:06:a0:95 txqueuelen 0 (Ethernet)
RX packets 621 bytes 62554 (61.0 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 146 bytes 12262 (11.9 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[root@overcloud-controller-0 ~(keystone_admin)]# ovs-vsctl show
765a651a-f908-4ae7-9dab-1712de0f8ed2
Bridge br-ex
Port "vlan50"
tag: 50
Interface "vlan50"
type: internal
Port phy-br-ex
Interface phy-br-ex
type: patch
options: {peer=int-br-ex}
Port "eth0"
Interface "eth0"
Port "vlan30"
tag: 30
Interface "vlan30"
type: internal
Port "vlan20"
tag: 20
Interface "vlan20"
type: internal
Port "vlan40"
tag: 40
Interface "vlan40"
type: internal
Port "vlan10"
tag: 10
Interface "vlan10"
type: internal
Port "qg-d116056c-ab"
Interface "qg-d116056c-ab"
type: internal
Port br-ex
Interface br-ex
type: internal
Bridge br-int
fail_mode: secure
Port int-br-ex
Interface int-br-ex
type: patch
options: {peer=phy-br-ex}
Port br-int
Interface br-int
type: internal
Port "qr-02a6b269-22"
tag: 4
Interface "qr-02a6b269-22"
type: internal
Port "ha-2043a0a0-79"
tag: 3
Interface "ha-2043a0a0-79"
type: internal
Port "tap8d7afb39-38"
tag: 4
Interface "tap8d7afb39-38"
type: internal
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Bridge br-tun
fail_mode: secure
Port "vxlan-ac100005"
Interface "vxlan-ac100005"
type: vxlan
options: {df_default="true", in_key=flow, local_ip="172.16.0.7", out_key=flow, remote_ip="172.16.0.5"}
Port "vxlan-ac100004"
Interface "vxlan-ac100004"
type: vxlan
options: {df_default="true", in_key=flow, local_ip="172.16.0.7", out_key=flow, remote_ip="172.16.0.4"}
Port "vxlan-ac100006"
Interface "vxlan-ac100006"
type: vxlan
options: {df_default="true", in_key=flow, local_ip="172.16.0.7", out_key=flow, remote_ip="172.16.0.6"}
Port br-tun
Interface br-tun
type: internal
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
ovs_version: "2.5.0"
[root@overcloud-controller-0 ~(keystone_admin)]# cd /etc/neutron
[root@overcloud-controller-0 neutron(keystone_admin)]# cat l3_agent.ini | grep -v ^#|grep -v ^$
[DEFAULT]
ovs_use_veth = False
interface_driver = neutron.agent.linux.interface.OVSInterfaceDriver
agent_mode = legacy
debug = False
[AGENT]
[root@overcloud-controller-0 neutron(keystone_admin)]# cd plugins/ml2
[root@overcloud-controller-0 ml2(keystone_admin)]# cat ml2_conf.ini | grep -v ^#|grep -v ^$
[DEFAULT]
[ml2]
type_drivers = vxlan,vlan,flat,gre
tenant_network_types = vxlan
mechanism_drivers =openvswitch
extension_drivers =qos,port_security
path_mtu = 0
[ml2_type_flat]
flat_networks = datacentre
[ml2_type_geneve]
[ml2_type_gre]
tunnel_id_ranges =1:4094
[ml2_type_vlan]
network_vlan_ranges =datacentre:1:1000
[ml2_type_vxlan]
vni_ranges =1:4094
vxlan_group = 224.0.0.1
[securitygroup]
[root@overcloud-controller-0 ml2(keystone_admin)]# cat openvswitch_agent.ini | grep -v ^#|grep -v ^$
[DEFAULT]
[agent]
tunnel_types =vxlan
vxlan_udp_port = 4789
l2_population = False
drop_flows_on_start = False
extensions=qos
[ovs]
integration_bridge = br-int
tunnel_bridge = br-tun
local_ip = 172.16.0.7
bridge_mappings =datacentre:br-ex
enable_tunneling=True
[securitygroup]
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver
###########
END UPDATE
###########
This posting follows up Deploying OpenStack on just one hosted server but is focused on utilizing i7 4790/4770 CPUs with inexpensive boards like ASUS Z97-P having 32 GB RAM. As remote workstation C2D E8400 with 8 GB RAM has been used . OS installed on both PCs was CentOS 7.2 (Release 1604). Mentioned environment allows in about couple of hours to obtain stable working configuration based on ha.yml template :-
######################
# Template code
######################
compute_memory: 6144
compute_vcpu:1
undercloud_memory: 8192
# Giving the undercloud additional CPUs can greatly improve heat's
# performance (and result in a shorter deploy time).
undercloud_vcpu: 4
# Create three controller nodes and one compute node.
overcloud_nodes:
- name: control_0
flavor: control
- name: control_1
flavor: control
- name: control_2
flavor: control
- name: compute_0
flavor: compute
# We don't need introspection in a virtual environment (because we are
# creating all the "hardware" we really know the necessary
# information).
introspect: false
# Tell tripleo about our environment.
network_isolation: true
extra_args: >-
--control-scale 3 --neutron-network-type vxlan
--neutron-tunnel-types vxlan
-e /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml
--ntp-server pool.ntp.org
deploy_timeout: 75
tempest: false
pingtest: true
**********************************************************************************
Fist fix bugs on Server mentioned in link above on the Server's Desktop
and run `yum groupinstall "Virtualization Host"`
**********************************************************************************
Then start on workstation :-
$ git clone https://github.com/openstack/tripleo-quickstart
$ cd tripleo-quickstart
$ sudo bash quickstart.sh --install-deps
$ sudo yum -y install redhat-rpm-config
$ export VIRTHOST=192.168.1.75 #put your own IP here
$ ssh-keygen
$ ssh-copy-id root@$VIRTHOST
$ ssh root@$VIRTHOST uname -a # no root login prompt
Then run under tripleo-quickstart
$ bash quickstart.sh --config ./config/general_config/ha.yml $VIRTHOST
If everything went well you will be brought back to command prompt and see message
##################################
Virtual Environment Setup Complete
##################################
Access the undercloud by:
ssh -F /home/boris/.quickstart/ssh.config.ansible undercloud
There are scripts in the home directory to continue the deploy:
undercloud-install.sh will run the undercloud install
undercloud-post-install.sh will perform all pre-deploy steps
overcloud-deploy.sh will deploy the overcloud
overcloud-deploy-post.sh will do any post-deploy configuration
overcloud-validate.sh will run post-deploy validation
During overcloud deployment open remote ssh session to server and run top
You will see that memory allocation matches your ha.yml
When done : su - stack on Server
[root@ServerCentOS72 ~]# su - stack
Last login: Fri Jun 3 10:47:22 MSK 2016 from 192.168.1.54 on pts/0
[stack@ServerCentOS72 ~]$ virsh list
Id Name State
----------------------------------------------------
2 undercloud running
7 compute_0 running
8 control_0 running
9 control_1 running
10 control_2 running
[stack@ServerCentOS72 ~]$ virsh dumpxml undercloud | grep cpu
<vcpu placement='static'>4</vcpu>
[stack@ServerCentOS72 ~]$ virsh dumpxml undercloud | grep memory
<memory unit='KiB'>8388608</memory>
[stack@ServerCentOS72 ~]$ virsh dumpxml control_0 | grep memory
<memory unit='KiB'>6291456</memory>
[stack@ServerCentOS72 ~]$ virsh dumpxml control_0 | grep cpu
<vcpu placement='static'>1</vcpu>
<cpu mode='host-passthrough'/>
[stack@ServerCentOS72 ~]$ virsh dumpxml compute_0 | grep cpu
<vcpu placement='static'>1</vcpu>
<cpu mode='host-passthrough'/>
[stack@ServerCentOS72 ~]$ virsh dumpxml compute_0 | grep memory
<memory unit='KiB'>6291456</memory>
***************************************
Up on completion of last script run :-
***************************************
[stack@undercloud ~]$ . stackrc
[stack@undercloud ~]$ heat stack-list
[stack@undercloud ~]$ ssh heat-admin@192.0.2.10
Last login: Fri Jun 3 10:01:44 2016 from gateway
[heat-admin@overcloud-controller-0 ~]$ sudo su -
Last login: Fri Jun 3 10:01:49 UTC 2016 on pts/0
[root@overcloud-controller-0 ~]# . keystonerc_admin <== /etc/stack/overcloudrc
[root@overcloud-controller-0 ~]# pcs status
Cluster name: tripleo_cluster
Last updated: Fri Jun 3 10:07:22 2016 Last change: Fri Jun 3 08:50:59 2016 by root via cibadmin on overcloud-controller-0
Stack: corosync
Current DC: overcloud-controller-0 (version 1.1.13-10.el7_2.2-44eb2dd) - partition with quorum
3 nodes and 123 resources configured
Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Full list of resources:
ip-192.0.2.6 (ocf::heartbeat:IPaddr2): Started overcloud-controller-0
Clone Set: haproxy-clone [haproxy]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
ip-192.0.2.7 (ocf::heartbeat:IPaddr2): Started overcloud-controller-1
Master/Slave Set: galera-master [galera]
Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: memcached-clone [memcached]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: rabbitmq-clone [rabbitmq]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-core-clone [openstack-core]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Master/Slave Set: redis-master [redis]
Masters: [ overcloud-controller-1 ]
Slaves: [ overcloud-controller-0 overcloud-controller-2 ]
Clone Set: mongod-clone [mongod]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-evaluator-clone [openstack-aodh-evaluator]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-scheduler-clone [openstack-nova-scheduler]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-l3-agent-clone [neutron-l3-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-netns-cleanup-clone [neutron-netns-cleanup]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-ovs-cleanup-clone [neutron-ovs-cleanup]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
openstack-cinder-volume (systemd:openstack-cinder-volume): Started overcloud-controller-2
Clone Set: openstack-heat-engine-clone [openstack-heat-engine]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-api-clone [openstack-ceilometer-api]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-listener-clone [openstack-aodh-listener]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-metadata-agent-clone [neutron-metadata-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-gnocchi-metricd-clone [openstack-gnocchi-metricd]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-notifier-clone [openstack-aodh-notifier]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-clone [openstack-heat-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-collector-clone [openstack-ceilometer-collector]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-glance-api-clone [openstack-glance-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-cinder-scheduler-clone [openstack-cinder-scheduler]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-api-clone [openstack-nova-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-consoleauth-clone [openstack-nova-consoleauth]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-sahara-api-clone [openstack-sahara-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-cloudwatch-clone [openstack-heat-api-cloudwatch]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-sahara-engine-clone [openstack-sahara-engine]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-glance-registry-clone [openstack-glance-registry]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-gnocchi-statsd-clone [openstack-gnocchi-statsd]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-notification-clone [openstack-ceilometer-notification]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-cinder-api-clone [openstack-cinder-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-dhcp-agent-clone [neutron-dhcp-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-openvswitch-agent-clone [neutron-openvswitch-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-novncproxy-clone [openstack-nova-novncproxy]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: delay-clone [delay]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-server-clone [neutron-server]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-central-clone [openstack-ceilometer-central]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: httpd-clone [httpd]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-cfn-clone [openstack-heat-api-cfn]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-conductor-clone [openstack-nova-conductor]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Failed Actions:
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-1 'not running' (7): call=76, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:47:22 2016', queued=0ms, exec=0ms
* openstack-ceilometer-central_start_0 on overcloud-controller-1 'not running' (7): call=290, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:51:18 2016', queued=0ms, exec=2132ms
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-2 'not running' (7): call=76, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:47:16 2016', queued=0ms, exec=0ms
* openstack-ceilometer-central_start_0 on overcloud-controller-2 'not running' (7): call=292, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:51:31 2016', queued=0ms, exec=2102ms
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-0 'not running' (7): call=77, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:47:19 2016', queued=0ms, exec=0ms
* openstack-ceilometer-central_start_0 on overcloud-controller-0 'not running' (7): call=270, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:50:02 2016', queued=0ms, exec=2199ms
PCSD Status:
overcloud-controller-0: Online
overcloud-controller-1: Online
overcloud-controller-2: Online
Daemon Status:
corosync: active/enabled
pacemaker: active/enabled
pcsd: active/enabled
Daemons running on Controller-0
UPDATE 06/17/2016
#################
In meantime undercloud-install,undercloud-post-install (openstack undercloud install, openstack overcloud image upload ) are supposed to be performed during original run `bash quickstart.sh --config /path-to/ha.yml $VIRTHOST`. Neutron networks deployment on undercloud and HA Server's configuration has been significantly rebuilt during the last weeks. I believe current design is close to proposed in https://remote-lab.net/rdo-manager-ha-openstack-deployment
However , attempt to reproduce http://docs.openstack.org/developer/tripleo-docs/installation/installation.html
results hanging on `openstack undercloud install`, wheh it attempts to start
openstack-nova-compute on undercloud. Nova-compute.log report failure
to connect 127.0.0.1:5672. Verification via `netstat -antp | grep 5672` reports
port 5672 bind only to 192.0.2.1 ( ctlplane IP address ).
See also https://www.redhat.com/archives/rdo-list/2016-March/msg00171.html
Quoting ( complaints are not mine) :-
By the way, I'd love to see and help to have an complete installation guide for TripleO powered by RDO on the RDO site (the instack virt setup without quickstart . . . .
Then start on workstation :-
$ git clone https://github.com/openstack/tripleo-quickstart
$ cd tripleo-quickstart
$ sudo bash quickstart.sh --install-deps
$ sudo yum -y install redhat-rpm-config
$ export VIRTHOST=192.168.1.75 #put your own IP here
$ ssh-keygen
$ ssh-copy-id root@$VIRTHOST
$ ssh root@$VIRTHOST uname -a # no root login prompt
Then run under tripleo-quickstart
$ bash quickstart.sh --config ./config/general_config/ha.yml $VIRTHOST
During this run the most important is to reach this point on VIRTHOST
[root@ServerCentOS72 ~]# cd /var/cache/tripleo-quickstart/images [root@ServerCentOS72 images]# ls -l total 2638232 -rw-rw-r--. 1 stack stack 2701548544 Jun 17 19:25 83e62624dd7bd637dada343bbf4fe8f1.qcow2 lrwxrwxrwx. 1 stack stack 75 Jun 17 19:25 latest-undercloud.qcow2 -> /var/cache/tripleo-quickstart/images/83e62624dd7bd637dada343bbf4fe8f1.qcow2If everything went well you will be brought back to command prompt and see message
PLAY RECAP
*********************************************************************
192.168.1.75 : ok=97 changed=50 unreachable=0 failed=0
localhost : ok=10 changed=4 unreachable=0 failed=0
undercloud : ok=24 changed=15 unreachable=0 failed=0
Friday 17 June 2016 19:48:21 +0300 (0:00:00.122) 0:25:38.417 ***********
===============================================================================
tripleo/undercloud : Install the undercloud --------------------------- 997.81s
/home/boris/tripleo-quickstart/roles/tripleo/undercloud/tasks/install-undercloud.yml:1
setup/undercloud : Get image ------------------------------------------- 83.00s
/home/boris/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/fetch_image.yml:81
setup/undercloud : Get undercloud vm ip address ------------------------ 81.33s
/home/boris/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:173
setup/undercloud : Resize undercloud image (call virt-resize) ---------- 77.90s
/home/boris/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:122
setup/undercloud : Copy instackenv.json to appliance ------------------- 71.66s
/home/boris/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:53
tripleo/undercloud : Prepare the undercloud for deploy ----------------- 64.63s
/home/boris/tripleo-quickstart/roles/tripleo/undercloud/tasks/post-install.yml:27
setup/undercloud : Upload undercloud volume to storage pool ------------ 54.75s
/home/boris/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:142
teardown/nodes : Check overcloud vms ----------------------------------- 36.14s
/home/boris/tripleo-quickstart/roles/libvirt/teardown/nodes/tasks/main.yml:21 -
setup/undercloud : Inject undercloud ssh public key to appliance -------- 7.68s
/home/boris/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:72
setup/undercloud : Get actual md5 checksum of image --------------------- 6.03s
/home/boris/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/fetch_image.yml:92
setup/undercloud : Perform selinux relabel on undercloud image ---------- 3.59s
/home/boris/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:94
tripleo/undercloud : Create undercloud configuration -------------------- 1.92s
/home/boris/tripleo-quickstart/roles/tripleo/undercloud/tasks/create-scripts.yml:3
setup ------------------------------------------------------------------- 1.82s
None --------------------------------------------------------------------------
setup ------------------------------------------------------------------- 1.73s
None --------------------------------------------------------------------------
setup ------------------------------------------------------------------- 1.65s
/home/boris/.quickstart/playbooks/provision.yml:29 ----------------------------
setup ------------------------------------------------------------------- 1.64s
None --------------------------------------------------------------------------
setup ------------------------------------------------------------------- 1.22s
None --------------------------------------------------------------------------
setup/overcloud : Define overcloud vms ---------------------------------- 1.19s
/home/boris/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:67
setup/overcloud : Create overcloud vm storage --------------------------- 1.18s
/home/boris/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:55
setup/undercloud : Get qcow2 image from cache --------------------------- 1.16s
/home/boris/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/fetch_image.yml:144
+ set +x
##################################
Virtual Environment Setup Complete
##################################
Access the undercloud by:
ssh -F /home/boris/.quickstart/ssh.config.ansible undercloud
There are scripts in the home directory to continue the deploy:
overcloud-deploy.sh will deploy the overcloud
overcloud-deploy-post.sh will do any post-deploy configuration
overcloud-validate.sh will run post-deploy validation
Alternatively, you can ignore these scripts and follow the upstream docs,
starting from the overcloud deploy section:
http://ow.ly/1Vc1301iBlb
[stack@undercloud ~]$ neutron net-list
+--------------------------------------+--------------+----------------------------------------+ | id | name | subnets | +--------------------------------------+--------------+----------------------------------------+ | 9f0b6b5e-4859-4ecb-9870-a0704330ba3b | internal_api | 233ee2b9-84a3-4c78-bbd3-f9e2bbca37dd | | | | 172.16.2.0/24 | | b7122e93-0a04-41c5-8638-d011910d9dd5 | external | 775b0c70-521f-4313-9010-404b136bf863 | | | | 10.0.0.0/24 | | be6df0b9-d75e-4c92-ac1c-326fa60d5815 | tenant | 5b5e7299-90dc-46ff-860b-3bb8324cd650 | | | | 172.16.0.0/24 | | 4cf94755-4a87-4a81-9454-e8757928860f | storage_mgmt | 86068f21-37d6-4439-93b7-58982018a60c | | | | 172.16.3.0/24 | | e3bca056-be41-4330-9dc3-262f4a54d3b2 | storage | 335e91d4-91f9-4c37-a129-3c23cf77b8e3 | | | | 172.16.1.0/24 | | 6fada30d-71cb-435a-b06c-76932a12bc96 | ctlplane | 372a173e-1aed-4df8-83ca-55f4f272d910 | | | | 192.0.2.0/24 | +--------------------------------------+--------------+----------------------------------------+
[stack@undercloud ~]$ heat stack-list
+--------------------------------------+------------+-----------------+---------------------+--------------+ | id | stack_name | stack_status | creation_time | updated_time | +--------------------------------------+------------+-----------------+---------------------+--------------+ | cad1cbe8-5790-4665-9512-9add40cea4e8 | overcloud | CREATE_COMPLETE | 2016-06-17T16:53:29 | None | +--------------------------------------+------------+-----------------+---------------------+--------------+
[stack@undercloud ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+-------------------------+--------+------------+-------------+---------------------+ | 74ad2828-978c-4c05-a7d7-24e3d769f09d | overcloud-controller-0 | ACTIVE | - | Running | ctlplane=192.0.2.9 | | 2d8d0321-f93b-42e7-857c-a7199ee89e27 | overcloud-controller-1 | ACTIVE | - | Running | ctlplane=192.0.2.7 | | ba130214-385f-4d32-948b-6ec522705bf3 | overcloud-controller-2 | ACTIVE | - | Running | ctlplane=192.0.2.10 | | 726a4273-9970-4601-8405-0d5e9a096691 | overcloud-novacompute-0 | ACTIVE | - | Running | ctlplane=192.0.2.8 | +--------------------------------------+-------------------------+--------+------------+-------------+---------------------+[root@undercloud ~]# route -n
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface 0.0.0.0 192.168.23.1 0.0.0.0 UG 0 0 0 eth0 10.0.0.0 0.0.0.0 255.255.255.0 U 0 0 0 vlan10 192.0.2.0 0.0.0.0 255.255.255.0 U 0 0 0 br-ctlplane 192.168.23.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0 192.168.122.0 0.0.0.0 255.255.255.0 U 0 0 0 virbr0
[root@undercloud ~]# ovs-vsctl show
cc957f71-47e7-4fdd-a32b-26b31de42cd0
Bridge br-ctlplane
Port "vlan10"
tag: 10
Interface "vlan10"
type: internal
Port phy-br-ctlplane
Interface phy-br-ctlplane
type: patch
options: {peer=int-br-ctlplane}
Port br-ctlplane
Interface br-ctlplane
type: internal
Port "eth1"
Interface "eth1"
Bridge br-int
fail_mode: secure
Port "tap2138f24c-cf"
tag: 1
Interface "tap2138f24c-cf"
type: internal
Port int-br-ctlplane
Interface int-br-ctlplane
type: patch
options: {peer=phy-br-ctlplane}
Port br-int
Interface br-int
type: internal
ovs_version: "2.5.0"
[root@undercloud ~]# ifconfig
br-ctlplane: flags=4163
inet 192.0.2.1 netmask 255.255.255.0 broadcast 192.0.2.255
inet6 fe80::251:8eff:fed1:cae1 prefixlen 64 scopeid 0x20
ether 00:51:8e:d1:ca:e1 txqueuelen 0 (Ethernet)
RX packets 3525063 bytes 282216789 (269.1 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 5194629 bytes 24689319446 (22.9 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth0: flags=4163
inet 192.168.23.24 netmask 255.255.255.0 broadcast 192.168.23.255
inet6 fe80::251:8eff:fed1:cadf prefixlen 64 scopeid 0x20
ether 00:51:8e:d1:ca:df txqueuelen 1000 (Ethernet)
RX packets 317765 bytes 583156188 (556.1 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 207058 bytes 40922620 (39.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth1: flags=4163
inet6 fe80::251:8eff:fed1:cae1 prefixlen 64 scopeid 0x20
ether 00:51:8e:d1:ca:e1 txqueuelen 1000 (Ethernet)
RX packets 3546320 bytes 289792462 (276.3 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 5219521 bytes 24981243189 (23.2 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 0 (Local Loopback)
RX packets 3891442 bytes 26647179103 (24.8 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 3891442 bytes 26647179103 (24.8 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:60:59:f7 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan10: flags=4163
inet 10.0.0.1 netmask 255.255.255.0 broadcast 10.0.0.255
inet6 fe80::3049:b4ff:fe89:f348 prefixlen 64 scopeid 0x20
ether 32:49:b4:89:f3:48 txqueuelen 0 (Ethernet)
RX packets 20613 bytes 7441258 (7.0 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 24083 bytes 291745696 (278.2 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
Option "notification_driver" from group "DEFAULT" is deprecated. Use option "driver" from group "oslo_messaging_notifications".
Option "notification_topics" from group "DEFAULT" is deprecated. Use option "topics" from group "oslo_messaging_notifications".
13.0.1-0.20160611000828.c8ec9eb.el7.centos
[root@overcloud-controller-0 ~(keystone_admin)]# pcs status
Cluster name: tripleo_cluster
Last updated: Fri Jun 17 18:19:25 2016 Last change: Fri Jun 17 17:24:54 2016 by root via cibadmin on overcloud-controller-0
Stack: corosync
Current DC: overcloud-controller-2 (version 1.1.13-10.el7_2.2-44eb2dd) - partition with quorum
3 nodes and 127 resources configured
Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Full list of resources:
ip-192.0.2.6 (ocf::heartbeat:IPaddr2): Started overcloud-controller-0
ip-172.16.2.5 (ocf::heartbeat:IPaddr2): Started overcloud-controller-1
ip-172.16.3.4 (ocf::heartbeat:IPaddr2): Started overcloud-controller-2
Clone Set: haproxy-clone [haproxy]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Master/Slave Set: galera-master [galera]
Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: memcached-clone [memcached]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
ip-10.0.0.4 (ocf::heartbeat:IPaddr2): Started overcloud-controller-0
ip-172.16.2.4 (ocf::heartbeat:IPaddr2): Started overcloud-controller-1
ip-172.16.1.4 (ocf::heartbeat:IPaddr2): Started overcloud-controller-2
Clone Set: rabbitmq-clone [rabbitmq]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-core-clone [openstack-core]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Master/Slave Set: redis-master [redis]
Masters: [ overcloud-controller-0 ]
Slaves: [ overcloud-controller-1 overcloud-controller-2 ]
Clone Set: mongod-clone [mongod]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-evaluator-clone [openstack-aodh-evaluator]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-scheduler-clone [openstack-nova-scheduler]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-l3-agent-clone [neutron-l3-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-netns-cleanup-clone [neutron-netns-cleanup]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-ovs-cleanup-clone [neutron-ovs-cleanup]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
openstack-cinder-volume (systemd:openstack-cinder-volume): Started overcloud-controller-0
Clone Set: openstack-heat-engine-clone [openstack-heat-engine]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-api-clone [openstack-ceilometer-api]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-listener-clone [openstack-aodh-listener]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-metadata-agent-clone [neutron-metadata-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-gnocchi-metricd-clone [openstack-gnocchi-metricd]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-notifier-clone [openstack-aodh-notifier]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-clone [openstack-heat-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-collector-clone [openstack-ceilometer-collector]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-glance-api-clone [openstack-glance-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-cinder-scheduler-clone [openstack-cinder-scheduler]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-api-clone [openstack-nova-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-consoleauth-clone [openstack-nova-consoleauth]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-sahara-api-clone [openstack-sahara-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-cloudwatch-clone [openstack-heat-api-cloudwatch]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-sahara-engine-clone [openstack-sahara-engine]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-glance-registry-clone [openstack-glance-registry]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-gnocchi-statsd-clone [openstack-gnocchi-statsd]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-notification-clone [openstack-ceilometer-notification]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-cinder-api-clone [openstack-cinder-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-dhcp-agent-clone [neutron-dhcp-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-openvswitch-agent-clone [neutron-openvswitch-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-novncproxy-clone [openstack-nova-novncproxy]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: delay-clone [delay]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-server-clone [neutron-server]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-central-clone [openstack-ceilometer-central]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: httpd-clone [httpd]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-cfn-clone [openstack-heat-api-cfn]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-conductor-clone [openstack-nova-conductor]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Failed Actions:
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-0 'not running' (7): call=96, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:21:27 2016', queued=0ms, exec=0ms
* openstack-gnocchi-metricd_monitor_60000 on overcloud-controller-0 'not running' (7): call=364, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 18:16:34 2016', queued=0ms, exec=0ms
* openstack-gnocchi-statsd_start_0 on overcloud-controller-0 'not running' (7): call=262, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:22:36 2016', queued=0ms, exec=2216ms
* openstack-ceilometer-central_start_0 on overcloud-controller-0 'not running' (7): call=325, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:25:56 2016', queued=0ms, exec=2088ms
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-2 'not running' (7): call=90, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:21:32 2016', queued=0ms, exec=0ms
* openstack-gnocchi-metricd_monitor_60000 on overcloud-controller-2 'not running' (7): call=345, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 18:16:30 2016', queued=0ms, exec=0ms
* openstack-gnocchi-statsd_start_0 on overcloud-controller-2 'not running' (7): call=302, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:24:27 2016', queued=0ms, exec=2203ms
* openstack-ceilometer-central_start_0 on overcloud-controller-2 'not running' (7): call=304, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:24:32 2016', queued=0ms, exec=2102ms
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-1 'not running' (7): call=95, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:21:29 2016', queued=0ms, exec=0ms
* openstack-gnocchi-metricd_monitor_60000 on overcloud-controller-1 'not running' (7): call=350, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 18:16:32 2016', queued=0ms, exec=0ms
* openstack-gnocchi-statsd_start_0 on overcloud-controller-1 'not running' (7): call=309, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:24:37 2016', queued=0ms, exec=2206ms
* openstack-ceilometer-central_start_0 on overcloud-controller-1 'not running' (7): call=287, status=complete, exitreason='none',
last-rc-change='Fri Jun 17 17:24:07 2016', queued=0ms, exec=2126ms
PCSD Status:
overcloud-controller-0: Online
overcloud-controller-1: Online
overcloud-controller-2: Online
Daemon Status:
corosync: active/enabled
pacemaker: active/enabled
pcsd: active/enabled
[heat-admin@overcloud-controller-0 ~]$ sudo cat /etc/os-net-config/config.json | jq '.[]'
[
{
"dns_servers": [
"8.8.8.8",
"8.8.4.4"
],
"name": "br-ex",
"members": [
{
"type": "interface",
"name": "nic1",
"primary": true
},
{
"routes": [
{
"default": true,
"next_hop": "10.0.0.1"
}
],
"type": "vlan",
"addresses": [
{
"ip_netmask": "10.0.0.7/24"
}
],
"vlan_id": 10
},
{
"type": "vlan",
"addresses": [
{
"ip_netmask": "172.16.2.8/24"
}
],
"vlan_id": 20
},
{
"type": "vlan",
"addresses": [
{
"ip_netmask": "172.16.1.8/24"
}
],
"vlan_id": 30
},
{
"type": "vlan",
"addresses": [
{
"ip_netmask": "172.16.3.6/24"
}
],
"vlan_id": 40
},
{
"type": "vlan",
"addresses": [
{
"ip_netmask": "172.16.0.7/24"
}
],
"vlan_id": 50
}
],
"routes": [
{
"ip_netmask": "169.254.169.254/32",
"next_hop": "192.0.2.1"
}
],
"use_dhcp": false,
"type": "ovs_bridge",
"addresses": [
{
"ip_netmask": "192.0.2.9/24"
}
]
}
]
[heat-admin@overcloud-controller-0 ~]$ sudo route -n
Kernel IP routing table Destination Gateway Genmask Flags Metric Ref Use Iface 0.0.0.0 10.0.0.1 0.0.0.0 UG 0 0 0 vlan10 10.0.0.0 0.0.0.0 255.255.255.0 U 0 0 0 vlan10 169.254.169.254 192.0.2.1 255.255.255.255 UGH 0 0 0 br-ex 172.16.0.0 0.0.0.0 255.255.255.0 U 0 0 0 vlan50 172.16.1.0 0.0.0.0 255.255.255.0 U 0 0 0 vlan30 172.16.2.0 0.0.0.0 255.255.255.0 U 0 0 0 vlan20 172.16.3.0 0.0.0.0 255.255.255.0 U 0 0 0 vlan40 192.0.2.0 0.0.0.0 255.255.255.0 U 0 0 0 br-ex
[root@overcloud-controller-0 ~(keystone_admin)]# ifconfig
br-ex: flags=4163
inet 192.0.2.9 netmask 255.255.255.0 broadcast 192.0.2.255
inet6 fe80::292:beff:fe94:32f9 prefixlen 64 scopeid 0x20
ether 00:92:be:94:32:f9 txqueuelen 0 (Ethernet)
RX packets 32540 bytes 74708595 (71.2 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 32034 bytes 3733716 (3.5 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth0: flags=4163
inet6 fe80::292:beff:fe94:32f9 prefixlen 64 scopeid 0x20
ether 00:92:be:94:32:f9 txqueuelen 1000 (Ethernet)
RX packets 1252373 bytes 973500960 (928.4 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1226276 bytes 584049729 (556.9 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 0 (Local Loopback)
RX packets 342429 bytes 576234034 (549.5 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 342429 bytes 576234034 (549.5 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan10: flags=4163
inet 10.0.0.7 netmask 255.255.255.0 broadcast 10.0.0.255
inet6 fe80::fcb9:82ff:fe2b:4785 prefixlen 64 scopeid 0x20
ether fe:b9:82:2b:47:85 txqueuelen 0 (Ethernet)
RX packets 18161 bytes 284359113 (271.1 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 16451 bytes 5011950 (4.7 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan20: flags=4163
inet 172.16.2.8 netmask 255.255.255.0 broadcast 172.16.2.255
inet6 fe80::345b:85ff:fec9:1a58 prefixlen 64 scopeid 0x20
ether 36:5b:85:c9:1a:58 txqueuelen 0 (Ethernet)
RX packets 1130946 bytes 290484989 (277.0 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1112747 bytes 214163892 (204.2 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan30: flags=4163
inet 172.16.1.8 netmask 255.255.255.0 broadcast 172.16.1.255
inet6 fe80::1892:70ff:febe:6fa5 prefixlen 64 scopeid 0x20
ether 1a:92:70:be:6f:a5 txqueuelen 0 (Ethernet)
RX packets 51203 bytes 51062473 (48.6 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 49854 bytes 311860707 (297.4 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan40: flags=4163
inet 172.16.3.6 netmask 255.255.255.0 broadcast 172.16.3.255
inet6 fe80::4858:c5ff:fe85:dca5 prefixlen 64 scopeid 0x20
ether 4a:58:c5:85:dc:a5 txqueuelen 0 (Ethernet)
RX packets 18746 bytes 267835013 (255.4 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 14631 bytes 44417807 (42.3 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan50: flags=4163
inet 172.16.0.7 netmask 255.255.255.0 broadcast 172.16.0.255
inet6 fe80::80d1:c1ff:fe06:a095 prefixlen 64 scopeid 0x20
ether 82:d1:c1:06:a0:95 txqueuelen 0 (Ethernet)
RX packets 621 bytes 62554 (61.0 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 146 bytes 12262 (11.9 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[root@overcloud-controller-0 ~(keystone_admin)]# ovs-vsctl show
765a651a-f908-4ae7-9dab-1712de0f8ed2
Bridge br-ex
Port "vlan50"
tag: 50
Interface "vlan50"
type: internal
Port phy-br-ex
Interface phy-br-ex
type: patch
options: {peer=int-br-ex}
Port "eth0"
Interface "eth0"
Port "vlan30"
tag: 30
Interface "vlan30"
type: internal
Port "vlan20"
tag: 20
Interface "vlan20"
type: internal
Port "vlan40"
tag: 40
Interface "vlan40"
type: internal
Port "vlan10"
tag: 10
Interface "vlan10"
type: internal
Port "qg-d116056c-ab"
Interface "qg-d116056c-ab"
type: internal
Port br-ex
Interface br-ex
type: internal
Bridge br-int
fail_mode: secure
Port int-br-ex
Interface int-br-ex
type: patch
options: {peer=phy-br-ex}
Port br-int
Interface br-int
type: internal
Port "qr-02a6b269-22"
tag: 4
Interface "qr-02a6b269-22"
type: internal
Port "ha-2043a0a0-79"
tag: 3
Interface "ha-2043a0a0-79"
type: internal
Port "tap8d7afb39-38"
tag: 4
Interface "tap8d7afb39-38"
type: internal
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Bridge br-tun
fail_mode: secure
Port "vxlan-ac100005"
Interface "vxlan-ac100005"
type: vxlan
options: {df_default="true", in_key=flow, local_ip="172.16.0.7", out_key=flow, remote_ip="172.16.0.5"}
Port "vxlan-ac100004"
Interface "vxlan-ac100004"
type: vxlan
options: {df_default="true", in_key=flow, local_ip="172.16.0.7", out_key=flow, remote_ip="172.16.0.4"}
Port "vxlan-ac100006"
Interface "vxlan-ac100006"
type: vxlan
options: {df_default="true", in_key=flow, local_ip="172.16.0.7", out_key=flow, remote_ip="172.16.0.6"}
Port br-tun
Interface br-tun
type: internal
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
ovs_version: "2.5.0"
[root@overcloud-controller-0 neutron(keystone_admin)]# cat l3_agent.ini | grep -v ^#|grep -v ^$
[DEFAULT]
ovs_use_veth = False
interface_driver = neutron.agent.linux.interface.OVSInterfaceDriver
agent_mode = legacy
debug = False
[AGENT]
[root@overcloud-controller-0 ml2(keystone_admin)]# cat ml2_conf.ini | grep -v ^#|grep -v ^$
[DEFAULT]
[ml2]
type_drivers = vxlan,vlan,flat,gre
tenant_network_types = vxlan
mechanism_drivers =openvswitch
extension_drivers =qos,port_security
path_mtu = 0
[ml2_type_flat]
flat_networks = datacentre
[ml2_type_geneve]
[ml2_type_gre]
tunnel_id_ranges =1:4094
[ml2_type_vlan]
network_vlan_ranges =datacentre:1:1000
[ml2_type_vxlan]
vni_ranges =1:4094
vxlan_group = 224.0.0.1
[securitygroup]
[root@overcloud-controller-0 ml2(keystone_admin)]# cat openvswitch_agent.ini | grep -v ^#|grep -v ^$
[DEFAULT]
[agent]
tunnel_types =vxlan
vxlan_udp_port = 4789
l2_population = False
drop_flows_on_start = False
extensions=qos
[ovs]
integration_bridge = br-int
tunnel_bridge = br-tun
local_ip = 172.16.0.7
bridge_mappings =datacentre:br-ex
enable_tunneling=True
[securitygroup]
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver
###########
END UPDATE
###########
This posting follows up Deploying OpenStack on just one hosted server but is focused on utilizing i7 4790/4770 CPUs with inexpensive boards like ASUS Z97-P having 32 GB RAM. As remote workstation C2D E8400 with 8 GB RAM has been used . OS installed on both PCs was CentOS 7.2 (Release 1604). Mentioned environment allows in about couple of hours to obtain stable working configuration based on ha.yml template :-
######################
# Template code
######################
compute_memory: 6144
compute_vcpu:1
undercloud_memory: 8192
# Giving the undercloud additional CPUs can greatly improve heat's
# performance (and result in a shorter deploy time).
undercloud_vcpu: 4
# Create three controller nodes and one compute node.
overcloud_nodes:
- name: control_0
flavor: control
- name: control_1
flavor: control
- name: control_2
flavor: control
- name: compute_0
flavor: compute
# We don't need introspection in a virtual environment (because we are
# creating all the "hardware" we really know the necessary
# information).
introspect: false
# Tell tripleo about our environment.
network_isolation: true
extra_args: >-
--control-scale 3 --neutron-network-type vxlan
--neutron-tunnel-types vxlan
-e /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml
--ntp-server pool.ntp.org
deploy_timeout: 75
tempest: false
pingtest: true
**********************************************************************************
Fist fix bugs on Server mentioned in link above on the Server's Desktop
and run `yum groupinstall "Virtualization Host"`
**********************************************************************************
Then start on workstation :-
$ git clone https://github.com/openstack/tripleo-quickstart
$ cd tripleo-quickstart
$ sudo bash quickstart.sh --install-deps
$ sudo yum -y install redhat-rpm-config
$ export VIRTHOST=192.168.1.75 #put your own IP here
$ ssh-keygen
$ ssh-copy-id root@$VIRTHOST
$ ssh root@$VIRTHOST uname -a # no root login prompt
Then run under tripleo-quickstart
$ bash quickstart.sh --config ./config/general_config/ha.yml $VIRTHOST
If everything went well you will be brought back to command prompt and see message
##################################
Virtual Environment Setup Complete
##################################
Access the undercloud by:
ssh -F /home/boris/.quickstart/ssh.config.ansible undercloud
There are scripts in the home directory to continue the deploy:
undercloud-install.sh will run the undercloud install
undercloud-post-install.sh will perform all pre-deploy steps
overcloud-deploy.sh will deploy the overcloud
overcloud-deploy-post.sh will do any post-deploy configuration
overcloud-validate.sh will run post-deploy validation
During overcloud deployment open remote ssh session to server and run top
You will see that memory allocation matches your ha.yml
When done : su - stack on Server
[root@ServerCentOS72 ~]# su - stack
Last login: Fri Jun 3 10:47:22 MSK 2016 from 192.168.1.54 on pts/0
[stack@ServerCentOS72 ~]$ virsh list
Id Name State
----------------------------------------------------
2 undercloud running
7 compute_0 running
8 control_0 running
9 control_1 running
10 control_2 running
[stack@ServerCentOS72 ~]$ virsh dumpxml undercloud | grep cpu
<vcpu placement='static'>4</vcpu>
[stack@ServerCentOS72 ~]$ virsh dumpxml undercloud | grep memory
<memory unit='KiB'>8388608</memory>
[stack@ServerCentOS72 ~]$ virsh dumpxml control_0 | grep memory
<memory unit='KiB'>6291456</memory>
[stack@ServerCentOS72 ~]$ virsh dumpxml control_0 | grep cpu
<vcpu placement='static'>1</vcpu>
<cpu mode='host-passthrough'/>
[stack@ServerCentOS72 ~]$ virsh dumpxml compute_0 | grep cpu
<vcpu placement='static'>1</vcpu>
<cpu mode='host-passthrough'/>
[stack@ServerCentOS72 ~]$ virsh dumpxml compute_0 | grep memory
<memory unit='KiB'>6291456</memory>
***************************************
Up on completion of last script run :-
***************************************
[stack@undercloud ~]$ . stackrc
[stack@undercloud ~]$ heat stack-list
+--------------------------------------+------------+-----------------+---------------------+--------------+ | id | stack_name | stack_status | creation_time | updated_time | +--------------------------------------+------------+-----------------+---------------------+--------------+ | 0c6b8205-be86-4a24-be36-fd4ece956c6d | overcloud | CREATE_COMPLETE | 2016-06-03T08:14:19 | None | +--------------------------------------+------------+-----------------+---------------------+--------------+
[stack@undercloud ~]$ nova list +--------------------------------------+-------------------------+--------+------------+-------------+---------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+-------------------------+--------+------------+-------------+---------------------+ | 6a38b7be-3743-4339-970b-6121e687741d | overcloud-controller-0 | ACTIVE | - | Running | ctlplane=192.0.2.10 | | 9222dc1b-5974-495b-8b98-b8176ac742f4 | overcloud-controller-1 | ACTIVE | - | Running | ctlplane=192.0.2.9 | | 76adbb27-220f-42ef-9691-94729ee28749 | overcloud-controller-2 | ACTIVE | - | Running | ctlplane=192.0.2.11 | | 8f57f7b6-a2d8-4b7b-b435-1c675e63ea84 | overcloud-novacompute-0 | ACTIVE | - | Running | ctlplane=192.0.2.8 | +--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
[stack@undercloud ~]$ ssh heat-admin@192.0.2.10
Last login: Fri Jun 3 10:01:44 2016 from gateway
[heat-admin@overcloud-controller-0 ~]$ sudo su -
Last login: Fri Jun 3 10:01:49 UTC 2016 on pts/0
[root@overcloud-controller-0 ~]# . keystonerc_admin <== /etc/stack/overcloudrc
[root@overcloud-controller-0 ~]# pcs status
Cluster name: tripleo_cluster
Last updated: Fri Jun 3 10:07:22 2016 Last change: Fri Jun 3 08:50:59 2016 by root via cibadmin on overcloud-controller-0
Stack: corosync
Current DC: overcloud-controller-0 (version 1.1.13-10.el7_2.2-44eb2dd) - partition with quorum
3 nodes and 123 resources configured
Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Full list of resources:
ip-192.0.2.6 (ocf::heartbeat:IPaddr2): Started overcloud-controller-0
Clone Set: haproxy-clone [haproxy]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
ip-192.0.2.7 (ocf::heartbeat:IPaddr2): Started overcloud-controller-1
Master/Slave Set: galera-master [galera]
Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: memcached-clone [memcached]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: rabbitmq-clone [rabbitmq]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-core-clone [openstack-core]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Master/Slave Set: redis-master [redis]
Masters: [ overcloud-controller-1 ]
Slaves: [ overcloud-controller-0 overcloud-controller-2 ]
Clone Set: mongod-clone [mongod]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-evaluator-clone [openstack-aodh-evaluator]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-scheduler-clone [openstack-nova-scheduler]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-l3-agent-clone [neutron-l3-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-netns-cleanup-clone [neutron-netns-cleanup]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-ovs-cleanup-clone [neutron-ovs-cleanup]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
openstack-cinder-volume (systemd:openstack-cinder-volume): Started overcloud-controller-2
Clone Set: openstack-heat-engine-clone [openstack-heat-engine]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-api-clone [openstack-ceilometer-api]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-listener-clone [openstack-aodh-listener]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-metadata-agent-clone [neutron-metadata-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-gnocchi-metricd-clone [openstack-gnocchi-metricd]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-aodh-notifier-clone [openstack-aodh-notifier]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-clone [openstack-heat-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-collector-clone [openstack-ceilometer-collector]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-glance-api-clone [openstack-glance-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-cinder-scheduler-clone [openstack-cinder-scheduler]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-api-clone [openstack-nova-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-consoleauth-clone [openstack-nova-consoleauth]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-sahara-api-clone [openstack-sahara-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-cloudwatch-clone [openstack-heat-api-cloudwatch]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-sahara-engine-clone [openstack-sahara-engine]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-glance-registry-clone [openstack-glance-registry]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-gnocchi-statsd-clone [openstack-gnocchi-statsd]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-notification-clone [openstack-ceilometer-notification]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-cinder-api-clone [openstack-cinder-api]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-dhcp-agent-clone [neutron-dhcp-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-openvswitch-agent-clone [neutron-openvswitch-agent]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-novncproxy-clone [openstack-nova-novncproxy]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: delay-clone [delay]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: neutron-server-clone [neutron-server]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-ceilometer-central-clone [openstack-ceilometer-central]
Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: httpd-clone [httpd]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-heat-api-cfn-clone [openstack-heat-api-cfn]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Clone Set: openstack-nova-conductor-clone [openstack-nova-conductor]
Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Failed Actions:
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-1 'not running' (7): call=76, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:47:22 2016', queued=0ms, exec=0ms
* openstack-ceilometer-central_start_0 on overcloud-controller-1 'not running' (7): call=290, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:51:18 2016', queued=0ms, exec=2132ms
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-2 'not running' (7): call=76, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:47:16 2016', queued=0ms, exec=0ms
* openstack-ceilometer-central_start_0 on overcloud-controller-2 'not running' (7): call=292, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:51:31 2016', queued=0ms, exec=2102ms
* openstack-aodh-evaluator_monitor_60000 on overcloud-controller-0 'not running' (7): call=77, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:47:19 2016', queued=0ms, exec=0ms
* openstack-ceilometer-central_start_0 on overcloud-controller-0 'not running' (7): call=270, status=complete, exitreason='none',
last-rc-change='Fri Jun 3 08:50:02 2016', queued=0ms, exec=2199ms
PCSD Status:
overcloud-controller-0: Online
overcloud-controller-1: Online
overcloud-controller-2: Online
Daemon Status:
corosync: active/enabled
pacemaker: active/enabled
pcsd: active/enabled
Daemons running on Controller-0
Neutron reports on Comtroller_0
[root@overcloud-controller-0 ~]# neutron l3-agent-list-hosting-router RouterDSA
+--------------------------------------+------------------------+----------------+-------+----------+
| id | host | admin_state_up | alive | ha_state |
+--------------------------------------+------------------------+----------------+-------+----------+
| 3ffad1c0-da80-4ab0-b165-1f555f1190e4 | overcloud-controller-0 | True | :-) | active |
| ec70ba18-9cc3-4409-a671-33b21f9a586f | overcloud-controller-1| True | :-) | standby |
| bd409fca-52a5-4bca-bb68-a8bd57632dfa | overcloud-controller-2 | True | :-) | standby |
+--------------------------------------+------------------------+----------------+-------+----------+
System information
Instances runing
Shapshots from underground
Connection to VMs running in overcloud from undercloud (VM)
Neutron port list on undercloud
Regarding details of ovecloud server's configuration
[root@overcloud-controller-0 network-scripts]# cat ifcfg-br-ex
# This file is autogenerated by os-net-config
DEVICE=br-ex
ONBOOT=yes
HOTPLUG=no
NM_CONTROLLED=no
DEVICETYPE=ovs
TYPE=OVSBridge
OVSBOOTPROTO=dhcp
OVSDHCPINTERFACES="eth0"
OVS_EXTRA="set bridge br-ex other-config:hwaddr=00:83:94:4b:f4:bf"
[root@overcloud-controller-0 network-scripts]# ifconfig
br-ex: flags=4163
inet 192.0.2.10 netmask 255.255.255.0 broadcast 192.0.2.255
inet6 fe80::283:94ff:fe4b:f4bf prefixlen 64 scopeid 0x20
ether 00:83:94:4b:f4:bf txqueuelen 0 (Ethernet)
RX packets 1524142 bytes 482079467 (459.7 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1479958 bytes 289821172 (276.3 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth0: flags=4163
inet6 fe80::283:94ff:fe4b:f4bf prefixlen 64 scopeid 0x20
ether 00:83:94:4b:f4:bf txqueuelen 1000 (Ethernet)
RX packets 1524492 bytes 482222219 (459.8 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1480362 bytes 289890148 (276.4 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
Watch https://www.youtube.com/watch?v=8zFQG5mKwPk&feature=autoshare
