Switching to newly created project's private network running Fedora 24 && CentOS 7.3 Cloud VMs on RDO Ocata.

This post is immediate followup to previous one "Adding Second VNIC to running Fedora 24 && CentOS 7.3 Cloud VMs on RDO Ocata"
I was forced to use Nova&&Neutron CLI due to python-openstackclient doesn't
seem to be ready replace required CLI commands at the moment. For instance
`nova interface-attach`,`nova interface-list`

Topology been deployed into overcloud originally via Tripleo QuickStart (branch Ocata)

[stack@undercloud ~]$ openstack server list
+-------------------------+-------------------------+--------+------------------------+----------------+
| ID                      | Name                    | Status | Networks               | Image Name     |
+-------------------------+-------------------------+--------+------------------------+----------------+
| febeae5c-c3cb-          | overcloud-controller-0  | ACTIVE | ctlplane=192.168.24.15 | overcloud-full |
| 40e0-b559-263eb767ed23  |                         |        |                        |                |
| bd4ada51-612e-          | overcloud-controller-2  | ACTIVE | ctlplane=192.168.24.16 | overcloud-full |
| 491b-b618-2e4cf0f2ba69  |                         |        |                        |                |
| df2a3e53-3479-4eee-8338 | overcloud-novacompute-0 | ACTIVE | ctlplane=192.168.24.12 | overcloud-full |
| -da42cfcd7422           |                         |        |                        |                |
| c6701636-dada-4c98      | overcloud-controller-1  | ACTIVE | ctlplane=192.168.24.14 | overcloud-full |
| -94fa-fb3f5ee1c950      |                         |        |                        |                |
| bb1b6214-a2e3-4a20      | overcloud-novacompute-1 | ACTIVE | ctlplane=192.168.24.10 | overcloud-full |
| -b60b-bc8ce46b83cd      |                         |        |                        |                |
+-------------------------+-------------------------+--------+------------------------+----------------+

Currently existing networks

[root@overcloud-controller-0 ~]# openstack network list
+-------------------------------+-------------------------------+-------------------------------+
| ID                            | Name                          | Subnets                       |
+-------------------------------+-------------------------------+-------------------------------+
| 5a42a09f-e252-42fb-a68c-      | HA network tenant 2cb6de12249 | e6b1c771-5dfb-4d5f-           |
| 8b72fabab643                  | c4240ad81d62ef0409f54         | 85e6-73d9585cc0a4             |
| 78565ad8-905e-                | ext-net                       | 07cc16e5-7a70-4b83-bd25-ec82a |
| 48ef-9377-7d1a025b7917        |                               | 03b709b                       |
| b2639935-0b5f-                | internal02                    | 21fecdf3-1224-4ca0-8e24-0a05a |
| 4e90-b441-e0f06d66b6c3        |                               | 05035cb                       |
| f83cbbb7-ea0d-4240-bb6d-      | internal01                    | a2a35789-ca8f-49c5-b2df-      |
| 0b166a3d9b03                  |                               | f4c6e150b97c                  |
+-------------------------------+-------------------------------+-------------------------------+

[root@overcloud-controller-0 ~]# openstack subnet list
+---------------------------+---------------------------+----------------------------+------------------+
| ID                        | Name                      | Network                    | Subnet           |
+---------------------------+---------------------------+----------------------------+------------------+
| 07cc16e5-7a70-4b83-bd25-e | ext-subnet                | 78565ad8-905e-             | 192.168.24.0/24  |
| c82a03b709b               |                           | 48ef-9377-7d1a025b7917     |                  |
| 21fecdf3-1224-4ca0-8e24-0 | sub-internal02            | b2639935-0b5f-             | 70.0.0.0/24      |
| a05a05035cb               |                           | 4e90-b441-e0f06d66b6c3     |                  |
| a2a35789-ca8f-49c5-b2df-  | sub-internal01            | f83cbbb7-ea0d-4240-bb6d-   | 50.0.0.0/24      |
| f4c6e150b97c              |                           | 0b166a3d9b03               |                  |
| e6b1c771-5dfb-4d5f-       | HA subnet tenant 2cb6de12 | 5a42a09f-e252-42fb-a68c-   | 169.254.192.0/18 |
| 85e6-73d9585cc0a4         | 249c4240ad81d62ef0409f54  | 8b72fabab643               |                  |
+---------------------------+---------------------------+----------------------------+------------------+ 

 Double check security group ID

[root@overcloud-controller-0 ~]# nova secgroup-list

+--------------------------------------+---------+------------------------+
| Id                                   | Name    | Description            |
+--------------------------------------+---------+------------------------+
| 24fb34c5-dbfb-4cb1-9d16-ad57d7c631ad | default | Default security group |
+--------------------------------------+---------+------------------------+

Port creation on newly created network should have --security-group specified,
what is a must versus situation described just for attaching this port to VM
on different private network

[root@overcloud-controller-0 ~]# neutron port-create --security-group \
24fb34c5-dbfb-4cb1-9d16-ad57d7c631ad  internal02
 Created a new port:
+-----------------------+-----------------------------------------------------------------------+
| Field                 | Value                                                                 |
+-----------------------+-----------------------------------------------------------------------+
| admin_state_up        | True                                                                  |
| allowed_address_pairs |                                                                       |
| binding:host_id       |                                                                       |
| binding:profile       | {}                                                                    |
| binding:vif_details   | {}                                                                    |
| binding:vif_type      | unbound                                                               |
| binding:vnic_type     | normal                                                                |
| created_at            | 2017-04-30T11:09:02Z                                                  |
| description           |                                                                       |
| device_id             |                                                                       |
| device_owner          |                                                                       |
| extra_dhcp_opts       |                                                                       |
| fixed_ips             | {"subnet_id": "21fecdf3-1224-4ca0-8e24-0a05a05035cb", "ip_address":   |
|                       | "70.0.0.5"}                                                           |
| id                    | 6d44aca2-e0ae-4e55-acff-656673c77d70                                  |
| mac_address           | fa:16:3e:b8:8e:e3                                                     |
| name                  |                                                                       |
| network_id            | b2639935-0b5f-4e90-b441-e0f06d66b6c3                                  |
| port_security_enabled | True                                                                  |
| project_id            | 2cb6de12249c4240ad81d62ef0409f54                                      |
| qos_policy_id         |                                                                       |
| revision_number       | 5                                                                     |
| security_groups       | 24fb34c5-dbfb-4cb1-9d16-ad57d7c631ad                                  |
| status                | DOWN                                                                  |
| tags                  |                                                                       |
| tenant_id             | 2cb6de12249c4240ad81d62ef0409f54                                      |
| updated_at            | 2017-04-30T11:09:02Z                                                  |
+-----------------------+-----------------------------------------------------------------------+

*********************************************************************
Attach port to running VM with no precosions and dissociate FIP
*********************************************************************

[root@overcloud-controller-0 ~]# nova interface-attach --port-id \
6d44aca2-e0ae-4e55-acff-656673c77d70 vf24devs01 
Create /etc/sysconfig/network-scripts/ifcfg-eth1 and restart VM. When VM appears back up :- 
Detect port-ID of port matching private IP of VM on new network either way suggested bellow

**********
Option 1.
**********
[root@overcloud-controller-0 ~]# neutron port-list | grep 70.0.0.5
| 6d44aca2-e0ae-4e55-acff-656673c77d70 |                                                 | 2cb6de12249c4240ad81d62ef0409f54 | fa:16:3e:b8:8e:e3 | {"subnet_id": "21fecdf3-1224-4ca0-8e24-0a05a05035cb", "ip_address": "70.0.0.5"}       |

**********
Option 2
**********
[root@overcloud-controller-0 ~]# nova interface-list vf24devs01
+------------+--------------------------------------+--------------------------------------+--------------+-------------------+
| Port State | Port ID                              | Net ID                               | IP addresses | MAC Addr          |
+------------+--------------------------------------+--------------------------------------+--------------+-------------------+
| ACTIVE     | 6aa496e5-f977-4072-818c-9b5348afaff7 | f83cbbb7-ea0d-4240-bb6d-0b166a3d9b03 | 50.0.0.5     | fa:16:3e:b2:96:2c |
| ACTIVE     | 6d44aca2-e0ae-4e55-acff-656673c77d70 | b2639935-0b5f-4e90-b441-e0f06d66b6c3 | 70.0.0.5     | fa:16:3e:b8:8e:e3 |
+------------+--------------------------------------+--------------------------------------+--------------+-------------------+

[root@overcloud-controller-0 ~]# openstack floating ip create ext-net
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| created_at          | 2017-04-30T11:20:04Z                 |
| description         |                                      |
| fixed_ip_address    | None                                 |
| floating_ip_address | 192.168.24.106                       |
| floating_network_id | 78565ad8-905e-48ef-9377-7d1a025b7917 |
| id                  | f5a5e4b0-3d6a-4266-95da-aabfa9631617 |
| name                | None                                 |
| port_id             | None                                 |
| project_id          | 2cb6de12249c4240ad81d62ef0409f54     |
| revision_number     | 1                                    |
| router_id           | None                                 |
| status              | DOWN                                 |
| updated_at          | 2017-04-30T11:20:04Z                 |
+---------------------+--------------------------------------+

***************************************************************************************** Assign allocated FIP ( via ID) to ID of neutron port belongs to new private network ***************************************************************************************** [root@overcloud-controller-0 ~]# neutron floatingip-associate f5a5e4b0-3d6a-4266-95da-aabfa9631617 6d44aca2-e0ae-4e55-acff-656673c77d70 

 Associated floating IP f5a5e4b0-3d6a-4266-95da-aabfa9631617

In meantime I have to notice that TripleO QuickStart dashboard fails to assign FIP
for new prvate IP 70.0.0.5 belongs to new network and associeted with neutron port
been created just in same session.What actually was done via Neutron CLI or might
be done via python-openstackclient ( case F24 Cloud Guest). For CentOS 7.3 Tripleo
QuickStart dashboard does work :-

Due to limited hardware setup for CentOS 7.3 Gloud Guest is a bit different
http://dbaxps.blogspot.com/2017/05/switching-to-newly-created-projects.html

Verify success (F24 Cloud Guest):-

[root@overcloud-controller-0 ~]# openstack server list
+---------------------------+------------+--------+---------------------------+-----------------+
| ID                        | Name       | Status | Networks                  | Image Name      |
+---------------------------+------------+--------+---------------------------+-----------------+
| 2be10d3f-f982-4362-8d19-f | vf24devs01 | ACTIVE | internal01=50.0.0.5;      | VF24Cloud-image |
| f744f23e45f               |            |        | internal02=70.0.0.5,      |                 |
|                           |            |        | 192.168.24.106            |                 |
+---------------------------+------------+--------+---------------------------+-----------------+

******************************************************************************************************************
Check connection from WKS via the same RSA private key of SSH Keypair been used during original VM's launching
******************************************************************************************************************

[boris@fedora24wks ~]$ ssh -i oskey043017.pem fedora@192.168.24.106
Last login: Sun Apr 30 11:23:19 2017 from 192.168.24.1
[fedora@vf24devs01 ~]$ sudo su -
[root@vf24devs01 ~]# ip route
default via 70.0.0.1 dev eth1 
50.0.0.0/24 dev eth0  proto kernel  scope link  src 50.0.0.5 
70.0.0.0/24 dev eth1  proto kernel  scope link  src 70.0.0.5 
169.254.169.254 via 70.0.0.1 dev eth1  proto static

[root@vf24devs01 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
    link/ether fa:16:3e:b2:96:2c brd ff:ff:ff:ff:ff:ff
    inet 50.0.0.5/24 brd 50.0.0.255 scope global dynamic eth0
       valid_lft 85643sec preferred_lft 85643sec
    inet6 fe80::f816:3eff:feb2:962c/64 scope link 
       valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
    link/ether fa:16:3e:b8:8e:e3 brd ff:ff:ff:ff:ff:ff
    inet 70.0.0.5/24 brd 70.0.0.255 scope global dynamic eth1
       valid_lft 85645sec preferred_lft 85645sec
    inet6 fe80::f816:3eff:feb8:8ee3/64 scope link 
       valid_lft forever preferred_lft forever








 

 VM vf24devs01 originally launched via internal01 private network switched to internal02 network due to changing default gateway device from eth0 to eth1.
Having RH's /etc/sysconfig/network configuration file - vice versa operation won't be a problem.

Adding Second VNIC to running Fedora 24 && CentOS 7.3 Cloud VMs on RDO Ocata

UPDATE 29/04/2017
Feedback accepted at ask.openstack.org
https://ask.openstack.org/en/question/105905/vm-supposed-to-have-two-nic-cant-bring-up-second-one/
END UPDATE

Posting bellow addresses one of currently pending questions at 
ask.openstack,org regarding adding second vnic to currently
running cloud guest which private IP and VNIC associated with neutron
port are located on different private subnet. The one which was 
selected booting this guest originally.
For RH's overcloud guests as F24 or CentOS7 adding instruction 
"GATEWAYDEV=eth0"
to /etc/sysconfig/network works on RDO Ocata as smoothly as it did 
in IceHouse times,preventing original gateway device from changing 
after attaching neutron port on new network.Attaching new neutron 
port happens during overcloud VM  runtime.
Creating ifcfg-eth1 allows to bring up eth1 via dhcp request been
sent to another dnsmasq daemon serving new private network.

*****************************************
Topology been utilized for testing :-
*****************************************
[stack@undercloud ~]$ date
Thu Apr 27 20:34:50 UTC 2017

[stack@undercloud ~]$ nova-manage --version
15.0.4
[stack@undercloud ~]$ openstack server list
+----------------------+----------------------+--------+-----------------------+----------------+
| ID                   | Name                 | Status | Networks              | Image Name     |
+----------------------+----------------------+--------+-----------------------+----------------+
| 134f6705-8156-4284   | overcloud-           | ACTIVE |ctlplane=192.168.24.6  | overcloud-full |
| -acce-0610ceec8c39   | controller-1         |        |                       |                |
| 53f45785-5a47-4008-9 | overcloud-           | ACTIVE |ctlplane=192.168.24.18 | overcloud-full |
| 147-12c32b7fbdbc     | controller-2         |        |                       |                |
| 5aab1903-7cdf-4d00   | overcloud-           | ACTIVE |ctlplane=192.168.24.13 | overcloud-full |
| -afce-060b2f5fac64   | novacompute-0        |        |                       |                |
| 9928671e-81ae-466c-  | overcloud-           | ACTIVE |ctlplane=192.168.24.11 | overcloud-full |
| b65b-d04b9fa0b3fd    | controller-0         |        |                       |                |
| 97167614-961e-46f3   | overcloud-           | ACTIVE | ctlplane=192.168.24.7 | overcloud-full |
| -841c-6f834d42162d   | novacompute-1        |        |                       |                |
+----------------------+----------------------+--------+-----------------------+----------------+

***************** 
Launch VM 
*****************

[root@overcloud-controller-0 ~]# openstack image list
+--------------------------------------+-----------------+--------+
| ID                                   | Name            | Status |
+--------------------------------------+-----------------+--------+
| b2123182-3350-4073-a405-4999383d2c9b | VF24Cloud-image | active |
+--------------------------------------+-----------------+--------+

[root@overcloud-controller-0 ~]# openstack network list
+-------------------------------+-------------------------------+-------------------------------+
| ID                            | Name                          | Subnets                       |
+-------------------------------+-------------------------------+-------------------------------+
| 02db6681-fec5-4d10-ae38-18021 | internal01                    | a7b8e363-0f2b-4eda-           |
| d6b0132                       |                               | 8ea7-23d396a95e70             |
| 2f954150-fe15-4e4f-           | ext-net                       | 8265b729-64dc-4c6d-bf8b-      |
| 9d26-60ecfd334186             |                               | 77ef40828fd1                  |
| 373f2bc3-c078-42dc-           | HA network tenant 0a3c66ba5fc | ac059474-3f58-48c9-b433-d3701 |
| ba97-c91d490f9364             | 74b72bb44d1620b36fb30         | be6d15c                       |
| fa984290-816e-                | internal02                    | 0b3115c1-88d3-4eb7-b120-9a099 |
| 4c17-bec1-0163aa68098a        |                               | 4456378                       |
+-------------------------------+-------------------------------+-------------------------------+

[root@overcloud-controller-0 ~]# openstack server create --flavor 2 \
--key-name oskey042717  --image b2123182-3350-4073-a405-4999383d2c9b \
--nic net-id=02db6681-fec5-4d10-ae38-18021d6b0132  vf24devs01
+-------------------------------------+--------------------------------------------------------+
| Field                               | Value                                                  |
+-------------------------------------+--------------------------------------------------------+
| OS-DCF:diskConfig                   | MANUAL                                                 |
| OS-EXT-AZ:availability_zone         |                                                        |
| OS-EXT-SRV-ATTR:host                | None                                                   |
| OS-EXT-SRV-ATTR:hypervisor_hostname | None                                                   |
| OS-EXT-SRV-ATTR:instance_name       |                                                        |
| OS-EXT-STS:power_state              | NOSTATE                                                |
| OS-EXT-STS:task_state               | scheduling                                             |
| OS-EXT-STS:vm_state                 | building                                               |
| OS-SRV-USG:launched_at              | None                                                   |
| OS-SRV-USG:terminated_at            | None                                                   |
| accessIPv4                          |                                                        |
| accessIPv6                          |                                                        |
| addresses                           |                                                        |
| adminPass                           | krWUrXZPzG3h                                           |
| config_drive                        |                                                        |
| created                             | 2017-04-27T18:46:30Z                                   |
| flavor                              | m1.small (2)                                           |
| hostId                              |                                                        |
| id                                  | b9ba03c7-8336-4ff9-b861-60ee292c8491                   |
| image                               | VF24Cloud-image (b2123182-3350-4073-a405-4999383d2c9b) |
| key_name                            | oskey042717                                            |
| name                                | vf24devs01                                             |
| progress                            | 0                                                      |
| project_id                          | 0a3c66ba5fc74b72bb44d1620b36fb30                       |
| properties                          |                                                        |
| security_groups                     | name='default'                                         |
| status                              | BUILD                                                  |
| updated                             | 2017-04-27T18:46:30Z                                   |
| user_id                             | 363f2f57000b4d378514aadaab142804                       |
| volumes_attached                    |                                                        |
+-------------------------------------+--------------------------------------------------------+

[root@overcloud-controller-0 ~]# nova list
+--------------------------------------+------------+--------+------------+-------------+---------------------+
| ID                                   | Name       | Status | Task State | Power State | Networks            |
+--------------------------------------+------------+--------+------------+-------------+---------------------+
| b9ba03c7-8336-4ff9-b861-60ee292c8491 | vf24devs01 | ACTIVE | -          | Running     | internal01=50.0.0.7 |
+--------------------------------------+------------+--------+------------+-------------+----------------------

Assign FIP (192.168.24.105) via dashboard 


[root@overcloud-controller-0 ~]# nova list
+--------------------------------------+------------+--------+------------+-------------+-----------------------------------------------------------+
| ID                                   | Name       | Status | Task State | Power State | Networks                                                  |
+--------------------------------------+------------+--------+------------+-------------+-----------------------------------------------------------+
| b9ba03c7-8336-4ff9-b861-60ee292c8491 | vf24devs01 | ACTIVE | -          | Running     | internal01=50.0.0.7, 192.168.24.105; internal02=70.0.0.12 |
+--------------------------------------+------------+--------+------------+-------------+-----------------------------------------------------------+


[root@overcloud-controller-0 ~]# openstack network list
+-------------------------------+-------------------------------+-------------------------------+
| ID                            | Name                          | Subnets                       |
+-------------------------------+-------------------------------+-------------------------------+
| 02db6681-fec5-4d10-ae38-18021 | internal01                    | a7b8e363-0f2b-4eda-           |
| d6b0132                       |                               | 8ea7-23d396a95e70             |
| 2f954150-fe15-4e4f-           | ext-net                       | 8265b729-64dc-4c6d-bf8b-      |
| 9d26-60ecfd334186             |                               | 77ef40828fd1                  |
| 373f2bc3-c078-42dc-           | HA network tenant 0a3c66ba5fc | ac059474-3f58-48c9-b433-d3701 |
| ba97-c91d490f9364             | 74b72bb44d1620b36fb30         | be6d15c                       |
| fa984290-816e-                | internal02                    | 0b3115c1-88d3-4eb7-b120-9a099 |
| 4c17-bec1-0163aa68098a        |                               | 4456378                       |
+-------------------------------+-------------------------------+-------------------------------+

Here we create new neutron port belongs newly created network :-

 [root@overcloud-controller-0 ~]# neutron port-create internal02
Created a new port:
+-----------------------+-----------------------------------------------------------------------+
| Field                 | Value                                                                 |
+-----------------------+-----------------------------------------------------------------------+
| admin_state_up        | True                                                                  |
| allowed_address_pairs |                                                                       |
| binding:host_id       |                                                                       |
| binding:profile       | {}                                                                    |
| binding:vif_details   | {}                                                                    |
| binding:vif_type      | unbound                                                               |
| binding:vnic_type     | normal                                                                |
| created_at            | 2017-04-27T18:54:11Z                                                  |
| description           |                                                                       |
| device_id             |                                                                       |
| device_owner          |                                                                       |
| extra_dhcp_opts       |                                                                       |
| fixed_ips             | {"subnet_id": "0b3115c1-88d3-4eb7-b120-9a0994456378", "ip_address":   |
|                       | "70.0.0.12"}                                                          |
| id                    | 35f5c0a8-41a2-47b6-8a16-0ac8f77d0f93                                  |
| mac_address           | fa:16:3e:fd:d1:ea                                                     |
| name                  |                                                                       |
| network_id            | fa984290-816e-4c17-bec1-0163aa68098a                                  |
| port_security_enabled | True                                                                  |
| project_id            | 0a3c66ba5fc74b72bb44d1620b36fb30                                      |
| qos_policy_id         |                                                                       |
| revision_number       | 5                                                                     |
| security_groups       | d799177b-f826-472b-9540-befd8b0da76f                                  |
| status                | DOWN                                                                  |
| tags                  |                                                                       |
| tenant_id             | 0a3c66ba5fc74b72bb44d1620b36fb30                                      |
| updated_at            | 2017-04-27T18:54:12Z                                                  |
+-----------------------+-----------------------------------------------------------------------+

 Here we attach neutron port belongs newly created network to cloud VM running on different 

 private network:- 

 [root@overcloud-controller-0 ~]# nova interface-attach --port-id \
 35f5c0a8-41a2-47b6-8a16-0ac8f77d0f93 vf24devs01


[boris@fedora24wks ~]$ ssh -i oskey042717.pem fedora@192.168.24.105
Last login: Thu Apr 27 19:05:16 2017 from 192.168.24.1

[fedora@vf24devs01 ~]$ sudo su -

[root@vf24devs01 ~]# cat /etc/sysconfig/network
NETWORKING=yes
NOZEROCONF=yes
DEVTIMEOUT=10
GATEWAYDEV=eth0  <====  eth0 is set manually 
                      as gateway device for running VMs
                      after attaching port belongs to internal02

Next commands 

# cd /etc/sysconfig/network-scripts
# cp ifcfg-eth0 ifcfg-eth1
  Edit ifcfg-eth1 to match "eth1" entry
# ifup eth1

******************************************************************************************* Skipping setting GATEWAYDEV will result to hang ssh connection via FIP and force to manage like bellow:- ********************************************************************************************

[root@overcloud-controller-0 ~]# ip netns
qdhcp-773be634-da70-4213-b653-7a510097f3c1
qdhcp-1bec9cb9-fc19-4686-bb30-d24c909a11b9
qrouter-f0da93c3-3e1f-4eb5-883e-c86692b07ff9


[root@overcloud-controller-0 ~]# ip netns exec \
   qdhcp-773be634-da70-4213-b653-7a510097f3c1 \
   ssh -i  oskey042817.pem fedora@70.0.0.12
The authenticity of host '70.0.0.12 (70.0.0.12)' can't be established.
ECDSA key fingerprint is 52:23:09:65:a3:78:90:85:e5:80:79:89:de:d3:48:a2.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '70.0.0.12' (ECDSA) to the list of known hosts.
Last login: Fri Apr 28 15:06:46 2017 from 192.168.24.1

[fedora@vf24devs01 ~]$ sudo su -
[root@vf24devs01 ~]# ifconfig
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1450
        inet 50.0.0.13  netmask 255.255.255.0  broadcast 50.0.0.255
        inet6 fe80::f816:3eff:fec0:eb37  prefixlen 64  scopeid 0x20<link>
        ether fa:16:3e:c0:eb:37  txqueuelen 1000  (Ethernet)
        RX packets 576  bytes 58794 (57.4 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 481  bytes 63460 (61.9 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

eth1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1450
        inet 70.0.0.12  netmask 255.255.255.0  broadcast 70.0.0.255
        inet6 fe80::f816:3eff:fe06:86b0  prefixlen 64  scopeid 0x20<link>
        ether fa:16:3e:06:86:b0  txqueuelen 1000  (Ethernet)
        RX packets 81  bytes 10785 (10.5 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 399  bytes 23427 (22.8 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1  (Local Loopback)
        RX packets 139  bytes 39092 (38.1 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 139  bytes 39092 (38.1 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

[root@vf24devs01 ~]# ip route
default via 70.0.0.1 dev eth1 
50.0.0.0/24 dev eth0  proto kernel  scope link  src 50.0.0.13 
70.0.0.0/24 dev eth1  proto kernel  scope link  src 70.0.0.12 
169.254.169.254 via 50.0.0.1 dev eth0  proto static 
******************************************************************************************
Update /etc/sysconfig/network as requested followed by cloud VM restart 
That will switch back to default Gateway device eth0 and recover floating IP for VM
******************************************************************************************
[root@vf24devs01 ~]# ifconfig
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1450
        inet 50.0.0.7  netmask 255.255.255.0  broadcast 50.0.0.255
        inet6 fe80::f816:3eff:feab:739e  prefixlen 64  scopeid 0x20<link>
        ether fa:16:3e:ab:73:9e  txqueuelen 1000  (Ethernet)
        RX packets 384  bytes 43397 (42.3 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 383  bytes 41874 (40.8 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

eth1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1450
        inet 70.0.0.12  netmask 255.255.255.0  broadcast 70.0.0.255
        inet6 fe80::f816:3eff:fefd:d1ea  prefixlen 64  scopeid 0x20<link>
        ether fa:16:3e:fd:d1:ea  txqueuelen 1000  (Ethernet)
        RX packets 6  bytes 760 (760.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 11  bytes 1048 (1.0 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1  (Local Loopback)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0


[root@overcloud-controller-0 ~]# openstack port list | grep 50.0.0.7
| 95a4666d-eac8-461c-87b8-3fcaf797c263 |                                                 | fa:16:3e:ab:73:9e | ip_address='50.0.0.7', subnet_id='a7b8e363-0f2b-4eda-8ea7-23d396a95e70'       | ACTIVE |

[root@overcloud-controller-0 ~]# openstack port list | grep 70.0.0.12
| 35f5c0a8-41a2-47b6-8a16-0ac8f77d0f93 |                                                 | fa:16:3e:fd:d1:ea | ip_address='70.0.0.12', subnet_id='0b3115c1-88d3-4eb7-b120-9a0994456378'      | ACTIVE |

[root@overcloud-controller-0 ~]# openstack subnet list
+------------------------+------------------------+--------------------------+------------------+
| ID                     | Name                   | Network                  | Subnet           |
+------------------------+------------------------+--------------------------+------------------+
| 0b3115c1-88d3-4eb7-b12 | sub-internal02         | fa984290-816e-           | 70.0.0.0/24      |
| 0-9a0994456378         |                        | 4c17-bec1-0163aa68098a   |                  |
| 8265b729-64dc-4c6d-    | ext-subnet             | 2f954150-fe15-4e4f-      | 192.168.24.0/24  |
| bf8b-77ef40828fd1      |                        | 9d26-60ecfd334186        |                  |
| a7b8e363-0f2b-4eda-    | sub-internal01         | 02db6681-fec5-4d10-ae38- | 50.0.0.0/24      |
| 8ea7-23d396a95e70      |                        | 18021d6b0132             |                  |
| ac059474-3f58-48c9-b43 | HA subnet tenant 0a3c6 | 373f2bc3-c078-42dc-      | 169.254.192.0/18 |
| 3-d3701be6d15c         | 6ba5fc74b72bb44d1620b3 | ba97-c91d490f9364        |                  |
|                        | 6fb30                  |                          |                  |
+------------------------+------------------------+--------------------------+------------------+





   

Instance restarted 


   Login into VM via qdhcp namespace



 

Same procedure works fine on CentOS 7.3 Cloud Guest

  

References
1.https://thornelabs.net/2014/09/03/configure-multiple-network-interfaces-on-an-openstack-instance.html

TripleO QuickStart Ocata branch Deployment with feature sets and nodes configuration (topology) separated

Quoting updated README.rst

In previous versions of triple-quickstart a config file 
was used to determine not only the features that would 
be enabled in tripleo and openstack but also the number of nodes 
to be used. For instance "config/general_config/ha.yml" would
configure pacemaker and ensure three controller nodes 
were provisioned.This typeof configuration is now deprecated 
but will still work through the Queens release.

The feature and node configuration have been seperated 
into two distinct configuration files to allow users 
to explicity select the configuration known as
"feature sets" and the nodes to be provisioned.  
The feature set configuration can be found under 
tripleo-quickstart/config/general_config/ 
and the node configuration can be found under 
tripleo-quickstart/config/nodes/ 

In general,Ocata overcloud deployment is more memory consuming then 
Newton. Minimal memory requirements highlighted bellow. 
Also minor trobleshooting step was undertaken several times
right after overcloud deployment. 
Command `pcs resource cleanup` was issued after detecting resources 
failed to start after original deployment completed.
The problem above would be gone in case when VIRTHOST (48GB) would allow
to allocate 8192 MB for each PCS Cluster's Controller. Sshuttle command 
line was also modified to provide access to control plane and 
external network from workstation at a time.
So create under config/nodes 3ctlr_1comp_2ceph.yml file - deployment topology 

[boris@fedora24wks nodes]$ cat 3ctlr_1comp_2ceph.yml
##########################################################
# Deploy an HA openstack environment. 32 GB VIRTHOST
##########################################################
control_memory: 7000
compute_memory: 6500

undercloud_memory: 8192

# Giving the undercloud additional CPUs can greatly improve heat's
# performance (and result in a shorter deploy time).
undercloud_vcpu: 4

# Since HA has more machines, we set the cpu for controllers and
# compute nodes to 1
default_vcpu: 1
compute_vcpu: 2

# This enables TLS for the undercloud which will also make haproxy bind to the
# configured public-vip and admin-vip.
undercloud_generate_service_certificate: True

# Create three controller nodes and one compute node.
overcloud_nodes:
  - name: control_0
    flavor: control
    virtualbmc_port: 6230

  - name: control_1
    flavor: control
    virtualbmc_port: 6231

  - name: control_2
    flavor: control
    virtualbmc_port: 6232

  - name: compute_0
    flavor: compute
    virtualbmc_port: 6233

  - name: ceph_0
    flavor: ceph
    virtualbmc_port: 6234

  - name: ceph_1
    flavor: ceph
    virtualbmc_port: 6235


# Tell tripleo about our environment.
topology: >-
  --control-scale 3
  --compute-scale 1
  --ceph-storage-scale 2
  -e {{overcloud_templates_path}}/environments/storage-environment.yaml


[boris@fedora24wks tripleo-quickstart]$ ssh root@$VIRTHOST uname -a
Linux Server73CentOS.localdomain 3.10.0-514.10.2.el7.x86_64 #1 SMP Fri Mar 3 00:04:05 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

[boris@fedora24wks tripleo-quickstart]$ bash quickstart.sh -R ocata \
--config config/general_config/pacemaker.yml \
--nodes config/nodes/3ctlr_1comp_2ceph.yml $VIRTHOST

New python executable in /home/boris/.quickstart/bin/python2
Also creating executable in /home/boris/.quickstart/bin/python
Installing setuptools, pip, wheel...done.
Requirement already up-to-date: pip in /home/boris/.quickstart/lib/python2.7/site-packages
Cloning tripleo-quickstart repository...
Cloning into '/home/boris/.quickstart/tripleo-quickstart'...
remote: Counting objects: 6985, done.
remote: Compressing objects: 100% (51/51), done.
remote: Total 6985 (delta 22), reused 2 (delta 2), pack-reused 6931
Receiving objects: 100% (6985/6985), 1.07 MiB | 1.08 MiB/s, done.
Resolving deltas: 100% (3683/3683), done.
Checking connectivity... done.
Fetching origin
~/.quickstart/tripleo-quickstart ~/.quickstart/tripleo-quickstart

Installed /home/boris/.quickstart/.eggs/pbr-2.0.0-py2.7.egg
[pbr] Generating ChangeLog
running install
running build
running install_data
creating /home/boris/.quickstart/usr
creating /home/boris/.quickstart/usr/local
creating /home/boris/.quickstart/usr/local/share
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown[boris@fedora24wks tripleo-quickstart]$ ssh root@$VIRTHOST uname -a
Linux Server73CentOS.localdomain 3.10.0-514.10.2.el7.x86_64 #1 SMP Fri Mar 3 00:04:05 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
[boris@fedora24wks tripleo-quickstart]$ bash quickstart.sh -R ocata --config config/general_config/pacemaker.yml --nodes config/nodes/3ctlr_1comp_2ceph.yml  $VIRTHOST
New python executable in /home/boris/.quickstart/bin/python2
Also creating executable in /home/boris/.quickstart/bin/python
Installing setuptools, pip, wheel...done.
Requirement already up-to-date: pip in /home/boris/.quickstart/lib/python2.7/site-packages
Cloning tripleo-quickstart repository...
Cloning into '/home/boris/.quickstart/tripleo-quickstart'...
remote: Counting objects: 6985, done.
remote: Compressing objects: 100% (51/51), done.
remote: Total 6985 (delta 22), reused 2 (delta 2), pack-reused 6931
Receiving objects: 100% (6985/6985), 1.07 MiB | 1.08 MiB/s, done.
Resolving deltas: 100% (3683/3683), done.
Checking connectivity... done.
Fetching origin
~/.quickstart/tripleo-quickstart ~/.quickstart/tripleo-quickstart

Installed /home/boris/.quickstart/.eggs/pbr-2.0.0-py2.7.egg
[pbr] Generating ChangeLog
running install
running build
running install_data
creating /home/boris/.quickstart/usr
creating /home/boris/.quickstart/usr/local
creating /home/boris/.quickstart/usr/local/share
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/user
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/user/tasks
copying roles/libvirt/teardown/user/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/user/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/meta
copying roles/libvirt/setup/undercloud/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/teardown
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/teardown/tasks
copying roles/provision/teardown/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/teardown/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts/kvm
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts/kvm/tasks
copying roles/parts/kvm/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts/kvm/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/overcloud
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks
copying roles/libvirt/setup/overcloud/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/nodes
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/nodes/tasks
copying roles/libvirt/teardown/nodes/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/nodes/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/local
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/local/tasks
copying roles/provision/local/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/local/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/remote
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/remote/meta
copying roles/provision/remote/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/remote/meta
creating /home/boris/.quickstart/config
creating /home/boris/.quickstart/config/release
creating /home/boris/.quickstart/config/release/trunk
copying config/release/trunk/liberty.yml -> /home/boris/.quickstart/config/release/trunk
copying config/release/trunk/mitaka.yml -> /home/boris/.quickstart/config/release/trunk
copying config/release/trunk/newton.yml -> /home/boris/.quickstart/config/release/trunk
copying config/release/trunk/ocata.yml -> /home/boris/.quickstart/config/release/trunk
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/overcloud/meta
copying roles/libvirt/setup/overcloud/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/overcloud/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/meta
copying roles/convert-image/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/setup
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/fetch-images
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/tasks
copying roles/tripleo-inventory/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/files
copying roles/libvirt/setup/undercloud/files/get-undercloud-ip.sh -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/files
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/support_check
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/support_check/meta
copying roles/provision/support_check/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/support_check/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/test_plugins
copying test_plugins/equalto.py -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/test_plugins/
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/user
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/user/meta
copying roles/libvirt/setup/user/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/user/meta
creating /home/boris/.quickstart/playbooks
copying playbooks/build-images-and-quickstart.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/libvirt-teardown.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/tripleo-roles.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/quickstart-extras.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/noop.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/teardown-provision.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/provision.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/repo-setup-virthost.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/quickstart.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/teardown-nodes.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/build-images.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/teardown.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/libvirt-setup.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/teardown-environment.yml -> /home/boris/.quickstart/playbooks/
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/vars
copying roles/environment/vars/redhat.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/vars
copying roles/environment/vars/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/vars
copying roles/environment/vars/fedora.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/vars
copying roles/environment/vars/centos-7.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/vars
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/setup/meta
copying roles/environment/setup/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/setup/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts/kvm/defaults
copying roles/parts/kvm/defaults/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts/kvm/defaults
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/setup/tasks
copying roles/environment/setup/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/setup/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/meta
copying roles/libvirt/setup/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/meta
creating /home/boris/.quickstart/config/nodes
copying config/nodes/ovb_4node.yml -> /home/boris/.quickstart/config/nodes
copying config/nodes/1ctlr_1comp_1ceph.yml -> /home/boris/.quickstart/config/nodes
copying config/nodes/1ctlr.yml -> /home/boris/.quickstart/config/nodes
copying config/nodes/1ctlr_1comp.yml -> /home/boris/.quickstart/config/nodes
copying config/nodes/3ctlr_3comp.yml -> /home/boris/.quickstart/config/nodes
copying config/nodes/3ctlr_1comp.yml -> /home/boris/.quickstart/config/nodes
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/meta
copying roles/tripleo-inventory/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks
copying roles/libvirt/setup/undercloud/tasks/inject_gating_repo.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks
copying roles/libvirt/setup/undercloud/tasks/customize_overcloud.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks
copying roles/libvirt/setup/undercloud/tasks/inject_repos.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks
copying roles/libvirt/setup/undercloud/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks
copying roles/libvirt/setup/undercloud/tasks/update_image.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks
copying roles/libvirt/setup/undercloud/tasks/convert_image.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/templates
copying roles/convert-image/templates/convert_image.sh.j2 -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/templates
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/user
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/user/meta
copying roles/provision/user/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/user/meta
creating /home/boris/.quickstart/config/general_config
creating /home/boris/.quickstart/config/general_config/releasenotes
creating /home/boris/.quickstart/config/general_config/releasenotes/notes
copying config/general_config/releasenotes/notes/break-out-general-config-8a02f40113e58dbc.yaml -> /home/boris/.quickstart/config/general_config/releasenotes/notes
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/meta
copying roles/libvirt/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/defaults
copying roles/tripleo-inventory/defaults/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/defaults
creating /home/boris/.quickstart/config/release/tripleo-ci
copying config/release/tripleo-ci/master.yml -> /home/boris/.quickstart/config/release/tripleo-ci
copying config/release/tripleo-ci/mitaka.yml -> /home/boris/.quickstart/config/release/tripleo-ci
copying config/release/tripleo-ci/newton.yml -> /home/boris/.quickstart/config/release/tripleo-ci
copying config/release/tripleo-ci/ocata.yml -> /home/boris/.quickstart/config/release/tripleo-ci
copying config/release/tripleo-ci/consistent-master.yml -> /home/boris/.quickstart/config/release/tripleo-ci
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/defaults
copying roles/convert-image/defaults/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/defaults
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/tasks
copying roles/convert-image/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/teardown
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/teardown/meta
copying roles/environment/teardown/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/teardown/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/tasks
copying roles/environment/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/common
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/common/defaults
copying roles/common/defaults/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/common/defaults
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/defaults
copying roles/libvirt/defaults/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/defaults
creating /home/boris/.quickstart/config/release/stable
copying config/release/stable/mitaka.yml -> /home/boris/.quickstart/config/release/stable
copying config/release/stable/newton.yml -> /home/boris/.quickstart/config/release/stable
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/remote/templates
copying roles/provision/remote/templates/libvirt.pkla.j2 -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/remote/templates
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/local/meta
copying roles/provision/local/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/local/meta
copying config/release/master.yml -> /home/boris/.quickstart/config/release
copying config/release/master-tripleo-ci.yml -> /home/boris/.quickstart/config/release
copying config/release/liberty.yml -> /home/boris/.quickstart/config/release
copying config/release/ocata-undercloud-newton-overcloud.yml -> /home/boris/.quickstart/config/release
copying config/release/mitaka.yml -> /home/boris/.quickstart/config/release
copying config/release/newton.yml -> /home/boris/.quickstart/config/release
copying config/release/ocata.yml -> /home/boris/.quickstart/config/release
copying config/release/newton-baseos-undercloud.yml -> /home/boris/.quickstart/config/release
. . . . . . . . .
copying config/release/master-undercloud-ocata-overcloud.yml -> /home/boris/.quickstart/config/release
Collecting ara (from -r requirements.txt (line 1))
  Downloading ara-0.12.4.tar.gz (3.1MB)
    100% |################################| 3.1MB 1.7MB/s 
Collecting ansible==2.2.0.0 (from -r requirements.txt (line 2))
  Downloading ansible-2.2.0.0.tar.gz (2.4MB)
    100% |################################| 2.4MB 1.5MB/s 
Collecting netaddr>=0.7.18 (from -r requirements.txt (line 3))
  Downloading netaddr-0.7.19-py2.py3-none-any.whl (1.6MB)
    100% |################################| 1.6MB 1.5MB/s 
Collecting pbr>=1.6 (from -r requirements.txt (line 4))
  Downloading pbr-2.0.0-py2.py3-none-any.whl (98kB)
    100% |################################| 102kB 487kB/s 
Requirement already satisfied: setuptools>=11.3 in /home/boris/.quickstart/lib/python2.7/site-packages (from -r requirements.txt (line 5))
Collecting tripleo-quickstart-extras from git+https://git.openstack.org/openstack/tripleo-quickstart-extras/#egg=tripleo-quickstart-extras (from -r quickstart-extras-requirements.txt (line 1))
  Cloning https://git.openstack.org/openstack/tripleo-quickstart-extras/ to /tmp/pip-build-6nHd7z/tripleo-quickstart-extras
Collecting Flask==0.11.1 (from ara->-r requirements.txt (line 1))
  Downloading Flask-0.11.1-py2.py3-none-any.whl (80kB)
    100% |################################| 81kB 586kB/s 
Collecting Flask-SQLAlchemy (from ara->-r requirements.txt (line 1))
  Downloading Flask_SQLAlchemy-2.2-py2.py3-none-any.whl
Collecting Flask-Migrate (from ara->-r requirements.txt (line 1))
  Downloading Flask-Migrate-2.0.3.tar.gz
Collecting Flask-Script (from ara->-r requirements.txt (line 1))
  Downloading Flask-Script-2.0.5.tar.gz (42kB)
    100% |################################| 51kB 46.8MB/s 
Collecting Frozen-Flask (from ara->-r requirements.txt (line 1))
  Downloading Frozen_Flask-0.14-py2.py3-none-any.whl
Collecting decorator>=4.0.0 (from ara->-r requirements.txt (line 1))
  Downloading decorator-4.0.11-py2.py3-none-any.whl
Collecting cliff (from ara->-r requirements.txt (line 1))
  Downloading cliff-2.5.0-py2-none-any.whl (56kB)
    100% |################################| 61kB 901kB/s 
Collecting pygments (from ara->-r requirements.txt (line 1))
  Downloading Pygments-2.2.0-py2.py3-none-any.whl (841kB)
    100% |################################| 849kB 471kB/s 
Collecting debtcollector>=1.2.0 (from ara->-r requirements.txt (line 1))
  Downloading debtcollector-1.13.0-py2.py3-none-any.whl
Collecting junit-xml>=1.7 (from ara->-r requirements.txt (line 1))
  Downloading junit-xml-1.7.tar.gz
Collecting paramiko (from ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading paramiko-2.1.2-py2.py3-none-any.whl (172kB)
    100% |################################| 174kB 725kB/s 
Collecting jinja2 (from ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading Jinja2-2.9.6-py2.py3-none-any.whl (340kB)
    100% |################################| 348kB 736kB/s 
Collecting PyYAML (from ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading PyYAML-3.12.tar.gz (253kB)
    100% |################################| 256kB 1.4MB/s 
Collecting pycrypto>=2.6 (from ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading pycrypto-2.6.1.tar.gz (446kB)
    100% |################################| 450kB 740kB/s 
Requirement already satisfied: appdirs>=1.4.0 in /home/boris/.quickstart/lib/python2.7/site-packages (from setuptools>=11.3->-r requirements.txt (line 5))
Requirement already satisfied: packaging>=16.8 in /home/boris/.quickstart/lib/python2.7/site-packages (from setuptools>=11.3->-r requirements.txt (line 5))
Requirement already satisfied: six>=1.6.0 in /home/boris/.quickstart/lib/python2.7/site-packages (from setuptools>=11.3->-r requirements.txt (line 5))
Collecting itsdangerous>=0.21 (from Flask==0.11.1->ara->-r requirements.txt (line 1))
  Downloading itsdangerous-0.24.tar.gz (46kB)
    100% |################################| 51kB 19.2MB/s 
Collecting click>=2.0 (from Flask==0.11.1->ara->-r requirements.txt (line 1))
  Downloading click-6.7-py2.py3-none-any.whl (71kB)
    100% |################################| 71kB 1.0MB/s 
Collecting Werkzeug>=0.7 (from Flask==0.11.1->ara->-r requirements.txt (line 1))
  Downloading Werkzeug-0.12.1-py2.py3-none-any.whl (312kB)
    100% |################################| 317kB 744kB/s 
Collecting SQLAlchemy>=0.8.0 (from Flask-SQLAlchemy->ara->-r requirements.txt (line 1))
  Downloading SQLAlchemy-1.1.9.tar.gz (5.2MB)
    100% |################################| 5.2MB 1.5MB/s 
Collecting alembic>=0.6 (from Flask-Migrate->ara->-r requirements.txt (line 1))
  Downloading alembic-0.9.1.tar.gz (999kB)
    100% |################################| 1.0MB 3.3MB/s 
Requirement already satisfied: pyparsing>=2.1.0 in /home/boris/.quickstart/lib/python2.7/site-packages (from cliff->ara->-r requirements.txt (line 1))
Collecting cmd2>=0.6.7 (from cliff->ara->-r requirements.txt (line 1))
  Downloading cmd2-0.7.0.tar.gz (371kB)
    100% |################################| 378kB 1.4MB/s 
Collecting unicodecsv>=0.8.0; python_version < "3.0" (from cliff->ara->-r requirements.txt (line 1))
  Downloading unicodecsv-0.14.1.tar.gz
Collecting PrettyTable<0.8,>=0.7.1 (from cliff->ara->-r requirements.txt (line 1))
  Downloading prettytable-0.7.2.zip
Collecting stevedore>=1.20.0 (from cliff->ara->-r requirements.txt (line 1))
  Downloading stevedore-1.21.0-py2.py3-none-any.whl
Collecting wrapt>=1.7.0 (from debtcollector>=1.2.0->ara->-r requirements.txt (line 1))
  Downloading wrapt-1.10.10.tar.gz
Collecting funcsigs>=0.4; python_version == "2.7" or python_version == "2.6" (from debtcollector>=1.2.0->ara->-r requirements.txt (line 1))
  Downloading funcsigs-1.0.2-py2.py3-none-any.whl
Collecting pyasn1>=0.1.7 (from paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading pyasn1-0.2.3-py2.py3-none-any.whl (53kB)
    100% |################################| 61kB 31.7MB/s 
Collecting cryptography>=1.1 (from paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading cryptography-1.8.1.tar.gz (423kB)
    100% |################################| 430kB 743kB/s 
Collecting MarkupSafe>=0.23 (from jinja2->ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading MarkupSafe-1.0.tar.gz
Collecting Mako (from alembic>=0.6->Flask-Migrate->ara->-r requirements.txt (line 1))
  Downloading Mako-1.0.6.tar.gz (575kB)
    100% |################################| 583kB 1.4MB/s 
Collecting python-editor>=0.3 (from alembic>=0.6->Flask-Migrate->ara->-r requirements.txt (line 1))
  Downloading python-editor-1.0.3.tar.gz
Collecting idna>=2.1 (from cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading idna-2.5-py2.py3-none-any.whl (55kB)
    100% |################################| 61kB 19.2MB/s 
Collecting asn1crypto>=0.21.0 (from cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading asn1crypto-0.22.0-py2.py3-none-any.whl (97kB)
    100% |################################| 102kB 1.4MB/s 
Collecting enum34 (from cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading enum34-1.1.6-py2-none-any.whl
Collecting ipaddress (from cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading ipaddress-1.0.18-py2-none-any.whl
Collecting cffi>=1.4.1 (from cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading cffi-1.10.0-cp27-cp27mu-manylinux1_x86_64.whl (392kB)
    100% |################################| 399kB 1.4MB/s 
Collecting pycparser (from cffi>=1.4.1->cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))
  Downloading pycparser-2.17.tar.gz (231kB)
    100% |################################| 235kB 732kB/s 
Installing collected packages: pyasn1, idna, asn1crypto, enum34, ipaddress, pycparser, cffi, cryptography, paramiko, MarkupSafe, jinja2, PyYAML, pycrypto, ansible, itsdangerous, click, Werkzeug, Flask, SQLAlchemy, Flask-SQLAlchemy, Mako, python-editor, alembic, Flask-Script, Flask-Migrate, Frozen-Flask, pbr, decorator, cmd2, unicodecsv, PrettyTable, stevedore, cliff, pygments, wrapt, funcsigs, debtcollector, junit-xml, ara, netaddr, tripleo-quickstart-extras
  Running setup.py install for pycparser ... done
  Running setup.py install for cryptography ... done
  Running setup.py install for MarkupSafe ... done
  Running setup.py install for PyYAML ... done
  Running setup.py install for pycrypto ... done
  Running setup.py install for ansible ... done
  Running setup.py install for itsdangerous ... done
  Running setup.py install for SQLAlchemy ... done
  Running setup.py install for Mako ... done
  Running setup.py install for python-editor ... done
  Running setup.py install for alembic ... done
  Running setup.py install for Flask-Script ... done
  Running setup.py install for Flask-Migrate ... done
  Running setup.py install for cmd2 ... done
  Running setup.py install for unicodecsv ... done
  Running setup.py install for PrettyTable ... done
  Running setup.py install for wrapt ... done
  Running setup.py install for junit-xml ... done
  Running setup.py install for ara ... done
  Running setup.py install for tripleo-quickstart-extras ... done
Successfully installed Flask-0.11.1 Flask-Migrate-2.0.3 Flask-SQLAlchemy-2.2 Flask-Script-2.0.5 Frozen-Flask-0.14 Mako-1.0.6 MarkupSafe-1.0 PrettyTable-0.7.2 PyYAML-3.12 SQLAlchemy-1.1.9 Werkzeug-0.12.1 alembic-0.9.1 ansible-2.2.0.0 ara-0.12.4 asn1crypto-0.22.0 cffi-1.10.0 click-6.7 cliff-2.5.0 cmd2-0.7.0 cryptography-1.8.1 debtcollector-1.13.0 decorator-4.0.11 enum34-1.1.6 funcsigs-1.0.2 idna-2.5 ipaddress-1.0.18 itsdangerous-0.24 jinja2-2.9.6 junit-xml-1.7 netaddr-0.7.19 paramiko-2.1.2 pbr-2.0.0 pyasn1-0.2.3 pycparser-2.17 pycrypto-2.6.1 pygments-2.2.0 python-editor-1.0.3 stevedore-1.21.0 tripleo-quickstart-extras-2.0.1.dev228 unicodecsv-0.14.1 wrapt-1.10.10
~/.quickstart/tripleo-quickstart
----------------------------------------------------------------------------
|                                ,   .   ,                                 |
|                                )-_'''_-(                                 |
|                               ./ o\ /o \.                                |
|                              . \__/ \__/ .                               |
|                              ...   V   ...                               |
|                              ... - - - ...                               |
|                               .   - -   .                                |
|                                `-.....-´                                 |
|   ____         ____      ____        _      _        _             _     |
|  / __ \       / __ \    / __ \      (_)    | |      | |           | |    |
| | |  | | ___ | |  | |  | |  | |_   _ _  ___| | _____| |_ __ _ _ __| |_   |
| | |  | |/ _ \| |  | |  | |  | | | | | |/ __| |/ / __| __/ _` | '__| __|  |
| | |__| | |_| | |__| |  | |__| | |_| | | (__|   <\__ \ |_|(_| | |  | |_   |
|  \____/ \___/ \____/    \___\_\\__,_|_|\___|_|\_\___/\__\__,_|_|   \__|  |
|                                                                          |
|                                                                          |
----------------------------------------------------------------------------
. . . . . . 

Installing OpenStack ocata on host 192.168.0.74
Using directory /home/boris/.quickstart for a local working directory
+ export ANSIBLE_CONFIG=/home/boris/.quickstart/tripleo-quickstart/ansible.cfg
+ ANSIBLE_CONFIG=/home/boris/.quickstart/tripleo-quickstart/ansible.cfg
+ export ANSIBLE_INVENTORY=/home/boris/.quickstart/hosts
+ ANSIBLE_INVENTORY=/home/boris/.quickstart/hosts
+ export ARA_DATABASE=sqlite:////home/boris/.quickstart/ara.sqlite
+ ARA_DATABASE=sqlite:////home/boris/.quickstart/ara.sqlite
+ source /home/boris/.quickstart/tripleo-quickstart/ansible_ssh_env.sh
++ export OPT_WORKDIR=/home/boris/.quickstart
++ OPT_WORKDIR=/home/boris/.quickstart
++ export SSH_CONFIG=/home/boris/.quickstart/ssh.config.ansible
++ SSH_CONFIG=/home/boris/.quickstart/ssh.config.ansible
++ touch /home/boris/.quickstart/ssh.config.ansible
++ export 'ANSIBLE_SSH_ARGS=-F /home/boris/.quickstart/ssh.config.ansible'
++ ANSIBLE_SSH_ARGS='-F /home/boris/.quickstart/ssh.config.ansible'
+ '[' 0 = 0 ']'
+ rm -f /home/boris/.quickstart/hosts
+ '[' 192.168.0.74 = localhost ']'
+ '[' '' = 1 ']'
+ VERBOSITY=vv
+ ansible-playbook -vv /home/boris/.quickstart/playbooks/quickstart-extras.yml -e @config/general_config/pacemaker.yml -e @config/nodes/3ctlr_1comp_2ceph.yml -e ansible_python_interpreter=/usr/bin/python -e @/home/boris/.quickstart/config/release/ocata.yml -e local_working_dir=/home/boris/.quickstart -e virthost=192.168.0.74 -t untagged,provision,environment,undercloud-scripts,overcloud-scripts,undercloud-install,undercloud-post-install,teardown-nodes
Using /home/boris/.quickstart/tripleo-quickstart/ansible.cfg as config file

. . . . . . . . . . 
PLAY RECAP *********************************************************************
192.168.0.74               : ok=116  changed=43   unreachable=0    failed=0   
localhost                  : ok=19   changed=8    unreachable=0    failed=0   
undercloud                 : ok=37   changed=25   unreachable=0    failed=0   

Sunday 09 April 2017  19:46:45 +0300 (0:00:01.674)       0:32:53.445 ********** 
=============================================================================== 
undercloud-deploy : Install the undercloud --------------------------- 1143.38s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/install-undercloud.yml:15 
overcloud-prep-images : Prepare the overcloud images for deploy ------- 161.73s
/home/boris/.quickstart/usr/local/share/ansible/roles/overcloud-prep-images/tasks/overcloud-prep-images.yml:1 
setup/undercloud : Perform selinux relabel on undercloud image --------- 97.42s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:154 
setup/undercloud : Upload undercloud volume to storage pool ------------ 43.41s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:257 
fetch-images : Get qcow2 image from cache ------------------------------ 30.48s
/home/boris/.quickstart/tripleo-quickstart/roles/fetch-images/tasks/fetch.yml:167 
overcloud-prep-flavors : Prepare the scripts for overcloud flavors ----- 28.48s
/home/boris/.quickstart/usr/local/share/ansible/roles/overcloud-prep-flavors/tasks/overcloud-prep-flavors.yml:1 
setup/undercloud : Copy instackenv.json to appliance ------------------- 26.88s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:73 
parts/libvirt : Install packages for libvirt --------------------------- 14.82s
/home/boris/.quickstart/tripleo-quickstart/roles/parts/libvirt/tasks/main.yml:17 
undercloud-deploy : Create the Virtual BMCs ---------------------------- 14.39s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/configure-vbmc.yml:23 
setup/undercloud : Get undercloud vm ip address ------------------------ 12.64s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:295 
setup/overcloud : Define overcloud vms ---------------------------------- 7.87s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:84 
undercloud-deploy : Create undercloud configuration --------------------- 7.66s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/create-scripts.yml:3 
setup/overcloud : Create overcloud vm storage --------------------------- 7.37s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:72 
undercloud-deploy : Start the Virtual BMCs ------------------------------ 7.20s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/configure-vbmc.yml:55 
setup/overcloud : Attach additional blockdevices to overcloud objectstorage VMs --- 6.92s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:102 
setup/undercloud : Inject undercloud ssh public key to appliance -------- 6.88s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:99 
setup/overcloud : Create additional blockdevice for objectstorage nodes --- 6.72s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:94 
overcloud-prep-network : Prepare the network-isolation required networks on the undercloud --- 6.57s
/home/boris/.quickstart/usr/local/share/ansible/roles/overcloud-prep-network/tasks/overcloud-prep-network.yml:1 
undercloud-deploy : Install VirtualBMC package -------------------------- 6.38s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/configure-vbmc.yml:3 
teardown/nodes : Check overcloud vms ------------------------------------ 6.35s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/teardown/nodes/tasks/main.yml:22 
+ set +x
##################################
Virtual Environment Setup Complete
##################################

Access the undercloud by:

    ssh -F /home/boris/.quickstart/ssh.config.ansible undercloud

Follow the documentation in the link below to complete your deployment.

    http://ow.ly/c44w304begR

##################################
Virtual Environment Setup Complete
##################################

Logging into undercloud VM :-

[boris@fedora24wks tripleo-quickstart]$ ssh -F /home/boris/.quickstart/ssh.config.ansible undercloud
Warning: Permanently added '192.168.0.74' (ECDSA) to the list of known hosts.
Warning: Permanently added 'undercloud' (ECDSA) to the list of known hosts.
Last login: Sun Apr  9 16:46:39 2017 from gateway
[stack@undercloud ~]$ . stackrc
[stack@undercloud ~]$ ironic node-list
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| UUID                                 | Name      | Instance UUID | Power State | Provisioning State | Maintenance |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| 86b18950-9cb1-4d10-bdab-a6fbae20bdcb | control-0 | None          | power off   | available          | False       |
| 185f231d-72e4-4be3-91e5-651310c05287 | control-1 | None          | power off   | available          | False       |
| 302fa421-f6a6-4561-a6ab-9ae14cca832e | control-2 | None          | power off   | available          | False       |
| f245e374-0a5f-48ca-978f-06a5ece2d1ac | compute-0 | None          | power off   | available          | False       |
| 0f616bef-5709-4f33-becd-cc247e7889dc | ceph-0    | None          | power off   | available          | False       |
| 7f01a0af-daba-4d9b-aec3-ca4e29df2db3 | ceph-1    | None          | power off   | available          | False       |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
********************************************************************************************
Next step :- 
$ sudo vi  /usr/share/openstack-tripleo-heat-templates/puppet/services/ceph-mon.yaml
Update line :-
ceph::profile::params::osd_pool_default_size: 2 
instead of default value "3". This step is acceptable only in Virtual Environment.
Setting  the osd_pool_default_size set to 2,you will only have
two copies of the object. As a general rule, you should run your cluster 
with more than two OSD and a pool size greater than 2 object replica - Quorum requirement. 
So having 48GB RAM on VIRTHOST  the optimal setting is osd_pool_default_size = 3 
********************************************************************************************
[stack@undercloud ~]$ ls -l
total 1645340
-rw-rw-r--. 1 stack stack        357 Apr  9 16:46 cloud-names.yaml
-rwxr-xr-x. 1 stack stack        371 Apr  9 16:42 containers-default-parameters.yaml
-rw-rw-r--. 1 stack stack       2521 Apr  9 16:18 instackenv.json
-rw-rw-r--. 1 stack stack  356179341 Apr  7 13:40 ironic-python-agent.initramfs
-rw-rw-r--. 1 stack stack    5393008 Apr  7 13:40 ironic-python-agent.kernel
-rw-r--r--. 1 stack stack        474 Apr  9 16:42 network-environment.yaml
-rw-rw-r--. 1 stack stack          0 Apr  9 16:42 overcloud_custom_tht_script.log
-rwxr-xr-x. 1 stack stack        293 Apr  9 16:42 overcloud-custom-tht-script.sh
-rwxr-xr-x. 1 stack stack        973 Apr  9 16:46 overcloud-deploy-post.sh
-rwxr-xr-x. 1 stack stack       3027 Apr  9 16:46 overcloud-deploy.sh
-rw-rw-r--. 1 stack stack   46927452 Apr  7 13:40 overcloud-full.initrd
-rw-rw-r--. 1 stack stack 1270480896 Apr  7 13:40 overcloud-full.qcow2
-rw-rw-r--. 1 stack stack    5393008 Apr  7 13:40 overcloud-full.vmlinuz
-rwxr-xr-x. 1 stack stack        894 Apr  9 16:42 overcloud-prep-containers.sh
-rw-rw-r--. 1 stack stack      10047 Apr  9 16:45 overcloud_prep_flavors.log
-rwxr-xr-x. 1 stack stack       3672 Apr  9 16:45 overcloud-prep-flavors.sh
-rw-rw-r--. 1 stack stack       5965 Apr  9 16:45 overcloud_prep_images.log
-rwxr-xr-x. 1 stack stack        618 Apr  9 16:42 overcloud-prep-images.sh
-rw-rw-r--. 1 stack stack       2310 Apr  9 16:46 overcloud_prep_network.log
-rwxr-xr-x. 1 stack stack        863 Apr  9 16:45 overcloud-prep-network.sh
-rw-------. 1 stack stack        543 Apr  9 16:22 quickstart-hieradata-overrides.yaml
-rw-------. 1 stack stack        715 Apr  9 16:40 stackrc
-rw-------. 1 stack stack       8526 Apr  9 16:22 undercloud.conf
-rw-rw-r--. 1 stack stack     348697 Apr  9 16:41 undercloud_install.log
-rwxr-xr-x. 1 stack stack        270 Apr  9 16:22 undercloud-install.sh
-rw-rw-r--. 1 stack stack       1924 Apr  9 16:22 undercloud-passwords.conf
[stack@undercloud ~]$ ./overcloud-deploy.sh
+ source /home/stack/stackrc
+++ set
+++ awk '{FS="="}  /^OS_/ {print $1}'
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_AUTH_TYPE
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_AUTH_URL
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_BAREMETAL_API_VERSION
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_CLOUDNAME
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_NO_CACHE
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_PASSWORD
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_TENANT_NAME
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_USERNAME
++ NOVA_VERSION=1.1
++ export NOVA_VERSION
+++ sudo hiera admin_password
++ OS_PASSWORD=fd9a907bb7579a1c988f442ea234b3f58027bef9
++ export OS_PASSWORD
++ OS_AUTH_TYPE=password
++ export OS_AUTH_TYPE
++ OS_AUTH_URL=https://192.168.24.2:13000/v2.0
++ PYTHONWARNINGS='ignore:Certificate has no, ignore:A true SSLContext object is not available'
++ export OS_AUTH_URL
++ export PYTHONWARNINGS
++ OS_USERNAME=admin
++ OS_TENANT_NAME=admin
++ COMPUTE_API_VERSION=1.1
++ OS_BAREMETAL_API_VERSION=1.15
++ OS_NO_CACHE=True
++ OS_CLOUDNAME=undercloud
++ export OS_USERNAME
++ export OS_TENANT_NAME
++ export COMPUTE_API_VERSION
++ export OS_BAREMETAL_API_VERSION
++ export OS_NO_CACHE
++ export OS_CLOUDNAME
+ true
++ openstack hypervisor stats show -c count -f value
+ count=6
+ '[' 6 -gt 0 ']'
+ break

+ openstack overcloud deploy --templates /usr/share/openstack-tripleo-heat-templates --libvirt-type qemu \
--control-flavor oooq_control --compute-flavor oooq_compute --ceph-storage-flavor oooq_ceph \
--block-storage-flavor oooq_blockstorage --swift-storage-flavor oooq_objectstorage \
--timeout 90 -e /home/stack/cloud-names.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml \
-e /home/stack/network-environment.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml \
--validation-warnings-fatal --control-scale 3 --compute-scale 1 --ceph-storage-scale 2 \
-e /usr/share/openstack-tripleo-heat-templates/environments/storage-environment.yaml \
--ntp-server pool.ntp.org

Removing the current plan files
Uploading new plan files
Started Mistral Workflow tripleo.plan_management.v1.update_deployment_plan. Execution ID: bf169eaa-5a71-4e1a-81ee-d5c6b4c97299
Plan updated
Deploying templates in the directory /tmp/tripleoclient-Yvn9Ec/tripleo-heat-templates
Started Mistral Workflow tripleo.deployment.v1.deploy_plan. Execution ID: 0d1bd32d-1259-4587-a524-be2ec7c70913
2017-04-09 16:52:46Z [overcloud]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 16:52:46Z [overcloud.ServiceNetMap]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.ServiceNetMap]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 16:52:47Z [overcloud.PcsdPassword]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.ServiceNetMap.ServiceNetMapValue]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.RabbitCookie]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.ServiceNetMap.ServiceNetMapValue]: CREATE_COMPLETE  state changed
2017-04-09 16:52:47Z [overcloud.ServiceNetMap]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 16:52:47Z [overcloud.HeatAuthEncryptionKey]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.MysqlRootPassword]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.HorizonSecret]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.Networks]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:48Z [overcloud.PcsdPassword]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.RabbitCookie]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.HeatAuthEncryptionKey]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.MysqlRootPassword]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.Networks]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 16:52:48Z [overcloud.HorizonSecret]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.ServiceNetMap]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.Networks.ExternalNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:48Z [overcloud.DefaultPasswords]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.ManagementNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.ExternalNetwork]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 16:52:49Z [overcloud.Networks.StorageNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.ExternalNetwork.ExternalNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.NetworkExtraConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.StorageNetwork]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 16:52:49Z [overcloud.Networks.TenantNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.StorageNetwork.StorageNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.ExternalNetwork.ExternalNetwork]: CREATE_COMPLETE  state changed
. . . . .

2017-04-09 17:42:17Z [overcloud.AllNodesDeploySteps.ComputeDeployment_Step5]: CREATE_COMPLETE  state changed
2017-04-09 17:44:49Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.1]: SIGNAL_IN_PROGRESS  Signal: deployment 910dc608-9e9c-4830-8428-5de6f7984fed succeeded
2017-04-09 17:44:50Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.1]: CREATE_COMPLETE  state changed
2017-04-09 17:45:24Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.2]: SIGNAL_IN_PROGRESS  Signal: deployment 15acd20e-e6d5-4827-98f4-5b1cde721051 succeeded
2017-04-09 17:45:24Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.2]: CREATE_COMPLETE  state changed
2017-04-09 17:47:50Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.0]: SIGNAL_IN_PROGRESS  Signal: deployment 533d33c1-37f6-4014-a934-9226c44e3884 succeeded
2017-04-09 17:47:51Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.0]: CREATE_COMPLETE  state changed
2017-04-09 17:47:51Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 17:47:51Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5]: CREATE_COMPLETE  state changed
2017-04-09 17:47:51Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.BlockStoragePostConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ObjectStoragePostConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate.SwiftRingUpdateConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate.SwiftRingUpdateConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate.SwiftRingUpdate]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ComputePostConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ControllerPostConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate.SwiftRingUpdateConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.CephStoragePostConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:53Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate.SwiftRingUpdateConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:53Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate.SwiftRingUpdate]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:53Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate.SwiftRingUpdate]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ObjectStoragePostConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.BlockStoragePostConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ControllerPostConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.CephStoragePostConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ComputePostConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ObjectStorageExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:55Z [overcloud.AllNodesDeploySteps.ComputeExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:55Z [overcloud.AllNodesDeploySteps.CephStorageExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:56Z [overcloud.AllNodesDeploySteps.BlockStorageExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:56Z [overcloud.AllNodesDeploySteps.ControllerExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:58Z [overcloud.AllNodesDeploySteps.BlockStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2017-04-09 17:47:58Z [overcloud.AllNodesDeploySteps.ObjectStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2017-04-09 17:47:58Z [overcloud.AllNodesDeploySteps.CephStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.ControllerExtraConfigPost]: CREATE_COMPLETE  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.ComputeExtraConfigPost]: CREATE_COMPLETE  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.ComputePostPuppet]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.CephStoragePostPuppet]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.BlockStoragePostPuppet]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.ObjectStoragePostPuppet]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:48:00Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 17:48:00Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetMaintenanceModeConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:48:00Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetMaintenanceModeConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:48:00Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetMaintenanceModeDeployment]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:48:00Z [overcloud.AllNodesDeploySteps.CephStoragePostPuppet]: CREATE_COMPLETE  state changed
2017-04-09 17:48:01Z [overcloud.AllNodesDeploySteps.BlockStoragePostPuppet]: CREATE_COMPLETE  state changed
2017-04-09 17:48:01Z [overcloud.AllNodesDeploySteps.ObjectStoragePostPuppet]: CREATE_COMPLETE  state changed
2017-04-09 17:48:02Z [overcloud.AllNodesDeploySteps.ComputePostPuppet]: CREATE_COMPLETE  state changed
2017-04-09 17:48:08Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate.SwiftRingUpdate]: CREATE_COMPLETE  state changed
2017-04-09 17:48:08Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 17:48:08Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate]: CREATE_COMPLETE  state changed
2017-04-09 17:48:22Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetMaintenanceModeDeployment]: CREATE_COMPLETE  state changed
2017-04-09 17:48:22Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetRestart]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:48:41Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetRestart]: CREATE_COMPLETE  state changed
2017-04-09 17:48:41Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 17:48:42Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet]: CREATE_COMPLETE  state changed
2017-04-09 17:48:42Z [overcloud.AllNodesDeploySteps]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 17:48:43Z [overcloud.AllNodesDeploySteps]: CREATE_COMPLETE  state changed
2017-04-09 17:48:43Z [overcloud]: CREATE_COMPLETE  Stack CREATE completed successfully

 Stack overcloud CREATE_COMPLETE 

Overcloud Endpoint: http://10.0.0.6:5000/v2.0
Overcloud Deployed
+ status_code=0
+ openstack stack list
+ grep -q CREATE_COMPLETE
+ exit 0

stack@undercloud ~]$ date
Sun Apr  9 21:49:40 UTC 2017
[stack@undercloud ~]$ openstack server list
+-------------------------+-------------------------+--------+------------------------+----------------+
| ID                      | Name                    | Status | Networks               | Image Name     |
+-------------------------+-------------------------+--------+------------------------+----------------+
| a5bf4ad9-6fc7-4ef4-aa80 | overcloud-cephstorage-0 | ACTIVE | ctlplane=192.168.24.14 | overcloud-full |
| -e179e1224974           |                         |        |                        |                |
| d2d0cdd1-1d9a-40e1      | overcloud-controller-2  | ACTIVE | ctlplane=192.168.24.7  | overcloud-full |
| -bfac-9280725200a7      |                         |        |                        |                |
| 2d6fda68-2330-4ea7-b391 | overcloud-cephstorage-1 | ACTIVE | ctlplane=192.168.24.9  | overcloud-full |
| -e1af16bcec90           |                         |        |                        |                |
| 229f24b6-bbab-          | overcloud-controller-0  | ACTIVE | ctlplane=192.168.24.8  | overcloud-full |
| 45cc-9215-8b0852b26365  |                         |        |                        |                |
| f5f3bab8-c431-4301      | overcloud-novacompute-0 | ACTIVE | ctlplane=192.168.24.13 | overcloud-full |
| -81ac-617ea5e14f20      |                         |        |                        |                |
| f5770298-96e0-47bd-     | overcloud-controller-1  | ACTIVE | ctlplane=192.168.24.17 | overcloud-full |
| beb6-1ea00190afa5       |                         |        |                        |                |
+-------------------------+-------------------------+--------+------------------------+----------------+
[stack@undercloud ~]$ nova-manage --version
15.0.2 

[stack@undercloud ~]$ cat overcloudrc.v3
# Clear any old environment that may conflict.
for key in $( set | awk '{FS="="}  /^OS_/ {print $1}' ); do unset $key ; done
export OS_USERNAME=admin
export OS_USER_DOMAIN_NAME=Default
export OS_PROJECT_DOMAIN_NAME=Default
export NOVA_VERSION=1.1
export OS_PROJECT_NAME=admin
export OS_PASSWORD=EXcbjGf2UrrvkEpzwTEMg8ChQ
export OS_NO_CACHE=True
export COMPUTE_API_VERSION=1.1
export no_proxy=,10.0.0.6,192.168.24.12
export OS_CLOUDNAME=overcloud
export OS_AUTH_URL=http://10.0.0.6:5000/v3
export OS_IDENTITY_API_VERSION=3
export OS_AUTH_TYPE=password
export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available"
[stack@undercloud ~]$ ssh heat-admin@192.168.24.8
The authenticity of host '192.168.24.8 (192.168.24.8)' can't be established.
ECDSA key fingerprint is 84:40:b1:8b:e8:91:c9:a1:65:77:35:a6:4a:66:6e:3d.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '192.168.24.8' (ECDSA) to the list of known hosts.
[heat-admin@overcloud-controller-0 ~]$ sudo su -
[root@overcloud-controller-0 ~]# vi overcloudrc.v3
[root@overcloud-controller-0 ~]# pcs status
Cluster name: tripleo_cluster
Stack: corosync
Current DC: overcloud-controller-2 (version 1.1.15-11.el7_3.4-e174ec8) - partition with quorum
Last updated: Sun Apr  9 17:52:30 2017        Last change: Sun Apr  9 17:48:15 2017 by root via cibadmin on overcloud-controller-1

3 nodes and 19 resources configured

Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]

Full list of resources:

 Master/Slave Set: galera-master [galera]
     Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: rabbitmq-clone [rabbitmq]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Master/Slave Set: redis-master [redis]
     Masters: [ overcloud-controller-2 ]
     Slaves: [ overcloud-controller-0 overcloud-controller-1 ]
 ip-192.168.24.12    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-0
 ip-10.0.0.6    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-1
 ip-172.16.2.13    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-2
 ip-172.16.2.8    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-0
 ip-172.16.1.6    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-1
 ip-172.16.3.7    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-2
 Clone Set: haproxy-clone [haproxy]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 openstack-cinder-volume    (systemd:openstack-cinder-volume):    Started overcloud-controller-0

Failed Actions:
* galera_monitor_10000 on overcloud-controller-2 'unknown error' (1): call=9, status=complete, exitreason='local node <overcloud-controller-2> is started, but not in primary mode. Unknown state.',
    last-rc-change='Sun Apr  9 17:37:23 2017', queued=0ms, exec=0ms
* galera_monitor_10000 on overcloud-controller-1 'unknown error' (1): call=13, status=complete, exitreason='local node <overcloud-controller-1> is started, but not in primary mode. Unknown state.',
    last-rc-change='Sun Apr  9 17:37:17 2017', queued=0ms, exec=0ms

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled

*********************************************************************
Here we need run command bellow to restart resources failed to start
during deployment :
[root@overcloud-controller-0 ~]# pcs resource cleanup
Waiting for 1 replies from the CRMd. OK
*********************************************************************
[root@overcloud-controller-0 ~]# pcs status
Cluster name: tripleo_cluster
Stack: corosync
Current DC: overcloud-controller-2 (version 1.1.15-11.el7_3.4-e174ec8) - partition with quorum
Last updated: Sun Apr  9 17:53:01 2017        Last change: Sun Apr  9 17:48:15 2017 by root via cibadmin on overcloud-controller-1

3 nodes and 19 resources configured
Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Full list of resources:

 Master/Slave Set: galera-master [galera]
     Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: rabbitmq-clone [rabbitmq]
     Started: [ overcloud-controller-0 overcloud-controller-1 ]
     Stopped: [ overcloud-controller-2 ]
 Master/Slave Set: redis-master [redis]
     Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 ip-192.168.24.12    (ocf::heartbeat:IPaddr2):    Stopped
 ip-10.0.0.6    (ocf::heartbeat:IPaddr2):    Stopped
 ip-172.16.2.13    (ocf::heartbeat:IPaddr2):    Stopped
 ip-172.16.2.8    (ocf::heartbeat:IPaddr2):    Stopped
 ip-172.16.1.6    (ocf::heartbeat:IPaddr2):    Stopped
 ip-172.16.3.7    (ocf::heartbeat:IPaddr2):    Stopped
 Clone Set: haproxy-clone [haproxy]
     Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 openstack-cinder-volume    (systemd:openstack-cinder-volume):    Stopped

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled

[root@overcloud-controller-0 ~]# pcs status
Cluster name: tripleo_cluster
Stack: corosync
Current DC: overcloud-controller-2 (version 1.1.15-11.el7_3.4-e174ec8) - partition with quorum
Last updated: Sun Apr  9 17:53:18 2017        Last change: Sun Apr  9 17:48:15 2017 by root via cibadmin on overcloud-controller-1

3 nodes and 19 resources configured
Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Full list of resources:

 Master/Slave Set: galera-master [galera]
     Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: rabbitmq-clone [rabbitmq]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Master/Slave Set: redis-master [redis]
     Masters: [ overcloud-controller-2 ]
     Slaves: [ overcloud-controller-0 overcloud-controller-1 ]
 ip-192.168.24.12    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-0
 ip-10.0.0.6    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-1
 ip-172.16.2.13    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-2
 ip-172.16.2.8    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-0
 ip-172.16.1.6    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-1
 ip-172.16.3.7    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-2
 Clone Set: haproxy-clone [haproxy]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 openstack-cinder-volume    (systemd:openstack-cinder-volume):    Started overcloud-controller-0

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled

[root@overcloud-controller-0 ~]# clustercheck
HTTP/1.1 200 OK
Content-Type: text/plain
Connection: close
Content-Length: 32

Galera cluster node is synced.
[root@overcloud-controller-0 ~]# ceph status
    cluster 57122104-1d43-11e7-8de2-00bd0ae930f1
     health HEALTH_OK
     monmap e1: 3 mons at {overcloud-controller-0=172.16.1.8:6789/0,overcloud-controller-1=172.16.1.7:6789/0,overcloud-controller-2=172.16.1.13:6789/0}
            election epoch 6, quorum 0,1,2 overcloud-controller-1,overcloud-controller-0,overcloud-controller-2
     osdmap e23: 2 osds: 2 up, 2 in
            flags sortbitwise
      pgmap v112: 288 pgs, 8 pools, 0 bytes data, 0 objects
            16751 MB used, 85623 MB / 102375 MB avail
288 active+clean

*****************************************************
Resources restarted && we are ready to go *****************************************************

 [root@overcloud-controller-0 ~]# openstack flavor create --public m1.small --id 2 \
>   --ram 2000 --disk 20 --vcpus 1 --rxtx-factor 1
+----------------------------+----------+
| Field                      | Value    |
+----------------------------+----------+
| OS-FLV-DISABLED:disabled   | False    |
| OS-FLV-EXT-DATA:ephemeral  | 0        |
| disk                       | 20       |
| id                         | 2        |
| name                       | m1.small |
| os-flavor-access:is_public | True     |
| properties                 |          |
| ram                        | 2000     |
| rxtx_factor                | 1.0      |
| swap                       |          |
| vcpus                      | 1        |
+----------------------------+----------+

[root@overcloud-controller-0 ~]# openstack keypair create oskey040917 > oskey040917.pem

[root@overcloud-controller-0 ~]# ceph status
    cluster 57122104-1d43-11e7-8de2-00bd0ae930f1
     health HEALTH_OK
     monmap e1: 3 mons at {overcloud-controller-0=172.16.1.8:6789/0,overcloud-controller-1=172.16.1.7:6789/0,overcloud-controller-2=172.16.1.13:6789/0}
            election epoch 6, quorum 0,1,2 overcloud-controller-1,overcloud-controller-0,overcloud-controller-2
     osdmap e28: 2 osds: 2 up, 2 in
            flags sortbitwise
      pgmap v261: 288 pgs, 8 pools, 1350 MB data, 352 objects
            19458 MB used, 82917 MB / 102375 MB avail
                 288 active+clean

***************************************************************************** [root@overcloud-controller-0 ~]# nova-manage --version 15.0.2 *****************************************************************************

[root@overcloud-controller-0 ~]# openstack  network create ext-net --external \
> --provider-physical-network datacentre  --provider-network-type flat
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2017-04-09T18:13:52Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 30f79296-42ef-4952-9f2a-2ab3363bcdb4 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| mtu                       | 1500                                 |
| name                      | ext-net                              |
| port_security_enabled     | True                                 |
| project_id                | 7963ea533a2a4f03a93bf4fae907a520     |
| provider:network_type     | flat                                 |
| provider:physical_network | datacentre                           |
| provider:segmentation_id  | None                                 |
| qos_policy_id             | None                                 |
| revision_number           | 4                                    |
| router:external           | External                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| updated_at                | 2017-04-09T18:13:52Z                 |
+---------------------------+--------------------------------------+

[root@overcloud-controller-0 ~]# openstack subnet create ext-subnet --network ext-net \
>  --subnet-range 192.168.24.0/24  --allocation-pool start=192.168.24.100,end=192.168.24.120 \
>  --no-dhcp --gateway 192.168.24.1
+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| allocation_pools  | 192.168.24.100-192.168.24.120        |
| cidr              | 192.168.24.0/24                      |
| created_at        | 2017-04-09T18:14:17Z                 |
| description       |                                      |
| dns_nameservers   |                                      |
| enable_dhcp       | False                                |
| gateway_ip        | 192.168.24.1                         |
| host_routes       |                                      |
| id                | 17e5b5c1-2d3e-45a0-ac34-1721c55b6ccb |
| ip_version        | 4                                    |
| ipv6_address_mode | None                                 |
| ipv6_ra_mode      | None                                 |
| name              | ext-subnet                           |
| network_id        | 30f79296-42ef-4952-9f2a-2ab3363bcdb4 |
| project_id        | 7963ea533a2a4f03a93bf4fae907a520     |
| revision_number   | 2                                    |
| segment_id        | None                                 |
| service_types     |                                      |
| subnetpool_id     | None                                 |
| updated_at        | 2017-04-09T18:14:17Z                 |
+-------------------+--------------------------------------+

[root@overcloud-controller-0 ~]# openstack router create Router1
+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| admin_state_up          | UP                                   |
| availability_zone_hints |                                      |
| availability_zones      |                                      |
| created_at              | 2017-04-09T18:16:04Z                 |
| description             |                                      |
| distributed             | False                                |
| external_gateway_info   | None                                 |
| flavor_id               | None                                 |
| ha                      | True                                 |
| id                      | 453fe78c-a2e8-4792-8f60-b0db666a961a |
| name                    | Router1                              |
| project_id              | 7963ea533a2a4f03a93bf4fae907a520     |
| revision_number         | None                                 |
| routes                  |                                      |
| status                  | ACTIVE                               |
| updated_at              | 2017-04-09T18:16:04Z                 |
+-------------------------+--------------------------------------+
[root@overcloud-controller-0 ~]# openstack router set Router1 --external-gateway ext-net

[root@overcloud-controller-0 ~]# openstack network create internal
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2017-04-09T18:17:11Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | e8919bc9-594e-4a5e-90b0-35cbb9f1ca89 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | None                                 |
| mtu                       | 1450                                 |
| name                      | internal                             |
| port_security_enabled     | True                                 |
| project_id                | 7963ea533a2a4f03a93bf4fae907a520     |
| provider:network_type     | vxlan                                |
| provider:physical_network | None                                 |
| provider:segmentation_id  | 53                                   |
| qos_policy_id             | None                                 |
| revision_number           | 3                                    |
| router:external           | Internal                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| updated_at                | 2017-04-09T18:17:11Z                 |
+---------------------------+--------------------------------------+

[root@overcloud-controller-0 ~]# openstack subnet create sub-internal --network internal \
>  --subnet-range 50.0.0.0/24  --dns-nameserver  83.221.202.254
+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| allocation_pools  | 50.0.0.2-50.0.0.254                  |
| cidr              | 50.0.0.0/24                          |
| created_at        | 2017-04-09T18:17:44Z                 |
| description       |                                      |
| dns_nameservers   | 83.221.202.254                       |
| enable_dhcp       | True                                 |
| gateway_ip        | 50.0.0.1                             |
| host_routes       |                                      |
| id                | ac3e0b85-5764-4102-ad42-9bc4d05707f7 |
| ip_version        | 4                                    |
| ipv6_address_mode | None                                 |
| ipv6_ra_mode      | None                                 |
| name              | sub-internal                         |
| network_id        | e8919bc9-594e-4a5e-90b0-35cbb9f1ca89 |
| project_id        | 7963ea533a2a4f03a93bf4fae907a520     |
| revision_number   | 2                                    |
| segment_id        | None                                 |
| service_types     |                                      |
| subnetpool_id     | None                                 |
| updated_at        | 2017-04-09T18:17:44Z                 |
+-------------------+--------------------------------------+

[root@overcloud-controller-0 ~]# openstack router add subnet Router1 ac3e0b85-5764-4102-ad42-9bc4d05707f7

[root@overcloud-controller-0 ~]# nova secgroup-list
+--------------------------------------+---------+------------------------+
| Id                                   | Name    | Description            |
+--------------------------------------+---------+------------------------+
| 47208a13-eb04-483c-9337-73b2114a534a | default | Default security group |
+--------------------------------------+---------+------------------------+

[root@overcloud-controller-0 ~]# openstack security group rule create 47208a13-eb04-483c-9337-73b2114a534a \
>  --protocol tcp --dst-port 22:22 --remote-ip 0.0.0.0/0

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| created_at        | 2017-04-09T18:19:45Z                 |
| description       |                                      |
| direction         | ingress                              |
| ether_type        | IPv4                                 |
| id                | ef8a7170-6548-4d73-bd2c-89c45c10697e |
| name              | None                                 |
| port_range_max    | 22                                   |
| port_range_min    | 22                                   |
| project_id        | 7963ea533a2a4f03a93bf4fae907a520     |
| protocol          | tcp                                  |
| remote_group_id   | None                                 |
| remote_ip_prefix  | 0.0.0.0/0                            |
| revision_number   | 1                                    |
| security_group_id | 47208a13-eb04-483c-9337-73b2114a534a |
| updated_at        | 2017-04-09T18:19:45Z                 |
+-------------------+--------------------------------------+
[root@overcloud-controller-0 ~]# cat over*
# Clear any old environment that may conflict.
for key in $( set | awk '{FS="="}  /^OS_/ {print $1}' ); do unset $key ; done
export OS_USERNAME=admin
export OS_USER_DOMAIN_NAME=Default
export OS_PROJECT_DOMAIN_NAME=Default
export NOVA_VERSION=1.1
export OS_PROJECT_NAME=admin
export OS_PASSWORD=EXcbjGf2UrrvkEpzwTEMg8ChQ
export OS_NO_CACHE=True
export COMPUTE_API_VERSION=1.1
export no_proxy=,10.0.0.6,192.168.24.12
export OS_CLOUDNAME=overcloud
export OS_AUTH_URL=http://10.0.0.6:5000/v3
export OS_IDENTITY_API_VERSION=3
export OS_AUTH_TYPE=password
export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available"

[root@overcloud-controller-0 ~]# ls -l
total 317400
-rw-------. 1 root root      6913 Mar  1 02:45 anaconda-ks.cfg
-rw-------. 1 root root      6580 Mar  1 02:45 original-ks.cfg
-rw-r--r--. 1 root root      1680 Apr  9 18:13 oskey040917.pem
-rw-r--r--. 1 root root       651 Apr  9 17:52 overcloudrc.v3
-rw-r--r--. 1 root root 324993024 Mar 31 15:33 xenial-server-cloudimg-amd64-disk1.img
[root@overcloud-controller-0 ~]# cat oskey040917.pem
-----BEGIN RSA PRIVATE KEY-----
MIIEpAIBAAKCAQEAxWZSGsBBgkncO0YrrVsuTm7HyjSrscwbNzOfGk9Qfl/Jhooq
y/4HhhedjUwqzqlFx/2WJlp3YEGekKL2/Hlf6Q/kUAHU0ZxP4e1jz/eq0ko+U6qh
KDvlsCMMYTEOYkXD9hOxCcd/n7mWrOgVg2WBx8xYBV16f/yiAcryfLEgjaQdDOnm
jhALQu8/Q0tGGzHUwMAvjz5FSxUwSaLer/yzJYJbSThOi5QktnD5LOaQo5vXVTZj
kwiOBCD/Mvt4GAa1zfQgQMxFZwx3E5WhCKzr3RXvePeUmLnpqJciWFKtdrvknn7z
MfW/OELpnMNqUOXW8lblXdjAGx27WTTSd9YcuQIDAQABAoIBAB/eCNswtmKmMduP
1HVEBxG6aJ6IKj+lx679sm246DG+nPYPUCFmfSh0n4a0CSUbxpwmoBrI+ASeE08e
P+k6XvVtD1qrMQQ1y9+ZR0fHn9gbDDzNiv7HzKjGv7ThCoVq5dvQCgCeKEhM2bpI
LVDtDiqHHp6fHKuUyUKo1MS0g6DZ2KY8jR/R/7DqJHE1CC6zostau6J70pTPc7l6
fYucF54lQ8PJuYtqfYmy+2EoH4Vm4Gz9UuRY9VhMDm+fdOt95HO/sVHYmrwMnXMt
bRRrp/rG153JJNIn3eFYwuwQRG+uaSr8wUvFrb78WV84xfnMjj9L0ZxD0mevn0ex
Tj+GbBECgYEA+lF3Sex5jZj7UBegoLzrsCaIElOK7Vkdom9jy9HuRz9kC0Flrdbe
s79fuU/7QZBtSlfKua5ybF640mk2rZDVZR3Uf5QvR9WLNybomKgirOAXeMtSeWQ1
cqt57NB2iKw/YPjewtXHcqGGQIEc/ui/L0vnSrp43zT1XCObd+wT2W8CgYEAyeFb
4evYH7Xo9u3hlkapmmp3b9v98Kimh+0Q7iJx1vy+vPyPO3CR/o8bMT6ven7AEsB/
5RXzfUW/gcY9FV6SMyDgTbDsDQnTe1s7sIwTer5OD5Xp9IHuDtE0uMDKOeRCa/9M
2VYbrfCZzw8EFG4v8fxVEAm9aAZWqSu2cH8QSFcCgYEAl6JJ9Mn/SDtn4biuYTCQ
RYDR5OgevHDDduarOYjOIvLPk9Hl2kzTU2eWgRdmSO1Ih0RvVdPLFMK8ixmZOcMG
wd40H6SQj59YWeyD8hXIC5kkHtRr/YUqq3Acx8vwQhK1wfSAXN5Ll7EpNmIAQpqT
Vf9Q+P/EwNG/4DThtN+ZlpkCgYBgT9VoCP5I0p5b/80ZxohvlM96XDfgMnWQb3ce
ROyOpnHQ86TZtLDSAy/z5HYPOJ0l1RSvFDPf1gCxRwQpR770CYE5T2iuJ7vvI+1s
IsfATT4sjVbaQYpzIzfF1KQlzlIp99iP71axOxIGCKHnpVHWXo2uYxcro6qAdsxJ
CzWXbQKBgQDu+hsa9l5RZkRa9a0Me9kia/5CkDV3ow/MlFaA6gyM+M0xE48XpjA+
39X3L7E8EVPqlR9VYDhYnAu7BVI6X1itUYtFT0nUX7dwx3RMZBWC3q7nvhK6p6aZ
620D7gUf8ouLMREvrU1wQaVYuWXfFQPF86w4UjGefntu017kyBIf9g==
-----END RSA PRIVATE KEY-----

[root@overcloud-controller-0 ~]# 


***********************************
Workstation && Shuttle Startup
**********************************

[boris@fedora24wks ~]$ sshuttle -e "ssh -F $HOME/.quickstart/ssh.config.ansible" -r undercloud  -v 10.0.0.0/24  192.168.24.0/24 
Starting sshuttle proxy.
[local sudo] Password: 
firewall manager: Starting firewall with Python version 3.5.3
firewall manager: ready method name nat.
IPv6 enabled: False
UDP enabled: False
DNS enabled: False
TCP redirector listening on ('127.0.0.1', 12300).
Starting client with Python version 3.5.3
c : connecting to server...
Warning: Permanently added '192.168.0.74' (ECDSA) to the list of known hosts.
Warning: Permanently added 'undercloud' (ECDSA) to the list of known hosts.
Starting server with Python version 2.7.5
 s: latency control setting = True
 s: available routes:
 s:   2/10.0.0.0/24
 s:   2/172.17.0.0/16
 s:   2/192.168.23.0/24
 s:   2/192.168.24.0/24
c : Connected.
firewall manager: setting up.
>> iptables -t nat -N sshuttle-12300
>> iptables -t nat -F sshuttle-12300
>> iptables -t nat -I OUTPUT 1 -j sshuttle-12300
>> iptables -t nat -I PREROUTING 1 -j sshuttle-12300
>> iptables -t nat -A sshuttle-12300 -j RETURN --dest 127.0.0.1/32 -p tcp
>> iptables -t nat -A sshuttle-12300 -j REDIRECT --dest 10.0.0.0/24 -p tcp --to-ports 12300 -m ttl ! --ttl 42
>> iptables -t nat -A sshuttle-12300 -j REDIRECT --dest 192.168.24.0/24 -p tcp --to-ports 12300 -m ttl ! --ttl 42
c : Accept TCP: 192.168.0.15:55816 -> 10.0.0.6:80.
c : Accept TCP: 192.168.0.15:55820 -> 10.0.0.6:80.
c : Accept TCP: 192.168.0.15:55822 -> 10.0.0.6:80.
c : Accept TCP: 192.168.0.15:55824 -> 10.0.0.6:80.
c : Accept TCP: 192.168.0.15:55826 -> 10.0.0.6:80.
c : Accept TCP: 192.168.0.15:55828 -> 10.0.0.6:80.
c : warning: closed channel 2 got cmd=TCP_STOP_SENDING len=0
 s: SW'unknown':Mux#2: deleting (11 remain)
 s: SW#7:10.0.0.6:80: deleting (10 remain)
c : SW#9:192.168.0.15:55820: deleting (11 remain)
c : SW'unknown':Mux#2: deleting (10 remain)
 s: SW'unknown':Mux#6: deleting (9 remain)
 s: SW#11:10.0.0.6:80: deleting (8 remain)
 s: SW'unknown':Mux#1: deleting (7 remain)

 

  

   Top report on VIRTHOST