Tuesday, July 11, 2017

Attempt to verify patch for "Instance sanitization in InstanceMetadata causes metadata_for_config_drive to fail" via Tripleo QS Master(Pike) HA/CEPH overcloud deployment

Originally issue with obtaining meta-data by Cloud VM was raised up for Pike in
Launchpad Bug https://bugs.launchpad.net/nova/+bug/1694666

However,final patch is provided by https://bugs.launchpad.net/nova/+bug/1702150
After deployment overcloud following patches might be applied on each controller
Apply (1) from https://bugs.launchpad.net/nova/+bug/1694666
Apply (2) from https://bugs.launchpad.net/nova/+bug/1702150
# cd /usr/lib/python2.7/site-packages/nova/api/metadata Then apply patches (1) https://git.openstack.org/cgit/openstack/nova/patch/?id=2fee972bde4a04d398d32aa6c8b6d27819db697b (2) https://review.openstack.org/gitweb?p=openstack/nova.git;a=patch;h=004d5ed1f3e35d43dc5726aa80d31429b931bd45 to base.py
PLAY RECAP *********************************************************************
192.168.0.74               : ok=112  changed=48   unreachable=0    failed=0   
localhost                  : ok=15   changed=8    unreachable=0    failed=0   
undercloud                 : ok=49   changed=36   unreachable=0    failed=0   

Tuesday 11 July 2017  14:29:50 +0300 (0:00:01.241)       0:34:01.462 ********** 
=============================================================================== 
undercloud-deploy : Install the undercloud --------------------------- 1115.32s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/install-undercloud.yml:15 
overcloud-prep-images : Prepare the overcloud images for deploy ------- 169.45s
/home/boris/.quickstart/usr/local/share/ansible/roles/overcloud-prep-images/tasks/overcloud-prep-images.yml:1 
setup/undercloud : Perform selinux relabel on undercloud image -------- 115.02s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:153 
setup/undercloud : Upload undercloud volume to storage pool ------------ 42.39s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:255 
fetch-images : Get qcow2 image from cache ------------------------------ 34.65s
/home/boris/.quickstart/tripleo-quickstart/roles/fetch-images/tasks/fetch.yml:167 
overcloud-prep-flavors : Prepare the scripts for overcloud flavors ----- 32.99s
/home/boris/.quickstart/usr/local/share/ansible/roles/overcloud-prep-flavors/tasks/overcloud-prep-flavors.yml:1 
setup/undercloud : Copy instackenv.json to appliance ------------------- 31.39s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:77 
undercloud-deploy : restart the httpd service -------------------------- 22.76s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/tripleo-ui.yml:78 
undercloud-deploy : Create the Virtual BMCs ---------------------------- 14.95s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/configure-vbmc.yml:61 
parts/libvirt : Install packages for libvirt --------------------------- 13.75s
/home/boris/.quickstart/tripleo-quickstart/roles/parts/libvirt/tasks/main.yml:17 
setup/undercloud : iptables -------------------------------------------- 12.59s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:346 
setup/undercloud : Get undercloud vm ip address ------------------------ 12.57s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:301 
undercloud-deploy : Install VirtualBMC package ------------------------- 10.29s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/configure-vbmc.yml:3 
setup/overcloud : Create overcloud vm storage --------------------------- 7.42s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:24 
undercloud-deploy : Start the Virtual BMCs ------------------------------ 7.23s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/configure-vbmc.yml:93 
setup/overcloud : Attach additional blockdevices to overcloud objectstorage VMs --- 6.96s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:52 
setup/overcloud : Define overcloud vms ---------------------------------- 6.92s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:34 
setup/undercloud : Inject undercloud ssh public key to appliance -------- 6.84s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:101 
setup/overcloud : Create additional blockdevice for objectstorage nodes --- 6.69s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:44 
overcloud-prep-network : Prepare the network-isolation required networks on the undercloud --- 6.63s
/home/boris/.quickstart/usr/local/share/ansible/roles/overcloud-prep-network/tasks/overcloud-prep-network.yml:1 
+ set +x
##################################
Virtual Environment Setup Complete
##################################

Access the undercloud by:

    ssh -F /home/boris/.quickstart/ssh.config.ansible undercloud

Follow the documentation in the link below to complete your deployment.

    http://ow.ly/c44w304begR

##################################
Virtual Environment Setup Complete
##################################
[boris@fedora24wks tripleo-quickstart]$ ssh -F /home/boris/.quickstart/ssh.config.ansible undercloud
Warning: Permanently added '192.168.0.74' (ECDSA) to the list of known hosts.
Warning: Permanently added 'undercloud' (ECDSA) to the list of known hosts.
Last login: Tue Jul 11 11:29:48 2017 from gateway
[stack@undercloud ~]$ . stackrc
(undercloud) [stack@undercloud ~]$ ironic node-list
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| UUID                                 | Name      | Instance UUID | Power State | Provisioning State | Maintenance |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| aa1d0353-25df-4492-8698-cfa44c4b64de | control-0 | None          | power off   | available          | False       |
| 0f3b2412-6641-4a85-a71a-5b07b726a9b4 | control-1 | None          | power off   | available          | False       |
| 3925bc1b-3a50-45d9-abc3-0afd6d3ab685 | control-2 | None          | power off   | available          | False       |
| 66512fbc-80f5-4ae6-a307-1aef0a37bbdd | compute-0 | None          | power off   | available          | False       |
| b221307e-b3fc-43aa-b3f7-a024e2ef1e9d | ceph-0    | None          | power off   | available          | False       |
| 57f7d3e6-6089-4f08-941d-087644a74353 | ceph-1    | None          | power off   | available          | False       |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
(undercloud) [stack@undercloud ~]$ sudo vi  /usr/share/openstack-tripleo-heat-templates/puppet/services/ceph-mon.yaml
(undercloud) [stack@undercloud ~]$ ls -l
total 1696008
-rw-rw-r--. 1 stack stack        357 Jul 11 11:29 cloud-names.yaml
-rwxr-xr-x. 1 stack stack        141 Jul 11 11:25 containers-default-parameters.yaml
-rw-------. 1 stack stack        544 Jul 11 11:04 hieradata-overrides-classic-undercloud.yaml
-rw-------. 1 stack stack        458 Jul 11 11:04 hieradata-overrides-t-h-t-undercloud.yaml
-rw-rw-r--. 1 stack stack       2581 Jul 11 11:00 instackenv.json
-rw-rw-r--. 1 stack stack  354833458 Jul 10 12:06 ironic-python-agent.initramfs
-rw-rw-r--. 1 stack stack    5397008 Jul 10 12:06 ironic-python-agent.kernel
-rw-r--r--. 1 stack stack        474 Jul 11 11:25 network-environment.yaml
-rwxr-xr-x. 1 stack stack        973 Jul 11 11:29 overcloud-deploy-post.sh
-rwxr-xr-x. 1 stack stack       3400 Jul 11 11:29 overcloud-deploy.sh
-rw-rw-r--. 1 stack stack   46943823 Jul 10 12:07 overcloud-full.initrd
-rw-rw-r--. 1 stack stack 1323696128 Jul 10 12:07 overcloud-full.qcow2
-rw-rw-r--. 1 stack stack    5397008 Jul 10 12:07 overcloud-full.vmlinuz
-rwxr-xr-x. 1 stack stack        903 Jul 11 11:25 overcloud-prep-containers.sh
-rw-rw-r--. 1 stack stack      10812 Jul 11 11:29 overcloud_prep_flavors.log
-rwxr-xr-x. 1 stack stack       3672 Jul 11 11:28 overcloud-prep-flavors.sh
-rw-rw-r--. 1 stack stack       9556 Jul 11 11:28 overcloud_prep_images.log
-rwxr-xr-x. 1 stack stack        618 Jul 11 11:25 overcloud-prep-images.sh
-rw-rw-r--. 1 stack stack       3075 Jul 11 11:29 overcloud_prep_network.log
-rwxr-xr-x. 1 stack stack        863 Jul 11 11:29 overcloud-prep-network.sh
-rw-------. 1 stack stack       1222 Jul 11 11:22 stackrc
-rw-------. 1 stack stack       8568 Jul 11 11:04 undercloud.conf
-rw-rw-r--. 1 stack stack     335591 Jul 11 11:23 undercloud_install.log
-rwxr-xr-x. 1 stack stack        270 Jul 11 11:04 undercloud-install.sh
-rw-------. 1 stack stack       1994 Jul 11 11:04 undercloud-passwords.conf
(undercloud) [stack@undercloud ~]$ ./overcloud-deploy.sh
+ source /home/stack/stackrc
+++ set
+++ awk '{FS="="}  /^OS_/ {print $1}'
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_AUTH_TYPE
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_AUTH_URL
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_BAREMETAL_API_VERSION
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_CLOUDNAME
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_IDENTITY_API_VERSION
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_NO_CACHE
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_PASSWORD
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_PROJECT_DOMAIN_NAME
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_PROJECT_NAME
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_USERNAME
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_USER_DOMAIN_NAME
++ NOVA_VERSION=1.1
++ export NOVA_VERSION
+++ sudo hiera admin_password
++ OS_PASSWORD=7a18c4a2fb68128e9929ef859f215ddeb9c4a9da
++ export OS_PASSWORD
++ OS_AUTH_TYPE=password
++ export OS_AUTH_TYPE
++ OS_AUTH_URL=https://192.168.24.2:13000/
++ PYTHONWARNINGS='ignore:Certificate has no, ignore:A true SSLContext object is not available'
++ export OS_AUTH_URL
++ export PYTHONWARNINGS
++ OS_USERNAME=admin
++ OS_PROJECT_NAME=admin
++ COMPUTE_API_VERSION=1.1
++ IRONIC_API_VERSION=1.29
++ OS_BAREMETAL_API_VERSION=1.29
++ OS_NO_CACHE=True
++ OS_CLOUDNAME=undercloud
++ export OS_USERNAME
++ export OS_PROJECT_NAME
++ export COMPUTE_API_VERSION
++ export IRONIC_API_VERSION
++ export OS_BAREMETAL_API_VERSION
++ export OS_NO_CACHE
++ export OS_CLOUDNAME
++ OS_IDENTITY_API_VERSION=3
++ export OS_IDENTITY_API_VERSION
++ OS_PROJECT_DOMAIN_NAME=Default
++ export OS_PROJECT_DOMAIN_NAME
++ OS_USER_DOMAIN_NAME=Default
++ export OS_USER_DOMAIN_NAME
++ '[' -z 1 ']'
+ true
++ openstack hypervisor stats show -c count -f value
+ count=6
+ '[' 6 -gt 0 ']'
+ break
+ openstack overcloud deploy --templates /usr/share/openstack-tripleo-heat-templates --libvirt-type qemu --control-flavor oooq_control --compute-flavor oooq_compute --ceph-storage-flavor oooq_ceph --block-storage-flavor oooq_blockstorage --swift-storage-flavor oooq_objectstorage --timeout 90 -e /home/stack/cloud-names.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml -e /home/stack/network-environment.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/disable-telemetry.yaml --validation-warnings-fatal --control-scale 3 --compute-scale 1 --ceph-storage-scale 2 -e /usr/share/openstack-tripleo-heat-templates/environments/storage-environment.yaml --ntp-server pool.ntp.org
Started Mistral Workflow tripleo.validations.v1.check_pre_deployment_validations. Execution ID: d395ef70-eadc-4095-bc74-1776d37d5250
Waiting for messages on queue '210df344-f360-4278-a857-616a8ed95ef5' with no timeout.
Removing the current plan files
Uploading new plan files
Started Mistral Workflow tripleo.plan_management.v1.update_deployment_plan. Execution ID: e45572ff-a602-4e12-be10-370878183a61
Plan updated.
Plan updated
Deploying templates in the directory /tmp/tripleoclient-LnNBpJ/tripleo-heat-templates
Started Mistral Workflow tripleo.deployment.v1.deploy_plan. Execution ID: e2b14118-4a3a-4f28-a2f5-28e1d9e2141d
2017-07-11 11:34:24Z [overcloud]: CREATE_IN_PROGRESS  Stack CREATE started
2017-07-11 11:34:24Z [overcloud.DeploymentServerBlacklistDict]: CREATE_IN_PROGRESS  state changed
2017-07-11 11:34:24Z [overcloud.HeatAuthEncryptionKey]: CREATE_IN_PROGRESS  state changed
2017-07-11 11:34:24Z [overcloud.RabbitCookie]: CREATE_IN_PROGRESS  state changed
2017-07-11 11:34:24Z [overcloud.Networks]: CREATE_IN_PROGRESS  state changed
2017-07-11 11:34:25Z [overcloud.HorizonSecret]: CREATE_IN_PROGRESS  state changed
2017-07-11 11:34:25Z [overcloud.PcsdPassword]: CREATE_IN_PROGRESS  state changed
2017-07-11 11:34:25Z [overcloud.Networks]: CREATE_IN_PROGRESS  Stack CREATE started
2017-07-11 11:34:25Z [overcloud.Networks.InternalNetwork]: CREATE_IN_PROGRESS  state changed
2017-07-11 11:34:25Z [overcloud.MysqlRootPassword]: CREATE_IN_PROGRESS  state changed
2017-07-11 11:34:26Z [overcloud.ServiceNetMap]: CREATE_IN_PROGRESS  state changed

. . . . . . . . . . . . . . . .


2017-07-11 12:33:19Z [overcloud.AllNodesDeploySteps.ControllerPostConfig]: CREATE_IN_PROGRESS  Stack CREATE started
2017-07-11 12:33:20Z [overcloud.AllNodesDeploySteps.ObjectStoragePostConfig]: CREATE_IN_PROGRESS  state changed
2017-07-11 12:33:20Z [overcloud.AllNodesDeploySteps.ControllerPostConfig.ControllerPostPuppetMaintenanceModeConfig]: CREATE_IN_PROGRESS  state changed
2017-07-11 12:33:20Z [overcloud.AllNodesDeploySteps.ControllerPostConfig.ControllerPostPuppetMaintenanceModeConfig]: CREATE_COMPLETE  state changed
2017-07-11 12:33:20Z [overcloud.AllNodesDeploySteps.ControllerPostConfig.ControllerPostPuppetMaintenanceModeDeployment]: CREATE_IN_PROGRESS  state changed
2017-07-11 12:33:21Z [overcloud.AllNodesDeploySteps.ComputePostConfig]: CREATE_COMPLETE  state changed
2017-07-11 12:33:21Z [overcloud.AllNodesDeploySteps.CephStoragePostConfig]: CREATE_COMPLETE  state changed
2017-07-11 12:33:21Z [overcloud.AllNodesDeploySteps.BlockStoragePostConfig]: CREATE_COMPLETE  state changed
2017-07-11 12:33:21Z [overcloud.AllNodesDeploySteps.ObjectStoragePostConfig]: CREATE_COMPLETE  state changed
2017-07-11 12:33:46Z [overcloud.AllNodesDeploySteps.ControllerPostConfig.ControllerPostPuppetMaintenanceModeDeployment]: CREATE_COMPLETE  state changed
2017-07-11 12:33:47Z [overcloud.AllNodesDeploySteps.ControllerPostConfig.ControllerPostPuppetRestart]: CREATE_IN_PROGRESS  state changed
2017-07-11 12:34:22Z [overcloud.AllNodesDeploySteps.ControllerPostConfig.ControllerPostPuppetRestart]: CREATE_COMPLETE  state changed
2017-07-11 12:34:22Z [overcloud.AllNodesDeploySteps.ControllerPostConfig]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-07-11 12:34:22Z [overcloud.AllNodesDeploySteps.ControllerPostConfig]: CREATE_COMPLETE  state changed
2017-07-11 12:34:22Z [overcloud.AllNodesDeploySteps]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-07-11 12:34:23Z [overcloud.AllNodesDeploySteps]: CREATE_COMPLETE  state changed
2017-07-11 12:34:23Z [overcloud]: CREATE_COMPLETE  Stack CREATE completed successfully

 Stack overcloud CREATE_COMPLETE 

Overcloud Endpoint: http://10.0.0.5:5000/v2.0
Overcloud Deployed
+ status_code=0
+ openstack stack list
+ grep -q overcloud
+ openstack stack list
+ grep -Eq '(CREATE|UPDATE)_COMPLETE'
+ exit 0
(undercloud) [stack@undercloud ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
| ID                                   | Name                    | Status | Task State | Power State | Networks               |
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
| cc9036e2-8a46-49bf-b9e1-09d61c44aa37 | overcloud-cephstorage-0 | ACTIVE | -          | Running     | ctlplane=192.168.24.16 |
| 98e82176-2cba-48de-96f9-4f587e2f8a55 | overcloud-cephstorage-1 | ACTIVE | -          | Running     | ctlplane=192.168.24.15 |
| e17331ba-040e-4a28-ae25-66f51ec99ed8 | overcloud-controller-0  | ACTIVE | -          | Running     | ctlplane=192.168.24.14 |
| ead071ae-9451-49fb-a0a1-a7dbde922779 | overcloud-controller-1  | ACTIVE | -          | Running     | ctlplane=192.168.24.11 |
| 50bf7d6f-2373-4e8d-8087-4dbd74baa021 | overcloud-controller-2  | ACTIVE | -          | Running     | ctlplane=192.168.24.17 |
| adcd4f5b-baaa-45e5-b859-eeaa6923f0af | overcloud-novacompute-0 | ACTIVE | -          | Running     | ctlplane=192.168.24.13 |
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
(undercloud) [stack@undercloud ~]$ cat overcloudrc.v3
# Clear any old environment that may conflict.
for key in $( set | awk '{FS="="}  /^OS_/ {print $1}' ); do unset $key ; done
export OS_USERNAME=admin
export OS_USER_DOMAIN_NAME=Default
export OS_PROJECT_DOMAIN_NAME=Default
export OS_BAREMETAL_API_VERSION=1.29
export NOVA_VERSION=1.1
export OS_PROJECT_NAME=admin
export OS_PASSWORD=6kzG79DVKHsWMg7U3U3F7xweE
export OS_NO_CACHE=True
export COMPUTE_API_VERSION=1.1
export no_proxy=,10.0.0.5,192.168.24.12
export OS_VOLUME_API_VERSION=3
export OS_CLOUDNAME=overcloud
export OS_AUTH_URL=http://10.0.0.5:5000/v3
export IRONIC_API_VERSION=1.29
export OS_IDENTITY_API_VERSION=3
export OS_IMAGE_API_VERSION=2
export OS_AUTH_TYPE=password
export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available"

# Add OS_CLOUDNAME to PS1
if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then
    export PS1=${PS1:-""}
    export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1
    export CLOUDPROMPT_ENABLED=1
fi
(undercloud) [stack@undercloud ~]$ ssh heat-admin@192.168.24.14
The authenticity of host '192.168.24.14 (192.168.24.14)' can't be established.
ECDSA key fingerprint is 97:fb:d3:b9:04:26:1b:b3:d7:5b:56:2b:d7:5d:5f:c2.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '192.168.24.14' (ECDSA) to the list of known hosts.
[heat-admin@overcloud-controller-0 ~]$ sudo su -
[root@overcloud-controller-0 ~]# vi overcloudrc.v3
[root@overcloud-controller-0 ~]# . overcloudrc.v3
(overcloud) [root@overcloud-controller-0 ~]# pcs status
Cluster name: tripleo_cluster
Stack: corosync
Current DC: overcloud-controller-1 (version 1.1.16-10.el7-94ff4df) - partition with quorum
Last updated: Tue Jul 11 12:36:52 2017
Last change: Tue Jul 11 12:33:29 2017 by root via cibadmin on overcloud-controller-1

3 nodes configured
19 resources configured

Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]

Full list of resources:

 Master/Slave Set: galera-master [galera]
     Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: rabbitmq-clone [rabbitmq]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Master/Slave Set: redis-master [redis]
     Masters: [ overcloud-controller-0 ]
     Slaves: [ overcloud-controller-1 overcloud-controller-2 ]
 ip-192.168.24.12    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-0
 ip-10.0.0.5    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-1
 ip-172.16.2.5    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-2
 ip-172.16.2.8    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-0
 ip-172.16.1.6    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-1
 ip-172.16.3.11    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-2
 Clone Set: haproxy-clone [haproxy]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 openstack-cinder-volume    (systemd:openstack-cinder-volume):    Started overcloud-controller-0

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled
(overcloud) [root@overcloud-controller-0 ~]# ceph status
    cluster 4a2589b4-662b-11e7-9fc7-00224052ec9f
     health HEALTH_OK
     monmap e2: 3 mons at {overcloud-controller-0=172.16.1.18:6789/0,overcloud-controller-1=172.16.1.12:6789/0,overcloud-controller-2=172.16.1.4:6789/0}
            election epoch 6, quorum 0,1,2 overcloud-controller-2,overcloud-controller-1,overcloud-controller-0
     osdmap e22: 2 osds: 2 up, 2 in
            flags sortbitwise,require_jewel_osds
      pgmap v132: 288 pgs, 8 pools, 0 bytes data, 0 objects
            16846 MB used, 85528 MB / 102375 MB avail
                 288 active+clean
(overcloud) [root@overcloud-controller-0 ~]# openstack flavor create --public m1.small --id 2 \
>   --ram 2000 --disk 20 --vcpus 1 --rxtx-factor 1
+----------------------------+----------+
| Field                      | Value    |
+----------------------------+----------+
| OS-FLV-DISABLED:disabled   | False    |
| OS-FLV-EXT-DATA:ephemeral  | 0        |
| disk                       | 20       |
| id                         | 2        |
| name                       | m1.small |
| os-flavor-access:is_public | True     |
| properties                 |          |
| ram                        | 2000     |
| rxtx_factor                | 1.0      |
| swap                       |          |
| vcpus                      | 1        |
+----------------------------+----------+
(overcloud) [root@overcloud-controller-0 ~]#  openstack keypair create oskey071117 > oskey071117.pem
(overcloud) [root@overcloud-controller-0 ~]# openstack  network create ext-net --external \
> --provider-physical-network datacentre  --provider-network-type flat
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2017-07-11T12:38:43Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 926470f1-1bde-4ffc-b951-1f141fb66f59 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1500                                 |
| name                      | ext-net                              |
| port_security_enabled     | True                                 |
| project_id                | b675aef6131d46ba98307128458c83b1     |
| provider:network_type     | flat                                 |
| provider:physical_network | datacentre                           |
| provider:segmentation_id  | None                                 |
| qos_policy_id             | None                                 |
| revision_number           | 3                                    |
| router:external           | External                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      | []                                   |
| updated_at                | 2017-07-11T12:38:43Z                 |
+---------------------------+--------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack subnet create ext-subnet --network ext-net \
>  --subnet-range 192.168.24.0/24  --allocation-pool start=192.168.24.100,end=192.168.24.120 \
>  --no-dhcp --gateway 192.168.24.1
+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| allocation_pools        | 192.168.24.100-192.168.24.120        |
| cidr                    | 192.168.24.0/24                      |
| created_at              | 2017-07-11T12:39:27Z                 |
| description             |                                      |
| dns_nameservers         |                                      |
| enable_dhcp             | False                                |
| gateway_ip              | 192.168.24.1                         |
| host_routes             |                                      |
| id                      | 95a7b7a7-b20b-40e8-9dac-c1d8a787ba6f |
| ip_version              | 4                                    |
| ipv6_address_mode       | None                                 |
| ipv6_ra_mode            | None                                 |
| name                    | ext-subnet                           |
| network_id              | 926470f1-1bde-4ffc-b951-1f141fb66f59 |
| project_id              | b675aef6131d46ba98307128458c83b1     |
| revision_number         | 0                                    |
| segment_id              | None                                 |
| service_types           |                                      |
| subnetpool_id           | None                                 |
| tags                    | []                                   |
| updated_at              | 2017-07-11T12:39:27Z                 |
| use_default_subnet_pool | None                                 |
+-------------------------+--------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack router create RouterDSA
+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| admin_state_up          | UP                                   |
| availability_zone_hints |                                      |
| availability_zones      |                                      |
| created_at              | 2017-07-11T12:40:05Z                 |
| description             |                                      |
| distributed             | False                                |
| external_gateway_info   | None                                 |
| flavor_id               | None                                 |
| ha                      | True                                 |
| id                      | ddc67ea4-3e19-4c18-8455-d4d1a03dfe6c |
| name                    | RouterDSA                            |
| project_id              | b675aef6131d46ba98307128458c83b1     |
| revision_number         | None                                 |
| routes                  |                                      |
| status                  | ACTIVE                               |
| tags                    | []                                   |
| updated_at              | 2017-07-11T12:40:05Z                 |
+-------------------------+--------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack router set RouterDSA --external-gateway ext-net
(overcloud) [root@overcloud-controller-0 ~]# openstack network create internal01
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2017-07-11T12:41:00Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 5ef05e1f-1e7e-44e4-80c8-e977d17d9bd0 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| is_vlan_transparent       | None                                 |
| mtu                       | 1450                                 |
| name                      | internal01                           |
| port_security_enabled     | True                                 |
| project_id                | b675aef6131d46ba98307128458c83b1     |
| provider:network_type     | vxlan                                |
| provider:physical_network | None                                 |
| provider:segmentation_id  | 81                                   |
| qos_policy_id             | None                                 |
| revision_number           | 2                                    |
| router:external           | Internal                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| tags                      | []                                   |
| updated_at                | 2017-07-11T12:41:00Z                 |
+---------------------------+--------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack subnet create sub-internal01 --network internal01 \
>  --subnet-range 50.0.0.0/24  --dns-nameserver  83.221.202.254
+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| allocation_pools        | 50.0.0.2-50.0.0.254                  |
| cidr                    | 50.0.0.0/24                          |
| created_at              | 2017-07-11T12:41:23Z                 |
| description             |                                      |
| dns_nameservers         | 83.221.202.254                       |
| enable_dhcp             | True                                 |
| gateway_ip              | 50.0.0.1                             |
| host_routes             |                                      |
| id                      | e4d20967-c0b4-4bd6-9286-7a7779eda103 |
| ip_version              | 4                                    |
| ipv6_address_mode       | None                                 |
| ipv6_ra_mode            | None                                 |
| name                    | sub-internal01                       |
| network_id              | 5ef05e1f-1e7e-44e4-80c8-e977d17d9bd0 |
| project_id              | b675aef6131d46ba98307128458c83b1     |
| revision_number         | 0                                    |
| segment_id              | None                                 |
| service_types           |                                      |
| subnetpool_id           | None                                 |
| tags                    | []                                   |
| updated_at              | 2017-07-11T12:41:23Z                 |
| use_default_subnet_pool | None                                 |
+-------------------------+--------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack router add subnet RouterDSA  e4d20967-c0b4-4bd6-9286-7a7779eda103
(overcloud) [root@overcloud-controller-0 ~]# cat over*
# Clear any old environment that may conflict.
for key in $( set | awk '{FS="="}  /^OS_/ {print $1}' ); do unset $key ; done
export OS_USERNAME=admin
export OS_USER_DOMAIN_NAME=Default
export OS_PROJECT_DOMAIN_NAME=Default
export OS_BAREMETAL_API_VERSION=1.29
export NOVA_VERSION=1.1
export OS_PROJECT_NAME=admin
export OS_PASSWORD=6kzG79DVKHsWMg7U3U3F7xweE
export OS_NO_CACHE=True
export COMPUTE_API_VERSION=1.1
export no_proxy=,10.0.0.5,192.168.24.12
export OS_VOLUME_API_VERSION=3
export OS_CLOUDNAME=overcloud
export OS_AUTH_URL=http://10.0.0.5:5000/v3
export IRONIC_API_VERSION=1.29
export OS_IDENTITY_API_VERSION=3
export OS_IMAGE_API_VERSION=2
export OS_AUTH_TYPE=password
export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available"

# Add OS_CLOUDNAME to PS1
if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then
    export PS1=${PS1:-""}
    export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1
    export CLOUDPROMPT_ENABLED=1
fi
Ignore interface Status DOWN" to Internal subnet and proceed as usual with launching Cloud VM
********************************* 
On each Controller Node :-
********************************* 
Apply (1) from https://bugs.launchpad.net/nova/+bug/1694666
Apply (2) from https://bugs.launchpad.net/nova/+bug/1702150  

# cd /usr/lib/python2.7/site-packages/nova/api/metadata
Then aplly patches
(1)
https://git.openstack.org/cgit/openstack/nova/patch/?id=2fee972bde4a04d398d32aa6c8b6d27819db697b
(2)
https://review.openstack.org/gitweb?p=openstack/nova.git;a=patch;h=004d5ed1f3e35d43dc5726aa80d31429b931bd45
to base.py
****************************************************************************
After patching  the critical piece of code base.py should look like
Details here https://bugs.launchpad.net/nova/+bug/1694666
****************************************************************************

class InstanceMetadata(object):
    """Instance metadata."""

    def __init__(self, instance, address=None, content=None, extra_md=None,
                 network_info=None, vd_driver=None, network_metadata=None,
                 request_context=None):
        """Creation of this object should basically cover all time consuming
        collection.  Methods after that should not cause time delays due to
        network operations or lengthy cpu operations.
        The user should then get a single instance and make multiple method
        calls on it.

        """

        if not content:
            content = []
        ctxt = context.get_admin_context()
        instance.ec2_ids
        instance.keypairs
        instance.device_metadata
        instance = objects.Instance.obj_from_primitive(
             instance.obj_to_primitive())


# python -m py_compile base.py
********************************************************************************
Following service is supposed to be restarted after recompiling base.py
on each Controller Node
********************************************************************************
# systemctl restart openstack-nova-api.service 

(overcloud) [root@overcloud-controller-0 ~]# cd /usr/lib/python2.7/site-packages/nova/api/metadata
(overcloud) [root@overcloud-controller-0 metadata]# cp base.py /root
(overcloud) [root@overcloud-controller-0 metadata]# vi base.py
(overcloud) [root@overcloud-controller-0 metadata]# python -m py_compile base.py
(overcloud) [root@overcloud-controller-0 metadata]# cd
(overcloud) [root@overcloud-controller-0 ~]# systemctl restart openstack-nova-api.service 
(overcloud) [root@overcloud-controller-0 ~]# systemctl status openstack-nova-api.service 
● openstack-nova-api.service - OpenStack Nova API Server
   Loaded: loaded (/usr/lib/systemd/system/openstack-nova-api.service; enabled; vendor preset: disabled)
   Active: active (running) since Tue 2017-07-11 12:48:04 UTC; 15s ago
 Main PID: 149307 (nova-api)
   CGroup: /system.slice/openstack-nova-api.service
           ├─149307 /usr/bin/python2 /usr/bin/nova-api
           └─149474 /usr/bin/python2 /usr/bin/nova-api

Jul 11 12:48:01 overcloud-controller-0 systemd[1]: Starting OpenStack Nova API Server...
Jul 11 12:48:04 overcloud-controller-0 sudo[149407]:     nova : TTY=unknown ; PWD=/ ; USER=r...-c
Jul 11 12:48:04 overcloud-controller-0 sudo[149442]:     nova : TTY=unknown ; PWD=/ ; USER=r...-c
Jul 11 12:48:04 overcloud-controller-0 systemd[1]: Started OpenStack Nova API Server.
Hint: Some lines were ellipsized, use -l to show in full.
(overcloud) [root@overcloud-controller-0 ~]# logout
[heat-admin@overcloud-controller-0 ~]$ logout
Connection to 192.168.24.14 closed.
(undercloud) [stack@undercloud ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
| ID                                   | Name                    | Status | Task State | Power State | Networks               |
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
| cc9036e2-8a46-49bf-b9e1-09d61c44aa37 | overcloud-cephstorage-0 | ACTIVE | -          | Running     | ctlplane=192.168.24.16 |
| 98e82176-2cba-48de-96f9-4f587e2f8a55 | overcloud-cephstorage-1 | ACTIVE | -          | Running     | ctlplane=192.168.24.15 |
| e17331ba-040e-4a28-ae25-66f51ec99ed8 | overcloud-controller-0  | ACTIVE | -          | Running     | ctlplane=192.168.24.14 |
| ead071ae-9451-49fb-a0a1-a7dbde922779 | overcloud-controller-1  | ACTIVE | -          | Running     | ctlplane=192.168.24.11 |
| 50bf7d6f-2373-4e8d-8087-4dbd74baa021 | overcloud-controller-2  | ACTIVE | -          | Running     | ctlplane=192.168.24.17 |
| adcd4f5b-baaa-45e5-b859-eeaa6923f0af | overcloud-novacompute-0 | ACTIVE | -          | Running     | ctlplane=192.168.24.13 |
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
(undercloud) [stack@undercloud ~]$ ssh heat-admin@192.168.24.11
The authenticity of host '192.168.24.11 (192.168.24.11)' can't be established.
ECDSA key fingerprint is 9f:72:b3:55:64:c3:65:ae:af:a1:97:05:50:ca:7f:77.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '192.168.24.11' (ECDSA) to the list of known hosts.
[heat-admin@overcloud-controller-1 ~]$ sudo su -
[root@overcloud-controller-1 ~]# cd /usr/lib/python2.7/site-packages/nova/api/metadata
[root@overcloud-controller-1 metadata]# cp base.py /root
[root@overcloud-controller-1 metadata]# vi base.py
[root@overcloud-controller-1 metadata]# python -m py_compile base.py
[root@overcloud-controller-1 metadata]# cd
[root@overcloud-controller-1 ~]# systemctl restart openstack-nova-api.service
[root@overcloud-controller-1 ~]# systemctl status openstack-nova-api.service
● openstack-nova-api.service - OpenStack Nova API Server
   Loaded: loaded (/usr/lib/systemd/system/openstack-nova-api.service; enabled; vendor preset: disabled)
   Active: active (running) since Tue 2017-07-11 12:51:53 UTC; 11s ago
 Main PID: 158118 (nova-api)
   CGroup: /system.slice/openstack-nova-api.service
           ├─158118 /usr/bin/python2 /usr/bin/nova-api
           └─158297 /usr/bin/python2 /usr/bin/nova-api

Jul 11 12:51:49 overcloud-controller-1 systemd[1]: Starting OpenStack Nova API Server...
Jul 11 12:51:52 overcloud-controller-1 sudo[158280]:     nova : TTY=unknown ; PWD=/ ; USER=r...-c
Jul 11 12:51:53 overcloud-controller-1 sudo[158283]:     nova : TTY=unknown ; PWD=/ ; USER=r...-c
Jul 11 12:51:53 overcloud-controller-1 systemd[1]: Started OpenStack Nova API Server.
Hint: Some lines were ellipsized, use -l to show in full.
[root@overcloud-controller-1 ~]# logout
[heat-admin@overcloud-controller-1 ~]$ logout
Connection to 192.168.24.11 closed.
(undercloud) [stack@undercloud ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
| ID                                   | Name                    | Status | Task State | Power State | Networks               |
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
| cc9036e2-8a46-49bf-b9e1-09d61c44aa37 | overcloud-cephstorage-0 | ACTIVE | -          | Running     | ctlplane=192.168.24.16 |
| 98e82176-2cba-48de-96f9-4f587e2f8a55 | overcloud-cephstorage-1 | ACTIVE | -          | Running     | ctlplane=192.168.24.15 |
| e17331ba-040e-4a28-ae25-66f51ec99ed8 | overcloud-controller-0  | ACTIVE | -          | Running     | ctlplane=192.168.24.14 |
| ead071ae-9451-49fb-a0a1-a7dbde922779 | overcloud-controller-1  | ACTIVE | -          | Running     | ctlplane=192.168.24.11 |
| 50bf7d6f-2373-4e8d-8087-4dbd74baa021 | overcloud-controller-2  | ACTIVE | -          | Running     | ctlplane=192.168.24.17 |
| adcd4f5b-baaa-45e5-b859-eeaa6923f0af | overcloud-novacompute-0 | ACTIVE | -          | Running     | ctlplane=192.168.24.13 |
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
(undercloud) [stack@undercloud ~]$ ssh heat-admin@192.168.24.17
The authenticity of host '192.168.24.17 (192.168.24.17)' can't be established.
ECDSA key fingerprint is 06:f6:3d:8f:25:56:07:a0:ba:8a:bf:dd:5a:00:f2:77.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '192.168.24.17' (ECDSA) to the list of known hosts.
[heat-admin@overcloud-controller-2 ~]$ sudo su -
[root@overcloud-controller-2 ~]# cd /usr/lib/python2.7/site-packages/nova/api/metadata
[root@overcloud-controller-2 metadata]# cp base.py /root
[root@overcloud-controller-2 metadata]# vi base.py
[root@overcloud-controller-2 metadata]# python -m py_compile base.py
[root@overcloud-controller-2 metadata]# cd
[root@overcloud-controller-2 ~]# systemctl restart openstack-nova-api.service
[root@overcloud-controller-2 ~]# systemctl status openstack-nova-api.service
● openstack-nova-api.service - OpenStack Nova API Server
   Loaded: loaded (/usr/lib/systemd/system/openstack-nova-api.service; enabled; vendor preset: disabled)
   Active: active (running) since Tue 2017-07-11 12:55:13 UTC; 11s ago
 Main PID: 187500 (nova-api)
   CGroup: /system.slice/openstack-nova-api.service
           ├─187500 /usr/bin/python2 /usr/bin/nova-api
           └─187845 /usr/bin/python2 /usr/bin/nova-api

Jul 11 12:55:09 overcloud-controller-2 systemd[1]: Starting OpenStack Nova API Server...
Jul 11 12:55:12 overcloud-controller-2 sudo[187814]:     nova : TTY=unknown ; PWD=/ ; USER=r...-c
Jul 11 12:55:12 overcloud-controller-2 sudo[187824]:     nova : TTY=unknown ; PWD=/ ; USER=r...-c
Jul 11 12:55:13 overcloud-controller-2 systemd[1]: Started OpenStack Nova API Server.
Hint: Some lines were ellipsized, use -l to show in full.
[root@overcloud-controller-2 ~]# logout
[heat-admin@overcloud-controller-2 ~]$ logout
Connection to 192.168.24.17 closed.
(undercloud) [stack@undercloud ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
| ID                                   | Name                    | Status | Task State | Power State | Networks               |
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
| cc9036e2-8a46-49bf-b9e1-09d61c44aa37 | overcloud-cephstorage-0 | ACTIVE | -          | Running     | ctlplane=192.168.24.16 |
| 98e82176-2cba-48de-96f9-4f587e2f8a55 | overcloud-cephstorage-1 | ACTIVE | -          | Running     | ctlplane=192.168.24.15 |
| e17331ba-040e-4a28-ae25-66f51ec99ed8 | overcloud-controller-0  | ACTIVE | -          | Running     | ctlplane=192.168.24.14 |
| ead071ae-9451-49fb-a0a1-a7dbde922779 | overcloud-controller-1  | ACTIVE | -          | Running     | ctlplane=192.168.24.11 |
| 50bf7d6f-2373-4e8d-8087-4dbd74baa021 | overcloud-controller-2  | ACTIVE | -          | Running     | ctlplane=192.168.24.17 |
| adcd4f5b-baaa-45e5-b859-eeaa6923f0af | overcloud-novacompute-0 | ACTIVE | -          | Running     | ctlplane=192.168.24.13 |
+--------------------------------------+-------------------------+--------+------------+-------------+------------------------+
(undercloud) [stack@undercloud ~]$ ssh heat-admin@192.168.24.14
Last login: Tue Jul 11 12:36:02 2017 from 192.168.24.1
[heat-admin@overcloud-controller-0 ~]$ sudo su -
Last login: Tue Jul 11 12:36:08 UTC 2017 on pts/0
[root@overcloud-controller-0 ~]# . overcloudrc.v3
(overcloud) [root@overcloud-controller-0 ~]# yum install wget -y
Loaded plugins: fastestmirror, priorities
base                                                                      | 3.6 kB  00:00:00     
centos-ceph-jewel                                                         | 2.9 kB  00:00:00     
centos7-rt-for-tuned-only                                                 | 2.9 kB  00:00:00     
delorean                                                                  | 3.0 kB  00:00:00     
delorean-pike-testing                                                     | 2.9 kB  00:00:00     
extras                                                                    | 3.4 kB  00:00:00     
rdo-qemu-ev                                                               | 2.9 kB  00:00:00     
updates                                                                   | 3.4 kB  00:00:00     
Loading mirror speeds from cached hostfile
 * base: mirror.corbina.net
 * extras: mirror.corbina.net
 * updates: mirror.corbina.net
22 packages excluded due to repository priority protections
Resolving Dependencies
--> Running transaction check
---> Package wget.x86_64 0:1.14-13.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=================================================================================================
 Package             Arch                  Version                     Repository           Size
=================================================================================================
Installing:
 wget                x86_64                1.14-13.el7                 base                546 k

Transaction Summary
=================================================================================================
Install  1 Package

Total download size: 546 k
Installed size: 2.0 M
Downloading packages:
wget-1.14-13.el7.x86_64.rpm                                               | 546 kB  00:00:00     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : wget-1.14-13.el7.x86_64                                                       1/1 
  Verifying  : wget-1.14-13.el7.x86_64                                                       1/1 

Installed:
  wget.x86_64 0:1.14-13.el7                                                                      

Complete!
(overcloud) [root@overcloud-controller-0 ~]# wget https://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1706.qcow2.xz
--2017-07-11 12:57:33--  https://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud-1706.qcow2.xz
Resolving cloud.centos.org (cloud.centos.org)... 162.252.80.138, 2001:bc8:242c::10
Connecting to cloud.centos.org (cloud.centos.org)|162.252.80.138|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 459219880 (438M) [application/x-xz]
Saving to: ‘CentOS-7-x86_64-GenericCloud-1706.qcow2.xz’

100%[=======================================================>] 459,219,880 1.75MB/s   in 5m 48s 

2017-07-11 13:03:22 (1.26 MB/s) - ‘CentOS-7-x86_64-GenericCloud-1706.qcow2.xz’ saved [459219880/459219880]

(overcloud) [root@overcloud-controller-0 ~]# xz -d *.xz
(overcloud) [root@overcloud-controller-0 ~]# ls -l
total 1352512
-rw-------. 1 root root       6913 Jul  3 14:54 anaconda-ks.cfg
-rw-r--r--. 1 root root      28860 Jul 11 12:45 base.py
-rw-r--r--. 1 root root 1384972288 Jul  3 15:57 CentOS-7-x86_64-GenericCloud-1706.qcow2
-rw-------. 1 root root       6580 Jul  3 14:54 original-ks.cfg
-rw-r--r--. 1 root root       1680 Jul 11 12:38 oskey071117.pem
-rw-r--r--. 1 root root        970 Jul 11 12:36 overcloudrc.v3
(overcloud) [root@overcloud-controller-0 ~]#  openstack image create --disk-format qcow2 --container-format bare \
>  --public --file ./CentOS-7-x86_64-GenericCloud-1706.qcow2  CentOS1706image01
+------------------+----------------------------------------------------------------------------+
| Field            | Value                                                                      |
+------------------+----------------------------------------------------------------------------+
| checksum         | c03e55c22b6fb2127e7de391b488d8d6                                           |
| container_format | bare                                                                       |
| created_at       | 2017-07-11T13:05:07Z                                                       |
| disk_format      | qcow2                                                                      |
| file             | /v2/images/3fd6a55b-cb9c-4bb9-bd6c-cfd230e87fc9/file                       |
| id               | 3fd6a55b-cb9c-4bb9-bd6c-cfd230e87fc9                                       |
| min_disk         | 0                                                                          |
| min_ram          | 0                                                                          |
| name             | CentOS1706image01                                                          |
| owner            | b675aef6131d46ba98307128458c83b1                                           |
| properties       | direct_url='rbd://4a2589b4-662b-11e7-9fc7-00224052ec9f/images/3fd6a55b-    |
|                  | cb9c-4bb9-bd6c-cfd230e87fc9/snap', locations='[{u'url': u'rbd://4a2589b4   |
|                  | -662b-11e7-9fc7-00224052ec9f/images/3fd6a55b-cb9c-4bb9-bd6c-               |
|                  | cfd230e87fc9/snap', u'metadata': {}}]'                                     |
| protected        | False                                                                      |
| schema           | /v2/schemas/image                                                          |
| size             | 1384972288                                                                 |
| status           | active                                                                     |
| tags             |                                                                            |
| updated_at       | 2017-07-11T13:06:18Z                                                       |
| virtual_size     | None                                                                       |
| visibility       | public                                                                     |
+------------------+----------------------------------------------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack volume create --image 3fd6a55b-cb9c-4bb9-bd6c-cfd230e87fc9 \
>    --size 12 --availability-zone nova CentOS1706Volume01
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| attachments         | []                                   |
| availability_zone   | nova                                 |
| bootable            | false                                |
| consistencygroup_id | None                                 |
| created_at          | 2017-07-11T13:07:14.141219           |
| description         | None                                 |
| encrypted           | False                                |
| id                  | 685acd22-d066-4ad0-8a57-6685e33f6335 |
| migration_status    | None                                 |
| multiattach         | False                                |
| name                | CentOS1706Volume01                   |
| properties          |                                      |
| replication_status  | None                                 |
| size                | 12                                   |
| snapshot_id         | None                                 |
| source_volid        | None                                 |
| status              | creating                             |
| type                | None                                 |
| updated_at          | None                                 |
| user_id             | c81001d24d0848ddbab0d50d23a98901     |
+---------------------+--------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# cinder list
+--------------------------------------+-------------+--------------------+------+-------------+----------+-------------+
| ID                                   | Status      | Name               | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-------------+--------------------+------+-------------+----------+-------------+
| 685acd22-d066-4ad0-8a57-6685e33f6335 | downloading | CentOS1706Volume01 | 12   | -           | false    |             |
+--------------------------------------+-------------+--------------------+------+-------------+----------+-------------+
(overcloud) [root@overcloud-controller-0 ~]# cinder list
ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-26ba0361-5bca-48b6-b6e3-ad14da61e66b)
(overcloud) [root@overcloud-controller-0 ~]# cinder list
+--------------------------------------+-------------+--------------------+------+-------------+----------+-------------+
| ID                                   | Status      | Name               | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-------------+--------------------+------+-------------+----------+-------------+
| 685acd22-d066-4ad0-8a57-6685e33f6335 | downloading | CentOS1706Volume01 | 12   | -           | false    |             |
+--------------------------------------+-------------+--------------------+------+-------------+----------+-------------+
(overcloud) [root@overcloud-controller-0 ~]# cinder list
+--------------------------------------+-------------+--------------------+------+-------------+----------+-------------+
| ID                                   | Status      | Name               | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-------------+--------------------+------+-------------+----------+-------------+
| 685acd22-d066-4ad0-8a57-6685e33f6335 | downloading | CentOS1706Volume01 | 12   | -           | false    |             |
+--------------------------------------+-------------+--------------------+------+-------------+----------+-------------+
Right after launching Cloud VM internal interface would have status UP a kind of this picture
(overcloud) [root@overcloud-controller-0 ~]# openstack floating ip create ext-net +---------------------+--------------------------------------+ | Field               | Value                                | +---------------------+--------------------------------------+ | created_at          | 2017-07-11T13:17:44Z                 | | description         |                                      | | fixed_ip_address    | None                                 | | floating_ip_address | 192.168.24.107                       | | floating_network_id | 926470f1-1bde-4ffc-b951-1f141fb66f59 | | id                  | 1a73e872-ca72-48c1-bada-34014d167336 | | name                | 192.168.24.107                       | | port_id             | None                                 | | project_id          | b675aef6131d46ba98307128458c83b1     | | revision_number     | 0                                    | | router_id           | None                                 | | status              | DOWN                                 | | updated_at          | 2017-07-11T13:17:44Z                 | +---------------------+--------------------------------------+
 (overcloud) [root@overcloud-controller-0 ~]# nova list
+--------------------------------------+------------------+--------+------------+-------------+---------------------+
| ID                                   | Name             | Status | Task State | Power State | Networks            |
+--------------------------------------+------------------+--------+------------+-------------+---------------------+
| d59848b3-b74e-4463-b321-a909fe827464 | centos1706devs01 | ACTIVE | -          | Running     | internal01=50.0.0.7 |
+--------------------------------------+------------------+--------+------------+-------------+---------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack server add floating ip centos1706devs01 192.168.24.107
(overcloud) [root@overcloud-controller-0 ~]# nova list
+--------------------------------------+------------------+--------+------------+-------------+-------------------------------------+
| ID                                   | Name             | Status | Task State | Power State | Networks                            |
+--------------------------------------+------------------+--------+------------+-------------+-------------------------------------+
| d59848b3-b74e-4463-b321-a909fe827464 | centos1706devs01 | ACTIVE | -          | Running     | internal01=50.0.0.7, 192.168.24.107 |
+--------------------------------------+------------------+--------+------------+-------------+-------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# ls -l
total 1352512
-rw-------. 1 root root       6913 Jul  3 14:54 anaconda-ks.cfg
-rw-r--r--. 1 root root      28860 Jul 11 12:45 base.py
-rw-r--r--. 1 root root 1384972288 Jul  3 15:57 CentOS-7-x86_64-GenericCloud-1706.qcow2
-rw-------. 1 root root       6580 Jul  3 14:54 original-ks.cfg
-rw-r--r--. 1 root root       1680 Jul 11 12:38 oskey071117.pem
-rw-r--r--. 1 root root        970 Jul 11 12:36 overcloudrc.v3

(overcloud) [root@overcloud-controller-0 ~]# nova list
+--------------------------------------+------------------+--------+------------+-------------+-------------------------------------+
| ID                                   | Name             | Status | Task State | Power State | Networks                            |
+--------------------------------------+------------------+--------+------------+-------------+-------------------------------------+
| d59848b3-b74e-4463-b321-a909fe827464 | centos1706devs01 | ACTIVE | -          | Running     | internal01=50.0.0.7, 192.168.24.107 |
+--------------------------------------+------------------+--------+------------+-------------+-------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# nova stop centos1706devs01
Request to stop server centos1706devs01 has been accepted.
(overcloud) [root@overcloud-controller-0 ~]# nova list
+--------------------------------------+------------------+---------+------------+-------------+-------------------------------------+
| ID                                   | Name             | Status  | Task State | Power State | Networks                            |
+--------------------------------------+------------------+---------+------------+-------------+-------------------------------------+
| d59848b3-b74e-4463-b321-a909fe827464 | centos1706devs01 | SHUTOFF | -          | Shutdown    | internal01=50.0.0.7, 192.168.24.107 |
+--------------------------------------+------------------+---------+------------+-------------+-------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# nova start centos1706devs01
Request to start server centos1706devs01 has been accepted.
(overcloud) [root@overcloud-controller-0 ~]# (overcloud) [root@overcloud-controller-0 ~]# nova list
+--------------------------------------+------------------+--------+------------+-------------+-------------------------------------+
| ID                                   | Name             | Status | Task State | Power State | Networks                            |
+--------------------------------------+------------------+--------+------------+-------------+-------------------------------------+
| d59848b3-b74e-4463-b321-a909fe827464 | centos1706devs01 | ACTIVE | -          | Running     | internal01=50.0.0.7, 192.168.24.107 |
+--------------------------------------+------------------+--------+------------+-------------+-------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack console log show centos1706devs01 | tail -25
[   13.149687] Netfilter messages via NETLINK v0.30.
[   13.160629] ip_set: protocol 6

CentOS Linux 7 (Core)
Kernel 3.10.0-514.26.1.el7.x86_64 on an x86_64

centos1706devs01 login: [   19.195037] cloud-init[864]: Cloud-init v. 0.7.5 running 'init' at Tue, 11 Jul 2017 13:33:58 +0000. Up 19.11 seconds.
[   19.247423] cloud-init[864]: ci-info: +++++++++++++++++++++++++Net device info+++++++++++++++++++++++++
[   19.252409] cloud-init[864]: ci-info: +--------+------+-----------+---------------+-------------------+
[   19.256960] cloud-init[864]: ci-info: | Device |  Up  |  Address  |      Mask     |     Hw-Address    |
[   19.274847] cloud-init[864]: ci-info: +--------+------+-----------+---------------+-------------------+
[   19.279535] cloud-init[864]: ci-info: |  lo:   | True | 127.0.0.1 |   255.0.0.0   |         .         |
[   19.298946] cloud-init[864]: ci-info: | eth0:  | True |  50.0.0.7 | 255.255.255.0 | fa:16:3e:1a:4e:94 |
[   19.304601] cloud-init[864]: ci-info: +--------+------+-----------+---------------+-------------------+
[   19.316939] cloud-init[864]: ci-info: +++++++++++++++++++++++++++++++++Route info+++++++++++++++++++++++++++++++++
[   19.322398] cloud-init[864]: ci-info: +-------+-----------------+----------+-----------------+-----------+-------+
[   19.346854] cloud-init[864]: ci-info: | Route |   Destination   | Gateway  |     Genmask     | Interface | Flags |
[   19.353001] cloud-init[864]: ci-info: +-------+-----------------+----------+-----------------+-----------+-------+
[   19.361904] cloud-init[864]: ci-info: |   0   |     0.0.0.0     | 50.0.0.1 |     0.0.0.0     |    eth0   |   UG  |
[   19.368236] cloud-init[864]: ci-info: |   1   |     50.0.0.0    | 0.0.0.0  |  255.255.255.0  |    eth0   |   U   |
[   19.392177] cloud-init[864]: ci-info: |   2   | 169.254.169.254 | 50.0.0.1 | 255.255.255.255 |    eth0   |  UGH  |
[   19.398507] cloud-init[864]: ci-info: +-------+-----------------+----------+-----------------+-----------+-------+
[   23.224409] cloud-init[2131]: Cloud-init v. 0.7.5 running 'modules:config' at Tue, 11 Jul 2017 13:34:02 +0000. Up 23.16 seconds.
[   23.481831] cloud-init[2137]: Cloud-init v. 0.7.5 running 'modules:final' at Tue, 11 Jul 2017 13:34:02 +0000. Up 23.43 seconds.
[   23.508420] cloud-init[2137]: Cloud-init v. 0.7.5 finished at Tue, 11 Jul 2017 13:34:02 +0000. Datasource DataSourceOpenStack [net,ver=2].  Up 23.49 seconds