Sunday, April 9, 2017

TripleO QuickStart Ocata branch Deployment with feature sets and nodes configuration (topology) separated

Quoting updated README.rst
In previous versions of triple-quickstart a config file 
was used to determine not only the features that would 
be enabled in tripleo and openstack but also the number of nodes 
to be used. For instance "config/general_config/ha.yml" would
configure pacemaker and ensure three controller nodes 
were provisioned.This typeof configuration is now deprecated 
but will still work through the Queens release.

The feature and node configuration have been seperated 
into two distinct configuration files to allow users 
to explicity select the configuration known as
"feature sets" and the nodes to be provisioned.  
The feature set configuration can be found under 
tripleo-quickstart/config/general_config/ 
and the node configuration can be found under 
tripleo-quickstart/config/nodes/ 
 
In general,Ocata overcloud deployment is more memory consuming then 
Newton. Minimal memory requirements highlighted bellow. 
Also minor trobleshooting step was undertaken several times
right after overcloud deployment. 
Command `pcs resource cleanup` was issued after detecting resources 
failed to start after original deployment completed.
The problem above would be gone in case when VIRTHOST (48GB) would allow
to allocate 8192 MB for each PCS Cluster's Controller. Sshuttle command 
line was also modified to provide access to control plane and 
external network from workstation at a time.
So create under config/nodes 3ctlr_1comp_2ceph.yml file - deployment topology 


[boris@fedora24wks nodes]$ cat 3ctlr_1comp_2ceph.yml
##########################################################
# Deploy an HA openstack environment. 32 GB VIRTHOST
##########################################################
control_memory: 7000
compute_memory: 6500

undercloud_memory: 8192

# Giving the undercloud additional CPUs can greatly improve heat's
# performance (and result in a shorter deploy time).
undercloud_vcpu: 4

# Since HA has more machines, we set the cpu for controllers and
# compute nodes to 1
default_vcpu: 1
compute_vcpu: 2

# This enables TLS for the undercloud which will also make haproxy bind to the
# configured public-vip and admin-vip.
undercloud_generate_service_certificate: True

# Create three controller nodes and one compute node.
overcloud_nodes:
  - name: control_0
    flavor: control
    virtualbmc_port: 6230

  - name: control_1
    flavor: control
    virtualbmc_port: 6231

  - name: control_2
    flavor: control
    virtualbmc_port: 6232

  - name: compute_0
    flavor: compute
    virtualbmc_port: 6233

  - name: ceph_0
    flavor: ceph
    virtualbmc_port: 6234

  - name: ceph_1
    flavor: ceph
    virtualbmc_port: 6235


# Tell tripleo about our environment.
topology: >-
  --control-scale 3
  --compute-scale 1
  --ceph-storage-scale 2
  -e {{overcloud_templates_path}}/environments/storage-environment.yaml


[boris@fedora24wks tripleo-quickstart]$ ssh root@$VIRTHOST uname -a
Linux Server73CentOS.localdomain 3.10.0-514.10.2.el7.x86_64 #1 SMP Fri Mar 3 00:04:05 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

[boris@fedora24wks tripleo-quickstart]$ bash quickstart.sh -R ocata \
--config config/general_config/pacemaker.yml \
--nodes config/nodes/3ctlr_1comp_2ceph.yml $VIRTHOST

New python executable in /home/boris/.quickstart/bin/python2
Also creating executable in /home/boris/.quickstart/bin/python
Installing setuptools, pip, wheel...done.
Requirement already up-to-date: pip in /home/boris/.quickstart/lib/python2.7/site-packages
Cloning tripleo-quickstart repository...
Cloning into '/home/boris/.quickstart/tripleo-quickstart'...
remote: Counting objects: 6985, done.
remote: Compressing objects: 100% (51/51), done.
remote: Total 6985 (delta 22), reused 2 (delta 2), pack-reused 6931
Receiving objects: 100% (6985/6985), 1.07 MiB | 1.08 MiB/s, done.
Resolving deltas: 100% (3683/3683), done.
Checking connectivity... done.
Fetching origin
~/.quickstart/tripleo-quickstart ~/.quickstart/tripleo-quickstart

Installed /home/boris/.quickstart/.eggs/pbr-2.0.0-py2.7.egg
[pbr] Generating ChangeLog
running install
running build
running install_data
creating /home/boris/.quickstart/usr
creating /home/boris/.quickstart/usr/local
creating /home/boris/.quickstart/usr/local/share
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown[boris@fedora24wks tripleo-quickstart]$ ssh root@$VIRTHOST uname -a
Linux Server73CentOS.localdomain 3.10.0-514.10.2.el7.x86_64 #1 SMP Fri Mar 3 00:04:05 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
[boris@fedora24wks tripleo-quickstart]$ bash quickstart.sh -R ocata --config config/general_config/pacemaker.yml --nodes config/nodes/3ctlr_1comp_2ceph.yml  $VIRTHOST
New python executable in /home/boris/.quickstart/bin/python2
Also creating executable in /home/boris/.quickstart/bin/python
Installing setuptools, pip, wheel...done.
Requirement already up-to-date: pip in /home/boris/.quickstart/lib/python2.7/site-packages
Cloning tripleo-quickstart repository...
Cloning into '/home/boris/.quickstart/tripleo-quickstart'...
remote: Counting objects: 6985, done.
remote: Compressing objects: 100% (51/51), done.
remote: Total 6985 (delta 22), reused 2 (delta 2), pack-reused 6931
Receiving objects: 100% (6985/6985), 1.07 MiB | 1.08 MiB/s, done.
Resolving deltas: 100% (3683/3683), done.
Checking connectivity... done.
Fetching origin
~/.quickstart/tripleo-quickstart ~/.quickstart/tripleo-quickstart

Installed /home/boris/.quickstart/.eggs/pbr-2.0.0-py2.7.egg
[pbr] Generating ChangeLog
running install
running build
running install_data
creating /home/boris/.quickstart/usr
creating /home/boris/.quickstart/usr/local
creating /home/boris/.quickstart/usr/local/share
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/user
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/user/tasks
copying roles/libvirt/teardown/user/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/user/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/meta
copying roles/libvirt/setup/undercloud/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/teardown
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/teardown/tasks
copying roles/provision/teardown/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/teardown/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts/kvm
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts/kvm/tasks
copying roles/parts/kvm/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts/kvm/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/overcloud
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks
copying roles/libvirt/setup/overcloud/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/nodes
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/nodes/tasks
copying roles/libvirt/teardown/nodes/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/teardown/nodes/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/local
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/local/tasks
copying roles/provision/local/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/local/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/remote
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/remote/meta
copying roles/provision/remote/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/remote/meta
creating /home/boris/.quickstart/config
creating /home/boris/.quickstart/config/release
creating /home/boris/.quickstart/config/release/trunk
copying config/release/trunk/liberty.yml -> /home/boris/.quickstart/config/release/trunk
copying config/release/trunk/mitaka.yml -> /home/boris/.quickstart/config/release/trunk
copying config/release/trunk/newton.yml -> /home/boris/.quickstart/config/release/trunk
copying config/release/trunk/ocata.yml -> /home/boris/.quickstart/config/release/trunk
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/overcloud/meta
copying roles/libvirt/setup/overcloud/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/overcloud/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/meta
copying roles/convert-image/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/setup
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/fetch-images
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/tasks
copying roles/tripleo-inventory/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/files
copying roles/libvirt/setup/undercloud/files/get-undercloud-ip.sh -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/files
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/support_check
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/support_check/meta
copying roles/provision/support_check/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/support_check/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/test_plugins
copying test_plugins/equalto.py -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/test_plugins/
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/user
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/user/meta
copying roles/libvirt/setup/user/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/user/meta
creating /home/boris/.quickstart/playbooks
copying playbooks/build-images-and-quickstart.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/libvirt-teardown.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/tripleo-roles.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/quickstart-extras.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/noop.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/teardown-provision.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/provision.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/repo-setup-virthost.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/quickstart.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/teardown-nodes.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/build-images.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/teardown.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/libvirt-setup.yml -> /home/boris/.quickstart/playbooks/
copying playbooks/teardown-environment.yml -> /home/boris/.quickstart/playbooks/
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/vars
copying roles/environment/vars/redhat.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/vars
copying roles/environment/vars/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/vars
copying roles/environment/vars/fedora.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/vars
copying roles/environment/vars/centos-7.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/vars
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/setup/meta
copying roles/environment/setup/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/setup/meta
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts/kvm/defaults
copying roles/parts/kvm/defaults/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/parts/kvm/defaults
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/setup/tasks
copying roles/environment/setup/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/setup/tasks
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/meta
copying roles/libvirt/setup/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/meta
creating /home/boris/.quickstart/config/nodes
copying config/nodes/ovb_4node.yml -> /home/boris/.quickstart/config/nodes
copying config/nodes/1ctlr_1comp_1ceph.yml -> /home/boris/.quickstart/config/nodes
copying config/nodes/1ctlr.yml -> /home/boris/.quickstart/config/nodes
copying config/nodes/1ctlr_1comp.yml -> /home/boris/.quickstart/config/nodes
copying config/nodes/3ctlr_3comp.yml -> /home/boris/.quickstart/config/nodes
copying config/nodes/3ctlr_1comp.yml -> /home/boris/.quickstart/config/nodes
creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/meta copying roles/tripleo-inventory/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/meta creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks copying roles/libvirt/setup/undercloud/tasks/inject_gating_repo.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks copying roles/libvirt/setup/undercloud/tasks/customize_overcloud.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks copying roles/libvirt/setup/undercloud/tasks/inject_repos.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks copying roles/libvirt/setup/undercloud/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks copying roles/libvirt/setup/undercloud/tasks/update_image.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks copying roles/libvirt/setup/undercloud/tasks/convert_image.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/templates copying roles/convert-image/templates/convert_image.sh.j2 -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/templates creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/user creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/user/meta copying roles/provision/user/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/user/meta creating /home/boris/.quickstart/config/general_config creating /home/boris/.quickstart/config/general_config/releasenotes creating /home/boris/.quickstart/config/general_config/releasenotes/notes copying config/general_config/releasenotes/notes/break-out-general-config-8a02f40113e58dbc.yaml -> /home/boris/.quickstart/config/general_config/releasenotes/notes creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/meta copying roles/libvirt/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/meta creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/defaults copying roles/tripleo-inventory/defaults/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/tripleo-inventory/defaults creating /home/boris/.quickstart/config/release/tripleo-ci copying config/release/tripleo-ci/master.yml -> /home/boris/.quickstart/config/release/tripleo-ci copying config/release/tripleo-ci/mitaka.yml -> /home/boris/.quickstart/config/release/tripleo-ci copying config/release/tripleo-ci/newton.yml -> /home/boris/.quickstart/config/release/tripleo-ci copying config/release/tripleo-ci/ocata.yml -> /home/boris/.quickstart/config/release/tripleo-ci copying config/release/tripleo-ci/consistent-master.yml -> /home/boris/.quickstart/config/release/tripleo-ci creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/defaults copying roles/convert-image/defaults/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/defaults creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/tasks copying roles/convert-image/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/convert-image/tasks creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/teardown creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/teardown/meta copying roles/environment/teardown/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/teardown/meta creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/tasks copying roles/environment/tasks/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/environment/tasks creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/common creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/common/defaults copying roles/common/defaults/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/common/defaults creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/defaults copying roles/libvirt/defaults/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/libvirt/defaults creating /home/boris/.quickstart/config/release/stable copying config/release/stable/mitaka.yml -> /home/boris/.quickstart/config/release/stable copying config/release/stable/newton.yml -> /home/boris/.quickstart/config/release/stable creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/remote/templates copying roles/provision/remote/templates/libvirt.pkla.j2 -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/remote/templates creating /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/local/meta copying roles/provision/local/meta/main.yml -> /home/boris/.quickstart/usr/local/share/tripleo-quickstart/roles/provision/local/meta copying config/release/master.yml -> /home/boris/.quickstart/config/release copying config/release/master-tripleo-ci.yml -> /home/boris/.quickstart/config/release copying config/release/liberty.yml -> /home/boris/.quickstart/config/release copying config/release/ocata-undercloud-newton-overcloud.yml -> /home/boris/.quickstart/config/release copying config/release/mitaka.yml -> /home/boris/.quickstart/config/release copying config/release/newton.yml -> /home/boris/.quickstart/config/release copying config/release/ocata.yml -> /home/boris/.quickstart/config/release copying config/release/newton-baseos-undercloud.yml -> /home/boris/.quickstart/config/release . . . . . . . . . copying config/release/master-undercloud-ocata-overcloud.yml -> /home/boris/.quickstart/config/release Collecting ara (from -r requirements.txt (line 1))   Downloading ara-0.12.4.tar.gz (3.1MB)     100% |################################| 3.1MB 1.7MB/s Collecting ansible==2.2.0.0 (from -r requirements.txt (line 2))   Downloading ansible-2.2.0.0.tar.gz (2.4MB)     100% |################################| 2.4MB 1.5MB/s Collecting netaddr>=0.7.18 (from -r requirements.txt (line 3))   Downloading netaddr-0.7.19-py2.py3-none-any.whl (1.6MB)     100% |################################| 1.6MB 1.5MB/s Collecting pbr>=1.6 (from -r requirements.txt (line 4))   Downloading pbr-2.0.0-py2.py3-none-any.whl (98kB)     100% |################################| 102kB 487kB/s Requirement already satisfied: setuptools>=11.3 in /home/boris/.quickstart/lib/python2.7/site-packages (from -r requirements.txt (line 5)) Collecting tripleo-quickstart-extras from git+https://git.openstack.org/openstack/tripleo-quickstart-extras/#egg=tripleo-quickstart-extras (from -r quickstart-extras-requirements.txt (line 1))   Cloning https://git.openstack.org/openstack/tripleo-quickstart-extras/ to /tmp/pip-build-6nHd7z/tripleo-quickstart-extras Collecting Flask==0.11.1 (from ara->-r requirements.txt (line 1))   Downloading Flask-0.11.1-py2.py3-none-any.whl (80kB)     100% |################################| 81kB 586kB/s Collecting Flask-SQLAlchemy (from ara->-r requirements.txt (line 1))   Downloading Flask_SQLAlchemy-2.2-py2.py3-none-any.whl Collecting Flask-Migrate (from ara->-r requirements.txt (line 1))   Downloading Flask-Migrate-2.0.3.tar.gz Collecting Flask-Script (from ara->-r requirements.txt (line 1))   Downloading Flask-Script-2.0.5.tar.gz (42kB)     100% |################################| 51kB 46.8MB/s Collecting Frozen-Flask (from ara->-r requirements.txt (line 1))   Downloading Frozen_Flask-0.14-py2.py3-none-any.whl Collecting decorator>=4.0.0 (from ara->-r requirements.txt (line 1))   Downloading decorator-4.0.11-py2.py3-none-any.whl Collecting cliff (from ara->-r requirements.txt (line 1))   Downloading cliff-2.5.0-py2-none-any.whl (56kB)     100% |################################| 61kB 901kB/s Collecting pygments (from ara->-r requirements.txt (line 1))   Downloading Pygments-2.2.0-py2.py3-none-any.whl (841kB)     100% |################################| 849kB 471kB/s Collecting debtcollector>=1.2.0 (from ara->-r requirements.txt (line 1))   Downloading debtcollector-1.13.0-py2.py3-none-any.whl Collecting junit-xml>=1.7 (from ara->-r requirements.txt (line 1))   Downloading junit-xml-1.7.tar.gz Collecting paramiko (from ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading paramiko-2.1.2-py2.py3-none-any.whl (172kB)     100% |################################| 174kB 725kB/s Collecting jinja2 (from ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading Jinja2-2.9.6-py2.py3-none-any.whl (340kB)     100% |################################| 348kB 736kB/s Collecting PyYAML (from ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading PyYAML-3.12.tar.gz (253kB)     100% |################################| 256kB 1.4MB/s Collecting pycrypto>=2.6 (from ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading pycrypto-2.6.1.tar.gz (446kB)     100% |################################| 450kB 740kB/s Requirement already satisfied: appdirs>=1.4.0 in /home/boris/.quickstart/lib/python2.7/site-packages (from setuptools>=11.3->-r requirements.txt (line 5)) Requirement already satisfied: packaging>=16.8 in /home/boris/.quickstart/lib/python2.7/site-packages (from setuptools>=11.3->-r requirements.txt (line 5)) Requirement already satisfied: six>=1.6.0 in /home/boris/.quickstart/lib/python2.7/site-packages (from setuptools>=11.3->-r requirements.txt (line 5)) Collecting itsdangerous>=0.21 (from Flask==0.11.1->ara->-r requirements.txt (line 1))   Downloading itsdangerous-0.24.tar.gz (46kB)     100% |################################| 51kB 19.2MB/s Collecting click>=2.0 (from Flask==0.11.1->ara->-r requirements.txt (line 1))   Downloading click-6.7-py2.py3-none-any.whl (71kB)     100% |################################| 71kB 1.0MB/s Collecting Werkzeug>=0.7 (from Flask==0.11.1->ara->-r requirements.txt (line 1))   Downloading Werkzeug-0.12.1-py2.py3-none-any.whl (312kB)     100% |################################| 317kB 744kB/s Collecting SQLAlchemy>=0.8.0 (from Flask-SQLAlchemy->ara->-r requirements.txt (line 1))   Downloading SQLAlchemy-1.1.9.tar.gz (5.2MB)     100% |################################| 5.2MB 1.5MB/s Collecting alembic>=0.6 (from Flask-Migrate->ara->-r requirements.txt (line 1))   Downloading alembic-0.9.1.tar.gz (999kB)     100% |################################| 1.0MB 3.3MB/s Requirement already satisfied: pyparsing>=2.1.0 in /home/boris/.quickstart/lib/python2.7/site-packages (from cliff->ara->-r requirements.txt (line 1)) Collecting cmd2>=0.6.7 (from cliff->ara->-r requirements.txt (line 1))   Downloading cmd2-0.7.0.tar.gz (371kB)     100% |################################| 378kB 1.4MB/s Collecting unicodecsv>=0.8.0; python_version < "3.0" (from cliff->ara->-r requirements.txt (line 1))   Downloading unicodecsv-0.14.1.tar.gz Collecting PrettyTable<0.8,>=0.7.1 (from cliff->ara->-r requirements.txt (line 1))   Downloading prettytable-0.7.2.zip Collecting stevedore>=1.20.0 (from cliff->ara->-r requirements.txt (line 1))   Downloading stevedore-1.21.0-py2.py3-none-any.whl Collecting wrapt>=1.7.0 (from debtcollector>=1.2.0->ara->-r requirements.txt (line 1))   Downloading wrapt-1.10.10.tar.gz Collecting funcsigs>=0.4; python_version == "2.7" or python_version == "2.6" (from debtcollector>=1.2.0->ara->-r requirements.txt (line 1))   Downloading funcsigs-1.0.2-py2.py3-none-any.whl Collecting pyasn1>=0.1.7 (from paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading pyasn1-0.2.3-py2.py3-none-any.whl (53kB)     100% |################################| 61kB 31.7MB/s Collecting cryptography>=1.1 (from paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading cryptography-1.8.1.tar.gz (423kB)     100% |################################| 430kB 743kB/s Collecting MarkupSafe>=0.23 (from jinja2->ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading MarkupSafe-1.0.tar.gz Collecting Mako (from alembic>=0.6->Flask-Migrate->ara->-r requirements.txt (line 1))   Downloading Mako-1.0.6.tar.gz (575kB)     100% |################################| 583kB 1.4MB/s Collecting python-editor>=0.3 (from alembic>=0.6->Flask-Migrate->ara->-r requirements.txt (line 1))   Downloading python-editor-1.0.3.tar.gz Collecting idna>=2.1 (from cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading idna-2.5-py2.py3-none-any.whl (55kB)     100% |################################| 61kB 19.2MB/s Collecting asn1crypto>=0.21.0 (from cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading asn1crypto-0.22.0-py2.py3-none-any.whl (97kB)     100% |################################| 102kB 1.4MB/s Collecting enum34 (from cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading enum34-1.1.6-py2-none-any.whl Collecting ipaddress (from cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading ipaddress-1.0.18-py2-none-any.whl Collecting cffi>=1.4.1 (from cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading cffi-1.10.0-cp27-cp27mu-manylinux1_x86_64.whl (392kB)     100% |################################| 399kB 1.4MB/s Collecting pycparser (from cffi>=1.4.1->cryptography>=1.1->paramiko->ansible==2.2.0.0->-r requirements.txt (line 2))   Downloading pycparser-2.17.tar.gz (231kB)     100% |################################| 235kB 732kB/s Installing collected packages: pyasn1, idna, asn1crypto, enum34, ipaddress, pycparser, cffi, cryptography, paramiko, MarkupSafe, jinja2, PyYAML, pycrypto, ansible, itsdangerous, click, Werkzeug, Flask, SQLAlchemy, Flask-SQLAlchemy, Mako, python-editor, alembic, Flask-Script, Flask-Migrate, Frozen-Flask, pbr, decorator, cmd2, unicodecsv, PrettyTable, stevedore, cliff, pygments, wrapt, funcsigs, debtcollector, junit-xml, ara, netaddr, tripleo-quickstart-extras   Running setup.py install for pycparser ... done   Running setup.py install for cryptography ... done   Running setup.py install for MarkupSafe ... done   Running setup.py install for PyYAML ... done   Running setup.py install for pycrypto ... done   Running setup.py install for ansible ... done   Running setup.py install for itsdangerous ... done   Running setup.py install for SQLAlchemy ... done   Running setup.py install for Mako ... done   Running setup.py install for python-editor ... done   Running setup.py install for alembic ... done   Running setup.py install for Flask-Script ... done   Running setup.py install for Flask-Migrate ... done   Running setup.py install for cmd2 ... done   Running setup.py install for unicodecsv ... done   Running setup.py install for PrettyTable ... done   Running setup.py install for wrapt ... done   Running setup.py install for junit-xml ... done   Running setup.py install for ara ... done   Running setup.py install for tripleo-quickstart-extras ... done Successfully installed Flask-0.11.1 Flask-Migrate-2.0.3 Flask-SQLAlchemy-2.2 Flask-Script-2.0.5 Frozen-Flask-0.14 Mako-1.0.6 MarkupSafe-1.0 PrettyTable-0.7.2 PyYAML-3.12 SQLAlchemy-1.1.9 Werkzeug-0.12.1 alembic-0.9.1 ansible-2.2.0.0 ara-0.12.4 asn1crypto-0.22.0 cffi-1.10.0 click-6.7 cliff-2.5.0 cmd2-0.7.0 cryptography-1.8.1 debtcollector-1.13.0 decorator-4.0.11 enum34-1.1.6 funcsigs-1.0.2 idna-2.5 ipaddress-1.0.18 itsdangerous-0.24 jinja2-2.9.6 junit-xml-1.7 netaddr-0.7.19 paramiko-2.1.2 pbr-2.0.0 pyasn1-0.2.3 pycparser-2.17 pycrypto-2.6.1 pygments-2.2.0 python-editor-1.0.3 stevedore-1.21.0 tripleo-quickstart-extras-2.0.1.dev228 unicodecsv-0.14.1 wrapt-1.10.10 ~/.quickstart/tripleo-quickstart ---------------------------------------------------------------------------- |                                ,   .   ,                                 | |                                )-_'''_-(                                 | |                               ./ o\ /o \.                                | |                              . \__/ \__/ .                               | |                              ...   V   ...                               | |                              ... - - - ...                               | |                               .   - -   .                                | |                                `-.....-´                                 | |   ____         ____      ____        _      _        _             _     | |  / __ \       / __ \    / __ \      (_)    | |      | |           | |    | | | |  | | ___ | |  | |  | |  | |_   _ _  ___| | _____| |_ __ _ _ __| |_   | | | |  | |/ _ \| |  | |  | |  | | | | | |/ __| |/ / __| __/ _` | '__| __|  | | | |__| | |_| | |__| |  | |__| | |_| | | (__|   <\__ \ |_|(_| | |  | |_   | |  \____/ \___/ \____/    \___\_\\__,_|_|\___|_|\_\___/\__\__,_|_|   \__|  | |                                                                          | |                                                                          | ---------------------------------------------------------------------------- . . . . . . 
Installing OpenStack ocata on host 192.168.0.74
Using directory /home/boris/.quickstart for a local working directory
+ export ANSIBLE_CONFIG=/home/boris/.quickstart/tripleo-quickstart/ansible.cfg
+ ANSIBLE_CONFIG=/home/boris/.quickstart/tripleo-quickstart/ansible.cfg
+ export ANSIBLE_INVENTORY=/home/boris/.quickstart/hosts
+ ANSIBLE_INVENTORY=/home/boris/.quickstart/hosts
+ export ARA_DATABASE=sqlite:////home/boris/.quickstart/ara.sqlite
+ ARA_DATABASE=sqlite:////home/boris/.quickstart/ara.sqlite
+ source /home/boris/.quickstart/tripleo-quickstart/ansible_ssh_env.sh
++ export OPT_WORKDIR=/home/boris/.quickstart
++ OPT_WORKDIR=/home/boris/.quickstart
++ export SSH_CONFIG=/home/boris/.quickstart/ssh.config.ansible
++ SSH_CONFIG=/home/boris/.quickstart/ssh.config.ansible
++ touch /home/boris/.quickstart/ssh.config.ansible
++ export 'ANSIBLE_SSH_ARGS=-F /home/boris/.quickstart/ssh.config.ansible'
++ ANSIBLE_SSH_ARGS='-F /home/boris/.quickstart/ssh.config.ansible'
+ '[' 0 = 0 ']'
+ rm -f /home/boris/.quickstart/hosts
+ '[' 192.168.0.74 = localhost ']'
+ '[' '' = 1 ']'
+ VERBOSITY=vv
+ ansible-playbook -vv /home/boris/.quickstart/playbooks/quickstart-extras.yml -e @config/general_config/pacemaker.yml -e @config/nodes/3ctlr_1comp_2ceph.yml -e ansible_python_interpreter=/usr/bin/python -e @/home/boris/.quickstart/config/release/ocata.yml -e local_working_dir=/home/boris/.quickstart -e virthost=192.168.0.74 -t untagged,provision,environment,undercloud-scripts,overcloud-scripts,undercloud-install,undercloud-post-install,teardown-nodes
Using /home/boris/.quickstart/tripleo-quickstart/ansible.cfg as config file

. . . . . . . . . . 
PLAY RECAP *********************************************************************
192.168.0.74               : ok=116  changed=43   unreachable=0    failed=0   
localhost                  : ok=19   changed=8    unreachable=0    failed=0   
undercloud                 : ok=37   changed=25   unreachable=0    failed=0   

Sunday 09 April 2017  19:46:45 +0300 (0:00:01.674)       0:32:53.445 ********** 
=============================================================================== 
undercloud-deploy : Install the undercloud --------------------------- 1143.38s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/install-undercloud.yml:15 
overcloud-prep-images : Prepare the overcloud images for deploy ------- 161.73s
/home/boris/.quickstart/usr/local/share/ansible/roles/overcloud-prep-images/tasks/overcloud-prep-images.yml:1 
setup/undercloud : Perform selinux relabel on undercloud image --------- 97.42s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:154 
setup/undercloud : Upload undercloud volume to storage pool ------------ 43.41s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:257 
fetch-images : Get qcow2 image from cache ------------------------------ 30.48s
/home/boris/.quickstart/tripleo-quickstart/roles/fetch-images/tasks/fetch.yml:167 
overcloud-prep-flavors : Prepare the scripts for overcloud flavors ----- 28.48s
/home/boris/.quickstart/usr/local/share/ansible/roles/overcloud-prep-flavors/tasks/overcloud-prep-flavors.yml:1 
setup/undercloud : Copy instackenv.json to appliance ------------------- 26.88s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:73 
parts/libvirt : Install packages for libvirt --------------------------- 14.82s
/home/boris/.quickstart/tripleo-quickstart/roles/parts/libvirt/tasks/main.yml:17 
undercloud-deploy : Create the Virtual BMCs ---------------------------- 14.39s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/configure-vbmc.yml:23 
setup/undercloud : Get undercloud vm ip address ------------------------ 12.64s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:295 
setup/overcloud : Define overcloud vms ---------------------------------- 7.87s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:84 
undercloud-deploy : Create undercloud configuration --------------------- 7.66s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/create-scripts.yml:3 
setup/overcloud : Create overcloud vm storage --------------------------- 7.37s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:72 
undercloud-deploy : Start the Virtual BMCs ------------------------------ 7.20s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/configure-vbmc.yml:55 
setup/overcloud : Attach additional blockdevices to overcloud objectstorage VMs --- 6.92s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:102 
setup/undercloud : Inject undercloud ssh public key to appliance -------- 6.88s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/undercloud/tasks/main.yml:99 
setup/overcloud : Create additional blockdevice for objectstorage nodes --- 6.72s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/setup/overcloud/tasks/main.yml:94 
overcloud-prep-network : Prepare the network-isolation required networks on the undercloud --- 6.57s
/home/boris/.quickstart/usr/local/share/ansible/roles/overcloud-prep-network/tasks/overcloud-prep-network.yml:1 
undercloud-deploy : Install VirtualBMC package -------------------------- 6.38s
/home/boris/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/configure-vbmc.yml:3 
teardown/nodes : Check overcloud vms ------------------------------------ 6.35s
/home/boris/.quickstart/tripleo-quickstart/roles/libvirt/teardown/nodes/tasks/main.yml:22 
+ set +x
##################################
Virtual Environment Setup Complete
##################################

Access the undercloud by:

    ssh -F /home/boris/.quickstart/ssh.config.ansible undercloud

Follow the documentation in the link below to complete your deployment.

    http://ow.ly/c44w304begR

##################################
Virtual Environment Setup Complete
##################################
Logging into undercloud VM :-
[boris@fedora24wks tripleo-quickstart]$ ssh -F /home/boris/.quickstart/ssh.config.ansible undercloud
Warning: Permanently added '192.168.0.74' (ECDSA) to the list of known hosts.
Warning: Permanently added 'undercloud' (ECDSA) to the list of known hosts.
Last login: Sun Apr  9 16:46:39 2017 from gateway
[stack@undercloud ~]$ . stackrc
[stack@undercloud ~]$ ironic node-list
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| UUID                                 | Name      | Instance UUID | Power State | Provisioning State | Maintenance |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
| 86b18950-9cb1-4d10-bdab-a6fbae20bdcb | control-0 | None          | power off   | available          | False       |
| 185f231d-72e4-4be3-91e5-651310c05287 | control-1 | None          | power off   | available          | False       |
| 302fa421-f6a6-4561-a6ab-9ae14cca832e | control-2 | None          | power off   | available          | False       |
| f245e374-0a5f-48ca-978f-06a5ece2d1ac | compute-0 | None          | power off   | available          | False       |
| 0f616bef-5709-4f33-becd-cc247e7889dc | ceph-0    | None          | power off   | available          | False       |
| 7f01a0af-daba-4d9b-aec3-ca4e29df2db3 | ceph-1    | None          | power off   | available          | False       |
+--------------------------------------+-----------+---------------+-------------+--------------------+-------------+
********************************************************************************************
Next step :- 
$ sudo vi  /usr/share/openstack-tripleo-heat-templates/puppet/services/ceph-mon.yaml
Update line :-
ceph::profile::params::osd_pool_default_size: 2 
instead of default value "3". This step is acceptable only in Virtual Environment.
Setting  the osd_pool_default_size set to 2,you will only have
two copies of the object. As a general rule, you should run your cluster 
with more than two OSD and a pool size greater than 2 object replica - Quorum requirement. 
So having 48GB RAM on VIRTHOST  the optimal setting is osd_pool_default_size = 3 
********************************************************************************************
[stack@undercloud ~]$ ls -l
total 1645340
-rw-rw-r--. 1 stack stack        357 Apr  9 16:46 cloud-names.yaml
-rwxr-xr-x. 1 stack stack        371 Apr  9 16:42 containers-default-parameters.yaml
-rw-rw-r--. 1 stack stack       2521 Apr  9 16:18 instackenv.json
-rw-rw-r--. 1 stack stack  356179341 Apr  7 13:40 ironic-python-agent.initramfs
-rw-rw-r--. 1 stack stack    5393008 Apr  7 13:40 ironic-python-agent.kernel
-rw-r--r--. 1 stack stack        474 Apr  9 16:42 network-environment.yaml
-rw-rw-r--. 1 stack stack          0 Apr  9 16:42 overcloud_custom_tht_script.log
-rwxr-xr-x. 1 stack stack        293 Apr  9 16:42 overcloud-custom-tht-script.sh
-rwxr-xr-x. 1 stack stack        973 Apr  9 16:46 overcloud-deploy-post.sh
-rwxr-xr-x. 1 stack stack       3027 Apr  9 16:46 overcloud-deploy.sh
-rw-rw-r--. 1 stack stack   46927452 Apr  7 13:40 overcloud-full.initrd
-rw-rw-r--. 1 stack stack 1270480896 Apr  7 13:40 overcloud-full.qcow2
-rw-rw-r--. 1 stack stack    5393008 Apr  7 13:40 overcloud-full.vmlinuz
-rwxr-xr-x. 1 stack stack        894 Apr  9 16:42 overcloud-prep-containers.sh
-rw-rw-r--. 1 stack stack      10047 Apr  9 16:45 overcloud_prep_flavors.log
-rwxr-xr-x. 1 stack stack       3672 Apr  9 16:45 overcloud-prep-flavors.sh
-rw-rw-r--. 1 stack stack       5965 Apr  9 16:45 overcloud_prep_images.log
-rwxr-xr-x. 1 stack stack        618 Apr  9 16:42 overcloud-prep-images.sh
-rw-rw-r--. 1 stack stack       2310 Apr  9 16:46 overcloud_prep_network.log
-rwxr-xr-x. 1 stack stack        863 Apr  9 16:45 overcloud-prep-network.sh
-rw-------. 1 stack stack        543 Apr  9 16:22 quickstart-hieradata-overrides.yaml
-rw-------. 1 stack stack        715 Apr  9 16:40 stackrc
-rw-------. 1 stack stack       8526 Apr  9 16:22 undercloud.conf
-rw-rw-r--. 1 stack stack     348697 Apr  9 16:41 undercloud_install.log
-rwxr-xr-x. 1 stack stack        270 Apr  9 16:22 undercloud-install.sh
-rw-rw-r--. 1 stack stack       1924 Apr  9 16:22 undercloud-passwords.conf
[stack@undercloud ~]$ ./overcloud-deploy.sh
+ source /home/stack/stackrc
+++ set
+++ awk '{FS="="}  /^OS_/ {print $1}'
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_AUTH_TYPE
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_AUTH_URL
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_BAREMETAL_API_VERSION
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_CLOUDNAME
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_NO_CACHE
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_PASSWORD
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_TENANT_NAME
++ for key in '$( set | awk '\''{FS="="}  /^OS_/ {print $1}'\'' )'
++ unset OS_USERNAME
++ NOVA_VERSION=1.1
++ export NOVA_VERSION
+++ sudo hiera admin_password
++ OS_PASSWORD=fd9a907bb7579a1c988f442ea234b3f58027bef9
++ export OS_PASSWORD
++ OS_AUTH_TYPE=password
++ export OS_AUTH_TYPE
++ OS_AUTH_URL=https://192.168.24.2:13000/v2.0
++ PYTHONWARNINGS='ignore:Certificate has no, ignore:A true SSLContext object is not available'
++ export OS_AUTH_URL
++ export PYTHONWARNINGS
++ OS_USERNAME=admin
++ OS_TENANT_NAME=admin
++ COMPUTE_API_VERSION=1.1
++ OS_BAREMETAL_API_VERSION=1.15
++ OS_NO_CACHE=True
++ OS_CLOUDNAME=undercloud
++ export OS_USERNAME
++ export OS_TENANT_NAME
++ export COMPUTE_API_VERSION
++ export OS_BAREMETAL_API_VERSION
++ export OS_NO_CACHE
++ export OS_CLOUDNAME
+ true
++ openstack hypervisor stats show -c count -f value
+ count=6
+ '[' 6 -gt 0 ']'
+ break
+ openstack overcloud deploy --templates /usr/share/openstack-tripleo-heat-templates --libvirt-type qemu \
--control-flavor oooq_control --compute-flavor oooq_compute --ceph-storage-flavor oooq_ceph \
--block-storage-flavor oooq_blockstorage --swift-storage-flavor oooq_objectstorage \
--timeout 90 -e /home/stack/cloud-names.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml \
-e /home/stack/network-environment.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/low-memory-usage.yaml \
--validation-warnings-fatal --control-scale 3 --compute-scale 1 --ceph-storage-scale 2 \
-e /usr/share/openstack-tripleo-heat-templates/environments/storage-environment.yaml \
--ntp-server pool.ntp.org
Removing the current plan files
Uploading new plan files
Started Mistral Workflow tripleo.plan_management.v1.update_deployment_plan. Execution ID: bf169eaa-5a71-4e1a-81ee-d5c6b4c97299
Plan updated
Deploying templates in the directory /tmp/tripleoclient-Yvn9Ec/tripleo-heat-templates
Started Mistral Workflow tripleo.deployment.v1.deploy_plan. Execution ID: 0d1bd32d-1259-4587-a524-be2ec7c70913
2017-04-09 16:52:46Z [overcloud]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 16:52:46Z [overcloud.ServiceNetMap]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.ServiceNetMap]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 16:52:47Z [overcloud.PcsdPassword]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.ServiceNetMap.ServiceNetMapValue]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.RabbitCookie]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.ServiceNetMap.ServiceNetMapValue]: CREATE_COMPLETE  state changed
2017-04-09 16:52:47Z [overcloud.ServiceNetMap]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 16:52:47Z [overcloud.HeatAuthEncryptionKey]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.MysqlRootPassword]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.HorizonSecret]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:47Z [overcloud.Networks]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:48Z [overcloud.PcsdPassword]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.RabbitCookie]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.HeatAuthEncryptionKey]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.MysqlRootPassword]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.Networks]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 16:52:48Z [overcloud.HorizonSecret]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.ServiceNetMap]: CREATE_COMPLETE  state changed
2017-04-09 16:52:48Z [overcloud.Networks.ExternalNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:48Z [overcloud.DefaultPasswords]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.ManagementNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.ExternalNetwork]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 16:52:49Z [overcloud.Networks.StorageNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.ExternalNetwork.ExternalNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.NetworkExtraConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.StorageNetwork]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 16:52:49Z [overcloud.Networks.TenantNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.StorageNetwork.StorageNetwork]: CREATE_IN_PROGRESS  state changed
2017-04-09 16:52:49Z [overcloud.Networks.ExternalNetwork.ExternalNetwork]: CREATE_COMPLETE  state changed
. . . . .

2017-04-09 17:42:17Z [overcloud.AllNodesDeploySteps.ComputeDeployment_Step5]: CREATE_COMPLETE  state changed
2017-04-09 17:44:49Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.1]: SIGNAL_IN_PROGRESS  Signal: deployment 910dc608-9e9c-4830-8428-5de6f7984fed succeeded
2017-04-09 17:44:50Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.1]: CREATE_COMPLETE  state changed
2017-04-09 17:45:24Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.2]: SIGNAL_IN_PROGRESS  Signal: deployment 15acd20e-e6d5-4827-98f4-5b1cde721051 succeeded
2017-04-09 17:45:24Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.2]: CREATE_COMPLETE  state changed
2017-04-09 17:47:50Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.0]: SIGNAL_IN_PROGRESS  Signal: deployment 533d33c1-37f6-4014-a934-9226c44e3884 succeeded
2017-04-09 17:47:51Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.0]: CREATE_COMPLETE  state changed
2017-04-09 17:47:51Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 17:47:51Z [overcloud.AllNodesDeploySteps.ControllerDeployment_Step5]: CREATE_COMPLETE  state changed
2017-04-09 17:47:51Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.BlockStoragePostConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ObjectStoragePostConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate.SwiftRingUpdateConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate.SwiftRingUpdateConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate.SwiftRingUpdate]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ComputePostConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ControllerPostConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate.SwiftRingUpdateConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:52Z [overcloud.AllNodesDeploySteps.CephStoragePostConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:53Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate.SwiftRingUpdateConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:53Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate.SwiftRingUpdate]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:53Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate.SwiftRingUpdate]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ObjectStorageSwiftRingUpdate]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ObjectStoragePostConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.BlockStoragePostConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ControllerPostConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.CephStoragePostConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ComputePostConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:47:54Z [overcloud.AllNodesDeploySteps.ObjectStorageExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:55Z [overcloud.AllNodesDeploySteps.ComputeExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:55Z [overcloud.AllNodesDeploySteps.CephStorageExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:56Z [overcloud.AllNodesDeploySteps.BlockStorageExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:56Z [overcloud.AllNodesDeploySteps.ControllerExtraConfigPost]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:58Z [overcloud.AllNodesDeploySteps.BlockStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2017-04-09 17:47:58Z [overcloud.AllNodesDeploySteps.ObjectStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2017-04-09 17:47:58Z [overcloud.AllNodesDeploySteps.CephStorageExtraConfigPost]: CREATE_COMPLETE  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.ControllerExtraConfigPost]: CREATE_COMPLETE  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.ComputeExtraConfigPost]: CREATE_COMPLETE  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.ComputePostPuppet]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.CephStoragePostPuppet]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.BlockStoragePostPuppet]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.ObjectStoragePostPuppet]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:47:59Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:48:00Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet]: CREATE_IN_PROGRESS  Stack CREATE started
2017-04-09 17:48:00Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetMaintenanceModeConfig]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:48:00Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetMaintenanceModeConfig]: CREATE_COMPLETE  state changed
2017-04-09 17:48:00Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetMaintenanceModeDeployment]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:48:00Z [overcloud.AllNodesDeploySteps.CephStoragePostPuppet]: CREATE_COMPLETE  state changed
2017-04-09 17:48:01Z [overcloud.AllNodesDeploySteps.BlockStoragePostPuppet]: CREATE_COMPLETE  state changed
2017-04-09 17:48:01Z [overcloud.AllNodesDeploySteps.ObjectStoragePostPuppet]: CREATE_COMPLETE  state changed
2017-04-09 17:48:02Z [overcloud.AllNodesDeploySteps.ComputePostPuppet]: CREATE_COMPLETE  state changed
2017-04-09 17:48:08Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate.SwiftRingUpdate]: CREATE_COMPLETE  state changed
2017-04-09 17:48:08Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 17:48:08Z [overcloud.AllNodesDeploySteps.ControllerSwiftRingUpdate]: CREATE_COMPLETE  state changed
2017-04-09 17:48:22Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetMaintenanceModeDeployment]: CREATE_COMPLETE  state changed
2017-04-09 17:48:22Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetRestart]: CREATE_IN_PROGRESS  state changed
2017-04-09 17:48:41Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet.ControllerPostPuppetRestart]: CREATE_COMPLETE  state changed
2017-04-09 17:48:41Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 17:48:42Z [overcloud.AllNodesDeploySteps.ControllerPostPuppet]: CREATE_COMPLETE  state changed
2017-04-09 17:48:42Z [overcloud.AllNodesDeploySteps]: CREATE_COMPLETE  Stack CREATE completed successfully
2017-04-09 17:48:43Z [overcloud.AllNodesDeploySteps]: CREATE_COMPLETE  state changed
2017-04-09 17:48:43Z [overcloud]: CREATE_COMPLETE  Stack CREATE completed successfully

 Stack overcloud CREATE_COMPLETE 

Overcloud Endpoint: http://10.0.0.6:5000/v2.0
Overcloud Deployed
+ status_code=0
+ openstack stack list
+ grep -q CREATE_COMPLETE
+ exit 0
stack@undercloud ~]$ date
Sun Apr  9 21:49:40 UTC 2017
[stack@undercloud ~]$ openstack server list
+-------------------------+-------------------------+--------+------------------------+----------------+
| ID                      | Name                    | Status | Networks               | Image Name     |
+-------------------------+-------------------------+--------+------------------------+----------------+
| a5bf4ad9-6fc7-4ef4-aa80 | overcloud-cephstorage-0 | ACTIVE | ctlplane=192.168.24.14 | overcloud-full |
| -e179e1224974           |                         |        |                        |                |
| d2d0cdd1-1d9a-40e1      | overcloud-controller-2  | ACTIVE | ctlplane=192.168.24.7  | overcloud-full |
| -bfac-9280725200a7      |                         |        |                        |                |
| 2d6fda68-2330-4ea7-b391 | overcloud-cephstorage-1 | ACTIVE | ctlplane=192.168.24.9  | overcloud-full |
| -e1af16bcec90           |                         |        |                        |                |
| 229f24b6-bbab-          | overcloud-controller-0  | ACTIVE | ctlplane=192.168.24.8  | overcloud-full |
| 45cc-9215-8b0852b26365  |                         |        |                        |                |
| f5f3bab8-c431-4301      | overcloud-novacompute-0 | ACTIVE | ctlplane=192.168.24.13 | overcloud-full |
| -81ac-617ea5e14f20      |                         |        |                        |                |
| f5770298-96e0-47bd-     | overcloud-controller-1  | ACTIVE | ctlplane=192.168.24.17 | overcloud-full |
| beb6-1ea00190afa5       |                         |        |                        |                |
+-------------------------+-------------------------+--------+------------------------+----------------+
[stack@undercloud ~]$ nova-manage --version
15.0.2 

[stack@undercloud ~]$ cat overcloudrc.v3
# Clear any old environment that may conflict.
for key in $( set | awk '{FS="="}  /^OS_/ {print $1}' ); do unset $key ; done
export OS_USERNAME=admin
export OS_USER_DOMAIN_NAME=Default
export OS_PROJECT_DOMAIN_NAME=Default
export NOVA_VERSION=1.1
export OS_PROJECT_NAME=admin
export OS_PASSWORD=EXcbjGf2UrrvkEpzwTEMg8ChQ
export OS_NO_CACHE=True
export COMPUTE_API_VERSION=1.1
export no_proxy=,10.0.0.6,192.168.24.12
export OS_CLOUDNAME=overcloud
export OS_AUTH_URL=http://10.0.0.6:5000/v3
export OS_IDENTITY_API_VERSION=3
export OS_AUTH_TYPE=password
export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available"
[stack@undercloud ~]$ ssh heat-admin@192.168.24.8
The authenticity of host '192.168.24.8 (192.168.24.8)' can't be established.
ECDSA key fingerprint is 84:40:b1:8b:e8:91:c9:a1:65:77:35:a6:4a:66:6e:3d.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '192.168.24.8' (ECDSA) to the list of known hosts.
[heat-admin@overcloud-controller-0 ~]$ sudo su -
[root@overcloud-controller-0 ~]# vi overcloudrc.v3
[root@overcloud-controller-0 ~]# pcs status
Cluster name: tripleo_cluster
Stack: corosync
Current DC: overcloud-controller-2 (version 1.1.15-11.el7_3.4-e174ec8) - partition with quorum
Last updated: Sun Apr  9 17:52:30 2017        Last change: Sun Apr  9 17:48:15 2017 by root via cibadmin on overcloud-controller-1

3 nodes and 19 resources configured

Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]

Full list of resources:

 Master/Slave Set: galera-master [galera]
     Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: rabbitmq-clone [rabbitmq]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Master/Slave Set: redis-master [redis]
     Masters: [ overcloud-controller-2 ]
     Slaves: [ overcloud-controller-0 overcloud-controller-1 ]
 ip-192.168.24.12    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-0
 ip-10.0.0.6    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-1
 ip-172.16.2.13    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-2
 ip-172.16.2.8    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-0
 ip-172.16.1.6    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-1
 ip-172.16.3.7    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-2
 Clone Set: haproxy-clone [haproxy]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 openstack-cinder-volume    (systemd:openstack-cinder-volume):    Started overcloud-controller-0

Failed Actions:
* galera_monitor_10000 on overcloud-controller-2 'unknown error' (1): call=9, status=complete, exitreason='local node <overcloud-controller-2> is started, but not in primary mode. Unknown state.',
    last-rc-change='Sun Apr  9 17:37:23 2017', queued=0ms, exec=0ms
* galera_monitor_10000 on overcloud-controller-1 'unknown error' (1): call=13, status=complete, exitreason='local node <overcloud-controller-1> is started, but not in primary mode. Unknown state.',
    last-rc-change='Sun Apr  9 17:37:17 2017', queued=0ms, exec=0ms
Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled
*********************************************************************
Here we need run command bellow to restart resources failed to start
during deployment :
[root@overcloud-controller-0 ~]# pcs resource cleanup
Waiting for 1 replies from the CRMd. OK
*********************************************************************
[root@overcloud-controller-0 ~]# pcs status
Cluster name: tripleo_cluster
Stack: corosync
Current DC: overcloud-controller-2 (version 1.1.15-11.el7_3.4-e174ec8) - partition with quorum
Last updated: Sun Apr  9 17:53:01 2017        Last change: Sun Apr  9 17:48:15 2017 by root via cibadmin on overcloud-controller-1

3 nodes and 19 resources configured
Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Full list of resources:

 Master/Slave Set: galera-master [galera]
     Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: rabbitmq-clone [rabbitmq]
     Started: [ overcloud-controller-0 overcloud-controller-1 ]
     Stopped: [ overcloud-controller-2 ]
 Master/Slave Set: redis-master [redis]
     Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 ip-192.168.24.12    (ocf::heartbeat:IPaddr2):    Stopped
 ip-10.0.0.6    (ocf::heartbeat:IPaddr2):    Stopped
 ip-172.16.2.13    (ocf::heartbeat:IPaddr2):    Stopped
 ip-172.16.2.8    (ocf::heartbeat:IPaddr2):    Stopped
 ip-172.16.1.6    (ocf::heartbeat:IPaddr2):    Stopped
 ip-172.16.3.7    (ocf::heartbeat:IPaddr2):    Stopped
 Clone Set: haproxy-clone [haproxy]
     Stopped: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 openstack-cinder-volume    (systemd:openstack-cinder-volume):    Stopped

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled

[root@overcloud-controller-0 ~]# pcs status
Cluster name: tripleo_cluster
Stack: corosync
Current DC: overcloud-controller-2 (version 1.1.15-11.el7_3.4-e174ec8) - partition with quorum
Last updated: Sun Apr  9 17:53:18 2017        Last change: Sun Apr  9 17:48:15 2017 by root via cibadmin on overcloud-controller-1

3 nodes and 19 resources configured
Online: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
Full list of resources:

 Master/Slave Set: galera-master [galera]
     Masters: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Clone Set: rabbitmq-clone [rabbitmq]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 Master/Slave Set: redis-master [redis]
     Masters: [ overcloud-controller-2 ]
     Slaves: [ overcloud-controller-0 overcloud-controller-1 ]
 ip-192.168.24.12    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-0
 ip-10.0.0.6    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-1
 ip-172.16.2.13    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-2
 ip-172.16.2.8    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-0
 ip-172.16.1.6    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-1
 ip-172.16.3.7    (ocf::heartbeat:IPaddr2):    Started overcloud-controller-2
 Clone Set: haproxy-clone [haproxy]
     Started: [ overcloud-controller-0 overcloud-controller-1 overcloud-controller-2 ]
 openstack-cinder-volume    (systemd:openstack-cinder-volume):    Started overcloud-controller-0

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled
[root@overcloud-controller-0 ~]# clustercheck
HTTP/1.1 200 OK
Content-Type: text/plain
Connection: close
Content-Length: 32

Galera cluster node is synced.
[root@overcloud-controller-0 ~]# ceph status
    cluster 57122104-1d43-11e7-8de2-00bd0ae930f1
     health HEALTH_OK
     monmap e1: 3 mons at {overcloud-controller-0=172.16.1.8:6789/0,overcloud-controller-1=172.16.1.7:6789/0,overcloud-controller-2=172.16.1.13:6789/0}
            election epoch 6, quorum 0,1,2 overcloud-controller-1,overcloud-controller-0,overcloud-controller-2
     osdmap e23: 2 osds: 2 up, 2 in
            flags sortbitwise
      pgmap v112: 288 pgs, 8 pools, 0 bytes data, 0 objects
            16751 MB used, 85623 MB / 102375 MB avail
288 active+clean
*****************************************************
Resources restarted && we are ready to go *****************************************************
 [root@overcloud-controller-0 ~]# openstack flavor create --public m1.small --id 2 \
>   --ram 2000 --disk 20 --vcpus 1 --rxtx-factor 1
+----------------------------+----------+
| Field                      | Value    |
+----------------------------+----------+
| OS-FLV-DISABLED:disabled   | False    |
| OS-FLV-EXT-DATA:ephemeral  | 0        |
| disk                       | 20       |
| id                         | 2        |
| name                       | m1.small |
| os-flavor-access:is_public | True     |
| properties                 |          |
| ram                        | 2000     |
| rxtx_factor                | 1.0      |
| swap                       |          |
| vcpus                      | 1        |
+----------------------------+----------+

[root@overcloud-controller-0 ~]# openstack keypair create oskey040917 > oskey040917.pem

[root@overcloud-controller-0 ~]# ceph status
    cluster 57122104-1d43-11e7-8de2-00bd0ae930f1
     health HEALTH_OK
     monmap e1: 3 mons at {overcloud-controller-0=172.16.1.8:6789/0,overcloud-controller-1=172.16.1.7:6789/0,overcloud-controller-2=172.16.1.13:6789/0}
            election epoch 6, quorum 0,1,2 overcloud-controller-1,overcloud-controller-0,overcloud-controller-2
     osdmap e28: 2 osds: 2 up, 2 in
            flags sortbitwise
      pgmap v261: 288 pgs, 8 pools, 1350 MB data, 352 objects
            19458 MB used, 82917 MB / 102375 MB avail
                 288 active+clean
***************************************************************************** [root@overcloud-controller-0 ~]# nova-manage --version 15.0.2 *****************************************************************************
[root@overcloud-controller-0 ~]# openstack  network create ext-net --external \
> --provider-physical-network datacentre  --provider-network-type flat
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2017-04-09T18:13:52Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | 30f79296-42ef-4952-9f2a-2ab3363bcdb4 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | False                                |
| mtu                       | 1500                                 |
| name                      | ext-net                              |
| port_security_enabled     | True                                 |
| project_id                | 7963ea533a2a4f03a93bf4fae907a520     |
| provider:network_type     | flat                                 |
| provider:physical_network | datacentre                           |
| provider:segmentation_id  | None                                 |
| qos_policy_id             | None                                 |
| revision_number           | 4                                    |
| router:external           | External                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| updated_at                | 2017-04-09T18:13:52Z                 |
+---------------------------+--------------------------------------+

[root@overcloud-controller-0 ~]# openstack subnet create ext-subnet --network ext-net \
>  --subnet-range 192.168.24.0/24  --allocation-pool start=192.168.24.100,end=192.168.24.120 \
>  --no-dhcp --gateway 192.168.24.1
+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| allocation_pools  | 192.168.24.100-192.168.24.120        |
| cidr              | 192.168.24.0/24                      |
| created_at        | 2017-04-09T18:14:17Z                 |
| description       |                                      |
| dns_nameservers   |                                      |
| enable_dhcp       | False                                |
| gateway_ip        | 192.168.24.1                         |
| host_routes       |                                      |
| id                | 17e5b5c1-2d3e-45a0-ac34-1721c55b6ccb |
| ip_version        | 4                                    |
| ipv6_address_mode | None                                 |
| ipv6_ra_mode      | None                                 |
| name              | ext-subnet                           |
| network_id        | 30f79296-42ef-4952-9f2a-2ab3363bcdb4 |
| project_id        | 7963ea533a2a4f03a93bf4fae907a520     |
| revision_number   | 2                                    |
| segment_id        | None                                 |
| service_types     |                                      |
| subnetpool_id     | None                                 |
| updated_at        | 2017-04-09T18:14:17Z                 |
+-------------------+--------------------------------------+

[root@overcloud-controller-0 ~]# openstack router create Router1
+-------------------------+--------------------------------------+
| Field                   | Value                                |
+-------------------------+--------------------------------------+
| admin_state_up          | UP                                   |
| availability_zone_hints |                                      |
| availability_zones      |                                      |
| created_at              | 2017-04-09T18:16:04Z                 |
| description             |                                      |
| distributed             | False                                |
| external_gateway_info   | None                                 |
| flavor_id               | None                                 |
| ha                      | True                                 |
| id                      | 453fe78c-a2e8-4792-8f60-b0db666a961a |
| name                    | Router1                              |
| project_id              | 7963ea533a2a4f03a93bf4fae907a520     |
| revision_number         | None                                 |
| routes                  |                                      |
| status                  | ACTIVE                               |
| updated_at              | 2017-04-09T18:16:04Z                 |
+-------------------------+--------------------------------------+
[root@overcloud-controller-0 ~]# openstack router set Router1 --external-gateway ext-net

[root@overcloud-controller-0 ~]# openstack network create internal
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | UP                                   |
| availability_zone_hints   |                                      |
| availability_zones        |                                      |
| created_at                | 2017-04-09T18:17:11Z                 |
| description               |                                      |
| dns_domain                | None                                 |
| id                        | e8919bc9-594e-4a5e-90b0-35cbb9f1ca89 |
| ipv4_address_scope        | None                                 |
| ipv6_address_scope        | None                                 |
| is_default                | None                                 |
| mtu                       | 1450                                 |
| name                      | internal                             |
| port_security_enabled     | True                                 |
| project_id                | 7963ea533a2a4f03a93bf4fae907a520     |
| provider:network_type     | vxlan                                |
| provider:physical_network | None                                 |
| provider:segmentation_id  | 53                                   |
| qos_policy_id             | None                                 |
| revision_number           | 3                                    |
| router:external           | Internal                             |
| segments                  | None                                 |
| shared                    | False                                |
| status                    | ACTIVE                               |
| subnets                   |                                      |
| updated_at                | 2017-04-09T18:17:11Z                 |
+---------------------------+--------------------------------------+

[root@overcloud-controller-0 ~]# openstack subnet create sub-internal --network internal \
>  --subnet-range 50.0.0.0/24  --dns-nameserver  83.221.202.254
+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| allocation_pools  | 50.0.0.2-50.0.0.254                  |
| cidr              | 50.0.0.0/24                          |
| created_at        | 2017-04-09T18:17:44Z                 |
| description       |                                      |
| dns_nameservers   | 83.221.202.254                       |
| enable_dhcp       | True                                 |
| gateway_ip        | 50.0.0.1                             |
| host_routes       |                                      |
| id                | ac3e0b85-5764-4102-ad42-9bc4d05707f7 |
| ip_version        | 4                                    |
| ipv6_address_mode | None                                 |
| ipv6_ra_mode      | None                                 |
| name              | sub-internal                         |
| network_id        | e8919bc9-594e-4a5e-90b0-35cbb9f1ca89 |
| project_id        | 7963ea533a2a4f03a93bf4fae907a520     |
| revision_number   | 2                                    |
| segment_id        | None                                 |
| service_types     |                                      |
| subnetpool_id     | None                                 |
| updated_at        | 2017-04-09T18:17:44Z                 |
+-------------------+--------------------------------------+

[root@overcloud-controller-0 ~]# openstack router add subnet Router1 ac3e0b85-5764-4102-ad42-9bc4d05707f7

[root@overcloud-controller-0 ~]# nova secgroup-list
+--------------------------------------+---------+------------------------+
| Id                                   | Name    | Description            |
+--------------------------------------+---------+------------------------+
| 47208a13-eb04-483c-9337-73b2114a534a | default | Default security group |
+--------------------------------------+---------+------------------------+

[root@overcloud-controller-0 ~]# openstack security group rule create 47208a13-eb04-483c-9337-73b2114a534a \
>  --protocol tcp --dst-port 22:22 --remote-ip 0.0.0.0/0

+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| created_at        | 2017-04-09T18:19:45Z                 |
| description       |                                      |
| direction         | ingress                              |
| ether_type        | IPv4                                 |
| id                | ef8a7170-6548-4d73-bd2c-89c45c10697e |
| name              | None                                 |
| port_range_max    | 22                                   |
| port_range_min    | 22                                   |
| project_id        | 7963ea533a2a4f03a93bf4fae907a520     |
| protocol          | tcp                                  |
| remote_group_id   | None                                 |
| remote_ip_prefix  | 0.0.0.0/0                            |
| revision_number   | 1                                    |
| security_group_id | 47208a13-eb04-483c-9337-73b2114a534a |
| updated_at        | 2017-04-09T18:19:45Z                 |
+-------------------+--------------------------------------+
[root@overcloud-controller-0 ~]# cat over*
# Clear any old environment that may conflict.
for key in $( set | awk '{FS="="}  /^OS_/ {print $1}' ); do unset $key ; done
export OS_USERNAME=admin
export OS_USER_DOMAIN_NAME=Default
export OS_PROJECT_DOMAIN_NAME=Default
export NOVA_VERSION=1.1
export OS_PROJECT_NAME=admin
export OS_PASSWORD=EXcbjGf2UrrvkEpzwTEMg8ChQ
export OS_NO_CACHE=True
export COMPUTE_API_VERSION=1.1
export no_proxy=,10.0.0.6,192.168.24.12
export OS_CLOUDNAME=overcloud
export OS_AUTH_URL=http://10.0.0.6:5000/v3
export OS_IDENTITY_API_VERSION=3
export OS_AUTH_TYPE=password
export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available"

[root@overcloud-controller-0 ~]# ls -l
total 317400
-rw-------. 1 root root      6913 Mar  1 02:45 anaconda-ks.cfg
-rw-------. 1 root root      6580 Mar  1 02:45 original-ks.cfg
-rw-r--r--. 1 root root      1680 Apr  9 18:13 oskey040917.pem
-rw-r--r--. 1 root root       651 Apr  9 17:52 overcloudrc.v3
-rw-r--r--. 1 root root 324993024 Mar 31 15:33 xenial-server-cloudimg-amd64-disk1.img
[root@overcloud-controller-0 ~]# cat oskey040917.pem
-----BEGIN RSA PRIVATE KEY-----
MIIEpAIBAAKCAQEAxWZSGsBBgkncO0YrrVsuTm7HyjSrscwbNzOfGk9Qfl/Jhooq
y/4HhhedjUwqzqlFx/2WJlp3YEGekKL2/Hlf6Q/kUAHU0ZxP4e1jz/eq0ko+U6qh
KDvlsCMMYTEOYkXD9hOxCcd/n7mWrOgVg2WBx8xYBV16f/yiAcryfLEgjaQdDOnm
jhALQu8/Q0tGGzHUwMAvjz5FSxUwSaLer/yzJYJbSThOi5QktnD5LOaQo5vXVTZj
kwiOBCD/Mvt4GAa1zfQgQMxFZwx3E5WhCKzr3RXvePeUmLnpqJciWFKtdrvknn7z
MfW/OELpnMNqUOXW8lblXdjAGx27WTTSd9YcuQIDAQABAoIBAB/eCNswtmKmMduP
1HVEBxG6aJ6IKj+lx679sm246DG+nPYPUCFmfSh0n4a0CSUbxpwmoBrI+ASeE08e
P+k6XvVtD1qrMQQ1y9+ZR0fHn9gbDDzNiv7HzKjGv7ThCoVq5dvQCgCeKEhM2bpI
LVDtDiqHHp6fHKuUyUKo1MS0g6DZ2KY8jR/R/7DqJHE1CC6zostau6J70pTPc7l6
fYucF54lQ8PJuYtqfYmy+2EoH4Vm4Gz9UuRY9VhMDm+fdOt95HO/sVHYmrwMnXMt
bRRrp/rG153JJNIn3eFYwuwQRG+uaSr8wUvFrb78WV84xfnMjj9L0ZxD0mevn0ex
Tj+GbBECgYEA+lF3Sex5jZj7UBegoLzrsCaIElOK7Vkdom9jy9HuRz9kC0Flrdbe
s79fuU/7QZBtSlfKua5ybF640mk2rZDVZR3Uf5QvR9WLNybomKgirOAXeMtSeWQ1
cqt57NB2iKw/YPjewtXHcqGGQIEc/ui/L0vnSrp43zT1XCObd+wT2W8CgYEAyeFb
4evYH7Xo9u3hlkapmmp3b9v98Kimh+0Q7iJx1vy+vPyPO3CR/o8bMT6ven7AEsB/
5RXzfUW/gcY9FV6SMyDgTbDsDQnTe1s7sIwTer5OD5Xp9IHuDtE0uMDKOeRCa/9M
2VYbrfCZzw8EFG4v8fxVEAm9aAZWqSu2cH8QSFcCgYEAl6JJ9Mn/SDtn4biuYTCQ
RYDR5OgevHDDduarOYjOIvLPk9Hl2kzTU2eWgRdmSO1Ih0RvVdPLFMK8ixmZOcMG
wd40H6SQj59YWeyD8hXIC5kkHtRr/YUqq3Acx8vwQhK1wfSAXN5Ll7EpNmIAQpqT
Vf9Q+P/EwNG/4DThtN+ZlpkCgYBgT9VoCP5I0p5b/80ZxohvlM96XDfgMnWQb3ce
ROyOpnHQ86TZtLDSAy/z5HYPOJ0l1RSvFDPf1gCxRwQpR770CYE5T2iuJ7vvI+1s
IsfATT4sjVbaQYpzIzfF1KQlzlIp99iP71axOxIGCKHnpVHWXo2uYxcro6qAdsxJ
CzWXbQKBgQDu+hsa9l5RZkRa9a0Me9kia/5CkDV3ow/MlFaA6gyM+M0xE48XpjA+
39X3L7E8EVPqlR9VYDhYnAu7BVI6X1itUYtFT0nUX7dwx3RMZBWC3q7nvhK6p6aZ
620D7gUf8ouLMREvrU1wQaVYuWXfFQPF86w4UjGefntu017kyBIf9g==
-----END RSA PRIVATE KEY-----

[root@overcloud-controller-0 ~]# 


***********************************
Workstation && Shuttle Startup
**********************************

[boris@fedora24wks ~]$ sshuttle -e "ssh -F $HOME/.quickstart/ssh.config.ansible" -r undercloud  -v 10.0.0.0/24  192.168.24.0/24 
Starting sshuttle proxy.
[local sudo] Password: 
firewall manager: Starting firewall with Python version 3.5.3
firewall manager: ready method name nat.
IPv6 enabled: False
UDP enabled: False
DNS enabled: False
TCP redirector listening on ('127.0.0.1', 12300).
Starting client with Python version 3.5.3
c : connecting to server...
Warning: Permanently added '192.168.0.74' (ECDSA) to the list of known hosts.
Warning: Permanently added 'undercloud' (ECDSA) to the list of known hosts.
Starting server with Python version 2.7.5
 s: latency control setting = True
 s: available routes:
 s:   2/10.0.0.0/24
 s:   2/172.17.0.0/16
 s:   2/192.168.23.0/24
 s:   2/192.168.24.0/24
c : Connected.
firewall manager: setting up.
>> iptables -t nat -N sshuttle-12300
>> iptables -t nat -F sshuttle-12300
>> iptables -t nat -I OUTPUT 1 -j sshuttle-12300
>> iptables -t nat -I PREROUTING 1 -j sshuttle-12300
>> iptables -t nat -A sshuttle-12300 -j RETURN --dest 127.0.0.1/32 -p tcp
>> iptables -t nat -A sshuttle-12300 -j REDIRECT --dest 10.0.0.0/24 -p tcp --to-ports 12300 -m ttl ! --ttl 42
>> iptables -t nat -A sshuttle-12300 -j REDIRECT --dest 192.168.24.0/24 -p tcp --to-ports 12300 -m ttl ! --ttl 42
c : Accept TCP: 192.168.0.15:55816 -> 10.0.0.6:80.
c : Accept TCP: 192.168.0.15:55820 -> 10.0.0.6:80.
c : Accept TCP: 192.168.0.15:55822 -> 10.0.0.6:80.
c : Accept TCP: 192.168.0.15:55824 -> 10.0.0.6:80.
c : Accept TCP: 192.168.0.15:55826 -> 10.0.0.6:80.
c : Accept TCP: 192.168.0.15:55828 -> 10.0.0.6:80.
c : warning: closed channel 2 got cmd=TCP_STOP_SENDING len=0
 s: SW'unknown':Mux#2: deleting (11 remain)
 s: SW#7:10.0.0.6:80: deleting (10 remain)
c : SW#9:192.168.0.15:55820: deleting (11 remain)
c : SW'unknown':Mux#2: deleting (10 remain)
 s: SW'unknown':Mux#6: deleting (9 remain)
 s: SW#11:10.0.0.6:80: deleting (8 remain)
 s: SW'unknown':Mux#1: deleting (7 remain)
   Top report on VIRTHOST