803 Commits

Author SHA1 Message Date
jianghua wang
78f6c1d70b tools/Xen: failed to install domU in new XenServer
Current install_os_domU.sh depends on some keywords which are changed in the
next version XenServer which is upgraded to CentOS 7. So with the existing
script to install domU in the new version XenServer, it will always fail.
This patch is to make it to be compatible with all XenServer versions:
1. the output format of "ifconfig" is changed; the fix is to use the ip
   command to retrieve IP address.
2. In XS 6.5 and the previous XS, the "xe-guest-utilities" package file name
   is as "xe-guest-utilities_<version>_<arch>.deb" but now it delivers a
   single file for all Arch's and the file name is
   "xe-guest-utilities_<version>_all.deb". In order to make it to be
   compatible, the fix will try to search the old file name pattern by
   default. If it does't exist, then try to search the new file name pattern.

Change-Id: I893e89e42a5ef7dd079b571ea308f318c9befc9e
Closes-Bug: #1494241
2015-09-24 09:07:26 +01:00
Takashi NATSUME
b848ad783f Fix a typo in make_cert.sh
Change-Id: I6d4f02edf843f0519c3d0413bb033604a7ec73e9
2015-09-08 10:56:28 +09:00
Jenkins
61716205b2 Merge "Use the pip installed version of requests with Fedora" 2015-09-04 19:21:24 +00:00
Attila Fazekas
c7e772c164 Use the pip installed version of requests with Fedora
The upstream version of requests contains a copy
of urllib3 and cardet library, common practice in many distros
to create symbolic links for these libraries instead of creating
a huge package which contains the same library as the distro provides
as separate package as well.

Now devstack upgrades the urllib3 to incompatible version,
but it leaves the requests unchanged because Fedora already has the
latest version.
The issue does not happens with Ubuntu because it has older requests
and devstack updates it as well.
The pip installed version contains a bundled urllib3 and the actually
installed urllib3 version does not matters.

This is not the `usual` distro package overrides pip installed package
case.

Change-Id: Icfa71368384b0c2e3ff39265b2fa9190b5566b9b
Related-Bug: #1476770
2015-09-04 09:18:53 +10:00
Jenkins
1d0b0d363e Merge "Add/Overwrite default images in IMAGE_URLS and detect duplicates" 2015-09-03 08:52:59 +00:00
John Hua
a4693b5dea Add/Overwrite default images in IMAGE_URLS and detect duplicates
IMAGE_URLS could be set both in localrc with customization or stackrc by
default. By setting DOWNLOAD_DEFAULT_IMAGES, user could choose to add
default images to IMAGE_URLS or overwrite them.

As uploading duplicate images will cause a "409 Conflict" error, a
duplicate detection will expose it earlier.

Care needs to be taken that you don't end up with a duplicate image, so
clean up Xen's README.

Depends-On: I6fbae12f950a03afab39f341132746d3db9f788c
Change-Id: I3ca4e576aa3fb8992c08ca44900a8c53dd4b4163
Closes-Bug: #1473432
2015-08-27 10:33:26 +01:00
Andrey Pavlov
485c962667 Fix create_userrc.sh script
Patchset fixes calculating EC2_URL/S3_URL for user rc files in 'accrc' directory.
Currently calculation of these url's uses 'openstack endpoint show' command
without specifying os-identity-v3 flag. But output is empty without such flag.
So this patchset uses same construction as exists in functions-common.

Change-Id: Ia4f2510750fa0f46e2f1d58cf0a7a16782f022b3
2015-08-24 22:55:19 +03:00
Jenkins
987dc6453e Merge "Just use constraints everywhere" 2015-08-18 23:07:53 +00:00
Clark Boylan
05aa3846a0 Just use constraints everywhere
Having behavior on your laptop diverge from behavior in the gate is
confusing. Just use constraints on every devstack run to be consistent.
Users of devstack can edit the requirements repo in order to change
these constraints locally if necessary.

Change-Id: I843208e2e982eb04931b76f5cb4bd219fbcd70de
2015-08-18 09:39:04 -07:00
Sean Dague
2da606da2e add ebtables to world dump
I'm still at a loss about why guests stop being pingable in grenade,
so lets get ourselves some ebtables output as well.

Change-Id: I4e40eff6d0b1ef194e43b151a83206fbd50deb66
2015-08-06 10:02:43 -04:00
Jenkins
2246a8a6fe Merge "add -n --name flag to worlddump" 2015-07-29 22:02:54 +00:00
Sean Dague
ac9313e5a5 add -n --name flag to worlddump
We're worlddumping at success points in grenade, and it would be much
handier to explain when that happens via a symbolic name in the
filename. Add a --name option to worlddump to allow it.

Change-Id: I644200fe08e404dc7ca2006478ae4e11ca020672
2015-07-27 13:33:30 -04:00
Stanislaw Szydlo
aa81e2ea73 Fix errors in tools/ping_neutron.sh
Due to errors in tools/ping_neutron.sh, exercise neutron-adv-test.sh
fails. Faults were: 'neutron net-list' took too much arguments and
variable REMAINING_ARGS was mistyped.

Change-Id: I681328bfb1e4445543ef9d94e3b3824dbc9c8346
Closes-Bug: #1478021
2015-07-27 10:54:44 +02:00
Jenkins
469215d374 Merge "Check for nova-compute before running kill" 2015-07-16 23:49:21 +00:00
Jenkins
19533886ff Merge "Wait for command in worlddump" 2015-07-16 16:08:00 +00:00
Jenkins
67011910d2 Merge "Include domain variables in accrc" 2015-07-10 19:43:46 +00:00
Jenkins
45f0e3d057 Merge "Use project instead of tenant in create_userrc" 2015-07-10 03:10:42 +00:00
John Hua
6e121ff53e Remove unused files from tools/xen.
Most of unused files were used with build_domU_multi.sh which has been 
replaced by build_xva.sh. Besides tools/xen/scripts/templatedelete.sh 
was created for convenience purposes and now not in use.

Change-Id: I4282c779629e3413ee3cd3ff134c3b7b19eee487
Closes-Bug: #1470535
2015-07-08 05:59:26 +00:00
Jamie Lennox
c54d4ab910 Include domain variables in accrc
Include the user and project domain parameters in the generated user rc files.
This is fairly simplistic, if we were to follow the existing attitudes we
should iterate over the domains and add a new level of folders however this
would change the output location for files that may be depended upon.

Change-Id: I5e9e78406b11382751a591d91f711161bb98f47a
2015-07-07 19:33:18 +00:00
Jamie Lennox
9d6d8f8015 Use project instead of tenant in create_userrc
The create_userrc file is littered with references to a tenant. The tenant
concept has been deprecated long enough that we should use project instead.

I have not attempted to maintain compatibility with the --os-tenant-X flags
because I have not found reference to anyone using this script outside of
devstack.

Change-Id: I613f1bdc6673f0c4bfe29aaab7b514348a617a8c
2015-07-07 19:21:06 +00:00
Jenkins
05e32fb51e Merge "Support identity API v3 when generate clouds.yaml" 2015-07-06 16:01:49 +00:00
Ian Wienand
3a9df1dab7 Check for nova-compute before running kill
Unconditionally running this can lead to confusing failure output from
kill as the pgrep matches nothing when nova-compute isn't yet running.

Change-Id: I37cb84fe8e0b393f49b8907af16a3e44f82c46a6
2015-07-01 06:18:47 +10:00
Ian Wienand
99440f9d59 Wait for command in worlddump
Wait for the command to complete and catch errors when running
commands.

Change-Id: I2c93b3bdd930ed8564e33bd2d45fe4e3f08f03f5
2015-07-01 06:14:01 +10:00
Amey Bhide
432268b17b Fix NameError in worlddump.py
Change-Id: Ie87e5b5ead777c0153ed7fa5d1db5cc1ae444261
2015-06-30 11:41:13 -07:00
Anandprakash Dnyaneshwar Tandale
bde24cb7c2 Fixing the deprecated library function
os.popen() is deprecated since version 2.6. Resolved with use of
    subprocess module.

Change-Id: Ib6a91ee525e2e57d3901d2c0c1b2d1305bc4566f
2015-06-29 15:04:30 +05:30
Brant Knudson
68e6ae60e7 Support identity API v3 when generate clouds.yaml
When using IDENTITY_API_VERSION=3, the clouds.yaml must also set
auth/user_domain_id and project_domain_id.

Change-Id: If028f2935ea729276f40039a4003c07c08e91672
2015-06-26 19:59:41 +00:00
Brant Knudson
e1fa0701b3 Update clouds.yaml
If the user already has a clouds.yaml, update it with the "devstack"
entry.

Change-Id: Id02378b6f3a86f9fee201d91688205705202c0a8
2015-06-21 10:16:23 -05:00
Jenkins
128d113418 Merge "Make sure iptables-services is installed" 2015-06-19 05:10:48 +00:00
Jenkins
7a6f0b6bff Merge "guru meditation report for nova-compute in worlddump" 2015-06-12 07:50:17 +00:00
Jenkins
dae868fcb0 Merge "Revert "Replace pip-installed requests CA bundle with link"" 2015-06-10 12:51:52 +00:00
Sean Dague
7272afdf8b Revert "Replace pip-installed requests CA bundle with link"
This does not gracefully handle the situation where requests
is not there at the beginning. Needs to be rethought.

This reverts commit 7d350720fe5d25fece68c5d1625a33a6cad431ef.

Change-Id: I101fac0dc6fdc97b7fb0b2955cffc6b4905152e5
2015-06-10 10:26:57 +00:00
Jenkins
6108092d30 Merge "XenAPI: Increase OpenStack DomU usage again" 2015-06-09 23:00:16 +00:00
Jenkins
1bbe71c856 Merge "Replace pip-installed requests CA bundle with link" 2015-06-09 23:00:07 +00:00
Ben Nemec
64b2ebca15 Make sure iptables-services is installed
The iptables service files are no longer included by default on
Fedora.  This causes the systemctl calls in fixup_stuff.sh to fail
when disabling firewalld in favor of iptables.

Change-Id: If37691d03e3d07ca8b53c541717081beeb184c16
Closes-Bug: #1462347
2015-06-09 15:22:37 +00:00
Joe Gordon
2ebe993b25 guru meditation report for nova-compute in worlddump
Nova-compute is hanging in the multinode test, and its difficult to
figure out why. So trigger a guru meditation report for nova-compute in
worlddump so we can see what nova-compute is doing when it is hung.

Having a hung nova-compute causes tempest to fail and
I035fe8e3333034e44b403ed0f986220ab5b0e57a runs worlddump whenever
tempest fails.

Bug 1462305 is one of the last issues left before the multinode job is
stable enough to gate on, and this patch should make it much easier to
debug.

Change-Id: I87d7536b5992c47b8082684cc662f953113fd1a8
Related-Bug: #1462305
2015-06-07 17:01:52 +09:00
Rob Crittenden
7d350720fe Replace pip-installed requests CA bundle with link
If the version of python-requests required is higher than
that provided by the operating system, pip will install
it from upstream.

The upstream version provides its own CA certificate bundle
based on the Mozilla bundle, and defaults to that in case
a CA certificate file is not specified for a request.

The distribution-specific packages point to the system-wide
CA bundle that can be managed by tools such as
update-ca-trust (Fedora/RHEL) and update-ca-certificates
(Debian/Ubuntu).

When installing in SSL/TLS mode, either with SSL=True or by
adding tls-proxy to ENABLED_SERVICES, if a non-systemwide
CA bundle is used, then the CA generated by devstack will
not be used causing the installation to fail.

Replace the upstream-provided bundle with a link to the
system bundle when possible.

Change-Id: I349662ff8f851b4a7f879f89b8975a068f2d73dc
Closes-Bug: #1459789
2015-06-02 18:35:33 -04:00
Tony Breeds
6d50d95cae Skip the .tox dir when building docs
When running tools/build_docs.sh in a devstack dir that has also run tox
build_docs needlessly runs shocco on the .tox files.

Just skip them.

Change-Id: Ia561e49ea2214ac75bd55964f1b86872118b2031
2015-05-29 12:26:31 +10:00
Bob Ball
40c5ea67d3 XenAPI: Increase OpenStack DomU usage again
Devstack has continued to grow in memory requirements and now we cannot
reliably fit in 4GB, with several services being unable to start.  Increase
the minimum for DomU to 6GB to leave room for virtual machines

Change-Id: Idbdfa1f36015b6af347d1ce27eb28baa360af5ef
2015-05-28 06:42:03 +01:00
Ian Wienand
3380a16974 Disable firewalld always
We've bike-sheded over this before
(I5252a12223a35f7fb7a4ac3c58aa4a3cd1bc4799) but I have just traced
down further issues to firewalld with neutron+ipv6 (see the bug).

In fact, as mentioned in the comments, RDO disables firewalld and the
neutron guide says to disable it [1].  The force flag is left if
anyone really wants this; but nobody is testing (or, as far as I can
tell, working on) this so bring devstack back into line and disable it
always.  Note we do not remove the package; as has been found in the
puppet scripts this can lead to dependency issues.

[1] http://docs.openstack.org/developer/devstack/guides/neutron.html

Change-Id: Ief7cb33d926a9538f4eb39c74d906ee0c879de35
Partial-Bug: 1455303
2015-05-15 19:14:19 +10:00
Sean Dague
737e94202f dump compute consoles on fail as well
This provides a dump of the compute consoles as well on failure.

Change-Id: Ib253537a54a1b9d83a930bbefa4512e039575fd1
2015-05-13 05:58:41 -04:00
Sean Dague
60a140571e add network info to the worlddump
This adds potentially helpful networking info to the world dump.

It also refactors some of the output mechanisms into reusable
functions for cleanliness in the code.

Change-Id: I39f95bd487c152925f8fadd1799149db35cffd52
2015-05-11 14:56:49 -04:00
Jenkins
db8898c495 Merge "Update default cirros version" 2015-05-08 18:43:38 +00:00
Jenkins
55f063a106 Merge "create a more generic work around for cffi & wheels" 2015-05-08 01:44:57 +00:00
Jens Rosenboom
9fd75f57fd Update default cirros version
Update the default CIRROS_VERSION to 0.3.4, which has better support
for IPv6 and some other bugfixes.

Co-Authored-By: Scott Moser <smoser@ubuntu.com>
Change-Id: I03ee6e1403680fb6c421225a7cadaf8a82edf702
Depends-On: Iac9f108d947ff4a51f99c6e8ad9d1ac5b32c000a
2015-05-07 16:06:02 +02:00
Sean Dague
168b7c226c dump iptables in the worlddump
If we fail during devstack / grenade runs, it would be nice to have
the map of iptables that are currently active as well. This makes it
handy to start figuring out what's going on when test servers don't
ping.

Change-Id: Ia31736ef2cb0221586d30c089473dfdc1db90e23
2015-05-07 08:57:28 -04:00
Sean Dague
5a59ac7d43 create a more generic work around for cffi & wheels
This is an attempt to fix the cffi vs. wheels bug in a more generic
way by just ensuring that pip has installed cffi with a pip understood
version into the venv before we try to do any builds.

Related-Bug: #1451992

Change-Id: Ibc58668c53933033405b40f79b0e9ffc73a01a6f
2015-05-06 15:58:24 +00:00
Jenkins
14d1cf90ed Merge "Add a peak memory tracker to dstat" 2015-04-20 19:16:58 +00:00
Ian Wienand
72a8be60cd Add a peak memory tracker to dstat
We can see at-a-glance memory usage during the run with dstat but we
have no way to break that down into an overview of where memory is
going.

This adds a peer-service to dstat that records snapshots of the system
during peak memory usage.  It checks periodically if there is less
memory available than before and, if so, records the running processes
and vm overview.

The intent is to add logic into the verify-pipeline jobs to use this
report and send statistics on peak memory usage to statsd [1].  We can
then build a picture of memory-usage growth over time.  This type of
report would have allowed better insight into issues such as
introduced by Idf3a3a914b54779172776822710b3e52e751b1d1 where
memory-usage jumped dramatically after switching to pip versions of
libraries.  Tracking details of memory usage is going to be an
important part of future development.

[1] http://graphite.openstack.org/

Change-Id: I4b0a8f382dcaa09331987ab84a68546ec29cbc18
2015-04-20 12:27:32 -04:00
Jenkins
9aad1b99fd Merge "refactor ping_check" 2015-04-20 13:39:33 +00:00
Jenkins
abfa858f79 Merge "Revert "List all CIRROS ARCH images in image_list.sh"" 2015-04-17 15:47:27 +00:00