Commit Graph

178 Commits

Author SHA1 Message Date
Drew Bailey
a8998f7599 Merge pull request #6573 from hashicorp/update-cci-consul
updates default consul version to 1.6.1
2019-11-07 11:01:22 -05:00
Drew Bailey
5d69b3a2a5 update vagrant & packer consul versions 2019-11-07 10:13:14 -05:00
Drew Bailey
8095b4868a New monitor pkg for shared monitor functionality
Adds new package that can be used by client and server RPC endpoints to
facilitate monitoring based off of a logger

clean up old code

small comment about write

rm old comment about minsize

rename to Monitor

Removes connection logic from monitor command

Keep connection logic in endpoints, use a channel to send results from
monitoring

use new multisink logger and interfaces

small test for dropped messages

update go-hclogger and update sink/intercept logger interfaces
2019-11-05 09:51:49 -05:00
Tim Gross
4abb6b5786 e2e: refactor Consul configurations (#6559)
Ensure that we're reusing the base configuration between client and
servers without the possibility of drift. Reduce the amount of `sed`
mangling of the configuration file, and make recommended changes from
`shellcheck` for this section of the provisioning script.

Fixes some rebase errors on the Nomad config as well.
2019-10-28 09:27:40 -04:00
Tim Gross
56bfcddba7 e2e: refactor Nomad configuration (#6560)
Share base configuration for telemetry and consul. Have the server
configurations respect the `var.server_count` config. Make changes
recommended by `shellcheck` in the provisioning scripts for this section.

Switch to OS/arch-tagged release bundles on S3 for compatibility with
adding Windows builds in the near future.
2019-10-28 08:21:02 -04:00
Tim Gross
5239e69e33 e2e: refactor Vault configuration (#6561)
Match the configuration directory layout we're using for Consul and
other services. Make recommended changes from `shellcheck` for this
section of the provisioning script.
2019-10-25 15:29:01 -04:00
Tim Gross
a7861b7637 e2e: use sockaddr for IP address configuration (#6548)
Update the Consul and Vault configs to take advantage of their
included `go-sockaddr` library for getting the IP addresses we need in
a portable way. This particularly avoids problems with "predictable"
interface names provided by systemd.

Also adds the `sockaddr` binary to the Packer build so we can use it
in our provisioning scripts.
2019-10-25 14:08:38 -04:00
Tim Gross
9ce6a84a0f e2e: split Packer build scripts from TF provisioning (#6542)
Make a clear split between Packer and Terraform provisioning steps:
the scripts in the `packer/linux` directory are run when we build the
AMI whereas the stuff in shared are run at Terraform provisioning time.

Merging all runtime provisioning scripts into a single script for each
of server/client solves the following:

* Userdata scripts can't take arguments, they can only be templated
  and that means we have to do TF escaping in bash/powershell scripts.
* TF provisioning scripts race with userdata scripts.
2019-10-25 08:08:24 -04:00
Tim Gross
8d97fc8b4a e2e: upgrade terraform to 0.12.x (#6489) 2019-10-14 11:27:08 -04:00
Tim Gross
0371664d03 e2e: move remote-exec inline to script (#6488)
A failing script in a `remote-exec` provisioner's `inline` stanza
won't fail the provisioning step. This lets us continue on to execute
tests against potentially broken deployments, rather than letting us
know the provisioning itself failed.
2019-10-14 10:23:41 -04:00
Danielle Lancashire
d058dabe3e chore: initial hclfmt 2019-10-11 14:00:05 +02:00
Lang Martin
dbd1488ac6 Merge pull request #6373 from hashicorp/b-raft-proto-upgrade
raft protocol defaults to version 2
2019-09-26 14:33:09 -04:00
Tim Gross
e17901d667 driver/networking: don't recreate existing network namespaces 2019-09-25 14:58:17 -04:00
Tim Gross
ba2a4a05c0 failing test for #6310 2019-09-25 14:58:17 -04:00
Lang Martin
bba2c2640d script e2e/upgrades: cluster upgrade scripts 2019-09-24 14:35:45 -04:00
Danielle
7ff5b838f2 Merge pull request #6342 from hashicorp/f-host-volume-e2e
Add Host Volumes E2E test
2019-09-18 12:59:32 -07:00
Tim Gross
a5c48b886f e2e: test infra for client node restarts (#6313)
Add a test helper that restarts a specific client node running under
systemd using a `raw_exec` job.
2019-09-18 10:10:14 -04:00
Tim Gross
00c24fcc29 e2e: move consul status check helpers to e2eutil (#6314) 2019-09-18 08:18:19 -04:00
Danielle Lancashire
cc7b8323d1 e2e: init host volumes test 2019-09-18 00:34:48 +02:00
Danielle Lancashire
844cc33ff3 e2e: Add Host Volume Configuration 2019-09-17 20:06:50 +02:00
Tim Gross
31f91cf4c8 e2e: fixes for race conditions in testing (#6300)
- In script checks, ensure we're running `Exec` against the new running
  allocation and not the earlier stopped one.
- In script checks, allow `Exec` calls to error due to lack of pty when
  we use the exec to kill the task.
- In `utils.go/RegisterAllocs`, force query for allocations to wait on
  wait index returned by registration call.
2019-09-10 13:45:16 -04:00
Tim Gross
f7c9db5624 e2e: tag instances with origin (#6293)
When multiple developers are working on e2e testing, it helps to be
able to identify which infrastructure belongs to which Nomad SHA and
which developer. This adds tags to the EC2 instances.
2019-09-06 15:49:18 -04:00
Tim Gross
f856cd4c58 script checks: use cat instead of ls for exit code agreement 2019-09-06 11:17:00 -04:00
Tim Gross
863339d65a e2e: script check testing 2019-09-06 10:18:55 -04:00
Michael Schurter
2011b46a19 e2e: test demo job for connect 2019-09-04 12:40:08 -07:00
Tim Gross
e19520cf13 e2e: filter default AMI by OS
Add an OS tag to Packer builds of our e2e test AMIs and then filters
by this in Terraform.
2019-08-30 16:51:13 -04:00
Danielle Lancashire
1cd86141d9 chore: Format hcl configurations 2019-07-20 16:55:07 +02:00
Michael Schurter
b73882882e e2e: debug log level for everyone! 2019-07-18 06:55:27 -07:00
Michael Schurter
b66c6cfc2d e2e: enable_debug=true for all agents
Enables the pprof http endpoint for debugging.
2019-07-17 15:20:45 -07:00
Preetha
c031f666c9 Merge pull request #5912 from hashicorp/f-systemd-nofile
systemd: set a high but non-infinite fd limit
2019-07-11 12:31:12 -05:00
Preetha Appan
47bdbf9f20 add module version constraint to e2e/terraform 2019-07-05 09:18:38 -05:00
Michael Schurter
4652ccfec5 systemd: set a high but non-infinite fd limit 2019-07-02 09:13:24 -07:00
Lang Martin
f7ab4f0f21 e2e update shell scripts argument quoting 2019-06-04 15:52:32 -04:00
Lang Martin
4b8c9428f4 e2e/deployment DeploymentsForJob fail instead of nil, error passing 2019-06-04 14:31:42 -04:00
Lang Martin
6ca33d0f20 e2e/deployment fail if the second deployment times out 2019-06-04 14:08:30 -04:00
Lang Martin
293b3d4b9f e2e bin/update and bin/run, README 2019-06-04 13:42:07 -04:00
Lang Martin
22b6c2e6ad e2e/deployment find the second deployment, use its status 2019-06-04 13:41:52 -04:00
Lang Martin
a234550d6f Update e2e/deployment/deployment.go
Co-Authored-By: Mahmood Ali <mahmood@notnoop.com>
2019-05-22 12:34:57 -04:00
Lang Martin
a5e3e8e818 e2e/deployment comment the job files for clarity 2019-05-22 12:34:57 -04:00
Lang Martin
dd2f16a031 e2e add deployment to the list of e2e tests, minor fixes 2019-05-22 12:34:57 -04:00
Lang Martin
1e9f3145d6 e2e readme minor changes to command + env val templates and order 2019-05-22 12:34:57 -04:00
Lang Martin
3a3c4426bb e2e utils remove ineffectual assignment of allocs 2019-05-22 12:34:57 -04:00
Lang Martin
78b9aeffa2 e2e README typo 2019-05-22 12:34:57 -04:00
Lang Martin
1a99a0f771 e2e utils error format arg match 2019-05-22 12:32:08 -04:00
Lang Martin
2422991220 new e2e deployment test 2019-05-22 12:32:08 -04:00
Lang Martin
8b64574721 e2e util split new alloc and await placement, new WaitForDeployment 2019-05-22 12:32:08 -04:00
Preetha
abaf5dcff1 Merge pull request #5702 from hashicorp/f-filter-by-create-index
Filter deployments by create index
2019-05-15 21:50:41 -05:00
Michael Schurter
846b482814 e2e: fix nomad service for systemd<230 2019-05-14 10:53:26 -07:00
Preetha Appan
af2ed66749 Add flag similar to --all for allocs to be able to filter deployments by latest 2019-05-13 18:33:41 -05:00
Mahmood Ali
5abbee5d39 Merge pull request #5632 from hashicorp/f-nomad-exec-parts-01-base
nomad exec part 1: plumbing and docker driver
2019-05-09 18:09:27 -04:00