Commit Graph

17892 Commits

Author SHA1 Message Date
Seth Hoenig
eef81c3b4f structs: fix compatibility between api and nomad/structs proxy definitions
The field names within the structs representing the Connect proxy
definition were not the same (nomad/structs/ vs api/), causing the
values to be lost in translation for the 'nomad job inspect' command.

Since the field names already shipped in v0.11.0 we cannot simply
fix the names. Instead, use the json struct tag on the structs/ structs
to remap the name to match the publicly expose api/ package on json
encoding.

This means existing jobs from v0.11.0 will continue to work, and
the JSON API for job submission will remain backwards compatible.
2020-04-13 15:59:45 -06:00
Seth Hoenig
dc11226763 jobspec: correctly parse proxy fields from jobspec
Before, the proxy stanza did not parse non-object fields
`local_service_port` and `local_service_address` from the
connect `proxy` stanza. This change fixes that.
2020-04-13 15:59:45 -06:00
Chris Baker
a8ed119496 documents the scaling block in the JSON Job docs (#7706)
* documents the scaling block in the JSON Job docs

resolves #7656

* add task-specific restart to JSON Job docs

companion to #7603

* [docs] improved and corrected scaling docs

* Update website/pages/api-docs/json-jobs.mdx

Co-Authored-By: Michael Schurter <mschurter@hashicorp.com>

Co-authored-by: Michael Schurter <mschurter@hashicorp.com>
2020-04-13 16:33:49 -05:00
Chris Baker
bea905264b update restart documentation (#7603)
* update `restart` documentation

#7288 added support for task-specific `restart` policy. this PR updates the docs to reflect that.

* added an explicit example of task-specific restart policy

* Update website/pages/docs/job-specification/restart.mdx
2020-04-13 16:29:43 -05:00
Drew Bailey
aab5233116 Merge pull request #7663 from hashicorp/b-taskrunner-shutdown_delay
Run task shutdown_delay regardless of service registration
2020-04-13 13:27:24 -04:00
Drew Bailey
f207abdc63 Update CHANGELOG.md 2020-04-13 12:41:13 -04:00
Tim Gross
092456b93f refactor: consolidate private methods for CSI RPC (#7702)
Follow-up for a method missed in the refactor for #7688. The
`volAndPluginLookup` method is only ever called from the server's `CSI`
RPC and never the `ClientCSI` RPC, so move it into that scope.
2020-04-13 10:46:43 -04:00
Tim Gross
cafdcc9216 e2e: testing reliability (#7701)
* pin CSI plugin versions
* ensure failing CSI tests clean up
* allow NOMAD_SHA env var to override makefile
2020-04-13 10:25:24 -04:00
Mahmood Ali
5fbb837556 Merge pull request #7693 from greut/bump-testify
api: testify v1.5.1
2020-04-11 09:09:44 -04:00
Yoan Blanc
def809b807 api: testify v1.5.1
Signed-off-by: Yoan Blanc <yoan@dosimple.ch>
2020-04-11 13:55:10 +02:00
Tim Gross
09abe0c702 refactor: make nodeForControllerPlugin private to ClientCSI (#7688)
The current design of `ClientCSI` RPC requires that callers in the
server know about the free-standing `nodeForControllerPlugin`
function. This makes it difficult to send `ClientCSI` RPC messages
from subpackages of `nomad` and adds a bunch of boilerplate to every
server-side caller of a controller RPC.

This changeset makes it so that the `ClientCSI` RPCs will populate and
validate the controller's client node ID if it hasn't been passed by
the caller, centralizing the logic of picking and validating
controller targets into the `nomad.ClientCSI` struct.
2020-04-10 16:47:21 -04:00
Seth Hoenig
47dfa762b3 Merge pull request #7684 from hashicorp/b-connect-sidecar-name
connect: enable configuring sidecar_task.name
2020-04-10 10:04:25 -06:00
Seth Hoenig
ce3b57e100 Merge pull request #7683 from hashicorp/b-no-sidecar-panic
connect: correctly handle missing sidecar_service task stanza
2020-04-10 09:49:59 -06:00
Seth Hoenig
0eb2844900 connect: extract common task keys 2020-04-10 09:49:19 -06:00
Drew Bailey
e2886582fb changelog 2020-04-10 11:14:39 -04:00
Drew Bailey
3af2d05f6b Run task shutdown_delay regardless of service registration
task shutdown_delay will currently only run if there are registered
services for the task. This implementation detail isn't explicity stated
anywhere and is defined outside of the service stanza.

This change moves shutdown_delay to be evaluated after prekill hooks are
run, outside of any task runner hooks.

just use time.sleep
2020-04-10 11:06:26 -04:00
Seth Hoenig
729931aced connect: enable configuring sidecar_task.name
Before, the submitted jobspec for sidecar_task would pass
through 2 key validation steps - once for the subset specific
to connect sidecar task definitions, and once again for the set
of normal task definition where the task would actually get
unmarshalled.

The valid keys for the normal task definition did not include
"name", which is supposed to be configurable for the sidecar
task. To fix this, just eliminate the double validation step,
and instead pass-in the correct set of keys to validate against
to the one generic task parser.

Fixes #7680
2020-04-09 21:01:16 -06:00
Seth Hoenig
79a5241176 connect: correctly deal with nil sidecar_service task stanza
Before, if the sidecar_service stanza of a connect enabled service
was missing, the job submission would cause a panic in the nomad
agent. Since the panic was happening in the API handler the agent
itself continued running, but this change will the condition more
gracefully.

By fixing the `Copy` method, the API handler now returns the proper
error.

$ nomad job run foo.nomad
Error submitting job: Unexpected response code: 500 (1 error occurred:
	* Task group api validation failed: 2 errors occurred:
	* Missing tasks for task group
	* Task group service validation failed: 1 error occurred:
	* Service[0] count-api validation failed: 1 error occurred:
	* Consul Connect must be native or use a sidecar service
2020-04-09 20:28:17 -06:00
Mahmood Ali
5b65b95a0e Merge pull request #7676 from hashicorp/vendor-golang-org-x-20200409
Upgrade all golang.org/x packages
2020-04-09 17:18:57 -04:00
Seth Hoenig
bb5f920179 Merge pull request #7678 from hashicorp/docs-connect-config-link-404
docs: fix link to envoy proxy documentation on consul site
2020-04-09 13:56:58 -06:00
Seth Hoenig
9abd8097ae docs: fix link to envoy proxy documentation on consul site 2020-04-09 13:46:59 -06:00
Mahmood Ali
00309e4079 Upgrade all golang.org/x packages
Upgrade all golang.org/x packages to pick up fixes and improvements.
Some packages date back to 2018 and so much improvement happened since
then!
2020-04-09 15:23:25 -04:00
Michael Schurter
64765aad64 Merge pull request #7675 from hashicorp/release-post-0110
Prepare for 0.11.1 release
2020-04-09 12:20:39 -07:00
Michael Schurter
343a2f62cd docs: add #7673 to changelog 2020-04-09 12:18:34 -07:00
Mahmood Ali
12c60390af Merge pull request #7673 from hashicorp/b-http2-cached-connections
vendor: upgrade golang.org/x/net packages
2020-04-09 15:14:40 -04:00
Michael Schurter
90c4b3b186 docs: prep changelog for 0.11.1 2020-04-09 12:11:54 -07:00
Michael Schurter
a6e0f330c2 release: bump version to 0.11.1 for development 2020-04-09 12:11:13 -07:00
James Rasell
9dc6ccd814 Merge pull request #7666 from hashicorp/add-0.11.0-changelog-release-date
changelog: add 0.11.0 release date.
2020-04-09 21:10:15 +02:00
Mahmood Ali
9df4c2405e vendor: upgrade golang.org/net/...
golang.org/net packages are ancient - upgrading them to pick up
important fixes, e.g. https://go-review.googlesource.com/c/go/+/87298/
2020-04-09 14:57:39 -04:00
Mahmood Ali
8259c6dfc0 Merge pull request #7672 from hashicorp/dev-e2e-tweaks-20200409
e2e: add a convenient creation script
2020-04-09 11:30:48 -04:00
Mahmood Ali
71d0652a21 fixup! e2e: add a convenient creation script 2020-04-09 11:04:26 -04:00
Mahmood Ali
a2875eb963 e2e: add a convenient creation script
Add a convenience Makefile for creating e2e environment for manual
debugging.
2020-04-09 10:54:30 -04:00
James Rasell
611f03a8b3 changelog: add 0.11.0 release date. 2020-04-09 10:35:17 +02:00
Mahmood Ali
65bff323cf Merge pull request #7652 from hashicorp/v-gomod-msgpaack
dev: Use go mod for managing hashicorp/go-msgpack
2020-04-08 14:42:39 -04:00
Mahmood Ali
c3abb33453 go mod for go-bindata
Use go mod for github.com/hashicorp/go-bindata/go-bindata and
github.com/elazarl/go-bindata-assetfs/go-bindata-assetfs but use
`@master` to pull the latest master.  These packages don't have release
tags so `@master` worksaround it.
2020-04-08 14:30:37 -04:00
Mahmood Ali
0c050339fa Merge pull request #7650 from hashicorp/deflake-set-server-tests
tests: deflake some SetServer related tests
2020-04-08 14:28:30 -04:00
Michael Schurter
7553e42878 Merge pull request #7658 from hashicorp/docs-0110
docs: update downloads+banner for 0.11.0 GA
2020-04-08 08:58:24 -07:00
Tim Gross
0046646ed3 dist: make README consistent with service unit (#7648) 2020-04-08 09:32:03 -04:00
Mahmood Ali
edb86465f3 Merge pull request #7662 from hashicorp/docs-external-rkt
docs: move rkt to external drivers
2020-04-08 07:59:26 -04:00
Mahmood Ali
a397031b06 change tense
Co-Authored-By: Chris Baker <1675087+cgbaker@users.noreply.github.com>
2020-04-08 07:59:11 -04:00
Mahmood Ali
b3f6ef5087 docs: move rkt to external drivers 2020-04-07 23:13:16 -04:00
Michael Schurter
0ee153daf2 docs: update downloads+banner for 0.11.0 GA 2020-04-07 15:14:22 -07:00
Michael Schurter
30eb4ef407 Merge pull request #7654 from hashicorp/docs-beta
docs: update changelog/upgrade for 0.11.0
2020-04-07 11:31:45 -07:00
Michael Schurter
a2d17783d0 docs: remove 0.11 from scaling docs
Keep beta label for now.
2020-04-07 11:22:13 -07:00
Michael Schurter
6b0dc990c9 docs: remove beta marker from lifecycle 2020-04-07 11:22:04 -07:00
Michael Schurter
3c4cb52e1c Update website/pages/docs/upgrade/upgrade-specific.mdx
Co-Authored-By: Buck Doyle <buck@hashicorp.com>
2020-04-07 11:08:40 -07:00
Michael Schurter
cf9dcfdce0 Update CHANGELOG.md
Co-Authored-By: Drew Bailey <2614075+drewbailey@users.noreply.github.com>
2020-04-07 10:45:18 -07:00
Michael Schurter
73e1d7d390 docs: update changelog/upgrade for 0.11.0 2020-04-07 10:32:23 -07:00
Tim Gross
9e26e4ad7e build: remove working dir from stack traces (#7653)
Adding `-trimpath` to builds removes the local working directory from
the goroutine stack traces, which makes our builds more reproducible
and doesn't leak information about our local development workstations
or CI environment.
2020-04-07 13:32:07 -04:00
dependabot[bot]
5f5a708e02 build(deps): bump next from 9.3.1 to 9.3.2 in /website (#7571)
Bumps [next](https://github.com/zeit/next.js) from 9.3.1 to 9.3.2.
- [Release notes](https://github.com/zeit/next.js/releases)
- [Commits](https://github.com/zeit/next.js/compare/v9.3.1...v9.3.2)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2020-04-07 12:31:27 -04:00