Commit Graph

51 Commits

Author SHA1 Message Date
Tim Gross
22bfcdecf1 docs: add missing copyright headers in Terraform examples (#20412) 2024-04-16 15:21:03 -04:00
Nick Wales
e014e8411c terraform: updates AWS example packer and terraform code (#19512)
The "Provision a Nomad cluster in the cloud" works in AWS with these updates:

- use an available ubuntu version
- uses hashicorp packages where possible
- updates Nvidia installation
- installs CNI plugins
2024-04-16 10:47:31 -04:00
Kerim Satirli
5e1bbf90fc docs: update all URLs to developer.hashicorp.com (#16247) 2023-10-24 11:00:11 -04:00
hashicorp-copywrite[bot]
a9d61ea3fd Update copyright file headers to BUSL-1.1 2023-08-10 17:27:29 -05:00
Bruce Lok
7173d3bc25 Add missing consul grpc config (#17943) 2023-07-24 12:39:23 +01:00
hashicorp-copywrite[bot]
f005448366 [COMPLIANCE] Add Copyright and License Headers 2023-04-10 15:36:59 +00:00
James Rasell
0a9ef36ab7 terraform: update installed versions of HashiCorp tools. (#13635) 2022-07-07 16:12:19 +02:00
Jason Paul Deland
f42c94dadd demo/terraform: fix nvidia drivers installation 2022-05-31 20:17:55 -04:00
Ivo
607ce11582 [terraform/aws] Fix NVidia GPG key error (#12985)
* Fix NVidia GPG key error - NVidia rotated their repo keys, see https://forums.developer.nvidia.com/t/notice-cuda-linux-repository-key-rotation/212771
2022-05-16 06:49:01 -04:00
Tim Gross
247e20e10b scripts: fix interpreter for bash (#12549)
Many of our scripts have a non-portable interpreter line for bash and
use bash-specific variables like `BASH_SOURCE`. Update the interpreter
line to be portable between various Linuxes and macOS without
complaint from posix shell users.
2022-04-12 10:08:21 -04:00
Mahmood Ali
cd59172191 Format Terraform files (#11099)
Also format terraform scripts with hclfmt, equivalent to terraform fmt.

I opted not to use terraform fmt, because I didn't want to introduce dev dependency on the terraform CLI.

Also, I've optimized the find command to ignore spurious directories (e.g. .git, node_modules) that seem to be populated with too many files! make hclfmt takes 0.3s on my mac down from 7 seconds!
2021-09-01 15:15:06 -04:00
Seth Hoenig
2a35c35a6e dist: place systemd unit options correctly
This PR places StartLimitIntervalSec and StartLimitBurst in the
Unit section of systemd unit files, rather than the Service section.

https://www.freedesktop.org/software/systemd/man/systemd.unit.html

Fixes #10065
2021-02-22 19:23:00 -06:00
Michael Schurter
cf89177c6b docs: update scripts to 0.12.4 2020-09-09 15:22:37 -07:00
Gale Fagan
10fa09943c Updating versions and removing deprecated items (#8750)
* Removed deprecated Spark pieces.

* Bumped HashiCorp stack versions to current as of commit date

* Bumped versions of HashiCorp stack tools

* Bumped versions, added VAULT_ADDR in GCP, removed refs to Spark in shared README
2020-09-02 10:14:47 -07:00
Kent 'picat' Gruber
aa23c57299 Cleanup, enable the Vault UI, and bind to all IPv4 addresses in the config
This make the config cleaner, and allows Vault to actually be accessible through a load balancer.
2020-07-16 15:26:22 -04:00
Kent 'picat' Gruber
865c09635e If $CLOUD is "gce" for auto-join, use different metadata curl command 2020-07-16 15:21:57 -04:00
Kent 'picat' Gruber
153fffe58a Create terraform/shared/config/consul_gce.service 2020-07-16 15:20:34 -04:00
Michael Schurter
2011b46a19 e2e: test demo job for connect 2019-09-04 12:40:08 -07:00
Ryan Lewkowicz
5c51d19837 bumped hadoop version 2019-08-12 16:40:04 -04:00
Omar Khawaja
88c03d0888 TF config enable services (#5947)
* enable vault, consul, and nomad services to make them persistent after reboot

* update AMI
2019-07-11 22:36:58 +02:00
Mahmood Ali
5035db0c49 docs: update s3 urls to use virtual bucket style
In response to https://forums.aws.amazon.com/ann.jspa?annID=6776
2019-05-06 10:39:51 -04:00
Chris Baker
26158acffc Update setup.sh 2019-04-11 09:31:47 -04:00
Chris Baker
2308a5839d terraform: work on terraform setup
* support for 0.9.0
* ELB for servers
* better output
* customizable security groups
* nvidia-docker support
* different server/client instance types
2019-04-11 13:00:20 +00:00
Michael Schurter
475bcaafd6 docs: sync systemd unit files; update deploy guide
The systemd configs spread across our repo were fairly out of sync. This
should get them on our best practices.

The deployment guide also had some strange things like running Nomad as
a non-root user. It would be fine for servers but completely breaks
clients. For simplicity I simply removed the non-root user references.
2019-03-19 15:18:12 -07:00
Omar Khawaja
24eaa4b9f9 AWS env update (#5423)
* update versions of all products and add consul-template

* update client and server user_data scripts

* modify README.md and terraform.tfvars

* fix typo in consul-template system unit file

* update AMI id
2019-03-15 15:55:34 -04:00
Omar Khawaja
3ad663be60 AWS sandbox environment upgrade (#4873)
* upgrade Nomad from 0.8.4 to 0.8.6

* update deprecated nomad and vault commands

* update AMI ID

* add ingress rule for default fabio port and fabio UI

* upgrade Consul and Vault versions

* update AMI ID in README.md and terraform.tfvars
2018-11-13 23:21:01 -05:00
Thomas Hackett
122c075bde Corrected vault address and port in client/server hcl 2018-09-14 16:18:03 +00:00
Rob Genova
dff70d274a bump Vault, Consul, Nomad versions; update AWS AMI 2018-06-26 22:13:47 +00:00
Rob Genova
61908a0dea bump Nomad to 0.8.1, Hadoop to 2.7.6 2018-04-18 22:33:58 +00:00
Rob Genova
500c397366 Update to Nomad 0.8, Consul 1.0.7 and Vault 0.10 2018-04-15 23:00:55 +00:00
Michael Schurter
c6371dcbe2 tf: update services and add tools
Also use the latest method for installing Docker via:
https://docs.docker.com/install/linux/docker-ce/debian/
2018-04-04 15:05:49 -07:00
Rob Genova
a6d620dcab Bump Hadoop version in run-time config scripts; update AMI 2018-03-20 19:55:09 +00:00
Rob Genova
bfd0967acf Enable raw_exec and Docker privileged mode 2018-03-20 17:48:14 +00:00
Rob Genova
dae97a9708 Bump Hadoop version 2018-03-20 17:47:24 +00:00
Rob Genova
606e7a6d54 Support dynamic replacement of the Nomad binary at run-time 2018-03-20 17:46:32 +00:00
Rob Genova
67e3e19666 Use latest versions of Consul, Vault and Nomad 2018-01-08 22:44:02 +00:00
Rob Genova
c9697d6b2c update provisioning scripts to support both AWS and Azure 2017-11-15 19:39:36 +00:00
Rob Genova
042ee76e3a update config files to support systemd and Azure; reorganize Packer file hierarchy; update Vagrantfile to use latest tool versions 2017-11-15 19:31:46 +00:00
Rob Genova
bbf79955d7 Update build and runtime config scripts to support multiple clouds 2017-11-01 21:15:58 +00:00
Rob Genova
7d1f35a5b9 Use per cloud upstart config files 2017-11-01 21:13:58 +00:00
Rob Genova
26a048da02 update Consul config files to use updated retry-join syntax 2017-11-01 21:09:07 +00:00
Rob Genova
44b6f25380 bind Nomad to all interfaces; enable Consul UI 2017-08-04 18:00:05 +00:00
Rob Genova
6a367d9f44 Update scripts and AMI to reflect Nomad 0.6 2017-07-26 22:34:34 +00:00
Rob Genova
490dee4e75 Replace references to personal S3 bucket 2017-07-07 22:29:21 -07:00
Rob Genova
9b80aeaeec remove GOMAXPROCS 2017-07-07 09:48:19 -07:00
Rob Genova
89b8118d7f remove custom chroot_env 2017-07-07 09:09:22 -07:00
Rob Genova
6bbb738b1a cleanup build/provision shell scripts 2017-06-25 11:54:56 -07:00
Rob Genova
6a6f9ca5da various script and config file tweaks 2017-06-25 10:09:54 -07:00
Rob Genova
547e7faae6 refactor build and provisioning scripts to support DNS integration, HDFS 2017-06-24 16:25:46 -07:00
Rob Genova
b8019fd1b7 install latest versions of products 2017-06-15 15:47:46 -07:00