23 Commits

Author	SHA1	Message	Date
Josh Soref	c77b05aebd	spelling: terminated	2018-03-11 19:01:49 +00:00
Josh Soref	672d51b774	spelling: parallelism	2018-03-11 18:35:54 +00:00
Michael Schurter	e93d625d44	Remove noisy log line ... Didn't mean to commit this	2017-11-03 16:00:30 -07:00
Michael Schurter	cb3a03c829	Make unable-to-gc log level adaptive ... WARNing when someone has over 50 non-terminal allocs was just too confusing. Tested manually with `gc_max_allocs = 10` and bumping a job from `count = 19` to `count = 21`: ``` 2017/11/02 17:54:21.076132 [INFO] client.gc: garbage collection due to number of allocations (19) is over the limit (10) skipped because no terminal allocations ... 2017/11/02 17:54:48.634529 [WARN] client.gc: garbage collection due to number of allocations (21) is over the limit (10) skipped because no terminal allocations ```	2017-11-02 10:57:42 -07:00
Michael Schurter	ec43315e13	Fix regression by returning error on unknown alloc	2017-11-01 15:16:38 -05:00
Michael Schurter	fb3a780b7a	Trigger GCs after alloc changes ... GC much more aggressively by triggering GCs when allocations become terminal as well as after new allocations are added.	2017-11-01 15:16:38 -05:00
Michael Schurter	9c1e595e2e	Fix GC'd alloc tracking ... The Client.allocs map now contains all AllocRunners again, not just un-GC'd AllocRunners. Client.allocs is only pruned when the server GCs allocs. Also stops logging "marked for GC" twice.	2017-11-01 15:16:38 -05:00
Michael Schurter	0f584a0143	initial attempt at refactoring blocked/migrating	2017-08-11 16:21:35 -07:00
Luke Farnell	7a56971508	fixed all spelling mistakes for goreport	2017-08-07 17:13:05 -04:00
Michael Schurter	cc11d9a563	Add new gc_max_allocs tuneable ... More than gc_max_allocs may be running on a node, but terminal allocs will be garbage collected to try to keep the total number below the limit.	2017-05-11 17:18:02 -07:00
Alex Dadgar	38ebed5e0e	Review fixes	2017-03-14 10:45:15 -07:00
Alex Dadgar	050cdd5b14	remove escape	2017-03-10 16:46:22 -08:00
Alex Dadgar	701537e9c5	Limit parallelism during garbage collection ... This PR introduces a parallelism limit during garbage collection. This is used to avoid large resource usage spikes if garbage collecting many allocations at once.	2017-03-10 16:27:00 -08:00
Diptanu Choudhury	6b0a1ebb58	Making the GC related fields tunable	2017-01-31 15:51:20 -08:00
Alex Dadgar	47d48bdaee	Fix nil dereference	2017-01-10 14:14:58 -08:00
Diptanu Choudhury	6f978dd051	Removing the alloc runner from GC if it is destroyed by the server	2016-12-20 11:14:22 -08:00
Diptanu Choudhury	7ebe4a6972	Added comments	2016-12-20 10:49:48 -08:00
Diptanu Choudhury	6143d8dbbd	Added tests	2016-12-19 13:21:47 -08:00
Diptanu Choudhury	61e534d684	Making the gc allocator understand real disk usage	2016-12-16 18:34:59 -08:00
Diptanu Choudhury	79fdad86c3	Added the stats collector to GC	2016-12-14 15:11:11 -08:00
Diptanu Choudhury	41d7ebc5c5	Refactored hoststats collector	2016-12-14 15:07:42 -08:00
Diptanu Choudhury	a38201a220	GC-ing before we start a new allocation	2016-12-14 15:04:06 -08:00
Diptanu Choudhury	615fbbe17a	Added a garbage collector for allocations	2016-12-14 15:01:12 -08:00