Skip to content

Commit b9378e0

Browse files
committed
Sch: Pause/limit task scheduling when over-memory
Track worker storage resources and devices Track thunk runtime allocations with gc_num Expand procutil option to time_util and alloc_util Add storage option for specifying MemPool storage device Format bytes in debug logs Add locking around CHUNK_CACHE Move return value Chunks to MemPool device
1 parent 66093aa commit b9378e0

File tree

5 files changed

+245
-129
lines changed

5 files changed

+245
-129
lines changed

Diff for: Project.toml

+1-1
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ UUIDs = "cf7118a7-6976-5b1a-9a39-7adc72f591a4"
2626
Colors = "0.10, 0.11, 0.12"
2727
ContextVariablesX = "0.1"
2828
DataAPI = "1"
29-
MemPool = "0.3.5"
29+
MemPool = "0.3.10"
3030
Requires = "1"
3131
SentinelArrays = "1"
3232
StatsBase = "0.28, 0.29, 0.30, 0.31, 0.32, 0.33"

Diff for: src/processor.jl

+4-2
Original file line numberDiff line numberDiff line change
@@ -342,7 +342,8 @@ get_tls() = (
342342
sch_uid=task_local_storage(:_dagger_sch_uid),
343343
sch_handle=task_local_storage(:_dagger_sch_handle),
344344
processor=thunk_processor(),
345-
utilization=task_local_storage(:_dagger_utilization),
345+
time_utilization=task_local_storage(:_dagger_time_utilization),
346+
alloc_utilization=task_local_storage(:_dagger_alloc_utilization),
346347
)
347348

348349
"""
@@ -354,5 +355,6 @@ function set_tls!(tls)
354355
task_local_storage(:_dagger_sch_uid, tls.sch_uid)
355356
task_local_storage(:_dagger_sch_handle, tls.sch_handle)
356357
task_local_storage(:_dagger_processor, tls.processor)
357-
task_local_storage(:_dagger_utilization, tls.utilization)
358+
task_local_storage(:_dagger_time_utilization, tls.time_utilization)
359+
task_local_storage(:_dagger_alloc_utilization, tls.alloc_utilization)
358360
end

0 commit comments

Comments
 (0)