Expand description
A ZMQ-based job dispatcher, interfacing between the task Backend and an open set of remote
workers
Modules§
- finalize
- Finalize thread responsible for registering the returned tasks and messages in the database
- manager
- Manager orchestrating all dispatcher threads
- prefetch
- Input-archive page-cache prefetcher (D-20)
Input-archive prefetcher (D-20): warm the next batch of task input archives into the OS page
cache ahead of dispatch, so the ventilator’s inline
/dataread is served from RAM instead of the cold QLC-RAID6 platter. - server
- Shared server utility functions between all dispatcher components
- sink
- Receiver ZMQ sink component
- ventilator
- Emitter ZMQ ventilator component