request_queue.h File Reference

Lock-free request queue with worker pool and backpressure. More...

#include <concurrentqueue.h>
#include <thread>
#include <vector>
#include <atomic>
#include <functional>
#include <future>
#include <iostream>
#include <mutex>
#include <condition_variable>

Include dependency graph for request_queue.h:

Go to the source code of this file.

Classes
class	neograph::util::RequestQueue
	Lock-free task queue with a fixed worker thread pool and backpressure. More...
struct	neograph::util::RequestQueue::Stats
	Runtime statistics for monitoring queue health. More...

Detailed Description

Lock-free request queue with worker pool and backpressure.

Provides a concurrent task queue backed by moodycamel::ConcurrentQueue with a configurable worker thread pool. Useful for decoupling HTTP connection acceptance from LLM call concurrency.

Definition in file request_queue.h.