rate_limited_provider.h File Reference

Provider decorator that honours HTTP 429 Retry-After. More...

#include <neograph/api.h>
#include <neograph/provider.h>
#include <memory>
#include <string>

Include dependency graph for rate_limited_provider.h:

Go to the source code of this file.

Classes
struct	neograph::llm::RateLimitedProvider::Config
	Configuration for rate-limit handling. More...
class	neograph::llm::RateLimitedProvider
	Decorator that retries on RateLimitError according to its Retry-After hint. More...

Detailed Description

Provider decorator that honours HTTP 429 Retry-After.

Wraps any Provider and turns RateLimitError throws into a bounded sleep+retry loop. The inner Provider stays policy-free; users opt into this behaviour by wrapping only when they need it (e.g., on low-tier Anthropic, not on a self-hosted vLLM).

Definition in file rate_limited_provider.h.