Thread-safe quota ledger. More...

#include <tenant.h>

Public Member Functions
void	release_usage (std::uint64_t model_tokens, std::uint64_t cost_microunits) noexcept
	Roll back a usage reservation (for failed admission).

bool	try_acquire_concurrency () noexcept
	Reserve one running slot.

bool	try_acquire_queue () noexcept
	Reserve one queued request.

bool	try_reserve_usage (std::uint64_t model_tokens, std::uint64_t cost_microunits) noexcept
	Atomically reserve bounded token/cost budget.

Detailed Description

Thread-safe quota ledger.

Reservations are fail-closed and leases release concurrency/artifact capacity on every exit path, including exceptions.

Definition at line 65 of file tenant.h.

The documentation for this class was generated from the following file:

Public Member Functions