Interface CacheMetadata

Cache metadata returned from the provider

interface CacheMetadata {
    cacheHit?: boolean;
    cachedTokenCount?: number;
}

Properties

cacheHit? cachedTokenCount?

Properties

Optional cacheHit

cacheHit?: boolean

Whether the request had a cache hit

Optional cachedTokenCount

cachedTokenCount?: number

The number of tokens retrieved from cache

Settings

Member Visibility

Theme

On This Page

cacheHitcachedTokenCount