Class Cache2<K1,K2,V>
- Type Parameters:
K1- The first key type. Can be an array type for content-based key matching.K2- The second key type. Can be an array type for content-based key matching.V- The value type.
Overview:
This class uses ConcurrentHashMap internally to provide a thread-safe caching layer with automatic
value computation, cache eviction, and statistics tracking for two-part composite keys. It's designed for
caching expensive-to-compute or frequently-accessed objects indexed by two keys.
Features:
- Thread-safe concurrent access without external synchronization
- Two-part composite key support
- Automatic cache eviction when maximum size is reached
- Lazy computation via
Function2supplier pattern - Default supplier support for simplified access
- Built-in hit/miss statistics tracking
- Optional logging of cache statistics on JVM shutdown
- Can be disabled entirely via builder or system property
WEAK Mode Semantics:
CacheMode.WEAK on this class is best-effort, not retention-guaranteed. Each lookup synthesizes
an internal Tuple2 composite key that is never exposed to the caller, so that key is reachable only
from this cache's own backing WeakHashMap. Consequently a WEAK-mode entry becomes GC-eligible
immediately after insertion and may be reclaimed at the very next garbage collection - effectively
behaving like CacheMode.NONE once any GC has occurred. This differs from the single-key Cache,
where WEAK mode keys directly on the caller's own key and therefore retains an entry for as long as that key
remains strongly reachable elsewhere. If guaranteed retention is required, use CacheMode.FULL (the
default mode) instead of WEAK. See CacheMode.WEAK for details.
Usage:
Cache Behavior:
- When a key pair is requested:
- If the key exists in the cache, the cached value is returned (cache hit)
- If the key doesn't exist, the supplier is invoked to compute the value
- The computed value is stored in the cache and returned (cache miss)
- When the cache exceeds
Cache2.Builder.maxSize(int), the entire cache is cleared - If the cache is disabled, the supplier is always invoked without caching
- Null keys always bypass the cache and invoke the supplier
Environment Variables:
The following system properties can be used to configure default cache behavior:
juneau.cache.mode - Cache mode: NONE/WEAK/FULL (default: FULL, case-insensitive)juneau.cache.maxSize - Maximum cache size before eviction (default: 1000)juneau.cache.logOnExit - Log cache statistics on shutdown (default:false )
Thread Safety:
This class is thread-safe and can be safely used from multiple threads without external synchronization. However, note that when the cache is cleared due to exceeding max size, there's a small window where multiple threads might compute the same value. This is acceptable for most use cases as it only affects performance, not correctness.
Performance Considerations:
- Cache operations are O(1) average time complexity
- The
get(Object, Object, java.util.function.Supplier)method usesConcurrentHashMap.putIfAbsent(Object, Object)to minimize redundant computation in concurrent scenarios - When max size is exceeded, the entire cache is cleared in a single operation
- Statistics tracking uses
AtomicIntegerfor thread-safe counting without locking
Examples:
See Also:
-
Nested Class Summary
Nested Classes -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionvoidcleanup()Cleans up thread-local storage for the current thread.voidclear()Removes all entries from the cache.booleancontainsKey(K1 key1, K2 key2) Returnstrue if the cache contains a mapping for the specified key pair.booleancontainsValue(V value) Returnstrue if the cache contains one or more entries with the specified value.static <K1,K2, V> Cache2.Builder<K1, K2, V> create()Creates a newCache2.Builderfor constructing a cache with explicit type parameters.Retrieves a cached value by key pair using the default supplier.Retrieves a cached value by key pair, computing it if necessary using the provided supplier.intReturns the total number of cache hits since this cache was created.booleanisEmpty()Returnstrue if the cache contains no entries.static <K1,K2, V> Cache2.Builder<K1, K2, V> Creates a newCache2.Builderfor constructing a cache.Associates the specified value with the specified key pair.Removes the entry for the specified key pair from the cache.intsize()Returns the number of entries in the cache.
-
Constructor Details
-
Cache2
Constructor.- Parameters:
builder- The builder containing configuration settings.
-
-
Method Details
-
create
Creates a newCache2.Builderfor constructing a cache with explicit type parameters.This variant allows you to specify the cache's generic types explicitly without passing the class objects, which is useful when working with complex parameterized types.
Example:
// Working with complex generic types Cache2<Class<?>,Class<? extends Annotation>,List<Annotation>>cache = Cache2.<Class<?>,Class<? extends Annotation>,List<Annotation>>create () .supplier((k1, k2) -> findAnnotations(k1, k2)) .build();- Type Parameters:
K1- The first key type.K2- The second key type.V- The value type.- Returns:
- A new builder for configuring the cache.
-
of
Creates a newCache2.Builderfor constructing a cache.Example:
Cache2<String,Integer,User>
cache = Cache2 .of (String.class , Integer.class , User.class ) .maxSize(100) .build();- Type Parameters:
K1- The first key type.K2- The second key type.V- The value type.- Parameters:
key1- The first key type class (used for type safety).key2- The second key type class (used for type safety).type- The value type class.- Returns:
- A new builder for configuring the cache.
-
clear
Removes all entries from the cache. -
cleanup
Cleans up thread-local storage for the current thread.This method should be called when a thread is finished using this cache to prevent memory leaks in thread pool environments where threads are reused. Only has an effect if this cache was created with thread-local mode enabled.
-
containsKey
Returnstrue if the cache contains a mapping for the specified key pair.- Parameters:
key1- The first key. Can benull (null keys are supported like any other key).key2- The second key. Can benull (null keys are supported like any other key).- Returns:
true if the cache contains the key pair.
-
containsValue
Returnstrue if the cache contains one or more entries with the specified value.- Parameters:
value- The value to check. Can benull , in which case this method returnsfalse (the cache never storesnull values).- Returns:
true if the cache contains the value.
-
get
Retrieves a cached value by key pair using the default supplier.This method uses the default supplier configured via
Cache2.Builder.supplier(Function2). If no default supplier was configured, this method will throw aNullPointerException.Example:
Cache2<String,Integer,User>
cache = Cache2 .of (String.class , Integer.class , User.class ) .supplier((tenant, id) -> userService.findUser(tenant, id)) .build();// Uses default supplier Useru =cache .get("tenant1" , 123);- Parameters:
key1- First key component. Can benull (null keys are supported like any other key).key2- Second key component. Can benull (null keys are supported like any other key).- Returns:
- The cached or computed value. May be
null if the supplier returnsnull . - Throws:
NullPointerException- if no default supplier was configured.
-
get
Retrieves a cached value by key pair, computing it if necessary using the provided supplier.This method implements the cache-aside pattern:
- If the key pair exists in the cache, return the cached value (cache hit)
- If the key pair doesn't exist, invoke the supplier to compute the value
- Store the computed value in the cache using
ConcurrentHashMap.putIfAbsent(Object, Object) - Return the value
Behavior:
- If the cache is disabled, always invokes the supplier without caching
- If the cache exceeds
Cache2.Builder.maxSize(int), clears all entries before storing the new value - Thread-safe: Multiple threads can safely call this method concurrently
- The supplier may be called multiple times for the same key pair in concurrent scenarios
(due to
ConcurrentHashMap.putIfAbsent(Object, Object)semantics)
Example:
Cache2<String,Integer,User>
cache = Cache2.of (String.class , Integer.class , User.class ).build();// First call: fetches user and caches it Useru1 =cache .get("tenant1" , 123, () -> userService.findUser("tenant1" , 123));// Second call: returns cached user instantly Useru2 =cache .get("tenant1" , 123, () -> userService.findUser("tenant1" , 123));assert u1 ==u2 ;// Same instance - Parameters:
key1- First key component. Can benull (null keys are supported like any other key).key2- Second key component. Can benull (null keys are supported like any other key).supplier- The supplier to compute the value if it's not in the cache. Must not benull or anIllegalArgumentExceptionis thrown.- Returns:
- The cached or computed value. May be
null if the supplier returnsnull .
-
getCacheHits
Returns the total number of cache hits since this cache was created.A cache hit occurs when
get(Object, Object)orget(Object, Object, java.util.function.Supplier)finds an existing cached value for the requested key pair, avoiding the need to invoke the supplier.Cache Effectiveness:
You can calculate the cache hit ratio using:
int hits =cache .getCacheHits();int misses =cache .size();int total =hits +misses ;double hitRatio = (double )hits /total ;// 0.0 to 1.0 Notes:
- This counter is never reset, even when
clear()is called - Thread-safe using
AtomicInteger - Returns 0 if the cache is disabled
- Returns:
- The total number of cache hits since creation.
- This counter is never reset, even when
-
isEmpty
Returnstrue if the cache contains no entries.- Returns:
true if the cache is empty.
-
put
Associates the specified value with the specified key pair.- Parameters:
key1- The first key. Can benull (null keys are supported like any other key).key2- The second key. Can benull (null keys are supported like any other key).value- The value to associate with the key pair.- Returns:
- The previous value associated with the key pair, or
null if there was no mapping.
-
remove
Removes the entry for the specified key pair from the cache.- Parameters:
key1- The first key. Can benull (null keys are supported like any other key).key2- The second key. Can benull (null keys are supported like any other key).- Returns:
- The previous value associated with the key pair, or
null if there was no mapping.
-
size
Returns the number of entries in the cache.- Returns:
- The number of cached entries.
-