Add a function Evaluator class with policy based caching capabilities (#5253)

#5215 for context and previous
reviews.
This work evolved into something a bit more generic than the tile
offsets transparent cache we originally intended to write.
This PR adds:
- `Evaluator` class
```c++
Evaluator<Policy<Key, Value>, decltype(cb)> eval(cb);
val = eval(key);

// where
Value cb(const Key& key);
```
- `ImmediateEvaluation` policy
Configures the evaluator to execute `cb(key)` for any invocation of
`eval(key)`.
```c++
Evaluator<ImmediateEvaluation<Key, Value>, Callback> eval(cb);
eval(key); // equivalent with cb(key)
eval(key); // equivalent with cb(key)
```
- `MaxEntriesCache` policy
Configures the evaluator to execute `cb(key)` and cache the results in a
LRU cache
that cannot hold more than `N` values. Caching value `N+1` triggers
cache eviction.
```c++
Evaluator<MaxEntriesCache<Key, Value, N>, Callback> eval(cb);
```
- `MemoryBudgetedCache` policy
Configures the evaluator to execute `cb(key)` and cache the results in a
LRU cache
with a capacity of `M` bytes where `M` is passed during the evaluator
construction.
```c++
Evaluator<MemoryBudgetedCache<Key, Value>, Callback> eval(cb, SizeFn, memory_budget);
// where `SizeFn` is a user provided function that returns the size of its argument in bytes.
```

[sc-51496]

---
TYPE: FEATURE 
DESC: Add a function Evaluator class with policy-based caching
capabilities

---------

Co-authored-by: Rebekah Davis <[email protected]>

Author: robertbindar

tiledb/common/CMakeLists.txt

@@ -3,7 +3,7 @@
 #
 # The MIT License
 #
-# Copyright (c) 2021-2022 TileDB, Inc.
+# Copyright (c) 2021-2024 TileDB, Inc.
 #
 # Permission is hereby granted, free of charge, to any person obtaining a copy
 # of this software and associated documentation files (the "Software"), to deal
@@ -40,6 +40,7 @@ endif()
 # Subdirectories
 #
 add_subdirectory(dynamic_memory)
+add_subdirectory(evaluator)
 add_subdirectory(exception)
 add_subdirectory(governor)
 add_subdirectory(interval)

tiledb/common/evaluator/CMakeLists.txt

@@ -0,0 +1,31 @@
+#
+# tiledb/common/evaluator/CMakeLists.txt
+#
+# The MIT License
+#
+# Copyright (c) 2024 TileDB, Inc.
+#
+# Permission is hereby granted, free of charge, to any person obtaining a copy
+# of this software and associated documentation files (the "Software"), to deal
+# in the Software without restriction, including without limitation the rights
+# to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+# copies of the Software, and to permit persons to whom the Software is
+# furnished to do so, subject to the following conditions:
+#
+# The above copyright notice and this permission notice shall be included in
+# all copies or substantial portions of the Software.
+#
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+# THE SOFTWARE.
+#
+
+# This is a header-only component, an object library is not needed
+
+include(common NO_POLICY_SCOPE)
+
+add_test_subdirectory()