metal : use residency set for other platforms

[jhen0409]

Enable for iOS/tvOS 18.0+ and visionOS 2.0+. (ref)

I tested it on iPhone 15 Pro with llama-swiftui example (with #11645) without any issues. Also, llama.rn have been started use it and not noticed any issues so far.

[charles-dyfis-net]

This change appears to have broken the nix build on Darwin. After it, but not before it:

[24/209] Building C object ggml/src/ggml-metal/CMakeFiles/ggml-metal.dir/ggml-metal.m.o
FAILED: ggml/src/ggml-metal/CMakeFiles/ggml-metal.dir/ggml-metal.m.o
/nix/store/v39c0h6xv6hvki2k1bsyp5n090q8y2bp-clang-wrapper-16.0.6/bin/clang -DGGML_BACKEND_BUILD -DGGML_BACKEND_SHARED -DGGML_METAL_EMBED_LIBRARY -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_DARWIN_C_SOURCE -D_XOPEN_SOURCE=600 -Dggml_metal_EXPORTS -I/tmp/nix-build-llama-cpp-metalkit-0.0.0.drv-0/source/ggml/src/ggml-metal/.. -I/tmp/nix-build-llama-cpp-metalkit-0.0.0.drv-0/source/ggml/src/../include -F/nix/store/amdympl4rz7kj93j82cva60v8007n4nv-apple-sdk-11.3/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/System/Library/Frameworks -D__ARM_FEATURE_DOTPROD=1 -O3 -DNDEBUG -std=gnu11 -isysroot /nix/store/amdympl4rz7kj93j82cva60v8007n4nv-apple-sdk-11.3/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk -fPIC -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wunreachable-code-break -Wunreachable-code-return -Wdouble-promotion -MD -MT ggml/src/ggml-metal/CMakeFiles/ggml-metal.dir/ggml-metal.m.o -MF ggml/src/ggml-metal/CMakeFiles/ggml-metal.dir/ggml-metal.m.o.d -o ggml/src/ggml-metal/CMakeFiles/ggml-metal.dir/ggml-metal.m.o -c /tmp/nix-build-llama-cpp-metalkit-0.0.0.drv-0/source/ggml/src/ggml-metal/ggml-metal.m
/tmp/nix-build-llama-cpp-metalkit-0.0.0.drv-0/source/ggml/src/ggml-metal/ggml-metal.m:26:5: error: 'TARGET_OS_VISION' is not defined, evaluates to 0 [-Werror,-Wundef-prefix=TARGET_OS_]
    TARGET_OS_VISION && __VISION_OS_VERSION_MAX_ALLOWED >= 200000
    ^
/tmp/nix-build-llama-cpp-metalkit-0.0.0.drv-0/source/ggml/src/ggml-metal/ggml-metal.m:518:20: warning: variable 'bundle' set but not used [-Wunused-but-set-variable]
        NSBundle * bundle = nil;
                   ^
1 warning and 1 error generated.

[ggerganov]

Since you have a repro, could you propose a fix - should be a simple change I think.

Edit: nvm, just saw #11690