$ llama-cli --version ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 3090, compute capability 8.6 ...
As JSON (JavasScript Object Notation) is widely in use and mature as Object Notation format, using all the lessons learned form JSON in TOON (Token-Oriented Object Notation) can help maturing it ...