Runs

RunModelHardwareWorkloadRuntimeCapacityrequests/sResponsivenessp95 TTFTStream speedp95 floorOutcomeEvidencePublished
run_Ij7nQCOk2Z3vDVWGmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.26 req/s12742.4 ms8.6 tok/scompletedranked
run_bJGD2V5xSxQCmoLjmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.37 req/s12744.1 ms12 tok/scompletedranked
run_GNd0cF39V4-y3Bajmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.28 req/s11128.6 ms9.5 tok/scompletedranked
run_je1y1g4VElJToEChmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.2 req/s1865.6 ms80.4 tok/scompletedranked
run_ABIAlnoJQOVFipdwmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b106890.08 req/s69.7 ms82.7 tok/scompletedranked
run_D8JKmhP0oZ4b10Ytmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b106890.08 req/s69.3 ms82.7 tok/scompletedranked
run_r2hT1Fvin_tihPGrmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b106890.08 req/s69.5 ms82.5 tok/scompletedranked
run_6JaGDduA6V6UUZAOmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b106890.3 req/s227.7 ms82.4 tok/scompletedranked
run_rnFdIe1VGz_CdGHBmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b106890.3 req/s226.7 ms82.5 tok/scompletedranked
run_hZrPPIaCESBXNmfimeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b106890.3 req/s227.2 ms82.3 tok/scompletedranked
run_3G618eg5AK4UDZj-meta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.27 req/s12566.6 ms8.7 tok/scompletedranked
run_drSvdLWHoqpp-Xmrmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.38 req/s12537.2 ms12.2 tok/scompletedranked
run_UcVYcgzXzDTetnWHmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.28 req/s11050.0 ms9.6 tok/scompletedranked
run_0TcGlopktIQXp3uimeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.2 req/s1842.2 ms80.2 tok/scompletedranked
run_SRteyZHstMez-NPAmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b106890.14 req/s486.3 ms18.3 tok/scompletedranked
run_Rv92orXGyCS2R1ncmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b106890.08 req/s67.5 ms82.5 tok/scompletedranked
run_TSbZl1OFV0-VveGLmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b106890.08 req/s67.1 ms82.4 tok/scompletedranked
run_3cKqnZbIlPZjdQvFmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b106890.08 req/s67.2 ms82.3 tok/scompletedranked
run_NP7Cgj167353GT8Xmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b106890.3 req/s221.5 ms82.2 tok/scompletedranked
run_vG1F0-GzWHpPsQuImeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b106890.3 req/s222.0 ms82.3 tok/scompletedranked
run_R6cE0ka8-q28MGRvmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b106890.3 req/s222.0 ms82.1 tok/scompletedranked
run_Wqvl463gYk_MoIpZmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b10689Speculative · Q4_K_M0.39 req/s16447.6 ms14.2 tok/scompletedranked
run_a8KLT66w4snPV-C_meta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b10689Speculative · Q4_K_M0.38 req/s15944.2 ms16.2 tok/scompletedranked
run_HH9wK2E0V7rDkCjpmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b10689Speculative · Q4_K_M0.39 req/s16178.2 ms14.2 tok/scompletedranked
run_-RkBS5z3ph21g5OSmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b10689Speculative · Q4_K_M0.37 req/s2336.1 ms699.9 tok/scompletedranked
run_Detp7qWzpW8eTAVSmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b10689Speculative · Q4_K_M1.45 req/s803.5 ms179.6 tok/scompletedranked
run_4yIvCI26xEIl1q3_meta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b10689Speculative · Q4_K_M1.16 req/s609.7 ms148.2 tok/scompletedranked
run_iqr-3lMPfKk1Cnskmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b10689Speculative · Q4_K_M1.46 req/s621.0 ms180.5 tok/scompletedranked
run_ItnsZ7eQkCsSGj9imeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b10689Speculative · Q4_K_M1.2 req/s623.2 ms152.5 tok/scompletedranked
run_-xw7EW6aooOjOWuPmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b10689Speculative · Q4_K_M0.68 req/s83.0 ms732.1 tok/scompletedranked
run_jpAO6AqnPV8fIE6Gmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b10689Speculative · Q4_K_M2.2 req/s2295.5 ms75.4 tok/scompletedranked
run_8p6kxiiQ0v4I6779meta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b10689Speculative · Q4_K_M1.58 req/s291.4 ms720.3 tok/scompletedranked
run_n1slR5fu_FGDsXy1meta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b10689Speculative · Q4_K_M1.58 req/s284.8 ms719.3 tok/scompletedranked
run_Cv7M7AziqHXBXxd_meta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b10689Speculative · Q4_K_M1.59 req/s284.0 ms725.2 tok/scompletedranked
run_n_Ode1eTiz7xJwbzmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b10689Speculative · Q4_K_M0.39 req/s15765.1 ms14.6 tok/scompletedranked
run_2E87nIksxGF5ikLlmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b10689Speculative · Q4_K_M0.4 req/s15754.9 ms14.5 tok/scompletedranked
run_A-sxzb7Q4y28D0b8meta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b10689Speculative · Q4_K_M0.4 req/s16075.8 ms14.5 tok/scompletedranked
run_Snm9nSPV8usPhFMLmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b10689Speculative · Q4_K_M0.38 req/s2333.7 ms692.1 tok/scompletedranked
run_yN1_MOPbeicaIh_Rmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b10689Speculative · Q4_K_M1.48 req/s772.2 ms183.8 tok/scompletedranked
run_N2VYNWN25kzDcrVkmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b10689Speculative · Q4_K_M1.15 req/s613.1 ms146.7 tok/scompletedranked
run_RPfdGEok-Szn4e-Cmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b10689Speculative · Q4_K_M1.46 req/s608.0 ms182.1 tok/scompletedranked
run_kF4pG6SlGbL9BMndmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b10689Speculative · Q4_K_M1.15 req/s621.6 ms142.8 tok/scompletedranked
run_BNuNM-mIdZ6fq4htmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 5090256 → 1024llama.cpp b10689Speculative · Q4_K_M0.68 req/s82.9 ms725.2 tok/scompletedranked
run_KnGBYhrH8L-i8lm6meta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b10689Speculative · Q4_K_M2.22 req/s2266.6 ms75.1 tok/scompletedranked
run_Y5Axw5x4__ZQ5beLmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b10689Speculative · Q4_K_M1.58 req/s288.1 ms719 tok/scompletedranked
run_ZezDHb_l9UhnlgfBmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b10689Speculative · Q4_K_M1.58 req/s281.4 ms719.7 tok/scompletedranked
run_LbJk_5I94aFDjfWGmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50901024 → 256llama.cpp b10689Speculative · Q4_K_M1.58 req/s289.2 ms714.6 tok/scompletedranked
run_-AoXomjXA_6Kr_y-meta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.24 req/s13360.5 ms7.9 tok/scompletedranked
run_xhcGxbxHYf8WtTP7meta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.35 req/s13328.5 ms11.4 tok/scompletedranked
run_ahWgiU9gPnz73uldmeta-models/Muse-Glimmer-30B-GGUF1× NVIDIA GeForce RTX 50908192 → 256llama.cpp b106890.24 req/s13584.4 ms7.9 tok/scompletedranked