PFArena-Leaderboard / data /leaderboard.csv
AMix-Bio's picture
Update data/leaderboard.csv
888ec1f verified
Raw History Blame Contribute Delete
4.14 kB
Task,Model,Type,NMS@40,Recall@40,Spearman,NDCG,NMS@5,Recall@5
T1,Random,Statistic,0.7749,0.0142,,,,
T1,GPT-6 Astra,LLM,0.7966,0.0254,,,,
T1,Claude Opus 5,LLM,0.7729,0.0205,,,,
T1,Gemini 3.1 Pro,LLM,0.7620,0.0211,,,,
T1,Kimi K3,LLM,0.7739,0.0199,,,,
T1,GLM-5.2,LLM,0.7734,0.0185,,,,
T1,DeepSeek-V4-Pro,LLM,0.7703,0.0185,,,,
T1,GPT-6.1 Sol,LLM,0.7789,0.0195,,,,
T1,Gemini 4 Argon,LLM,0.7561,0.0240,,,,
T1,DeepSeek-V4.1-Flash,LLM,0.7746,0.0230,,,,
T1,Biomni + GPT-6 Astra,Agent,0.7677,0.0388,,,,
T1,Biomni + Claude Opus 5,Agent,0.7651,0.0307,,,,
T1,AMixKit + GPT-6 Astra,Agent,0.7866,0.0386,,,,
T1,AMixKit + Claude Opus 5,Agent,0.7858,0.0354,,,,
T1,AMixKit + AMix-2.1,Agent,0.7872,0.0368,,,,
T1,VenusREM,PLM,0.7932,0.0427,,,,
T1,S3F-MSA,PLM,0.7816,0.0364,,,,
T1,ProSST-2048,PLM,0.7847,0.0407,,,,
T1,S3F,PLM,0.7804,0.0364,,,,
T1,ESM-2,PLM,0.7854,0.0370,,,,
T1,ProGen2-base,PLM,0.7709,0.0274,,,,
T2,Random,Statistic,,,-0.0215,0.8196,0.7113,0.0811
T2,GPT-6 Astra,LLM,,,0.2726,0.8635,0.7967,0.2216
T2,Claude Opus 5,LLM,,,0.2841,0.8653,0.8031,0.1919
T2,Gemini 3.1 Pro,LLM,,,0.2239,0.8595,0.7723,0.1973
T2,Kimi K3,LLM,,,0.1973,0.8507,0.7499,0.1919
T2,GLM-5.2,LLM,,,0.1607,0.8519,0.7706,0.2000
T2,DeepSeek-V4-Pro,LLM,,,0.2187,0.8587,0.7760,0.2135
T2,GPT-6.1 Sol,LLM,,,0.2514,0.8619,0.7700,0.2027
T2,Gemini 4 Argon,LLM,,,0.2766,0.8614,0.7691,0.2000
T2,DeepSeek-V4.1-Flash,LLM,,,0.2034,0.8530,0.7678,0.2000
T2,Biomni + GPT-6 Astra,Agent,,,0.3194,0.8767,0.8038,0.2162
T2,Biomni + Claude Opus 5,Agent,,,0.3064,0.8689,0.8016,0.2351
T2,AMixKit + GPT-6 Astra,Agent,,,0.2851,0.8702,0.7781,0.2027
T2,AMixKit + Claude Opus 5,Agent,,,0.3330,0.8764,0.8120,0.2351
T2,AMixKit + AMix-2.1,Agent,,,0.2960,0.8706,0.7911,0.2000
T2,VenusREM,PLM,,,0.2804,0.8684,0.8003,0.2162
T2,S3F-MSA,PLM,,,0.2803,0.8700,0.7964,0.2027
T2,ProSST-2048,PLM,,,0.2777,0.8657,0.7829,0.2108
T2,S3F,PLM,,,0.2785,0.8626,0.7751,0.1757
T2,ESM-2,PLM,,,0.2539,0.8634,0.7831,0.1892
T2,ProGen2-base,PLM,,,0.1405,0.8563,0.7887,0.1784
T3,Random,Statistic,,,0.0411,0.8216,0.7659,0.1970
T3,GPT-6 Astra,LLM,,,0.3516,0.8886,0.8258,0.3134
T3,Claude Opus 5,LLM,,,0.3540,0.8858,0.8263,0.3015
T3,Gemini 3.1 Pro,LLM,,,0.2865,0.8814,0.8019,0.2806
T3,Kimi K3,LLM,,,0.3131,0.8857,0.8124,0.2925
T3,GLM-5.2,LLM,,,0.2676,0.8701,0.8149,0.2866
T3,DeepSeek-V4-Pro,LLM,,,0.2627,0.8698,0.8106,0.2687
T3,GPT-6.1 Sol,LLM,,,0.3299,0.8878,0.8196,0.3104
T3,Gemini 4 Argon,LLM,,,0.3822,0.8938,0.8307,0.3313
T3,DeepSeek-V4.1-Flash,LLM,,,0.2568,0.8817,0.8207,0.3075
T3,Biomni + GPT-6 Astra,Agent,,,0.3687,0.8828,0.7925,0.3045
T3,Biomni + Claude Opus 5,Agent,,,0.4511,0.8985,0.8511,0.3463
T3,AMixKit + GPT-6 Astra,Agent,,,0.3833,0.8907,0.8323,0.3433
T3,AMixKit + Claude Opus 5,Agent,,,0.3665,0.8875,0.8515,0.3433
T3,AMixKit + AMix-2.1,Agent,,,0.3616,0.8902,0.8515,0.3254
T3,VenusREM,PLM,,,0.3698,0.8897,0.8578,0.3612
T3,S3F-MSA,PLM,,,0.3159,0.8860,0.8382,0.3224
T3,ProSST-2048,PLM,,,0.3836,0.8903,0.8620,0.3672
T3,S3F,PLM,,,0.3357,0.8842,0.8523,0.2955
T3,ESM-2,PLM,,,0.3128,0.8840,0.8099,0.3045
T3,ProGen2-base,PLM,,,0.1870,0.8606,0.7835,0.2716
T4,Random,Statistic,,,-0.0204,0.8124,0.6371,0.0552
T4,GPT-6 Astra,LLM,,,0.5988,0.9274,0.8935,0.4483
T4,Claude Opus 5,LLM,,,0.5823,0.9244,0.8723,0.4276
T4,Gemini 3.1 Pro,LLM,,,0.5329,0.9059,0.8595,0.4000
T4,Kimi K3,LLM,,,0.4794,0.8956,0.8337,0.3586
T4,GLM-5.2,LLM,,,0.4959,0.8984,0.8338,0.3862
T4,DeepSeek-V4-Pro,LLM,,,0.5308,0.9059,0.8595,0.4000
T4,GPT-6.1 Sol,LLM,,,0.6006,0.9270,0.8936,0.4483
T4,Gemini 4 Argon,LLM,,,0.5826,0.9200,0.8817,0.4276
T4,DeepSeek-V4.1-Flash,LLM,,,0.5662,0.9213,0.8602,0.4207
T4,Biomni + GPT-6 Astra,Agent,,,0.6373,0.9347,0.9145,0.4828
T4,Biomni + Claude Opus 5,Agent,,,0.6446,0.9293,0.9015,0.4345
T4,AMixKit + GPT-6 Astra,Agent,,,0.6382,0.9336,0.9131,0.4897
T4,AMixKit + Claude Opus 5,Agent,,,0.6462,0.9336,0.9090,0.4690
T4,AMixKit + AMix-2.1,Agent,,,0.5531,0.9115,0.8642,0.3862
T4,VenusREM,PLM,,,0.3821,0.8809,0.8212,0.2552
T4,S3F-MSA,PLM,,,0.3662,0.9005,0.8686,0.2897
T4,ProSST-2048,PLM,,,0.3779,0.8725,0.8078,0.2483
T4,S3F,PLM,,,0.3487,0.8836,0.8410,0.2759
T4,ESM-2,PLM,,,0.3153,0.8828,0.8129,0.2276
T4,ProGen2-base,PLM,,,0.2568,0.8736,0.8357,0.1793