Lemmy.one
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
twelvefloatinghands@lemmy.world to Free Open-Source Artificial Intelligence@lemmy.worldEnglish ·
edit-2
2 years ago

Benchmark tracking for open-source models?

message-square
message-square
3
fedilink
9
message-square

Benchmark tracking for open-source models?

twelvefloatinghands@lemmy.world to Free Open-Source Artificial Intelligence@lemmy.worldEnglish ·
edit-2
2 years ago
message-square
3
fedilink

Just starting to look into open source AI models. Is anyone aware of anywhere with a table of all the open source models and their scores on various available benchmarks?

Edit: Found it: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

alert-triangle
You must log in or # to comment.
  • Blaed@lemmy.worldM
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    2 years ago

    If you’re looking to broaden your search, I’ve found a few more resources to share. Hope this helps!

    LLM Leaderboards

    • HuggingFace Open LLM Leaderboard
    • LMSYS Chatbot Arena
    • LudwigStumpp’s Leaderboard Repo

    LLM Search Tools

    • LLM Explorer
    • Open LLMs

    LLM Eval & Benchmark Resources

    • Holistic Evaluation of Language Models (HELM)
    • TextSynth
    • The Curious Case of LLM Evaluations
    • Mosaic Benchmarks

    I’m going to add a few of these to the sidebar for quick access. Let me know if I’ve missed one!

Free Open-Source Artificial Intelligence@lemmy.world

fosai@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !fosai@lemmy.world

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

  • !localllama@sh.itjust.works
  • !models@lemmy.intai.tech
  • !artificial_intel@lemmy.ml
  • LocalLLaMA (Reddit)

LLM Leaderboards

  • HuggingFace Open LLM Leaderboard
  • LMSYS Chatbot Arena

Developer Resources

  • Replicate
  • vLLM
  • RunPod
  • Vast AI
  • Together AI
  • AI Horde

GitHub Projects

  • GitHub Stars

FOSAI Time Capsule

  • The Internet is Healing
  • General Resources
  • FOSAI Welcome Message
  • FOSAI Crash Course
  • FOSAI Nexus Resource Hub
  • FOSAI LLM Guide
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 1 user / week
  • 2 users / month
  • 98 users / 6 months
  • 28 local subscribers
  • 3.35K subscribers
  • 264 Posts
  • 713 Comments
  • Modlog
  • mods:
  • Blaed@lemmy.world
  • fosai@lemmy.world
  • BE: 0.19.7
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org