Lemmy.one
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
RSS Bot@lemmy.bestiver.seMB to Hacker News@lemmy.bestiver.seEnglish · 9 days ago

You can now train a 70B language model at home

www.answer.ai

external-link
message-square
5
fedilink
  • cross-posted to:
  • hackernews@lemmy.smeargle.fans
7
external-link

You can now train a 70B language model at home

www.answer.ai

RSS Bot@lemmy.bestiver.seMB to Hacker News@lemmy.bestiver.seEnglish · 9 days ago
message-square
5
fedilink
  • cross-posted to:
  • hackernews@lemmy.smeargle.fans
You can now train a 70b language model at home – Answer.AI
www.answer.ai
external-link
We’re releasing an open source system, based on FSDP and QLoRA, that can train a 70b model on two 24GB GPUs.

Comments

alert-triangle
You must log in or # to comment.
  • fubarx@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    9 days ago

    They’re using fine-tuning on top of existing models. Still useful, but the headline implies creating foundation models, which is still the domain of big iron.

  • insufferableninja@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    2
    ·
    9 days ago

    And yet, I still won’t

  • Kairos@lemmy.today
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 days ago

    “Can”

  • Noxy@pawb.social
    link
    fedilink
    English
    arrow-up
    1
    ·
    9 days ago

    The fuck does 70B mean? 70 bytes?

    • howrar@lemmy.ca
      link
      fedilink
      English
      arrow-up
      6
      ·
      edit-2
      9 days ago

      70 billion parameters. It’s standard notation in the context of LLMs.

Hacker News@lemmy.bestiver.se

hackernews@lemmy.bestiver.se

Subscribe from Remote Instance

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !hackernews@lemmy.bestiver.se
lock
Community locked: only moderators can create posts. You can still comment on posts.

Posts from the RSS Feed of HackerNews.

The feed sometimes contains ads and posts that have been removed by the mod team at HN.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 321 users / day
  • 1.99K users / week
  • 4.06K users / month
  • 7.94K users / 6 months
  • 2 local subscribers
  • 2.2K subscribers
  • 13.1K Posts
  • 5.87K Comments
  • Modlog
  • mods:
  • patrick@lemmy.bestiver.se
  • RSS Bot@lemmy.bestiver.se
  • BE: 0.19.7
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org