Lemmy.one
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
fox@lemm.ee to Machine Learning@lemmy.mlEnglish · 2 years ago

RT-2: New model translates vision and language into action

www.deepmind.com

external-link
message-square
0
fedilink
  • cross-posted to:
  • futurology@chat.maiion.com
  • futurology@futurology.today
  • robotics_and_ai@mander.xyz
1
external-link

RT-2: New model translates vision and language into action

www.deepmind.com

fox@lemm.ee to Machine Learning@lemmy.mlEnglish · 2 years ago
message-square
0
fedilink
  • cross-posted to:
  • futurology@chat.maiion.com
  • futurology@futurology.today
  • robotics_and_ai@mander.xyz
Introducing Robotic Transformer 2 (RT-2), a novel vision-language-action (VLA) model that learns from both web and robotics data, and translates this knowledge into generalised instructions for robotic control, while retaining web-scale capabilities. This work builds upon Robotic Transformer 1 (RT-1), a model trained on multi-task demonstrations which can learn combinations of tasks and objects seen in the robotic data. RT-2 shows improved generalisation capabilities and semantic and visual understanding, beyond the robotic data it was exposed to. This includes interpreting new commands and responding to user commands by performing rudimentary reasoning, such as reasoning about object categories or high-level descriptions.
alert-triangle
You must log in or # to comment.

Machine Learning@lemmy.ml

machinelearning@lemmy.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !machinelearning@lemmy.ml
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 1 user / week
  • 7 users / month
  • 54 users / 6 months
  • 35 local subscribers
  • 2.03K subscribers
  • 206 Posts
  • 167 Comments
  • Modlog
  • mods:
  • osipov@lemmy.ml
  • BE: 0.19.7
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org