• OgdenTO [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    15
    ·
    4 days ago

    Almost everyone in the comments misunderstands what is happening here, right? To the best of my knowledge, this is an AI video generated in real time, in the same vein as an LLM.

    Please correct me if I’m wrong, but its essentially predicting the most likely next frame of the screen based on “learning” from watching videos of the game. So if the videos have people push the jump button, the most likely next frame is that the character jumps. If the most likely next frames from the dig action being taken is the block removed and the item appearing in the inventory bar then that is what would occur. But there’s nothing here actually “happening”, this can never be a game - that is, everything that makes a game a game is the ability to succeed. There is no health, experience, etc. It is total frothy slop, and just a surface level moving photo of the game.

    • ProfessorOwl_PhD [any]@hexbear.net
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 days ago

      If the most likely next frames from the dig action being taken is the block removed and the item appearing in the inventory bar then that is what would occur

      You’ll notice it’s not actually got as far as the item appearing in the inventory bar - it doesn’t manage to pick up any blocks in the video, and when placing blocks the item counter just jumps around randomly.

      I suspect, like with the Doom video BelieveRevolt mentioned, it can only make about 3 seconds of footage at a time too, which is the reason it keeps jumping to new scenes.

    • BelieveRevolt [he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      7
      ·
      3 days ago

      You’ve got it right. There was already a video of someone “playing” Doom and it was mess with objects and enemies not reacting to weapon fire, randomly disappearing, health obviously not being tracked etc.

      This was fucking Doom, a 30 year old game that will run on anything, and they were trying to brag about the energy guzzling treat printer making a horribly mangled version of it.

    • KobaCumTribute [she/her]@hexbear.netOP
      link
      fedilink
      English
      arrow-up
      6
      ·
      4 days ago

      AFAIK the premise is basically “given the last frame and the current input, what is the next frame?” so there’s no object permanence or structure behind it it’s just making a video that for any given span of two consecutive frames looks like a video of minecraft.