Minecraft with object impermanence

Dreamlike Experience & Object Impermanence

  • Many commenters say the AI Minecraft feels exactly like dreaming: scenes lack persistence, logic is loose, and inconsistencies feel “normal” until you wake up or stop playing.
  • Several draw parallels to how human perception works: narrow foveal vision, brain-filled periphery, and confabulated continuity rather than true “ground truth” memory.
  • Some suggest this reveals how much of our sense of a stable world is constructed, not directly perceived.

Lucid Dreaming & Nightmares

  • Multiple people compare the AI’s glitches to dream cues used in lucid dreaming, e.g., shifting text or clocks that change when you look away.
  • Experiences differ: some can easily recognize and “hijack” dreams; others say their reasoning shuts down completely in dreams.
  • Nightmares are described as “excitement” gone wrong, with some reporting they can now steer dreams away from fear by reflecting on them while awake.

Technical Discussion: Models, Memory, and Object Permanence

  • Several infer the system behaves like a Markov process: next frame depends only on current frame + input, so off-screen state disappears.
  • Proposals to add permanence include:
    • Longer temporal context (many past frames, analogous to LLM context windows).
    • Persistent hidden states that carry forward internal memory.
    • Training on full game state (world snapshots), not just pixels, though this reduces generality.
  • Some note that if perfected, this would largely re-implement vanilla Minecraft but far more expensively.

Minecraft-Specific Reactions & Nostalgia

  • Longtime players point out that some “weird AI artifacts” are just normal modern Minecraft (e.g., kelp, honeycomb blocks), highlighting how many players’ mental model is stuck in the alpha/early-1.0 era.
  • There’s extensive reminiscing about how much the game has changed, modding eras, and account migration headaches after the Microsoft acquisition.

Game Design, Endings & Modding Culture

  • Discussion around “The End” dimension: some see it as a joke or meta-commentary; others argue adding a formal end subtly shifts player behavior.
  • Comparisons are made to other sandbox and factory games where a nominal “end” still doesn’t exhaust the content.
  • Strong split between players who prefer pure vanilla designs and those who view heavy modding as the real source of fun.

Use Cases, Concerns & Critiques

  • Potential positive uses mentioned: testing edge cases for robotics/self-driving, or novel interactive experiences.
  • Concerns include:
    • It’s “just” a steerable video, not a real world model, due to lack of permanence.
    • Energy and compute costs for what some see as a toy.
    • Fear of it fueling infinite generative social media content.
  • Others see promise in similar work (e.g., AI Dungeon, AI Counter-Strike demos) and argue that dismissing it shows a lack of imagination.