Author here. This started as a 20-second ad: a household robot waters a plant, the camera orbits, and its revealed the water is actually missing the plant. Fun gag, but I had no idea the struggle that would ensue trying to get the model to produce a result against its rewarded training data. Hadn't done much with generative video before this; Learned a lot about the state of video models and AI world knowledge on this project.
Author here. This started as a 20-second ad: a household robot waters a plant, the camera orbits, and its revealed the water is actually missing the plant. Fun gag, but I had no idea the struggle that would ensue trying to get the model to produce a result against its rewarded training data. Hadn't done much with generative video before this; Learned a lot about the state of video models and AI world knowledge on this project.