video_id
string
| prompt
string
| major content
dict
| attribute control
dict
| prompt complexity
sequence
| source
string
| video_url
string
| unusual type
null
|
|---|---|---|---|---|---|---|---|
"video9033" | "a person jumps from building" | {
"spatial": [
"people",
"buildings & infrastructure"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=rJ9zBV97d5M" | null |
"video9376" | "a horse race is happening" | {
"spatial": [
"animals"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=2h7uMrThu5s" | null |
"video9957" | "people are dancing" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=mHDDE714EtY" | null |
"video8601" | "someone folds paper" | {
"spatial": [
"people",
"artifacts"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=3LmWjp21o8Q" | null |
"video8387" | "a person is cooking" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=j3Sk8ZnAiEA" | null |
"video8536" | "rabbits are running around" | {
"spatial": [
"animals"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=2ixspJ-SnMk" | null |
"video8114" | "a girl is singing" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=x6zffL5Iht8" | null |
"video7915" | "a boy is beat boxing" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=28VK6WSdvVA" | null |
"video8455" | "a man is driving" | {
"spatial": [
"people",
"vehicles"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=DFG-bQnDj84" | null |
"video9772" | "a bird flying" | {
"spatial": [
"animals"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=Xwtc96u6Nkk" | null |
"1012955795" | "Footage of a butterfly fluttering in a tree." | {
"spatial": [
"animals",
"plants"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1012955795/preview/stock-footage-footage-of-a-butterfly-fluttering-in-a-tree-x.mp4" | null |
"video7100" | "baby dogs are sleeping" | {
"spatial": [
"animals"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=tYGy9WX_J5Y" | null |
"video9062" | "a dog is sneezing" | {
"spatial": [
"animals"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=c5s1hON1lKI" | null |
"video9311" | "a horse is eating" | {
"spatial": [
"animals"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=nmOQYaJ9UQg" | null |
"video9460" | "there are fox jumping" | {
"spatial": [
"animals"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=sEs20eppVN4" | null |
"video7244" | "a woman is talking" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=HbQAVo4vFpE" | null |
"video8795" | "a comedian is performing" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=-XqH24X-7gM" | null |
"video9194" | "kids are learning how to wrestle" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=x4y69H0zh2w" | null |
"video9321" | "a penguin is walking" | {
"spatial": [
"animals"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=Beg3bl_lwUY" | null |
"video9675" | "someone is playing a video game" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=Cy2UwZXb-Bk" | null |
"video9819" | "a man is reporting the news" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=1Z1MbIZSv1Y" | null |
"video9849" | "a fire is burning" | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"light change"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=Ndonnv8iHhU" | null |
"1860838" | "Dam flood water" | {
"spatial": [
"buildings & infrastructure",
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1860838/preview/stock-footage-dam-flood-water-v.mp4" | null |
"1006807024" | "A mountain stream" | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1006807024/preview/stock-footage-a-mountain-stream.mp4" | null |
"31839697" | "waves on the beach" | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/31839697/preview/stock-footage-sea-backwash.mp4" | null |
"video7761" | "fireworks are being displayed" | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"light change"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=0c4J8oicKsA" | null |
"2035465" | "Ducks swimming in water" | {
"spatial": [
"animals",
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"actions",
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/2035465/preview/stock-footage-egret-in-water.mp4" | null |
"video7594" | "a small table fountain with rock structure and baby turtles swimming around" | {
"spatial": [
"animals",
"artifacts",
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"kinetic motions",
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"complex"
] | "MSRVTT" | "https://www.youtube.com/watch?v=cQ2foYvVFcg" | null |
"video9481" | "some guy water skiiing" | {
"spatial": [
"people",
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"actions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=adVPIB5mKEQ" | null |
"25618907" | "Flying over the sea" | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/25618907/preview/stock-footage-flying-over-the-sea.mp4" | null |
"video9511_1" | "sea side road" | {
"spatial": [
"buildings & infrastructure",
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=Q3qTl7_JJ6k" | null |
"22953001" | "Video of snow falling" | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/22953001/preview/stock-footage-video-of-snow-falling.mp4" | null |
"video9826" | "car driving in snow" | {
"spatial": [
"vehicles",
"scenery & natural objects"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=-UGthwiEkBU" | null |
"video7137" | "two men covered with snow hugging each other" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"quantity"
],
"temporal": null
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=2ZiTb7uir2c" | null |
"4752161" | "Background - sunset landscape beach" | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"light change"
]
} | {
"spatial": null,
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/4752161/preview/stock-footage-background-sunset-landscape-beach.mp4" | null |
"5000996" | "Dragonfly sunset" | {
"spatial": [
"animals"
],
"temporal": [
"light change"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/5000996/preview/stock-footage-dragonfly-sunset.mp4" | null |
"video8882" | "a car flipping over" | {
"spatial": [
"vehicles"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=CDQZ3gfcuO8" | null |
"video7945" | "the cars drove fast" | {
"spatial": [
"vehicles"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=9oyvpaFfRCA" | null |
"video9328" | "it is a car racing" | {
"spatial": [
"vehicles"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=cjGn1um4PvA" | null |
"video7255" | "a war vehicle is driving" | {
"spatial": [
"vehicles"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=33zuhdPqgAw" | null |
"video7307" | "some vehicles are driving around" | {
"spatial": [
"vehicles"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=B2SDedkJN6Y" | null |
"video8497" | "a car accident happens" | {
"spatial": [
"vehicles"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=0FdsjQZEtH4" | null |
"video7245" | "a car is parked" | {
"spatial": [
"vehicles"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=-iDeWUWdvWg" | null |
"video8871" | "car is drifting" | {
"spatial": [
"vehicles"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=cjGn1um4PvA" | null |
"video9252" | "a garage door lifts revealing a car" | {
"spatial": [
"vehicles",
"buildings & infrastructure"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": [
"motion direction"
]
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=QWhyru5PG1Q" | null |
"video9955" | "a paper air plane is being thrown" | {
"spatial": [
"artifacts"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=9RarsyiUQBI" | null |
"video9629" | "a car gauge is going up" | {
"spatial": [
"artifacts"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=-cL1-y0J3gw" | null |
"video9092" | "the toy bulldozer moves around" | {
"spatial": [
"vehicles"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=5jCBJItAWAU" | null |
"video7226" | "a video game plane is flown" | {
"spatial": [
"vehicles"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=1-Tl18UtNPc" | null |
"1056147005" | "Close up asian sports runner checking heart rate on smartwatch after running while standing on the beach during a beautiful sunset in summer. healthy sports lifestyle concept." | {
"spatial": [
"people",
"artifacts",
"scenery & natural objects"
],
"temporal": [
"actions",
"light change"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1056147005/preview/stock-footage-close-up-asian-sports-runner-checking-heart-rate-on-smartwatch-after-running-while-standing-on-the.mp4" | null |
"1037520449" | "Close up of making vegan chia pudding with nuts and fruits in slow motion" | {
"spatial": [
"food & beverage",
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": [
"speed"
]
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1037520449/preview/stock-footage-close-up-of-making-vegan-chia-pudding-with-nuts-and-fruits-in-slow-motion.mp4" | null |
"1038806252" | "Female theatre performer walking on stage. medium shot. profile view." | {
"spatial": [
"people",
"buildings & infrastructure"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1038806252/preview/stock-footage-female-theatre-performer-walking-on-stage-medium-shot-profile-view.mp4" | null |
"1022570278" | "Close up of a hairdresser's hands washing a customers hair before he is getting a haircut." | {
"spatial": [
"people"
],
"temporal": [
"fluid motions",
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1022570278/preview/stock-footage-close-up-of-a-hairdresser-s-hands-washing-a-customers-hair-before-he-is-getting-a-haircut.mp4" | null |
"1042956187" | "Close up of doctor hands using laptop at medical office with stethoscope in the foreground" | {
"spatial": [
"artifacts",
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1042956187/preview/stock-footage-close-up-of-doctor-hands-using-laptop-at-medical-office-with-stethoscope-in-the-foreground.mp4" | null |
"34350805" | "Overweight male trying to fasten a button on his jacket, bottom view of fat man" | {
"spatial": [
"artifacts",
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/34350805/preview/stock-footage-overweight-male-trying-to-fasten-a-button-on-his-jacket-bottom-view-of-fat-man.mp4" | null |
"1031765333" | "Backside view of woman butt in black leather skirt walking on street, close up, slow motion." | {
"spatial": [
"people",
"buildings & infrastructure"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": [
"camera view",
"color"
],
"temporal": [
"speed"
]
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1031765333/preview/stock-footage-backside-view-of-woman-butt-in-black-leather-skirt-walking-on-street-close-up-slow-motion.mp4" | null |
"1039335197" | "Needle mesotherapy in beauty spa salon or clinic. cosmetics been injected to woman's face, close up portrait" | {
"spatial": [
"artifacts",
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1039335197/preview/stock-footage-needle-mesotherapy-in-beauty-spa-salon-or-clinic-cosmetics-been-injected-to-woman-s-face-close-up.mp4" | null |
"1025304926" | "Side view laughing teenage young girl using tablet pc sitting on couch at cosiness living room" | {
"spatial": [
"artifacts",
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1025304926/preview/stock-footage-side-view-laughing-teenage-young-girl-using-tablet-pc-sitting-on-couch-at-cosiness-living-room.mp4" | null |
"1017107038" | "Profile view of young handsome bearded indian businessman looking back" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1017107038/preview/stock-footage-profile-view-of-young-handsome-bearded-indian-businessman-looking-back.mp4" | null |
"28416544" | "4k close up of businessmen signing contracts & shaking hands on a deal. blurred business group congratulate their colleague in the background. slow motion" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": [
"speed"
]
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/28416544/preview/stock-footage--k-close-up-of-businessmen-signing-contracts-shaking-hands-on-a-deal-blurred-business-group.mp4" | null |
"1056794021" | "A man is typing on a wireless keyboard . close up ." | {
"spatial": [
"people",
"artifacts"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1056794021/preview/stock-footage-a-man-is-typing-on-a-wireless-keyboard-close-up.mp4" | null |
"1028199887" | "Close up of sleeping woman lying on bed under blue blanket." | {
"spatial": [
"people",
"artifacts"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view",
"color"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1028199887/preview/stock-footage-close-up-of-sleeping-woman-lying-on-bed-under-blue-blanket.mp4" | null |
"video7219" | "a first person view of a man driving a red formula one car" | {
"spatial": [
"people",
"vehicles"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": [
"camera view",
"color"
],
"temporal": null
} | [
"complex"
] | "MSRVTT" | "https://www.youtube.com/watch?v=VZ6OQXcZzCI" | null |
"1014038519" | "The musician plays the guitar. close up" | {
"spatial": [
"people",
"artifacts"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1014038519/preview/stock-footage-the-musician-plays-the-guitar-close-up.mp4" | null |
"1009242149" | "Man ties up a red tie. green screen. close up" | {
"spatial": [
"people",
"artifacts"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view",
"color"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1009242149/preview/stock-footage-man-ties-up-a-red-tie-green-screen-close-up.mp4" | null |
"1061563237" | "Shaving facial skin macro closeup of man point of view camera movement" | {
"spatial": [
"people"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1061563237/preview/stock-footage-shaving-facial-skin-macro-closeup-of-man-point-of-view-camera-movement.mp4" | null |
"video8869" | "a first person view of someone showing off block toys" | {
"spatial": [
"people",
"artifacts"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=4iM9-53qGFU" | null |
"video8787" | "a first person view of a player moving through minecraft" | {
"spatial": [
"people"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=BwFw7w893Mc" | null |
"1006927693" | "Close up of unrecognisable clown smiling large in slow motion, profile view" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": [
"speed"
]
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1006927693/preview/stock-footage-close-up-of-unrecognisable-clown-smiling-large-to-the-camera-in-slow-motion.mp4" | null |
"video8768" | "ariel views of a mountainous region with people hiking" | {
"spatial": [
"people",
"scenery & natural objects"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=SOomDInRR1o" | null |
"1047754408" | "Extreme close up video of bearded smiling man" | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1047754408/preview/stock-footage-extreme-close-up-video-of-bearded-smiling-man.mp4" | null |
"video8099" | "an arial view of animals running" | {
"spatial": [
"animals"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"simple"
] | "MSRVTT" | "https://www.youtube.com/watch?v=2iUPb7y0hgE" | null |
"video7606" | "overhead view as pingpong players compete on the table" | {
"spatial": [
"people",
"artifacts"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=sNmZ1wP3If0" | null |
"1008232396" | "Handsome man showing different emotions. close up." | {
"spatial": [
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1008232396/preview/stock-footage-handsome-man-showing-different-emotions-close-up.mp4" | null |
"video7023" | "a close up of a young girl using powder makeup on her face" | {
"spatial": [
"artifacts",
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=SNZ2cPQFQhE" | null |
"video8105" | "a skiin video is displayed filmed from the first person perspective of the skier" | {
"spatial": [
"people"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=Sw7tsNIVyfY" | null |
"video7837" | "1st person view of walking down stairs in an outdoor setting" | {
"spatial": [
"buildings & infrastructure",
"people"
],
"temporal": [
"actions",
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=Y5apMcmeS7I" | null |
"1027328231" | "close up of a businessman man controlling a futuristic computer system using his eye." | {
"spatial": [
"artifacts",
"people"
],
"temporal": [
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1027328231/preview/stock-footage-a-close-up-of-a-businessman-eye-controlling-a-futuristic-computer-system-with-a-security-business.mp4" | null |
"29797315" | "Aerial uhd 4k view. mid-air flight over fresh and clean mountain river at sunny summer morning. green trees and sun rays on horizon. direct on sun" | {
"spatial": [
"plants",
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"light change",
"kinetic motions"
]
} | {
"spatial": [
"light",
"camera view",
"color"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/29797315/preview/stock-footage-aerial-uhd-k-view-mid-air-flight-over-fresh-and-clean-mountain-river-at-sunny-summer-morning.mp4" | null |
"29223100" | "Aerial view of clouds of smoke and steam coming from power station" | {
"spatial": [
"buildings & infrastructure"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/29223100/preview/stock-footage-aerial-view-of-clouds-of-smoke-and-steam-coming-from-power-station-in-russia.mp4" | null |
"1039250324" | "Stream slowly ripples in autumn forest in a sunny day." | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"light change"
]
} | {
"spatial": null,
"temporal": [
"speed"
]
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1039250324/preview/stock-footage-stream-in-the-woods-autumn-forest.mp4" | null |
"1021805248" | "Slow motion interior vehicle point of view footage while driving in the rain in a rural area. focus on the windscreen." | {
"spatial": [
"vehicles"
],
"temporal": [
"fluid motions",
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": [
"speed"
]
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1021805248/preview/stock-footage-slow-motion-interior-vehicle-point-of-view-footage-while-driving-in-the-rain-in-a-rural-area-of.mp4" | null |
"30305434" | "Young girl canoeing in a beautiful lake with close up on paddle in super slow motion 4k" | {
"spatial": [
"people",
"artifacts",
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": [
"speed"
]
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/30305434/preview/stock-footage-young-girl-canoeing-in-a-beautiful-lake-with-close-up-on-paddle-in-super-slow-motion-k.mp4" | null |
"1046043280" | "Aerial view of a hilly coastline from a mediterranean sea. mountains on the horizon " | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1046043280/preview/stock-footage-aerial-view-of-monaco-hilly-coastline-from-a-mediterranean-sea-mountains-on-the-horizon.mp4" | null |
"25460006" | "4k (uhd) aerial view. low flight over fresh cold mountain river at sunny summer morning. green trees and sun rays on horisont. verical down view." | {
"spatial": [
"plants",
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"kinetic motions",
"light change"
]
} | {
"spatial": [
"light",
"camera view",
"color"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/25460006/preview/stock-footage--k-uhd-aerial-view-low-flight-over-fresh-cold-mountain-river-at-sunny-summer-morning-green.mp4" | null |
"1047136504" | "Make coffee. amazing closeup macro shot of pouring swirly espresso coffee or cappuccino with tasty foam in a glass cup. slow motion. " | {
"spatial": [
"artifacts",
"food & beverage"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": [
"speed"
]
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1047136504/preview/stock-footage-make-coffee-amazing-closeup-macro-shot-of-pouring-swirly-espresso-coffee-or-cappuccino-with-tasty.mp4" | null |
"12160229" | "Tea particles in water. macro shot 4k" | {
"spatial": [
"food & beverage"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/12160229/preview/stock-footage-the-leaves-green-tea-and-tea-particles-macro-shot-k.mp4" | null |
"1029169490" | "Aerial view sea waves breaking on sand beach. misty weather, beautiful peninsula landscape. sea waves on the beautiful cape aerial view drone 4k shot." | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1029169490/preview/stock-footage-aerial-view-sea-waves-breaking-on-sand-beach-misty-weather-beautiful-peninsula-landscape-sea.mp4" | null |
"19300912" | "Backhoe loader truck dump dirty snow from folding bucket, close view. urban city blurred background." | {
"spatial": [
"buildings & infrastructure",
"vehicles",
"scenery & natural objects"
],
"temporal": [
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/19300912/preview/stock-footage-backhoe-loader-truck-dump-dirty-snow-from-folding-bucket-close-view-urban-city-blurred-background.mp4" | null |
"10296182" | "Beautiful nature view of ripply waterfall in early spring park. static tripod shot. 4k uhd video clip." | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/10296182/preview/stock-footage-beautiful-nature-view-of-ripply-waterfall-in-early-spring-park-static-tripod-shot-k-uhd-video.mp4" | null |
"11785907" | "Close up of washing gravel from a gold pan. gold mining on the river." | {
"spatial": [
"people",
"artifacts",
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/11785907/preview/stock-footage-close-up-of-washing-gravel-from-a-gold-pan-gold-mining-on-the-river-miner-washing-gold-in-the-pan.mp4" | null |
"1024989728" | "aerial view of surfers on longboards with oars sailing in bay. beautiful sunny summer day" | {
"spatial": [
"people",
"artifacts",
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"actions",
"light change",
"kinetic motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1024989728/preview/stock-footage-nakhodka-russia-august-aerial-view-of-surfers-on-longboards-with-oars-sailing-in-bay.mp4" | null |
"30069892" | "Close up footage rain drops falling on thatched roof with green nature mountain background." | {
"spatial": [
"buildings & infrastructure",
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": [
"camera view",
"color"
],
"temporal": null
} | [
"complex"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/30069892/preview/stock-footage-close-up-footage-rain-drops-falling-on-thatched-roof-with-green-nature-mountain-background.mp4" | null |
"video7923" | "an amazing aerial view of water flowing through a mountainous rivulet and dropping down like a waterfall" | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"complex"
] | "MSRVTT" | "https://www.youtube.com/watch?v=xxRM6hwV7fU" | null |
"27254191" | "Aerial view of tugboat and cargo ship on river" | {
"spatial": [
"vehicles",
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/27254191/preview/stock-footage-aerial-view-of-tugboat-and-cargo-ship-delaware-river-philadelphia.mp4" | null |
"video8312" | "a scenic view of a large lake and great hills is shown" | {
"spatial": [
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": [],
"temporal": null
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=T8gm10FFTQA" | null |
"3109510" | "Coast forest view through water surf" | {
"spatial": [
"plants",
"scenery & natural objects"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": null,
"temporal": null
} | [
"medium"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/3109510/preview/stock-footage-coast-forest-view-through-water-surf.mp4" | null |
"1032804956" | "Close up pouring whiskey.glass of whiskey" | {
"spatial": [
"food & beverage",
"artifacts"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/1032804956/preview/stock-footage-close-up-poring-whiskey-glass-of-whiskey.mp4" | null |
"video8888" | "a person showing under water view on the screen" | {
"spatial": [
"people",
"artifacts",
"scenery & natural objects"
],
"temporal": [
"fluid motions",
"actions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"medium"
] | "MSRVTT" | "https://www.youtube.com/watch?v=_UUjJJQ02n0" | null |
"3926288" | "Toasting with beer, close up view." | {
"spatial": [
"food & beverage"
],
"temporal": [
"fluid motions"
]
} | {
"spatial": [
"camera view"
],
"temporal": null
} | [
"simple"
] | "WebVid" | "https://ak.picdn.net/shutterstock/videos/3926288/preview/stock-footage-toasting-with-beer-close-up-view.mp4" | null |
FETV
FETV is a benchmark for Fine-grained Evaluation of open-domain Text-to-Video generation
Overview
FETV consist of a diverse set of text prompts, categorized based on three orthogonal aspects: major content, attribute control, and prompt complexity.
Dataset Structure
Data Instances
All FETV data are all available in the file fetv_data.json. Each line is a data instance, which is formatted as:
{
"video_id": "1006807024",
"prompt": "A mountain stream",
"major content": {
"spatial": ["scenery & natural objects"],
"temporal": ["fluid motions"]
},
"attribute control": {
"spatial": null,
"temporal": null
},
"prompt complexity": ["simple"],
"source": "WebVid",
"video_url": "https://ak.picdn.net/shutterstock/videos/1006807024/preview/stock-footage-a-mountain-stream.mp4",
"unusual type": null
}
Data Fields
- "video_id": The video identifier in the original dataset where the prompt comes from.
- "prompt": The text prompt for text-to-video generation.
- "major content": The major content described in the prompt.
- "attribute control": The attribute that the prompt aims to control.
- "prompt complexity": The complexity of the prompt.
- "source": The original dataset where the prompt comes from, which can be "WebVid", "MSRVTT" or "ours".
- "video_url": The url link of the reference video.
- "unusual type": The type of unusual combination the prompt involves. Only available for data instances with
"source": "ours".
Dataset Statistics
FETV contains 619 text prompts. The data distributions over different categories are as follows (the numbers over categories do not sum up to 619 because a data instance can belong to multiple categories)
- Downloads last month
- 2