image
image
caption
string
label
string
"[start] a child in a pink dress is climbing up a set of stairs in an entry way ."
"babies"
"[start] a black dog and a white dog with brown spots are staring at each other in the street .|[start] a black dog and a tri-colored dog playing with each other on the road .|[start] a black dog and a spotted dog are fighting"
"dogs|dogs|dogs"
"[start] a man sleeping on a bench outside with a white and black dog sitting next to him .|[start] a man lays on the bench to which a white dog is also tied .|[start] man laying on bench holding leash of dog sitting on ground|[start] a shirtless man lies on a park bench with his dog .|[start] a man lays on a bench while his dog sits by him ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a small child grips onto the red ropes at the playground .|[start] the small child climbs on a red ropes on a playground .|[start] a child playing on a rope net ."
"babies|babies|babies"
"[start] a black and white dog is running in a grassy garden surrounded by a white fence .|[start] a black and white dog is running through the grass .|[start] a dog runs on the green grass near a wooden fence ."
"dogs|dogs|dogs"
"[start] an officer in a reflective vest stands at the front of his van with his dog .|[start] a trained police dog sits next to his handler in front of the police van .|[start] a security man with his watch dog is looking for something .|[start] a policeman is standing with a german shepherd dog .|[start] a policeman stops on a street with a search dog ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a asian man wearing a white top and baby blue bottoms is using a broom to remove the dirt of the pavement ."
"babies"
"[start] white dog with brown ears standing near water with head turned to one side .|[start] a white dog shakes on the edge of a beach with an orange ball .|[start] white dog playing with a red ball on the shore near the water .|[start] a dog shakes its head near the shore a red ball next to it ."
"dogs|dogs|dogs|dogs"
"[start] two men each with a small child on their backs walk on a paved road ."
"babies"
"[start] a young child is walking on a stone paved street with a metal pole and a man behind him ."
"babies"
"[start] a mottled black and gray dog in a blue collar jumping over a fallen tree .|[start] a gray dog is leaping over a fallen tree .|[start] a large black dog leaps a fallen log .|[start] the black dog jumped the tree stump .|[start] a black dog leaps over a log ."
"dogs|dogs|dogs|dogs|dogs"
"[start] the white and brown dog is running over the surface of the snow .|[start] a white and brown dog is running through a snow covered field .|[start] a brown and white dog is running through the snow .|[start] a dog running through snow .|[start] a dog is running in the snow"
"dogs|dogs|dogs|dogs|dogs"
"[start] large brown dog running away from the sprinkler in the grass .|[start] a brown dog chases the water from a sprinkler on a lawn .|[start] a brown dog running on a lawn near a garden hose|[start] a brown dog plays with the hose .|[start] a dog is playing with a hose ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a dog prepares to catch a thrown object in a field with nearby cars .|[start] a white dog is ready to catch a yellow ball flying through the air .|[start] a white dog is about to catch a yellow ball in its mouth .|[start] a white dog is about to catch a yellow dog toy .|[start] a white dog running after a yellow ball"
"dogs|dogs|dogs|dogs|dogs"
"[start] a white dog is trying to catch a ball in midair over a grassy field .|[start] the white dog is playing in a green field with a yellow toy .|[start] a black and white dog jumping in the air to get a toy .|[start] a black and white dog jumps up towards a yellow toy .|[start] a dog leaps to catch a ball in a field ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a child and a woman are at waters edge in a big city ."
"babies"
"[start] a couple with their newborn baby sitting under a tree facing a lake .|[start] couple with a baby sit outdoors next to their stroller .|[start] a couple sit on the grass with a baby and stroller ."
"babies|babies|babies"
"[start] this is a black dog splashing in the water .|[start] the black dog runs through the water .|[start] a black dog running in the surf .|[start] a dog splashes in the water"
"dogs|dogs|dogs|dogs"
"[start] a black dog carries a green toy in his mouth as he walks through the grass .|[start] a wet black dog is carrying a green toy through the grass .|[start] a black dog carrying something through the grass .|[start] a dog in grass with a blue item in his mouth .|[start] a black dog has a blue toy in its mouth ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a man and a baby are in a yellow kayak on water .|[start] a man and child kayak through gentle waters .|[start] man and child in yellow kayak"
"babies|babies|babies"
"[start] a woman in a dark dress smiles while a woman across from her and a child sit in chairs ."
"babies"
"[start] a child with headphones riding on his mother 's shoulders ."
"babies"
"[start] a black dog and a brown dog play with a red toy on a courtyard .|[start] a black dog and a brown dog are jumping up to catch a red toy .|[start] black dog snaps at red and black object as brown dog lunges ."
"dogs|dogs|dogs"
"[start] a child in a red jacket playing street hockey guarding a goal ."
"babies"
"[start] a toddler in a blue shirt with red shorts and hat looks out from behind a fenced in area of a brick patio .|[start] a young child wearing a blue shirt and red hat grabs onto black bars in front of him ."
"babies|babies"
"[start] a woman wearing a brown dress with a matching turban is pushing a toddler through a park in his stroller .|[start] woman dressed in brown african attire pushing a toddler in a stroller .|[start] a woman is walking her baby with a stroller at the local park .|[start] the lady is pushing a child in a stroller .|[start] a woman pushes her baby in a stroller ."
"babies|babies|babies|babies|babies"
"[start] a young child with a band-aid on his head sits eating at a small white table with a little girl eating off a yellow plate ."
"babies"
"[start] a child biting into a baked good ."
"babies"
"[start] a baby boy crying standing on a field of grass .|[start] a toddler is walking in on a grassy knoll .|[start] a blond toddler walks in a field .|[start] a child walks in a grassy field ."
"babies|babies|babies|babies"
"[start] a man and his dog are grilling green beans on a grill .|[start] a man grilling vegetables on a patio with his dog .|[start] a man and a dog grilling green beans .|[start] guy and his dog cooking outside"
"dogs|dogs|dogs|dogs"
"[start] an african american child is supported by his three peers while riding his bicycle ."
"babies"
"[start] this little baby girl dressed whimsically in striped pantaloons is pictured so that one must ask which is bigger her feet or her sleepy smile .|[start] a sleeping baby is in someone 's arms and wearing a pink striped outfit|[start] a sleeping baby in a pink striped outfit .|[start] a little baby cradled in someones arms .|[start] a little baby is wearing purple pants ."
"babies|babies|babies|babies|babies"
"[start] a child in a dress runs through the yard with a miniature orange soccer ball in her hand ."
"babies"
"[start] a young child wearing a blue shirt and sandals playing with a red toy while sitting on the floor .|[start] a black-haired child in a blue outfit is playing with a toy outside on a tile floor .|[start] a young child playing with a toy while laying on the floor ."
"babies|babies|babies"
"[start] a child is performing a skateboard trick while another child with a skateboard leans on a wall ."
"babies"
"[start] a child has fun with a blender in the kitchen .|[start] a child using an electric mixer in a bowl .|[start] a child happily mixing batter in a bowl ."
"babies|babies|babies"
"[start] a brown dog is running after a black dog on a rocky shore .|[start] a brown dog is running after the black dog ."
"dogs|dogs"
"[start] a child jumps off a high diving board into the pool ."
"babies"
"[start] a white dog is running down a rocky beach .|[start] light brown dog running along the beach .|[start] a light-colored dog runs on the beach .|[start] a small yellow dog runs on a beach|[start] a tan dog runs on a sandy beach ."
"dogs|dogs|dogs|dogs|dogs"
"[start] one child is climbing in a tree while another older child watches ."
"babies"
"[start] a man is kneeling down with a child on a beach where bright blue and red boats are stationed in the background ."
"babies"
"[start] a black and white dog is attempting to catch a yellow and purple object in a low cut yard .|[start] a black dog is jumping up to catch a purple and green toy .|[start] a black and white dog jumps after a yellow toy .|[start] a black and white dog jumps to get the frisbee .|[start] a dog jumps to catch a toy ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a white and black dog and a brown dog in sandy terrain .|[start] one dog is chasing another one on the beach .|[start] a woolly dog chases a doberman on a beach ."
"dogs|dogs|dogs"
"[start] a multicolor dog jumping to catch a tennis ball in a grassy field .|[start] a dog leaps while chasing a tennis ball through a grassy field .|[start] a dog is jumping to catch a object thrown at it .|[start] a black and white dog catches a toy in midair .|[start] a dog and a tennis ball ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a child swings a baseball bat at the ball ."
"babies"
"[start] a child with a helmet on his head rides a bike ."
"babies"
"[start] a child covered in foam is climbing on a black inflatable ramp ."
"babies"
"[start] a child is falling off a slide onto colored balloons floating on a pool of water ."
"babies"
"[start] a man in a wetsuit is throwing a toddler up in the air and is ready to catch him .|[start] a man in a wetsuit is throwing a baby wearing a wetsuit up into the air ."
"babies|babies"
"[start] a mother decides to take her child on a piggyback ride outside their apartment complex .|[start] a baby boy in a blue and white striped shirt is sitting on his mother 's shoulders .|[start] a young woman is giving a baby a ride on her shoulders .|[start] a woman gives a small child a piggyback ride ."
"babies|babies|babies|babies"
"[start] a large brown dog is pushing a small boston terrier with his face while anouther dog watches .|[start] a large skinny dog stands near two smaller dogs in the dirt ."
"dogs|dogs"
"[start] a white dog is resting its head on a tiled floor with its eyes open .|[start] a closeup of a white dog that is laying its head on its paws .|[start] a white dog rests its head on the patio bricks .|[start] a white dog has its head on the ground .|[start] a large white dog lying on the floor ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a light brown dog runs down a path happily .|[start] a brown dog running down a paved pathway|[start] a brown dog running next to grass .|[start] a dog is running down a road .|[start] energetic brown dog running"
"dogs|dogs|dogs|dogs|dogs"
"[start] a girl laughs while holding an younger girl on her back and facing a small child ."
"babies"
"[start] a young man and a toddler look under the hood of an old-fashioned truck .|[start] man working on old truck while child watches ."
"babies|babies"
"[start] a brown dog plays in a deep pile of snow .|[start] a tan dog stand in the snow and looks up .|[start] a dog looking at the camera in snow .|[start] the brown dog is out in the snow .|[start] a dog runs through the snow ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a child plays in a fountain ."
"babies"
"[start] the dog is running out of the tunnel on a dog obedience course .|[start] the small brown and white dog is running out of a small tunnel .|[start] a dog runs out of a tunnel on a course ."
"dogs|dogs|dogs"
"[start] a yellow dog and a black and white dog are running in the dirt .|[start] a blond dog and a black and white dog run in a dirt field .|[start] a dog chases another dog ."
"dogs|dogs|dogs"
"[start] a black and white dog is being soaked with a jet of water in a blue paddling pool .|[start] a dog sticking its face into the shower from a garden hose .|[start] a black and white dog drinking water from a water spray .|[start] a white and black dog is jumping into a pool .|[start] a small white dog gets sprayed by water"
"dogs|dogs|dogs|dogs|dogs"
"[start] a child is sitting on a couch with a ripped cushion ."
"babies"
"[start] a young child is standing alone on some jagged rocks ."
"babies"
"[start] a baby is crying while holding on to the side of a crib .|[start] a white baby boy crying over a tipped over toy .|[start] crying baby in a blue shirt and white pants .|[start] a baby with blond-hair crying or yelling .|[start] a toddler in a blue shirt is crying ."
"babies|babies|babies|babies|babies"
"[start] the child paints on a large paper with water colors .|[start] a child painting a picture ."
"babies|babies"
"[start] a black dog playing fetch with a ball of rope .|[start] a large black dog is playing in a grassy yard .|[start] a black dog running after his rope toy .|[start] a black dog jumping to catch a rope toy|[start] a black dog pounces to get a rope toy ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a small child and an adult walk on the beach in front of ocean waves .|[start] an adult and a child walk along the beach during the day .|[start] an adult and child walking along the beach on the sand .|[start] a woman and a child are walking on a beach .|[start] a man and a child walking down a beach ."
"babies|babies|babies|babies|babies"
"[start] a brown and white dog catches a frisbee in it mouth in front of a group of people .|[start] a brown and white dog jumping up to catch a frisbee while an audience watches .|[start] an agile dog catches a frisbee while a crowd of onlookers watches closely .|[start] a dog jumps to catch a frisbee while many people watch ."
"dogs|dogs|dogs|dogs"
"[start] a toddler sitting on a pile of rocks holding a rock at a beach .|[start] a baby is sitting on and playing with smooth rocks .|[start] a baby is stacking rocks on the beach ."
"babies|babies|babies"
"[start] a child finishing an ice cream cone mugs for the camera ."
"babies"
"[start] five men one wearing a white shirt standing on something hanging up a picture of a child ."
"babies"
"[start] a father is playing with his child in the sand ."
"babies"
"[start] a blond child is wearing blue goggles and a green speedo tank top while swimming underwater .|[start] a child swimming underneath the water .|[start] a child is swimming with goggles on ."
"babies|babies|babies"
"[start] a child playing with a fountain at the beach .|[start] a child plays with a fountain ."
"babies|babies"
"[start] a black dog runs along the beach and jumps over a wood barrior .|[start] a dog jumping over a small wall at a beach near the water .|[start] a black dog is jumping over a log along a beach .|[start] a dog is running on the beach ."
"dogs|dogs|dogs|dogs"
"[start] a brown dog is running in the sand .|[start] a brown dog playing in the sand .|[start] a dog running fast in the sand .|[start] a brown dog plays at the beach .|[start] a dog is standing in the sand ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a small child wades through the water while being guided by another person .|[start] a young child splashing in water ."
"babies|babies"
"[start] a little tan dog with large ears running through the grass .|[start] this is a small beige dog running through a grassy field|[start] a playful dog is running through the grass .|[start] the small dog is running across the lawn ."
"dogs|dogs|dogs|dogs"
"[start] a brown black and white dog is running through a large field with its mouth open .|[start] a dog with its mouth open running through a field torwards the camera .|[start] a black brown and white dog running through a field .|[start] a black and white dog is running through the field .|[start] a dog running in a field ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a child and a young adult the adult is maybe demonstrating how to do something to teach the young child|[start] a man with a bucket and a child pointing to some machinery .|[start] a man and a child stand next to a blue and black tube .|[start] a man and child on a ship doing maintenance ."
"babies|babies|babies|babies"
"[start] a small child doing a handstand on a bed .|[start] a child is standing on her head ."
"babies|babies"
"[start] a little toddler dressed in white is smiling while a lady helps him wave a flag .|[start] a baby in a white garment holds a flag with crescent moon and star .|[start] a baby is holding a small black flag with a moon and a star on it .|[start] a baby wearing a white gown waves a muslim flag ."
"babies|babies|babies|babies"
"[start] a small child in poverty conditions is holding a chicken ."
"babies"
"[start] a brown and white and a black and white dog hauling in a floating toy from the ocean ."
"dogs"
"[start] blond child with large black coat multicolored scarf and knit hat standing in front of a window .|[start] a child standing outside in a matching cap and scarf ."
"babies|babies"
"[start] a brown dog swims through water outdoors with a tennis ball in its mouth .|[start] a red dog holding a ball splashes through vegetation filled water .|[start] a brown dog is running through neck-deep water carrying a tennis ball .|[start] a brown dog splashes in the water while carrying a ball in its mouth .|[start] brown dog with tennis ball in mouth in water and bushes ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a child blowing bubbles in water ."
"babies"
"[start] a pile of seaweed sits on the sand behind it a big black dog is running in the water .|[start] a dog at the shore of an ocean with seaweed in foreground .|[start] a black dog runs into the ocean next to a pile of seaweed .|[start] a dog is running in the waves at the beach ."
"dogs|dogs|dogs|dogs"
"[start] a furry dog attempts to dry itself by shaking the water off its coat .|[start] a brown and white dog stands outside while it snows .|[start] the large brown and white dog shakes off water .|[start] a dog is looking at something near the water .|[start] a white and brown dog shaking its self dry ."
"dogs|dogs|dogs|dogs|dogs"
"[start] a small child is jumping on a bed ."
"babies"
"[start] a woman wearing glasses puts her hand on the shoulder of a young child as they sit at a flat wooden surface .|[start] a woman with glasses puts her arm around a very young child who is eating something .|[start] a woman has her arm around a child as the child is eating|[start] a brown-haired woman looks at a baby eating something .|[start] a woman touching her child 's shoulder ."
"babies|babies|babies|babies|babies"
"[start] a small child in green clothing walks past a store opening and a woman in pink pants .|[start] the child in the green one piece suit is walking past a store window .|[start] a small child walks down a sidewalk ."
"babies|babies|babies"
"[start] a child getting out of the car wearing soccer shoes ."
"babies"
"[start] a child looks at her reflection in a puddle of water ."
"babies"
"[start] a child is hiding under a sweater in a chair ."
"babies"
"[start] a child and a man sit on the ground together ready to use paintbrushes and a bucket .|[start] a man and a child with a bucket of paint .|[start] a man and a child painting a post ."
"babies|babies|babies"
"[start] a child using a woodworking tool"
"babies"
"[start] a young dark-skinned child in a long blue coat is chasing a ball ."
"babies"
"[start] a little baby dressed in green and yellow wearing a bib cries .|[start] a baby wearing a green bib with a frog on it is crying ."
"babies|babies"
"[start] a child practices hitting a baseball into a net while two adult men watch ."
"babies"
"[start] a man and dog concentrating on a camera taking their picture in the street .|[start] black and white dog looking at camera with man bent over in the background .|[start] white with black spots dog is being looked at by a man on the street .|[start] a man and his dog are both interested in the photographer .|[start] a black and white dog standing near a man ."
"dogs|dogs|dogs|dogs|dogs"

Flickr30k dogs and babies selection

The data set was created for an image-to-text/text-to-image tutorial of the Advanced Natural Language Processing (KEN4259) course at Maastricht University. To make a good demo, but limit the data size and required training time, we selected only images where the caption has a term for dog or a small child. Images were also cropped to squares and compressed to 128 x 128 pixels to fit into our SWIN transformer.

Authors and acknowledgment

Aki Härmä, Department of Advances Computing Sciences, Faculty of Science and Engineering, Maastricht University, The Netherlands

License

The Flickr30k data can be used for research and education use. See Flickr30k data set for the original license and citatation info.

Project status

First draft

Downloads last month
79
Edit dataset card
Evaluate models HF Leaderboard