full
string
trimmed
string
edited
string
masks
images list
task
string
start-time
int32
end-time
int32
manipulation-type
string
editor-id
string
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4z1v27.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4z1v27.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4z1v27.mp4"
"add a long earring to the ear"
68
72
"splicing"
"w7nprx"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4dpxd4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4dpxd4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4dpxd4.mp4"
Not supported with pagination yet
"Frame duplication/Reversed Frames/"
70
80
"frame-level"
"w7nprx"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/73mnr4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/73mnr4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/73mnr4.mp4"
Not supported with pagination yet
"Trim to 5 seconds (00:00 - 00:05) and then in that 5 seconds duplicate frames in between to make it look like the guy is going slow in between and fast in between and pausing it now and then."
0
5
"frame-level"
"groedl"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/48l3km.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/48l3km.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/48l3km.mp4"
Not supported with pagination yet
"Change the color of the shirt from white to purple 00: 00-00: 05 sec"
0
5
"swap"
"pd4ydl"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4romo4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4romo4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4romo4.mp4"
"add a flock of birds in the sky"
3
9
"splicing"
"ldw3r9"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/9mon3y.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/9mon3y.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/9mon3y.mp4"
Not supported with pagination yet
"Remove the person who says 00: 02-00: 07 sec"
2
7
"inpainting"
"pd4ydl"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/48o0e9.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/48o0e9.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/48o0e9.mp4"
Not supported with pagination yet
"Reversed Frames/Speeding up"
10
20
"frame-level"
"w7nprx"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4wgnr7.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4wgnr7.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4wgnr7.mp4"
Not supported with pagination yet
"add the text "Exclusive" in bold letters to the jacket on the right side"
52
56
"splicing"
"w7nprx"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4zyg22.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4zyg22.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4zyg22.mp4"
Not supported with pagination yet
"Replace the framed picture with a forest landscape 08: 34-08: 42"
514
522
"splicing"
"pd4ydl"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/72m1x9.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/72m1x9.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/72m1x9.mp4"
Not supported with pagination yet
"Place aux14.mp4 (either the man or the woman) on the right side of this video."
-1
-1
"splicing"
"groedl"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/40yvx9.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/40yvx9.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/40yvx9.mp4"
"remove girl and shadow"
0
4
"inpainting"
"gre97n"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4zyr07.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4zyr07.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4zyr07.mp4"
"change lip color to purple"
10
15
"swap"
"l7x2rq"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/72yv89.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/72yv89.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/72yv89.mp4"
"Add a hat to your head"
0
5
"splicing"
"w7nprx"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4dp3v4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4dp3v4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4dp3v4.mp4"
"add a cat lying on the floor"
33
37
"splicing"
"w7nprx"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4dp8d4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4dp8d4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4dp8d4.mp4"
Not supported with pagination yet
"Reversed Frames/Slowing down"
10
20
"frame-level"
"gre97n"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/72yjd9.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/72yjd9.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/72yjd9.mp4"
Not supported with pagination yet
"Reversed Frames"
20
30
"frame-level"
"ldw3r9"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4qwky4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4qwky4.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4qwky4.mp4"
"Add text to the curtain in large letters "Imagination""
5
10
"splicing"
"gre97n"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/7e8wxv.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/7e8wxv.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/7e8wxv.mp4"
Not supported with pagination yet
"Change hair color 00: 14-00: 19 sec"
14
19
"swap"
"pd4ydl"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/9g28ln.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/9g28ln.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/9g28ln.mp4"
Not supported with pagination yet
"Remove books on the shelf from 00: 21-00: 26 sec."
21
26
"inpainting"
"pd4ydl"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4xegn7.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4xegn7.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4xegn7.mp4"
"Add the text "Beijing 2022" to the roof on the right (center)"
0
7
"splicing"
"vdk473"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/full/4xe85r.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/trimmed/4xe85r.mp4"
"https://huggingface.co/datasets/AlexBlck/ANAKIN/resolve/main/edited/4xe85r.mp4"
Not supported with pagination yet
"Remove the ball at 00: 00-00: 05 sec"
0
5
"inpainting"
"pd4ydl"

arxiv

ANAKIN

ANAKIN is a dataset of mANipulated videos and mAsK annotatIoNs. To our best knowledge, ANAKIN is the first real-world dataset of professionally edited video clips, paired with source videos, edit descriptions and binary mask annotations of the edited regions. ANAKIN consists of 1023 videos in total, including 352 edited videos from the VideoSham dataset plus 671 new videos collected from the Vimeo platform.

Data Format

Label Description
video-id Video ID
full* Full length original video
trimmed Short clip trimmed from full
edited Manipulated version of trimmed
masks* Per-frame binary masks, annotating the manipulation
start-time* Trim beginning time (in seconds)
end-time* Trim end time (in seconds)
task Task given to the video editor
manipulation-type One of the 5 manipulation types: splicing, inpainting, swap, audio, frame-level
editor-id Editor ID

*There are several subset configurations available. The choice depends on whether you need to download full length videos and/or you only need the videos with masks available. start-time and end-time will be returned for subset configs with full videos in them.

config full masks train/val/test
all yes maybe 681/98/195
no-full no maybe 716/102/205
has-masks no yes 297/43/85
full-masks yes yes 297/43/85

Example

The data can either be downloaded or streamed.

Downloaded

from datasets import load_dataset
from torchvision.io import read_video

config = 'no-full' # ['all', 'no-full', 'has-masks', 'full-masks']
dataset = load_dataset("AlexBlck/ANAKIN", config, nproc=8)

for sample in dataset['train']: # ['train', 'validation', 'test']
    trimmed_video, trimmed_audio, _ = read_video(sample['trimmed'], output_format="TCHW")
    edited_video, edited_audio, _ = read_video(sample['edited'], output_format="TCHW")
    masks = sample['masks']
    print(sample.keys())

Streamed

from datasets import load_dataset
import cv2

dataset = load_dataset("AlexBlck/ANAKIN", streaming=True)

sample = next(iter(dataset['train'])) # ['train', 'validation', 'test']
cap = cv2.VideoCapture(sample['trimmed'])

while(cap.isOpened()):
    ret, frame = cap.read()
    # ...
Downloads last month
130
Edit dataset card
Evaluate models HF Leaderboard