ViVo

Samples

Music Samples
Athletic Samples
Misceleneous Samples

All scenes

We show the set-up for all scenes described in the paper and time sheet (below). We have ordered each instance w.r.t the time sheet. The entire dataset is quite large (> 1 TB zipped), so please contact us if you have any questions about scene details (e.g. "Which one should I use if I want slower motions?" or "Which scenes are relevant to dynamic textures?")

Contributor 1
Keyboard
Contributor 2
Standing Keyboard
Contributor 3
Tennis Juggling
Contributor 4
Tennis Serves
Contributor 5
Banana Juggling
Contributor 6
Banana Drinking
Contributor 7
Bananas Sharing
Contributor 8
Bananas Drinking
Contributor 9
Trio Standing
Contributor 10
Plain Trio Birthday
Contributor 11
Fancy Trio Birthday
Contributor 12
Meditative Motions
Contributor 13
Hip-Hop
Contributor 14
Breakdancing
Contributor 15
Bass
Contributor 16
Cymbals
Contributor 17
Triangle
Contributor 18
Cymbals and Guitar
Contributor 19
Triangle and Guitar
Contributor 20
Guitar
Contributor 21
Flute
Contributor 22
Flute and Guitar
Contributor 23
Goblin Cosplay
Contributor 24
Inflatable Unicorn
Contributor 25
Party Clown
Contributor 26
Clown Popping Ballons
Contributor 27
Passing Baskets
Contributor 28
Stretching
Contributor 29
Squatting 300KG
Contributor 30
Curling 100KG
Contributor 31
Dog Show
Contributor 32
Dog Play

Time Sheet

Below is a dictionary-style time sheet for the action sets. Each block is split into:
1. Three sessions, e.g. "[15-10-24] Session 1: {...}" (depending on filming date)
2. Sub-sessions, e.g. "A1-A2"

Each instance corresponds to a specific scene and motion. Hence, some instances will share scenes (and performers) but not share motions.

For each instance we have labelled the start and end frame number (relevant for file names) and a description of of each instance. Other meta data (e.g. materials and speed of motion) may be added at a later date

Note: The sub-session split was done this way to minimize the number of recordings we needed to make. It consumes a lot of energy and time to boot the capture system for recording. Consequently, we have also labelled the instances between performaces where the scene changes with "Description: Scene Change". The naming is arbitrary. 


[15-10-24] Session 1: {   
    
    "A1-A2": {
        "Frame Start": 0, 
        "Frame End": 700,
        "Description": "Testing piano for audio"
    },
    "A1-A2": {
        "Frame Start": 700, 
        "Frame End": 850,
        "Description": "Performer puts on sunglasses"
    },
    "A1-A2": {
        "Frame Start": 850, 
        "Frame End": 1725,
        "Description": "Performer plays piano standing up"
    },
    "A1-A2": {
        "Frame Start": 1725, 
        "Frame End": 2600,
        "Description": "Scene Change"
    },
    "A1-A2": {
        "Frame Start": 2600, 
        "Frame End": 3600,
        "Description": "Performer plays piano with one leg on a chair, holding piano in arms. (slow)"
    },
    "A1-A2": {
        "Frame Start": 3600, 
        "Frame End": 3800,
        "Description": "Performer resituates"
    },
    "A1-A2": {
        "Frame Start": 3800, 
        "Frame End": 4500,
        "Description":  "Performer plays piano with one leg on a chair, holding piano in arms. (fast)"
    },
    "A1-A2": {
        "Frame Start": 4500, 
        "Frame End": End,
        "Description": "Scene Change"
    },

    "A4-A5": {
        "Frame Start": 0, 
        "Frame End": 200,
        "Description": "Performer waits for set-up"
    },
    "A4-A5": {
        "Frame Start": 200, 
        "Frame End": 560,
        "Description": "Performer walking in circles juggling tennis ball on racket"
    },
    "A4-A5": {
        "Frame Start": 560, 
        "Frame End": 750,
        "Description": "Performer bounces ball on floor"
    },
    "A4-A5": {
        "Frame Start": 750, 
        "Frame End": 920,
        "Description": "Performer emulates tennis serve"
    },
    "A4-A5": {
        "Frame Start": 920, 
        "Frame End": 1250,
        "Description": "Performer keeps juggling ball on tennis racket"
    },
    "A4-A5": {
        "Frame Start": 1250, 
        "Frame End": 1800,
        "Description": "Performer bounces tennis ball on floor in a cirle"
    },
    "A4-A5": {
        "Frame Start": 1800, 
        "Frame End": 1800,
        "Description": "Scene Change"
    },

    "B1-B2": {
        "Frame Start": 0, 
        "Frame End": 630,
        "Description": "Performer waits for set-up"
    },
    "B1-B2": {
        "Frame Start": 630, 
        "Frame End": 1310,
        "Description": "Performer juggles three oranges (fast)"
    },
    "B1-B2": {
        "Frame Start": 1310, 
        "Frame End": 1700,
        "Description": "Scene Change"
    },
    "B1-B2": {
        "Frame Start": 1700, 
        "Frame End": 2800,
        "Description": "Performer drinks purple juice from transparent glass (slow)"
    },
    "B1-B2": {
        "Frame Start": 2800, 
        "Frame End": 3650,
        "Description": "Scene Change"
    },
    "B1-B2": {
        "Frame Start": 3650, 
        "Frame End": 3900,
        "Description": "Performers hold pears and oranges"
    },
    "B1-B2": {
        "Frame Start": 3900, 
        "Frame End": 4400,
        "Description": "Performers trade pears and oranges (slow)"
    },
    "B1-B2": {
        "Frame Start": 4400, 
        "Frame End": 4800,
        "Description": "Performers throws pear and continues trading (eratic motion)"
    },
    "B1-B2": {
        "Frame Start": 4800, 
        "Frame End": 5800,
        "Description": "Scene Change"
    },
    "B1-B2": {
        "Frame Start": 5800, 
        "Frame End": 7300,
        "Description": "Performers cheers and drink green and pruple juice from transparent glass"
    },
    "B1-B2": {
        "Frame Start": 7300, 
        "Frame End": End,
        "Description": "Scene Change"
    },

    "C1-C2": {
        "Frame Start": 0, 
        "Frame End": 640,
        "Description": "Performers wait for set-up"
    },
    "C1-C2": {
        "Frame Start": 640, 
        "Frame End": 1000,
        "Description": "Scene Change"
    },
    "C1-C2": {
        "Frame Start": 1000, 
        "Frame End": 1850,
        "Description": "Performers sing happy birthday while central performer holds cake with candles and reflective tin-tray"
    },
    "C1-C2": {
        "Frame Start": 1850, 
        "Frame End": 2600,
        "Description": "Performers finish singing and wait"
    },
    "C1-C2": {
        "Frame Start": 2600, 
        "Frame End": 2700,
        "Description": "Scene Change"
    },
    "C1-C2": {
        "Frame Start": 2700, 
        "Frame End": 4400,
        "Description": "Performers put shiny glasses and reflective birthday hats on"
    },
    "C1-C2": {
        "Frame Start": 4400, 
        "Frame End": 5300,
        "Description": "Performers sing happy birthday with new headwear and candles and reflective cake tray"
    },
    "C1-C2": {
        "Frame Start": 5300, 
        "Frame End": End,
        "Description": "Scene Change"
    }
}


[18-12-24] Session 2: {   
    "D1-D2": {
        "Frame Start": 0, 
        "Frame End": 1080,
        "Description": "Performer goes through meditative motions (slow)"
    },
    "D1-D2": {
        "Frame Start": 1080, 
        "Frame End": 1200,
        "Description": "Scene Change"
    },
    "D1-D2": {
        "Frame Start": 1200, 
        "Frame End": 1900,
        "Description": "Performer goes through meditative motions (fast)"
    },
    "D1-D2": {
        "Frame Start": 1900, 
        "Frame End": End,
        "Description": "Performer stand and waits for end of scene"
    },

    "D2": {
        "Frame Start": 0, 
        "Frame End": 550,
        "Description": "Performer dances to Hip-Hop"
    },
    "D2": {
        "Frame Start": 550, 
        "Frame End": End,
        "Description": "Scene Change"
    },

    "D3-D4": {
        "Frame Start": 0, 
        "Frame End": 550,
        "Description": "Performer waits for set-up"
    },
    "D3-D4": {
        "Frame Start": 550, 
        "Frame End": 1900,
        "Description": "Performer begins to breakdance (fast)"
    },
    "D3-D4": {
        "Frame Start": 1900, 
        "Frame End": 3000,
        "Description": "Performer breakdances faster (very fast)"
    },
    "D3-D4": {
        "Frame Start": 3000, 
        "Frame End": End,
        "Description": "Scene Change"
    },

    "E1-E2": {
        "Frame Start": 0, 
        "Frame End": 2300,
        "Description": "Performer plays bass guitar and progressively gets faster in motion"
    },
    "E1-E2": {
        "Frame Start": 2300, 
        "Frame End": End,
        "Description": "Scene Change"
    },

    "E3-E4": {
        "Frame Start": 0, 
        "Frame End": 1100,
        "Description": "Performer plays cymbals while moving around stage"
    },
    "E3-E4": {
        "Frame Start": 1100, 
        "Frame End": 1450,
        "Description": "Scene Change"
    },
    "E3-E4": {
        "Frame Start": 1450, 
        "Frame End": End,
        "Description": "Performer plays triangle"
    },

    "E5-E6": {
        "Frame Start": 0, 
        "Frame End": 1100,
        "Description": "Performers play the guitar and cymbals together"
    },
    "E5-E6": {
        "Frame Start": 1100, 
        "Frame End": 1700,
        "Description": "Scene Change"
    },
    "E5-E6": {
        "Frame Start": 1700, 
        "Frame End": 3300,
        "Description": "Performers play the guitar and triangle together"
    },
    "E5-E6": {
        "Frame Start": 3300, 
        "Frame End": End,
        "Description": "Scene Change"
    }
}


[11-02-25] Session 3: {   
    
    "A1-A4": {
        "Frame Start": 0, 
        "Frame End": 500,
        "Description": "Performers waits for set-up"
    },
    "A1-A4": {
        "Frame Start": 500, 
        "Frame End": 2500,
        "Description": "Performers plays guitar (slow)"
    },
    "A1-A4": {
        "Frame Start": 2500, 
        "Frame End": 3600,
        "Description": "Performers plays guitar (fast)"
    },
    "A1-A4": {
        "Frame Start": 3600, 
        "Frame End": 5100,
        "Description": "Scene Change"
    },
    "A1-A4": {
        "Frame Start": 5100, 
        "Frame End": 6750,
        "Description": "Performer plays flute"
    },
    "A1-A4": {
        "Frame Start": 6750, 
        "Frame End": 8400,
        "Description": "Scene Change"
    },
    "A1-A4": {
        "Frame Start": 8400, 
        "Frame End": 9300,
        "Description": "Performers play guitar and flute together (slow)"
    },
    "A1-A4": {
        "Frame Start": 9300, 
        "Frame End": End,
        "Description": "Performers play guitar and flute together (faster + jumping)"
    },

    "B1-B2": {
        "Frame Start": 0, 
        "Frame End": 500,
        "Description": "Performer in Goblin cosplay does posing"
    },
    "B1-B2": {
        "Frame Start": 500, 
        "Frame End": 1000,
        "Description": "Performer throws halloween balls around"
    },
    "B1-B2": {
        "Frame Start": 1000, 
        "Frame End": 2200,
        "Description": "Scene Change"
    },
    "B1-B2": {
        "Frame Start": 2200, 
        "Frame End": 3400,
        "Description": "Performer in blow-up unicorn costumer waits for costumer to blow-up"
    },
    "B1-B2": {
        "Frame Start": 3400, 
        "Frame End": 4700,
        "Description": "Performer stars bouncing and then dancing"
    },
    "B1-B2": {
        "Frame Start": 4700, 
        "Frame End": End,
        "Description": "Scene Change"
    },

    "B3-B5": {
        "Frame Start": 0, 
        "Frame End": 1450,
        "Description": "Performer in clown costume holds reflective baloons"
    },
    "B3-B5": {
        "Frame Start": 1450, 
        "Frame End": 3300,
        "Description": "A fan is switched on an performer tries to get the balloons to blow (slow)"
    },
    "B3-B5": {
        "Frame Start": 3300, 
        "Frame End": 3600,
        "Description": "Scene Change"
    },
    "B3-B5": {
        "Frame Start": 3300, 
        "Frame End": 5050,
        "Description": "Performer in begins popping the baloows witha knife and crushing them"
    },

    "C1-C2": {
        "Frame Start": 0, 
        "Frame End": 1500,
        "Description": "Performer bounce basket ball around stage"
    },
    "C1-C2": {
        "Frame Start": 1500, 
        "Frame End": End,
        "Description": "Scene Change"
    },

    "C2-Part2": {
        "Frame Start": 0, 
        "Frame End": 1900,
        "Description": "Performer stretches with green and purple rubber gym bands"
    },
    "C2-Part2": {
        "Frame Start": 1900, 
        "Frame End": 2400,
        "Description": "Performer squats with dumbell weights"
    },
    "C2-Part2": {
        "Frame Start": 2400, 
        "Frame End": 2900,
        "Description": "Performer does bent-over rows with dumbells"
    },
    "C2-Part2": {
        "Frame Start": 2900, 
        "Frame End": 3700,
        "Description": "Performer does bicep curls with dumbells"
    },
    "C2-Part2": {
        "Frame Start": 3700, 
        "Frame End": End,
        "Description": "Scene Change"
    },

    "D1-D2": {
        "Frame Start": 0, 
        "Frame End": 550,
        "Description": "Performers wait for set-up"
    },
    "D1-D2": {
        "Frame Start": 550, 
        "Frame End": 925,
        "Description": "Performer pretend to walk Dog"
    },
    "D1-D2": {
        "Frame Start": 925, 
        "Frame End": 2100,
        "Description": "Performer cuddles and plays with Dog"
    }
}