Sequences in time that are not controlled by a clock

[ahankinson]

Description

A slide deck (for example) contains a sequence of images that proceed one after another, but the point at which they proceed can be controlled by a user advancing the slide. (i.e., proceeding to the next slide happens independent of time). This might be paired with a video painted on a canvas that does have a specific time.

The underlying assumption of the 'canvas clock' is that media painted onto a time-based canvas is that it will proceed according to 'wall time', but a sequence of images that proceed one after another is "time-based," but that time is indeterminate.

Variation(s)

A set of images that are always 'paused', but when proceeding to another image it triggers a video or audio to start playing.

A museum has a postcard kiosk where they display their collection of local postcards. When a user navigates to another postcard, the kiosk will start playing back an audio loop recorded from the viewpoint of the postcard.

Proposed Solutions

(any ideas about how your use case might be supported)

Additional Background

(more about your perspective, existing work, etc. goes here.)

[azaroth42]

Seems like this can already be accomplished with the Presentation API 2.x. Advancing a slide is just clicking next, or equivalent interaction.

[tomcrane]

Most of this is manual control of navigation from canvas to canvas, apart from "...This might be paired with a video painted on a canvas that does have a specific time." That is, the user is in control of some of the flow but not all of it.

Another example that I think captures the use case - a film is playing, but I also have access to an number of production stills associated with this particular scene, that I can advance through at my preferred pace.

We have the viewingHint together for looking at an album sleeve while listening to the music (two manifests in a collection), but the scenario above is not the same as this.

[azaroth42]

What about the viewingHint none?

If this hint is provided, then the client should not render the resource by default, but allow the user to turn it on and off.

[tomcrane]

Example - the green video appears from 1:04 to 1:37 in the canvas clock, but does not play with the clock time, unlike the red and blue videos which exhibit the behaviour assumed in examples so far.

https://demo.frametrail.org/player/?project=1&hypervideo=2

viewingHint none on the annotation(?) would hide the video rather than cede control of its playtime to the user at the media level rather than the canvas level.

This may not be a real use case at all, as discussed in the AV call 27 June.