Slit Tears: Visualizing Video over Time
Demos.SlitTears History
Hide minor edits - Show changes to output
Added lines 28-29:
* [[Attach:SlitTears-v2.zip | SlitTears, Version 2.0]]: This version creates static timelines, and adds a few features for skipping through frames in a video.
Changed lines 35-36 from:
to:
# If you are not sure what to do, look at the [[Attach:SlitTearsInstructionalVideo.wmv | Slit Tears Instructional Video]]
Changed lines 38-40 from:
* There is a bug where it sometimes loses a bit of one's sketching action atop the video.
to:
* There are several bugs, but they shouldn't get in the way of understanding the concept
- it sometimes loses a bit of one's sketching action atop the video
- reading in of video files is somewhat limited to certain types
- it sometimes loses a bit of one's sketching action atop the video
- reading in of video files is somewhat limited to certain types
Changed lines 58-59 from:
* (Under Construction)
to:
* See the [[Attach:SlitTearsInstructionalVideo.wmv | Slit Tears Instructional Video]] to see how to use the system
Changed lines 32-33 from:
#To be added
to:
# Unzip the file
# Navigate to SlitTears-Version1 -> SlitTears -> bin -> Release
# Run SlitTears.exe
# Navigate to SlitTears-Version1 -> SlitTears -> bin -> Release
# Run SlitTears.exe
Changed line 37 from:
* To be added
to:
* There is a bug where it sometimes loses a bit of one's sketching action atop the video.
Changed lines 28-29 from:
* [[Attach:XXX.zip | TimeLine ]]: This C# version uses a package we wrote called EasyImages to get and manipulate video frames, as well as a 3rd party software written by Corinna John (Hannnover, Germany) to read frames from an AVI file. See [[#SlitTearInstallationInstructions | Installation Instructions]].
to:
* [[Attach:SlitTears-v1.zip | SlitTears, Version 1.0]]: This C# version uses a package we wrote called EasyImages to get and manipulate video frames, as well as a 3rd party software written by Corinna John (Hannnover, Germany) to read frames from an AVI file. Both are included as dlls. See [[#SlitTearInstallationInstructions | Installation Instructions]].
Changed lines 28-29 from:
* [[Attach:XXX.zip | TimeLine ]]: This C# version uses a package we wrote called EasyImages to get and manipulate video frames. See [[#SlitTearInstallationInstructions | Installation Instructions]].
to:
* [[Attach:XXX.zip | TimeLine ]]: This C# version uses a package we wrote called EasyImages to get and manipulate video frames, as well as a 3rd party software written by Corinna John (Hannnover, Germany) to read frames from an AVI file. See [[#SlitTearInstallationInstructions | Installation Instructions]].
Added lines 46-49:
* [[http://grouplab.cpsc.ucalgary.ca/cookbook/index.php/Demos/TimeLine |Timeline ]] is a simpler type of slit-tear, that captures the region only under a single vertical line.
* [[http://grouplab.cpsc.ucalgary.ca/cookbook/index.php/Toolkits/VideoSlitScanning | Tutorial on Slit Scanning]] shows how to create a simple vertical slit-tear using EasyImages and C#.
* [[http://grouplab.cpsc.ucalgary.ca/cookbook/index.php/Toolkits/VideoSlitScanning | Tutorial on Slit Scanning]] shows how to create a simple vertical slit-tear using EasyImages and C#.
Changed lines 42-47 from:
* Tang, A., Greenberg, S. and Fels, S. (2008)
* Tang, A., Greenberg, S. and Fels, S. (2008)
[[http://grouplab.cpsc.ucalgary.ca/Publications/2008-SlitTearVideo.Report2008-897-10 | Exploring Video Streams Using Slit-Tear Visualizations: The Video.]] Research report 2008-897-10, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada. Duration 6:20.
* Tang, A., Greenberg, S. and Fels, S. (2008)
[[http://grouplab.cpsc.ucalgary.ca/Publications/2008-SlitTearVideo.Report2008-897-10 | Exploring Video Streams Using Slit-Tear Visualizations: The Video.]] Research report 2008-897-10, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada. Duration 6:20.
to:
* Tang, A., Greenberg, S. and Fels, S. (2008) [[http://grouplab.cpsc.ucalgary.ca/Publications/2008-SlitTear.AVI | Exploring Video Streams Using Slit-Tear Visualizations.]] In Proceedings of Advanced Visual Interfaces (AVI'08). (Napoli, Italy), pages 191-198, May 28-30.
* Tang, A., Greenberg, S. and Fels, S. (2008) [[http://grouplab.cpsc.ucalgary.ca/Publications/2008-SlitTearVideo.Report2008-897-10 | Exploring Video Streams Using Slit-Tear Visualizations: The Video.]] Research report 2008-897-10, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada. Duration 6:20.
* Tang, A., Greenberg, S. and Fels, S. (2008) [[http://grouplab.cpsc.ucalgary.ca/Publications/2008-SlitTearVideo.Report2008-897-10 | Exploring Video Streams Using Slit-Tear Visualizations: The Video.]] Research report 2008-897-10, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada. Duration 6:20.
Changed lines 12-14 from:
Update, 18/10/2006: TimeLine package updated. Installer for the mpeg4 V2 codec included.
to:
Video slicing — a variant of slit scanning in photography — extracts a scan line from a video frame and successively adds that line to a composite image over time. The composite image becomes a time line, where its visual patterns reflect changes in a particular area of the video stream. We extend this idea of video slicing by allowing users to draw marks anywhere on the source video to capture areas of interest. These marks, which we call slit-tears, are used in place of a scan line, and the resulting composite timeline image provides a much richer visualization of the video data. Depending on how tears are placed, they can accentuate motion, small changes, directional movement, and relational patterns. The software below implements one version of slit-tears
Changed lines 28-37 from:
* [[Attach:Timeline-22.03.2007.zip | TimeLine ]]: TimeLine uses slit scanning to render visualizations of the last minute/hour/day/week of video history. See [[#TimeLineInstallationInstructions | Installation Instructions]], and read the README in the download.
Other visualizations
The ones below are toy examples that we developed in parallel with TimeLine, where each uses a different strategy for showing a video history. Source is included.
*[[Attach:cubism.zip | Video Slit Scanning]]: Basic Video Slit Scanning example (we also call this 'cubism')
* [[Attach:motionblur.zip | Motion Blur]]: Creates a motion blurred composite image by adding 5 images sampled over an adjustable period of time.
* [[Attach:storyboard.zip | Story Board]]: Samples frames over a regular interval to create a storyboard. Change detection (sampling the frame with maximal difference within the sampling interval) is available.
* [[Attach:changedetect.zip | Change Detect]]: Uses change detection to trigger sampling. This is done by either choosing the frame with maximal difference within the sampling interval, or using a set threshold to trigger new image capture.
[[#TimeLineInstallationInstructions]]
The ones below are toy examples that we developed in parallel with TimeLine, where each uses a different strategy for showing a video history. Source is included.
*
* [[Attach:motionblur.zip | Motion Blur]]: Creates a motion blurred composite image by adding 5 images sampled over an adjustable period of time.
* [[Attach:storyboard.zip | Story Board]]: Samples frames over a regular interval to create a storyboard. Change detection (sampling the frame with maximal difference within the sampling interval) is available.
* [[Attach:changedetect.zip | Change Detect]]: Uses change detection to trigger sampling. This is done by either choosing the frame with maximal difference within the sampling interval, or using a set threshold to trigger new image capture.
[[#TimeLineInstallationInstructions
to:
* [[Attach:XXX.zip | TimeLine ]]: This C# version uses a package we wrote called EasyImages to get and manipulate video frames. See [[#SlitTearInstallationInstructions | Installation Instructions]].
[[#SlitTearInstallationInstructions]]
[[#SlitTearInstallationInstructions]]
Changed lines 32-44 from:
# Read the README file in the download. There are several things that you may have to do if your machine does not have some standard software. For example, we include a video codec if the appropriate one isn't installed on your machine - you can install it with a single click.
# Install GroupLab Collabrary: The Collabrary can be found in \Installs\collabrary.msi or can be downloaded from http://grouplab.cpsc.ucalgary.ca/collabrary.
# Copy Build Directory (optional): The build directory contains the precompiled executables for the Timeline. The contents of the build directory can be copied to wherever you want the program installed. The build directory has two subdirectories, archive and img; archive is where video files are stored and loaded, and img contains some images used by the program.
# Run CameraFeed (Optional): One can setup or join a camera feed server using the CameraFeed application /build/CameraFeed.exe. Timeline has the ability to connect to a server and run using one of the feeds contained therein. To The CameraFeed application will take the webcam feed from the locally connected machine and put it into a shared dictionary server. Simply run the CameraFeed application, enter a username, and the name of the shared dictionary server to connect to. (A server can be started simply by using the local ip and a shared dictionary name, for example "tcp://(localip):webcam".)
# Run Timeline: The Timeline program can be run using \Build\Timeline.exe. When the program starts up it gives three run options: running from the local archive, running live from the local webcam, and running live from a webcam feed. Select the desired option. If that option is to run using a webcam feed, you will also need to enter the address of a camera feed server - use the same server adress/name as used when you set up the camera feed application. When the Timeline successfully connects to the camera feed server you will see a list of available camera feeds and can select the one you wish to use. Note that when running in a live mode any video in the archive directory prior to running will be erased.
# To Recompile: The program was built in Visual Studio 2005. Open TimeLine.sln in the source\Timeline\ directory. Check that the references for Tao, Collabrary, and AviFile are ok. If not, these references are contained in the directory \Source\Steven\libs and can be re-added. Compile. The img subdirectory is already included in the Debug and Release directories and is required to run the program. The archive subdirectory is not included, however it will be generated the first time the program is run in live mode.
!!! Bug List (Timeline):
* When doing archive retrieval from a line that has already been loaded from the archive the accuracy of the retrieval point gradually drifts. I suspect there's a frame counter that is being added to the look up which only should be added when retrieving from live video.
* Retrieving off the end of a line that isn't fully populated does work, but does not automatically refresh when done as the refresh is triggered when the line is filled. A refresh can be triggered manually by adjusting the slicing column.
* Retrieving near the beginning of a line (when the retrieval point is already being displayed by the next line up) appears to start the retrieval process (the braces are drawn and the lines go blank) and hangs because it doesn't load anything. Loading isn't really necessary as the point is already viewable, but the the UI shouldn't do anything either.
* If the program crashes, the archived video is corrupted and can't be reloaded.
# Install GroupLab Collabrary: The Collabrary can be found in \Installs\collabrary.msi or can be downloaded from http://grouplab.cpsc.ucalgary.ca/collabrary.
# Copy Build Directory (optional): The build directory contains the precompiled executables for the Timeline. The contents of the build directory can be copied to wherever you want the program installed. The build directory has two subdirectories, archive and img; archive is where video files are stored and loaded, and img contains some images used by the program.
# Run CameraFeed (Optional): One can setup or join a camera feed server using the CameraFeed application /build/CameraFeed.exe. Timeline has the ability to connect to a server and run using one of the feeds contained therein. To The CameraFeed application will take the webcam feed from the locally connected machine and put it into a shared dictionary server. Simply run the CameraFeed application, enter a username, and the name of the shared dictionary server to connect to. (A server can be started simply by using the local ip and a shared dictionary name, for example "tcp://(localip):webcam".)
# Run Timeline: The Timeline program can be run using \Build\Timeline.exe. When the program starts up it gives three run options: running from the local archive, running live from the local webcam, and running live from a webcam feed. Select the desired option. If that option is to run using a webcam feed, you will also need to enter the address of a camera feed server - use the same server adress/name as used when you set up the camera feed application. When the Timeline successfully connects to the camera feed server you will see a list of available camera feeds and can select the one you wish to use. Note that when running in a live mode any video in the archive directory prior to running will be erased.
# To Recompile: The program was built in Visual Studio 2005. Open TimeLine.sln in the source\Timeline\ directory. Check that the references for Tao, Collabrary, and AviFile are ok. If not, these references are contained in the directory \Source\Steven\libs and can be re-added. Compile. The img subdirectory is already included in the Debug and Release directories and is required to run the program. The archive subdirectory is not included, however it will be generated the first time the program is run in live mode.
!!! Bug List (Timeline):
* When doing archive retrieval from a line that has already been loaded from the archive the accuracy of the retrieval point gradually drifts. I suspect there's a frame counter that is being added to the look up which only should be added when retrieving from live video.
* Retrieving off the end of a line that isn't fully populated does work, but does not automatically refresh when done as the refresh is triggered when the line is filled. A refresh can be triggered manually by adjusting the slicing column.
* Retrieving near the beginning of a line (when the retrieval point is already being displayed by the next line up) appears to start the retrieval process (the braces are drawn and the lines go blank) and hangs because it doesn't load anything. Loading isn't really necessary as the point is already viewable, but the the UI shouldn't do anything either.
* If the program crashes, the archived video is corrupted and can't be reloaded.
to:
#To be added
!!! Bug List
* To be added
!!! Bug List
* To be added
Changed lines 42-47 from:
* Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. (2007) [[http://grouplab.cpsc.ucalgary.ca/papers/2007/07-VisualTraces-Nunes-report/07-VisualTraces-Nunes-report.pdf | What Did I Miss? Visualizing the Past through Video Traces.]] Report 2007-855-07, Dept. Computer Science, University of Calgary, Calgary, Alberta, Canada. March. 21 pages.
* Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. (2006) [[http://grouplab.cpsc.ucalgary.ca/papers/2006/06-TimelinesVideo-Nunes-CSCW/abstract.html | Timeline: Video Traces for Awareness.]] Video Proceedings of ACM CSCW'06 Conference on Computer Supported Cooperative Work, November, ACM Press. Duration 4:44 '-(This abstract page points to both the video and two-page summary).-'
* Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. (2006) [[http://grouplab.cpsc.ucalgary.ca/papers/2006/06-VisualTraces-Nunes-CHIWorkshop/visual-traces-report2006-909-02.pdf|Video traces]]. In Karahalios, K. and Viegas, F. (Eds) ACM CHI 2006 Workshop on Social Visualization: Exploring Text, Audio, and Video Interactions, April 22-27. '-Also published as Report 2006-809-02.-'
* Nunes, M., (2006) [[Attach:VideoTraces-CPSC781Report.pdf|Video traces]]. CPSC 781 Class Project report that describes precursors to TimeLine.
* [[http://www.flong.com/writings/lists/list_slit_scan.html|A fantastic catalog of slit-scan video artworks]] compiled by Golan Levin
* Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. (2006) [[http://grouplab.cpsc.ucalgary.ca/papers/2006/06-VisualTraces-Nunes-CHIWorkshop/visual-traces-report2006-909-02.pdf|Video traces]]. In Karahalios, K. and Viegas, F. (Eds) ACM CHI 2006 Workshop on Social Visualization: Exploring Text, Audio, and Video Interactions, April 22-27. '-Also published as Report 2006-809-02.-'
* Nunes, M., (2006) [[Attach:VideoTraces-CPSC781Report.pdf|Video traces]]. CPSC 781 Class Project report that describes precursors to TimeLine.
* [[http://www.flong.com/writings/lists/list_slit_scan.html|A fantastic catalog of slit-scan video artworks]] compiled by Golan Levin
to:
* Tang, A., Greenberg, S. and Fels, S. (2008)
[[http://grouplab.cpsc.ucalgary.ca/Publications/2008-SlitTear.AVI | Exploring Video Streams Using Slit-Tear Visualizations.]] In Proceedings of Advanced Visual Interfaces (AVI'08). (Napoli, Italy), pages 191-198, May 28-30.
* Tang, A., Greenberg, S. and Fels, S. (2008)
[[http://grouplab.cpsc.ucalgary.ca/Publications/2008-SlitTearVideo.Report2008-897-10 | Exploring Video Streams Using Slit-Tear Visualizations: The Video.]] Research report 2008-897-10, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada. Duration 6:20.
[[http://grouplab.cpsc.ucalgary.ca/Publications/2008-SlitTear.AVI | Exploring Video Streams Using Slit-Tear Visualizations.]] In Proceedings of Advanced Visual Interfaces (AVI'08). (Napoli, Italy), pages 191-198, May 28-30.
* Tang, A., Greenberg, S. and Fels, S. (2008)
[[http://grouplab.cpsc.ucalgary.ca/Publications/2008-SlitTearVideo.Report2008-897-10 | Exploring Video Streams Using Slit-Tear Visualizations: The Video.]] Research report 2008-897-10, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada. Duration 6:20.
Added lines 1-72:
(:title Slit Tears: Visualizing Video over Time :)
%define=box padding-left=1em padding-right=1em margin='3px 3px 0'%
%define=yellowbox box bgcolor=#fdfaea border='1px solid #ffad80'%
%define=redbox box bgcolor=#fff3f3 border='1px solid #ffc9c9'%
%define=bluebox box bgcolor=#f4fbff border='1px solid #a1cae6'%
%define=skybox box bgcolor=#f8fcff border='1px solid #aaaaaa'%
%define=greybox box bgcolor=#fbfbfb border='1px solid #aaaaaa'%
%define=greenbox box bgcolor=#e6f3e5 border='1px solid #8fd586'%
%define=whitebox box bgcolor=#ffffff border='1px solid #999999'%
\\
%rfloat% Attach:slit-tears.png
TimeLine is a visualization that captures a video stream, and then allows people to explore the history of that video stream. TimeLine was originally conceived to work as part of a media space, where people would use it to reveal their collaborator's events and activities over time, ostensibly to gauge their availability. It may also be useful for surveillance, for monitoring, and as an interactive art installation. Our concern is that TimeLine is so effective that it raises serious privacy concerns. Thus it is best seen as an extreme of what is possible, and we make it available to encourage debate about these kinds of video trace systems. As well, we offer a few other (less developed) examples of different video tracevisualizations.
Update, 18/10/2006: TimeLine package updated. Installer for the mpeg4 V2 codec included.
!!! Contents
* [[#download | Download and Installation]]
* [[#recipes | Recipes, How-To's]]
* [[#tutorials | Tutorials and Examples]]
* [[#links | Links]]
\\
\\
[[#download]]
>>greenbox<<
!!! Download and Installation
* [[Attach:Timeline-22.03.2007.zip | TimeLine ]]: TimeLine uses slit scanning to render visualizations of the last minute/hour/day/week of video history. See [[#TimeLineInstallationInstructions | Installation Instructions]], and read the README in the download.
Other visualizations
The ones below are toy examples that we developed in parallel with TimeLine, where each uses a different strategy for showing a video history. Source is included.
* [[Attach:cubism.zip | Video Slit Scanning]]: Basic Video Slit Scanning example (we also call this 'cubism')
* [[Attach:motionblur.zip | Motion Blur]]: Creates a motion blurred composite image by adding 5 images sampled over an adjustable period of time.
* [[Attach:storyboard.zip | Story Board]]: Samples frames over a regular interval to create a storyboard. Change detection (sampling the frame with maximal difference within the sampling interval) is available.
* [[Attach:changedetect.zip | Change Detect]]: Uses change detection to trigger sampling. This is done by either choosing the frame with maximal difference within the sampling interval, or using a set threshold to trigger new image capture.
[[#TimeLineInstallationInstructions]]
!!! TimeLine Installation Instructions:
# Read the README file in the download. There are several things that you may have to do if your machine does not have some standard software. For example, we include a video codec if the appropriate one isn't installed on your machine - you can install it with a single click.
# Install GroupLab Collabrary: The Collabrary can be found in \Installs\collabrary.msi or can be downloaded from http://grouplab.cpsc.ucalgary.ca/collabrary.
# Copy Build Directory (optional): The build directory contains the precompiled executables for the Timeline. The contents of the build directory can be copied to wherever you want the program installed. The build directory has two subdirectories, archive and img; archive is where video files are stored and loaded, and img contains some images used by the program.
# Run CameraFeed (Optional): One can setup or join a camera feed server using the CameraFeed application /build/CameraFeed.exe. Timeline has the ability to connect to a server and run using one of the feeds contained therein. To The CameraFeed application will take the webcam feed from the locally connected machine and put it into a shared dictionary server. Simply run the CameraFeed application, enter a username, and the name of the shared dictionary server to connect to. (A server can be started simply by using the local ip and a shared dictionary name, for example "tcp://(localip):webcam".)
# Run Timeline: The Timeline program can be run using \Build\Timeline.exe. When the program starts up it gives three run options: running from the local archive, running live from the local webcam, and running live from a webcam feed. Select the desired option. If that option is to run using a webcam feed, you will also need to enter the address of a camera feed server - use the same server adress/name as used when you set up the camera feed application. When the Timeline successfully connects to the camera feed server you will see a list of available camera feeds and can select the one you wish to use. Note that when running in a live mode any video in the archive directory prior to running will be erased.
# To Recompile: The program was built in Visual Studio 2005. Open TimeLine.sln in the source\Timeline\ directory. Check that the references for Tao, Collabrary, and AviFile are ok. If not, these references are contained in the directory \Source\Steven\libs and can be re-added. Compile. The img subdirectory is already included in the Debug and Release directories and is required to run the program. The archive subdirectory is not included, however it will be generated the first time the program is run in live mode.
!!! Bug List (Timeline):
* When doing archive retrieval from a line that has already been loaded from the archive the accuracy of the retrieval point gradually drifts. I suspect there's a frame counter that is being added to the look up which only should be added when retrieving from live video.
* Retrieving off the end of a line that isn't fully populated does work, but does not automatically refresh when done as the refresh is triggered when the line is filled. A refresh can be triggered manually by adjusting the slicing column.
* Retrieving near the beginning of a line (when the retrieval point is already being displayed by the next line up) appears to start the retrieval process (the braces are drawn and the lines go blank) and hangs because it doesn't load anything. Loading isn't really necessary as the point is already viewable, but the the UI shouldn't do anything either.
* If the program crashes, the archived video is corrupted and can't be reloaded.
>><<
[[#links]]
>>greybox<<
!!! Links
* Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. (2007) [[http://grouplab.cpsc.ucalgary.ca/papers/2007/07-VisualTraces-Nunes-report/07-VisualTraces-Nunes-report.pdf | What Did I Miss? Visualizing the Past through Video Traces.]] Report 2007-855-07, Dept. Computer Science, University of Calgary, Calgary, Alberta, Canada. March. 21 pages.
* Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. (2006) [[http://grouplab.cpsc.ucalgary.ca/papers/2006/06-TimelinesVideo-Nunes-CSCW/abstract.html | Timeline: Video Traces for Awareness.]] Video Proceedings of ACM CSCW'06 Conference on Computer Supported Cooperative Work, November, ACM Press. Duration 4:44 '-(This abstract page points to both the video and two-page summary).-'
* Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. (2006) [[http://grouplab.cpsc.ucalgary.ca/papers/2006/06-VisualTraces-Nunes-CHIWorkshop/visual-traces-report2006-909-02.pdf|Video traces]]. In Karahalios, K. and Viegas, F. (Eds) ACM CHI 2006 Workshop on Social Visualization: Exploring Text, Audio, and Video Interactions, April 22-27. '-Also published as Report 2006-809-02.-'
* Nunes, M., (2006) [[Attach:VideoTraces-CPSC781Report.pdf|Video traces]]. CPSC 781 Class Project report that describes precursors to TimeLine.
* [[http://www.flong.com/writings/lists/list_slit_scan.html|A fantastic catalog of slit-scan video artworks]] compiled by Golan Levin
>><<
[[#tutorials]]
>>bluebox<<
!!! Tutorials and Examples
* (Under Construction)
%define=box padding-left=1em padding-right=1em margin='3px 3px 0'%
%define=yellowbox box bgcolor=#fdfaea border='1px solid #ffad80'%
%define=redbox box bgcolor=#fff3f3 border='1px solid #ffc9c9'%
%define=bluebox box bgcolor=#f4fbff border='1px solid #a1cae6'%
%define=skybox box bgcolor=#f8fcff border='1px solid #aaaaaa'%
%define=greybox box bgcolor=#fbfbfb border='1px solid #aaaaaa'%
%define=greenbox box bgcolor=#e6f3e5 border='1px solid #8fd586'%
%define=whitebox box bgcolor=#ffffff border='1px solid #999999'%
\\
%rfloat% Attach:slit-tears.png
TimeLine is a visualization that captures a video stream, and then allows people to explore the history of that video stream. TimeLine was originally conceived to work as part of a media space, where people would use it to reveal their collaborator's events and activities over time, ostensibly to gauge their availability. It may also be useful for surveillance, for monitoring, and as an interactive art installation. Our concern is that TimeLine is so effective that it raises serious privacy concerns. Thus it is best seen as an extreme of what is possible, and we make it available to encourage debate about these kinds of video trace systems. As well, we offer a few other (less developed) examples of different video tracevisualizations.
Update, 18/10/2006: TimeLine package updated. Installer for the mpeg4 V2 codec included.
!!! Contents
* [[#download | Download and Installation]]
* [[#recipes | Recipes, How-To's]]
* [[#tutorials | Tutorials and Examples]]
* [[#links | Links]]
\\
\\
[[#download]]
>>greenbox<<
!!! Download and Installation
* [[Attach:Timeline-22.03.2007.zip | TimeLine ]]: TimeLine uses slit scanning to render visualizations of the last minute/hour/day/week of video history. See [[#TimeLineInstallationInstructions | Installation Instructions]], and read the README in the download.
Other visualizations
The ones below are toy examples that we developed in parallel with TimeLine, where each uses a different strategy for showing a video history. Source is included.
* [[Attach:cubism.zip | Video Slit Scanning]]: Basic Video Slit Scanning example (we also call this 'cubism')
* [[Attach:motionblur.zip | Motion Blur]]: Creates a motion blurred composite image by adding 5 images sampled over an adjustable period of time.
* [[Attach:storyboard.zip | Story Board]]: Samples frames over a regular interval to create a storyboard. Change detection (sampling the frame with maximal difference within the sampling interval) is available.
* [[Attach:changedetect.zip | Change Detect]]: Uses change detection to trigger sampling. This is done by either choosing the frame with maximal difference within the sampling interval, or using a set threshold to trigger new image capture.
[[#TimeLineInstallationInstructions]]
!!! TimeLine Installation Instructions:
# Read the README file in the download. There are several things that you may have to do if your machine does not have some standard software. For example, we include a video codec if the appropriate one isn't installed on your machine - you can install it with a single click.
# Install GroupLab Collabrary: The Collabrary can be found in \Installs\collabrary.msi or can be downloaded from http://grouplab.cpsc.ucalgary.ca/collabrary.
# Copy Build Directory (optional): The build directory contains the precompiled executables for the Timeline. The contents of the build directory can be copied to wherever you want the program installed. The build directory has two subdirectories, archive and img; archive is where video files are stored and loaded, and img contains some images used by the program.
# Run CameraFeed (Optional): One can setup or join a camera feed server using the CameraFeed application /build/CameraFeed.exe. Timeline has the ability to connect to a server and run using one of the feeds contained therein. To The CameraFeed application will take the webcam feed from the locally connected machine and put it into a shared dictionary server. Simply run the CameraFeed application, enter a username, and the name of the shared dictionary server to connect to. (A server can be started simply by using the local ip and a shared dictionary name, for example "tcp://(localip):webcam".)
# Run Timeline: The Timeline program can be run using \Build\Timeline.exe. When the program starts up it gives three run options: running from the local archive, running live from the local webcam, and running live from a webcam feed. Select the desired option. If that option is to run using a webcam feed, you will also need to enter the address of a camera feed server - use the same server adress/name as used when you set up the camera feed application. When the Timeline successfully connects to the camera feed server you will see a list of available camera feeds and can select the one you wish to use. Note that when running in a live mode any video in the archive directory prior to running will be erased.
# To Recompile: The program was built in Visual Studio 2005. Open TimeLine.sln in the source\Timeline\ directory. Check that the references for Tao, Collabrary, and AviFile are ok. If not, these references are contained in the directory \Source\Steven\libs and can be re-added. Compile. The img subdirectory is already included in the Debug and Release directories and is required to run the program. The archive subdirectory is not included, however it will be generated the first time the program is run in live mode.
!!! Bug List (Timeline):
* When doing archive retrieval from a line that has already been loaded from the archive the accuracy of the retrieval point gradually drifts. I suspect there's a frame counter that is being added to the look up which only should be added when retrieving from live video.
* Retrieving off the end of a line that isn't fully populated does work, but does not automatically refresh when done as the refresh is triggered when the line is filled. A refresh can be triggered manually by adjusting the slicing column.
* Retrieving near the beginning of a line (when the retrieval point is already being displayed by the next line up) appears to start the retrieval process (the braces are drawn and the lines go blank) and hangs because it doesn't load anything. Loading isn't really necessary as the point is already viewable, but the the UI shouldn't do anything either.
* If the program crashes, the archived video is corrupted and can't be reloaded.
>><<
[[#links]]
>>greybox<<
!!! Links
* Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. (2007) [[http://grouplab.cpsc.ucalgary.ca/papers/2007/07-VisualTraces-Nunes-report/07-VisualTraces-Nunes-report.pdf | What Did I Miss? Visualizing the Past through Video Traces.]] Report 2007-855-07, Dept. Computer Science, University of Calgary, Calgary, Alberta, Canada. March. 21 pages.
* Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. (2006) [[http://grouplab.cpsc.ucalgary.ca/papers/2006/06-TimelinesVideo-Nunes-CSCW/abstract.html | Timeline: Video Traces for Awareness.]] Video Proceedings of ACM CSCW'06 Conference on Computer Supported Cooperative Work, November, ACM Press. Duration 4:44 '-(This abstract page points to both the video and two-page summary).-'
* Nunes, M., Greenberg, S., Carpendale, S. and Gutwin, C. (2006) [[http://grouplab.cpsc.ucalgary.ca/papers/2006/06-VisualTraces-Nunes-CHIWorkshop/visual-traces-report2006-909-02.pdf|Video traces]]. In Karahalios, K. and Viegas, F. (Eds) ACM CHI 2006 Workshop on Social Visualization: Exploring Text, Audio, and Video Interactions, April 22-27. '-Also published as Report 2006-809-02.-'
* Nunes, M., (2006) [[Attach:VideoTraces-CPSC781Report.pdf|Video traces]]. CPSC 781 Class Project report that describes precursors to TimeLine.
* [[http://www.flong.com/writings/lists/list_slit_scan.html|A fantastic catalog of slit-scan video artworks]] compiled by Golan Levin
>><<
[[#tutorials]]
>>bluebox<<
!!! Tutorials and Examples
* (Under Construction)