Final exam S2010Final.docx will be in "lab" exam Monday 7:15 pm 5/10 in
EN233 or EN138.
You have internet access, open book, open note, no chat. The link will be turned on 7:15pm. Email me your answer and make sure I acknowledge the reception.
We will cover the following topics in the final.
Multimedia Synchronization
In terms of specification categories, how you classify Smil?
What is the Lipsync problem? How different cases of video/audio insynch can be tolerated based on IBM studies?
Smil
Similar to Hw3. Are there an equivalent of SMIL support for before(dt), beforeendof(dt), cobegin(dt), coend(dt1), while(dt1, dt2), delayed(dt1, dt20) endIn(dt1, dt2) Figure 24 of Multiimedia Synchization paper?
If not, what would you generate an equivalent effect in a SMIL presentation?
Laban and Human Motion Specification
Given the following staff convention for specifying the movement, direction and level symbols, and the body signs
Figure 1. Figure 2.
Here Figure1 and Figure 2 will be replaced with labanotations.
Problems:
Given a figure, explain in plain English the dance that is specified.
What it takes for Labanotation to be developed and used similar to MIDI and save network bandwidth?
How much compression ratio we can achieve by using labanotation instead of sensor tracking data (time-3D data sequence)?
There are five problems. You have 2 hours.
Your grade will be based on the best three answers. You are encouraged
to answer all five problems. Some problems are more tedious than others.
Use your time wisely. When the problems is not clear to you, make your
own assumptions and show all your work. Write
down your name and phone number to reach you.
Name:
Phone:
Problem 1. Copier Memory Design.
Assume a fixed data rate, 4 Mbps instead
of 1.5Mbps is generated by a 100 minute NTSC movie stored in the copier
memory. We plan to use a RAID Level 0 system with 8 ultra wide SCSI-2 disks.
Each disk has 4 heads. Each head has 80 Mbps data transfer rate. The ultra
wide SCSI channel has 40 MBps transfer rate.
How many ultra wide SCSI channels are needed
in this RAID 0 system to avoid that the SCSI channels (buses) becomes the
bottleneck?
What is the reason of using RAID0 instead
of RAID3? Hint: the original movie is in a CD changer storage system.
How many bytes of the disk space are needed
to store the movie?
How many phases can each head produce?
Assume that the movie is striped over the
whole RAID0 system. How long is a phase?
What is the size of start-stop buffer, in
terms of bytes?
Can the start-stop buffer handle fast rewind?
Problem 2. VoD Storage Server. Answer the
following questions based on the paper presented by Dr. Du in JSAC.
What is the maximum number of concurrent HDTV
video streams that they achieved using the block size of 128, frame size
of 16KB, single RAID3 in their VoD prototype?
Why the application level striping system
performs better than the logical volume striping system?
For a video retrieval process, what memory
management features are needed to guarantee its performance to meet the
real-time requirement?
What are the possible limiting factors in
a VoD storage system?
Problem 3. Media Synchronization based on
the survey paper by Blakowski and STeinmetz. In your homework #3
"Multimedia authoring project using Authorware", you are asked to provide
an animation of a car driving to EAS parking lot. At the beginning of the
animation you would like to play some light music. As the car approaching
the first traffic light, you would like to stop the music and then play
the voice direction "turn left on the traffic light" just before the car
reaches the traffic light. Assume that the car animation are divided into
several portions. The first portion terminates when the car reaches the
traffic light. Assume here we would like achieve a tight synchronization
between the end of this voice direction and the end of the car animation.
We would like the voice direction to stop 1 second before the end of animation.
Let animate1 represent the first portion of the car animation. Let voice1
be the voice direction. and Let music1 be the light music.
Specify the synchronization of those three
media objects using the interval-based method. Follow the slide show
example in page 20 of the paper. Try to use the operations in Figure
24.
Specify the above synchronization requirement
using virtual time axes specification method.
Specify the above synchronization requirement
using the time Petri net.
Problem 4. Rate Matching.
Given the audio/video teleconference example
I gave. The audio is recording at 8000 samples per second and 1 byte
per sample. It is being transferred at 500 samples per packet. The
video is recording at 24 frames per seconds. At the receiving site, we
use the logical time system to synchronize the audio and video playback.
Let us assume that the video is playing back slowly at 1.1 times of the
original recording speed, and assume the video interrupts are happening
at a fix constant interval. With audio served as a master device,
When will the first rate matching event occur?
How often it occurs?
Is the video frame being skipped or paused?
Problem 5. Synchronized Multimedia Integration
Language (SMIL).
The new proposed SMIL standard is
based on the basic hierarchical specification method and provides the following
tags and attributes for specifying the synchronization among multimedia
objects:
Provide the "parallel" tag <par></par>
where all the media objects specified within the tag will be played concurrently.
Provide the "sequential" tag <seq></seq>
where all media objects specified within the tag will be played in sequential.
For example,
<seq>
<audio src="music.wav">
<video src="animate.mov">
</seq>
specifies that the animation video media
object is played right after audio media object is played.
Provide the "id" attribute in a media
object tag for identifying the object and for the cross reference in synchronization.
For example, in
<audio id="a" src="voice1.wav"> "a"
will be used in other SMIL tags to reference this audio object.
Provide the "begin" attribute in a media object
tag for specifying the delay time that is either relative to the activity
specified in the parent tag, or relative to other media objects.
For example,
<par>
<audio id="a"
begin="6s" src="music1.wav" />
<video
begin="id(a)(4s)" src="video1.avi" />
</par>
specifies that the audio media object
starts 6 seconds after the whole parallel group activity is scheduled to
start. The video starts 4 seconds after the audio media object begins.
id(a) denotes the audio media object.
Using these SMIL tags and attributes to specify
the multimedia presentation that satisfies the synchronization requirement
of problem 3. Assume that we know the duration of animate1 (src="animate1.avi")
is 20 seconds. The duration of voice1 (src="voice1.wav") is 3 seconds.
The duration of music1 (src="music1.mid") is 22 seconds.
