CCS352 MULTIMEDIA AND ANIMATION

UNIT I INTRODUCTION TO MULTIMEDIA 6

Definitions, Elements, Multimedia Hardware and Software,
Distributed multimedia systems, challenges: security, sharing /
distribution, storage, retrieval, processing, computing. Multimedia
metadata, Multimedia databases, Hypermedia, Multimedia
Learning.

UNIT II MULTIMEDIA FILE FORMATS AND STANDARDS 6

File formats – Text, Image fileformats, Graphic and animation file
formats, Digital Audio and Video file formats, Color in image and
video, Color Models. Multimedia data and file formats for the web.

UNIT III MULTIMEDIA AUTHORING 6

Authoring metaphors, Tools Features and Types: Card and Page
Based Tools, Icon and Object Based Tools, Time Based Tools,
Cross Platform Authoring Tools, Editing Tools, Painting and
DrawingTools, 3D Modeling and Animation Tools, Image Editing
Tools, Audio Editing Tools, Digital Movie Tools, Creating
interactive presentations, Virtual learning, simulations.

UNIT IV ANIMATION 6
Principles of animation: staging, squash and stretch, timing, onion
skinning, secondary action, 2D, 2 ½ D, and 3D animation,
Animation techniques: Keyframe, Morphing, Inverse Kinematics,
Hand Drawn, Character rigging, vector animation, stop motion,
motion graphics, , Fluid Simulation, skeletal animation, skinning
Virtual Reality, Augmented Reality.

UNIT V MULTIMEDIA APPLICATIONS

Multimedia Big data computing, social networks, smart phones,
surveillance, Analytics, Multimedia Cloud Computing, Multimedia
streaming cloud, media on demand, security and forensics, Online
social networking, multimedia ontology, Content based retrieval
from digital libraries.
TOTAL: 30 PERIODS
UNIT I INTRODUCTION TO MULTIMEDIA
Definitions, Elements, Multimedia Hardware and Software, Distributed multimedia systems,
challenges: security, sharing / distribution, storage, retrieval, processing, computing. Multimedia
metadata, Multimedia databases, Hypermedia, Multimedia Learning.

1.1. DEFINITIONS
 The word multimedia is composed of two parts: the prefix Multi and the root Media.
“Multi” = “numerous” (latin word ”multus”)
“media” = “intermediary” (latin word “medium” singular “media” plural)
 Multimedia is something people can see, hear, touch and read on websites, radio,
television, video games, phone applications, retail stores, cinema halls and ATMs.
Multimedia can be defined as a combination of picture, text, sound, video and animation.
In simple terms, multimedia is the combination of more than one media.
 A comprehensive material presented in a combination of text, graphics, video, animation
and sound. Any system that is capable of presenting multimedia is called multimedia
system.
Advantages of Multimedia
 Enhancement of Text Only Messages: Multimedia enhances text only presentations by
adding interesting sounds and compelling visuals.
 Improves over Traditional Audio-Video Presentations: Audiences are more attentive
to multimedia messages than traditional presentations done with slides or overhead
transparencies.
 Gains and Holds Attention: People are more interested in multimedia messages which
combine the elements of text, audio, graphics and video.
 Multimedia is Entertaining as Well as Educational.

Disadvantages of Multimedia
 Information overload: Because it is so easy to use, it can contain too much information
at once.
 Takes time to compile: Even though it is flexible, it takes time to put the original draft
together.
 Expensive: Multimedia makes use of a wide range of resources, which can cost you a
large amount of money.
 Too much makes it impractical: Large files like video and audio has an effect of the
time it takes for your presentation to load. Adding too much can mean that you have to
use a larger computer to store the files. In case you want to upload it onto the Internet,
there are a few factors to keep in mind, for example bandwidth and the user’s abilities.
Use of Multimedia
The technology used for business, education and entertainment.
 Business: multimedia exists in the form of advertisements, presentations,
videoconferencing ,voice mail etc
 Educations: multimedia tools for learning are widely used to learn easily and quickly
when they are presented information with the virtual effect.
 Entertainment: Home PCs equipped with CD-ROMs and game machine hooked up with
TV screens have brought home entertainment to new levels. Interactive maps at public
places like libraries museums airports and the standalone terminal. Virtual reality helps
us feel a real life like experience. Games using virtual reality effect are very popular.

1.2. MULTIMEDIA ELEMENTS

Multimedia applications require dynamic handling of data consisting of a mix of text, voice,
audio components, video components and image animation. Integrated multimedia applications
allow the user to cut sections of all or any of these components and paste them in a new
document or in another application such as animated sequence of events or a desktop publishing
system or a spread sheet. Some of the elements of Multimedia are:
 Text
 Facsimile (or fax)
 Document images
 Photographic images
 Geographic Information System maps
 Voice commands and synthesis
 Audio messages
 Video messages
 Graphics
 Full-motion stored and live video
 Holographic images
 Fractals
 Animation
 Hyperlinks
 Interactivity
 Graphics

Text:
Textual content plays a crucial role in multimedia by providing information, context, and
narrative. It includes titles, headings, captions, descriptions, and any written content used to
convey messages or guide the audience.
Facsimile:
A facsimile is a copy or reproduction of an old book, manuscript, amp art print, that is as true to
the original copy. Facsimile transmission was the first practical means of transmitting document
images over the telephone lines. This basic technology having lower dpi of 100 to 200.

Images:
Images are visual representations that enhance understanding, evoke emotions, and
convey information.
 Document Images: Document images are being used for storing business documents
that must be retained for long time or may need to be accessed by a large number of
people. Providing multimedia access to such documents remove the need for making
several copies of the original for storage or distribution.
 Photographic Images: Photographic images are used for a wide range of
applications such as employee records for instant identification at a security desk, real
estate systems with photograph of houses in the database containing the description of
houses and medical case histories.

Geographical Information Systems:

Map created in a GIS systems are being used widely for natural resources and wild life
management as well as urban planning. The map containing database items containing wildlife
statistics or details of the floors and rooms and workers in an office building.
Voice Commands and Voice Synthesis:
Voice commands are being used for hands-free-operation for computer programs. Voice
synthesis is used for presenting the results of an action to the user in a synthesized voice.
Application such as a patient monitoring system in a surgical theatre will be prime beneficiaries
of these capabilities. Voice commands allow the user to direct computer operation by spoken
commands.

Audio message:
Audio elements involve sounds, music, voice-overs, and other auditory components.
They can provide background music, sound effects, narration, or spoken dialogue to enhance the
multimedia experience. Audio messages refer to a message that could be sent to a destination
using voice media. Annotated voice mail already uses audio or voice messages as attachments to
memos and documents such as maintenance manuals.

Video message:
Videos are moving visual sequences that capture real-life events or animations. They can be
used to demonstrate processes, tell stories, showcase products, or present information through
motion and visuals. Video messages refer to a message that could be sent to a destination using
video transmission media. They are being used in a manner similar to annotated voice mail.
Full motion stored and Live Video (FMV):
Full motion video started out as a very useful idea for online training and maintenance
manual.
The evolutionary step of FMV is video conferencing.
Holographic images:
Holographic images extend the concept of virtual reality by allowing the user to get inside a
part such as an engine and view its operations from inside.
Fractals:
This technology is based on synthesizing and storing algorithms that describe the
information.

Animation:
Animation involves the creation of moving and dynamic visuals. It brings static elements to
life and can be used to demonstrate concepts, create interactive experiences, or add visual
interest and engagement to multimedia content.
Hyperlinks:
Hyperlinks are clickable elements that allow users to navigate between different parts of the
multimedia or to external sources. They provide a way to access additional information, related
content, or relevant resources.

Interactivity:
Interactivity allows users to engage with the multimedia content and actively participate in
the experience. It can include clickable buttons, menus, navigation, quizzes, games, and other
interactive elements that enable users to control and manipulate the content.

Graphics:
These are visual images or designs on some surface, such as a wall, canvas, screen, paper,
or stone to inform, illustrate, or entertain.

By integrating these elements effectively, multimedia enables the creation of engaging and
interactive digital content that can inform, entertain, educate, and captivate audiences across
various platforms and devices.

1.3. MULTIMEDIA HARDWARE AND SOFTWARE

MULTIMEDIA HARDWARE
A multimedia system includes the following hardware components:
 Input Devices
 Output Devices
 Communication Devices
INPUT DEVICES:
A great variety or input devices -from the familiar keyboard and handy mouse to touch
screen and voice recognition setups can be used for development and delivery or a multimedia
project.
Keyboard:
 A keyboard is the most common method of interaction with a Computer.
 Keyboards provide various tactile responses and have variously layout depending upon
the Computer system and keyboard -model.
 Keyboard is typically rated at least 50 million cycles.
 The most common keyboard for PCs is the 1011 style, although many styles are available
with one or more special keys LED’s.
Mouse:
 A mouse is the standard tool for interacting with a graphical user interface (GUI).
 All Macintosh computers require a mouse; on PCs, mouse: are not required but
recommended.
 The buttons on the mouse provide additional user input, such as pointing and double
clicking to open a document.
Track Ball:
 Track ball are similar to mice except that the cursor is moved by using one or more
fingers to roll across the top of the ball.
 The track ball does not need the flat space required by a mouse.
 Track ball have at least two buttons; one for the user to click, and the other to provide the
press and hold condition necessary for selecting & dragging operation.
Touch Screen:
 Touch screens are monitors that usually have a textured coating across the glass face.
 This coating is sensitive to pressure and register the location of the user’s finger when it
touches the screen.
 The touch mate system, which has no coating, actually measures the pitch roll, and yaw
rotation of the monitor when pressed by finger, and determine how much force exerted
and the location where the force was applied.
Magnetic Card Encoders and Readers:
 Magnetic card setups are useful when an interface is needed for a data- base application
or multimedia project that tracks users.
 Both card encoder and a card reader are used for this type of interface.
 The encoder connects to the computer at the serial port and transfer information to
magnetic strip of tape on the back of the card.
Flat-Bed Scanners:
 A scanner may be the most useful piece of equipment you will use in the course of
producing a multimedia project.
  There are flat bed scanner and handheld scanners.
 Most commonly available are gray -scale and color flat- bed scanners that provide a
resolution of 300 or 600 dots per inch.
 Professional graphics houses may use even higher resolution unit.
Optical Character Recognition (OCR) Devices:
 OCR sofware, such as omni page from cacre or perceive from ocron, to convert printed
matter to ASCII text files in our computer.
 Also paper document is converted into a word processing document on our computer
without retyping or rekeying.
 An OCR terminal can be of use to multimedia developer because it recognizes not only
printed characters but also handwriting.
Infrared Remotes:
 An infrared remote unit lets a user interact with the project while freely moving about.
 Remotes work like mice and trackballs, except they use infrared light to direct the cursor
and require no cables to communicate.
 Remote mice work well for a lecture or other presentation in an auditorium or similar
environment, when the speaker needs to move around the room.
Voice Recognition System:
 Voice recognition system facilitates hands free interaction with your project.
 These system usually provide a unidirectional cardiod, noise canceling microphone that
automatically filters out background noise.
 Most voice recognition system currently available can trigger common events such as
Save, Quit, Open, Print etc.
 The Macintosh A V and Power Macintosh computer include voice recognition capability
and add on soundboard such as the Sound blaster or Diamond Sonic Sound and other
provide this features for PCs.
Digital Camera:
 Digital Camera use the same technology i.e. CCD as video camera uses.
 They capture the still images of a given no. of pixels and the images are stored in the
camera's memory to be uploaded later to a computer.
 The higher the megapixel rating, the higher the resolution of the camera.
 Images are uploaded from the camera's memory using a serial, parallel cable.

OUTPUT DEVICES:
 Presentation or the audio and the visual components of the multimedia project requires
hardware that may or may not be included with the computer itself speakers, amplifiers,
monitor, motion video devices, and capable storage devices.
 There is no greater test of the benefit of good output hardware than feeding the audio
output of your computer into an external amplifier.
Audio Devices:
 All Macintosh are equipped with an internal speaker and a dedicated sound chip and they
are capable of audio output without additional hardware and /or software.
 To take advantage of built-in stereo sound, external speakers are required.
 Digitizing sound on the Macintosh requires an external microphone and sound
editing/recording software such as Sound Edit 16 from Macromedia, Sound Forge.
Amplifiers and Speakers:
 Often the speakers we use during a project development will not be adequate for the
development of the multimedia project.
 Speakers with built-in amplifiers are important when our project will be presented to a
large audience.
Monitors:
 The monitors are needed for the development of multimedia projects depending on the
type of application created.
 A wide variety of monitors are available for both Machintosh and PCs.High-end, large
screen graphics monitors and LCD panels are available for both, and they are expensive.
 Serious multimedia developers will often attach more than one monitor to their
computers, using add-on graphics boards.
 This is because many authoring systems allow us to work with several open windows at a
time so we can dedicate one monitor to viewing the work we are creating or designing
and can perform various editing tasks in windows on other monitors that do not block the
view of work.
Video Devices:
 Message medium has the visual impact of video with a video digitizing board installed in
the computer, and can display a television picture on the monitor.
 Some boards include frame-grabber features for capturing the images and turning it into a
color bitmap, which can be saved as a PICT or TIFF file and then used as a part of a
graphics or a background project.
Projectors:
 When there is a need to show material to more viewers that can huddle around a
computer monitor, we will need to project it onto a large screen or even a white-painted
wall.
 Cathode-ray tube projectors, liquid crystal display (LCD) panels attached to an overhead
projector, stand-alone LCD projectors, and light-valve projectors are available to splash
work onto big screen surfaces.
Printers:
 With the advent of reasonably priced color printers, hard copy output has entered the
mutimedia scene.
 From storyboards to presentation to production of collateral marketing material, color
printers have become an important part of the multimedia development environment.
 Color helps clarify concept, improve understanding and retention or information, and
organize complex data. Xerox offers both solid ink and laser options.
COMMUNICATION DEVICES:
Many multimedia applications are developed in workgroups comprising instructional
designers, writers, graphics artists, programmers, and musicians located in the same office space
or building. The workgroup member's computers typically are connected to a local area network
(LAN) the client's computers, however, may be a thousand miles distant, requiring other methods
of good communication. In the workplace, use quality equipment and software for
communication setup. The cost of both the time and money of stable and fast networking will be
returned.
Modems:
 Modems can be connected to your computer externally at the serial port or internally as a
separate board. Internal modems often include fax capability.
 Be sure that the modem is Hayes compatible. Hayes AT standard command set allows us
to work with most software communication packages.
 Modem speed, measured in band, is the most important consideration.
 Because the multimedia files that contain the graphics, audio resources, video samples,
and progressive version of the project are usually large, and in many cases, we need to
move as much data in a short period.
 Compression saves significant transmission time and money, especially over long
distances.
ISDN:
 For higher transmission speed, use Integrated Service Digital Network (ISDN), switched
- 56, TI, T3, DSL, ATM, etc.
 ISDN lines are popular because of their fast 128 kbps data transfer rate- four to five times
faster than the more common 28.8 kbps analog modem.
 ISDN lines are important for Internet access,
 Networking and audio and video conferencing. They are more expensive than the
conventional analog lines, so analyze your costs and benefits carefully before upgrading
to ISDN.
 Newer and faster Digital Subscriber Line (DSL) technology using copper lines and
promoted by telephone companies may overtake ISDN.
Cable Modem:
 Cable modems usually send and receive data symmetrically -they receive more (faster)
than they send.
 In the downstream direction from provider to user, the data is modulated and placed on a
common 6 Mhz television

MULTIMEDIA SOFTWARE
The basic toolset for building a multimedia project can be divided into the following categories.
1. Text editing and word processing tools
 2. Painting and Drawing tools
3. 3-D modeling and Animation tools
4. Graphics and Image editing tools
5. Sound editing tools
6. Animation, Video, and Digital Movie Tools

1. Text Editing and Word Processing Tools

 A word processor is usually the first software tool computer users learn.
 The word processor may also be your most often used tool, as you design and build a
multimedia project.
 Keyboarding and typing skills, the easier and more efficient will be your multimedia day-
to-day life.
 Word processor comes bundled in an “office suite” that might include a spreadsheet,
database, e-mail, web browser, and presentation application.
 Word processors such as Word and Word Perfect are powerful applications that include
spell checkers, table formaters, thesauruses, and pre-built templates for letters, resumes,
purchase orders, and other common documents.
OCR Software
 With optical character recognition software, a flat-bed scanner, and your computer, one
can save
 many hours of rekeying printed words, and get the job done faster than a roomful of
typists.
 OCR software turns bitmapped characters into electrically recognized ASCII text.
 A scanner typically used to create a bitmap.
 Then the software breaks the bitmap into chunks according to whether it contains text or
graphics.

2. Painting and Drawing Tools

 Painting and drawing tools, as well as 3-D modelers, are perhaps the most important
items in the multimedia projects.
 To have greater impact to the end user the painting and drawing tools are used in the
project Painting software such as Photoshop, Picture Publisher, and Fractal Design
Painter is dedicated to producing crafted bitmap images.
 Drawing software such as CorelDraw, Freehand, Illustrator, Designer, and Canvas, is
dedicated to producing vector based line art easily to paper using PostScript or another
page markup system such as QuickDraw on the Macintosh.

3. 3-D Modeling and Animation Tools

 With 3-D modeling software, objects rendered in perspective appear more Realistic.
 One can create stunning scenes and wander through them, choosing just the right lighting
and perspective for your final rendering image.
  Powerful modeling packages such as Macromedia’s Extreme 3D, AutoDesk’s 3D Studio
Max, Strata Vision’s 3D are available for objects such as people, furniture, buildings,
airplanes, trees etc.,

Animation Tools:
Multimedia APIs
 Java3D is an API used by Java to construct and render 3D graphics, similar to the way
Java Media Framework handles media files. It provides a basic set of object primitives
(cube, splines, etc.) upon which the developer can build scenes. It is an abstraction layer
built on top of OpenGL or DirectX (the user can select which), so the graphics are
accelerated.
 DirectX, a Windows API that supports video, images, audio, and 3D animation, is a
common API used to develop multimedia Windows applications such as computer
games.
 OpenGL was created in 1992 and is still a popular 3D API today. OpenGL is highly
portable and will run on all popular modern operating systems, such as UNIX, Linux,
Windows, and MacOS.
Animation Software
 Autodesk 3ds Max (formerly 3D Studio Max) includes a number of high-end
professional tools for character animation, game development, and visual effects
production. Models produced using this tool can be seen in several consumer games, such
as for the Sony PlayStation.
 Autodesk Maya is a complete modeling, animation, and rendering package. It features a
wide variety of modeling and animation tools, such as to create realistic clothes and fur.
Autodesk Maya runs on Windows, MacOS, and Linux.
 Blender is a free and open-source alternative to the paid Autodesk suite of tools. It also
offers a complete modeling, animation, and rendering feature set, as well as Python
scripting capabilities.
GIF Animation Packages
 For a much simpler approach to animation that also allows quick development of
effective small animations for the web, many shareware and other programs permit
creation of animated GIF images.
 GIFs can contain several images, and looping through them creates a simple animation.
Linux also provides some simple animation tools, such as animate.

4. Graphics and Image-Editing Tools

 Imaging editing tools are specialized and powerful tools for enhancing and retouching
existing bitmapped images.
 These applications also provide many of the features and tools of painting and drawing
programs and can be used to create images from scratch as well as digitized images from
scanners, video frame-grabbers and digital cameras.
Adobe Illustrator
 Illustrator is a powerful publishing tool for creating and editing vector graphics, which
can easily be exported to use on the web.
 It is especially useful for logo graphics design.
Adobe Photoshop
 Photoshop is the standard in tool for graphics, image processing, and image manipulation.
 Layers of images, graphics, and text can be separately manipulated for maximum
flexibility, and its set of filters permits the creation of sophisticated lighting effects.
GIMP
 GIMP is a free and open-source graphics editor alternative to Photoshop.
 It supports many bitmap formats, such as GIF, PNG, and JPEG. These are pixel-based
formats, in that each pixel is specified.
 It also supports vector-based formats, in which endpoints of lines are specified instead of
the pixels themselves, such as SWF (Adobe Flash).
 It can also read in Photoshop format.

5. Sound Editing Tools

 Sound editing tools for both digitized and MIDI sound let you see music as well as hear
it.
 One can cut, copy, paste, and otherwise edit segments of it with great precision.
 System sounds are shipped with both Macintosh and Windows systems as soon as you
install the OS.
 Echo effects, mixing of sound, etc., can be made by Sound Editing Tools. Software like
Creative Labs’ Wave Studio is used for editing sounds to perform in greater experience.

Digital Audio tools deal with accessing and editing the actual sampled sounds that makeup audio.
Adobe Audition
 Adobe Audition (formerly Cool Edit) is a powerful, popular digital audio toolkit that
emulates a professional audio studio, including multitrack productions and sound file
editing, along with digital signal processing effects.
Sound Forge
 Like Audition, Sound Forge is a sophisticated PC-based program for editing WAV sound
files.
 Sound can be captured through the sound card, and then mixed and edited. It also permits
adding complex special effects.
Avid Pro Tools
 Pro Tools is a high-end integrated audio production and editing environment that runs on
Macintosh computers as well as Windows.
 Pro Tools offers easy MIDI creation and manipulation as well as powerful audio mixing,
recording, and editing software. Full effects depend on purchasing a dongle.
6. Animation, Video, and Digital Movie Tools
 Animation and digital video movies are sequences of bitmapped graphic scenes (frames)
rapidly played back.
 Movie-making tools take advantage of Quick Time (Macintosh and Windows) and
Microsoft Video for Windows (also known as AVI,or Audio Video Interleaved, available
for Windows only) technology and let you create, edit, and present digitized motion
video segments, usually in a small window in the project.
 Moving-making tools such as Premiere, VideoShop, and MediaStudio Pro let you edit
and assemble video clips captured from the camera, tape, other digitized movie segments,
scanned images, animations, and from digitized audio.
Adobe Premiere
 Premiere is a simple, intuitive video editing tool for nonlinear editing—putting video
clips into any order.
 Video and audio are arranged in tracks, like a musical score.
 It provides a large number of video and audio tracks, superimpositions, and virtual clips.
 A large library of built-in transitions, filters, and motions for clips allows easy creation of
effective multimedia productions.
Adobe After Effects
 After Effects is a powerful video editing tool that enables users to add and change
existing movies with effects such as lighting, shadows, and motion blurring.
 It also allows layers, as in Photoshop, to permit manipulating objects independently.
iMovie
 iMovie is a video editing tool for MacOS and iOS devices.
 It is versatile and convenient for video editing and creation of movie trailers.
 iMovie on iPhones is especially handy and popular. Later versions of iMovie also support
4K UHD video editing.
Final Cut Pro
 Final Cut Pro is a professional video editing tool offered by Apple for MacOS.
 It allows the input of video and audio from numerous sources, and provides a complete
environment, from editing and color correction to the final output of a video file.

1.4. DISTRIBUTED MULTIMEDIA SYSTEMS

Distributed multimedia systems consist of multimedia databases, proxy and information
servers, and clients, and are intended to for the distribution of multimedia content over the
networks

Architecture of Distributed Multimedia Systems:

The architecture of a distributed multimedia system main comprises of three basic
components
 1. An information server
2. A wide area network (WAN)
3. A multimedia client (User)

Functions of each of the components:

Multimedia Client/User:
 The user terminal is equipped with hardware such as computers, speakers, monitors,
keyboards etc.
 These hardware devices play an important role in manipulating the multimedia object and
presenting it to the user. Interaction may also occur in certain multimedia objects.
Wide Area Network:
 The network provides a pathway that connects the server and the user, thus providing a
communication mechanism for the system.
Information server:
 The server is responsible for handling multimedia objects and databases for the user.
 Creating a multimedia object requires a intricate process of integrating and
synchronizing the object for transport, display and manipulation.
 The distributed multimedia system usually consists of several networks, users and
servers in order to maintain efficiency.

If the multimedia systems are supported by multiuser system, then those multimedia systems are
called as distributed multimedia systems.
A multi-user system designed to support multimedia applications for a large number of users
consists of a number of system components. A typical multimedia application environment
consists of the following components:
1. Application software
2. Container object store/ Document Store
3. Image and still video store
4. Audio and video component store
5. Object directory service agent
6. Component service agent
7. User interface and service agent
8. Networks (LAN and WAN)

1. Application Software
The application software performs a number of tasks related to a specific business
process.
A business process consists of a series of actions that may be performed by one or more users.

The basic tasks combined to form an application include the following:

 Object Selection - The user selects a database record or a hypermedia document from a
file system, database management system, or document server.
 Object Retrieval- The application retrieves the base object.
 Object Component Display - Some document components are displayed automatically
when the user moves the pointer to the field or button associated with the multimedia
object.
 User Initiated Display - Some document components require user action before
playback/display.
 Object Display Management and Editing: Component selection may invoke a component
control sub application which allows a user to control playback or edit the component
object.

2. Document store
A document store is necessary for an application that requires storage of large volume of
documents. The following describes some characteristics of document stores.
 Primary Document Storage: A file system or database that contains primary document
objects (container objects). Other attached or embedded documents and multimedia
objects may be stored in the document server along with the container object.
 Linked Object Storage: Embedded components, such as text and formatting information,
and linked information, and linked components, such as pointers to image, audio, and
video. Components contained in a document, may be stored on separate servers.
  Linked Object Management: Link information contains the name of the component,
service class or type, general attributes such as size, duration of play for isochronous
objects and hardware, and software requirements for rendering.

3. Image and still video store

An image and still video is a database system optimized for the storage of images. Most
systems employ optical disk libraries. Optical disk libraries consist of multiple optical disk
platters that are played back by automatically loading the appropriate platter in the drive under
device driver control.
The characteristics of image and still video stores are as follows:
 Compressed information
 Multi-image documents
 Related annotations
 Large volumes
 Migration between high-volume such as an optical disk library and high-speed media
such as magnetic cache storage.
 Shared access: The server software managing the server has to be able to manage the
different requirements.

4. Audio and video Full motion video store

Audio and Video objects are isochronous. The following lists some characteristics of
audio and full-motion video object stores:
 Large-capacity file system: A compressed video object can be as large as six to ten M
bytes for one minute of video playback.
 Temporary or permanent Storage: Video objects may be stored temporarily on client
workstations, servers providing disk caches, and multiple audio or video object
servers.
 Migration to high volume/lower-cost media.
 Playback isochronocity: Playing back a video object requires consistent speed without
breaks. Multiple shared access objects being played back in a stream mode must be
accessible by other users.

5. Object Directory Service Agent

The directory service agent is a distributed service that provides a directory of all
multimedia objects on the server tracked by that element of the directory service agent.
The following describes various services provided by a directory service Agent.
 Directory Service: It lists all multimedia objects by class and server location.
 Object Assignment: The directory service agent assigns unique identification to each
multimedia object.
 Object Status Management: The directory service must track the current usage status of
each object.
  Directory Service Domains: The directory service should be modular to allow setting up
domains constructed around groups of servers that form the core operating environment
for a group of users.
 Directory Service Server Elements: Each multimedia object server must have a directory
service element that reside on either server or some other resources.
 Network Access: The directory service agent must be accessible from any workstation on
the network.

6. Component Service Agent

 A service is provided to the multimedia used workstation by each multimedia component.
 This service consists of retrieving objects, managing playback of objects, storing objects,
and so on.
 The characteristics of services provided by each multimedia component are object
creating service, playback service, component object service agent, service agents on
servers and multifaceted services means (multifaceted services component objects may
exist in several forms, such as compressed Or uncompressed).

7. User Interface Service Agent

 It resides on each user workstation.
 It provides direct services to the application software for the management of the
multimedia object display windows, creation and storage of multimedia objects, and
scaling and frame shedding for rendering of multimedia objects.
 The services provided by user interface service agents are Windows management, object
creation and capture, object display and playback, services on workstations, and display
software.
 The user interface service agent is the client side of the service agents. The user interface
agent manages all redirection since objects are located by a look-up mechanism in the
directory service agent

1.5. CHALLENGES
Distributed multimedia systems face several challenges in areas such as security,
sharing/distribution, storage, retrieval, and processing. Here's a breakdown of these challenges:
Security:
Security is a major concern in distributed multimedia systems due to the sensitivity of
multimedia content and the potential for unauthorized access, piracy, or tampering. Challenges
include:
 Encryption: Ensuring the confidentiality of multimedia content during transmission and
storage.
  Authentication and access control: Verifying the identity of users and providing
appropriate access rights to protect against unauthorized access.
 Watermarking and copyright protection: Protecting against unauthorized copying or
distribution of multimedia content by embedding watermarks or employing digital rights
management (DRM) techniques.

Sharing/Distribution:
Efficient sharing and distribution of multimedia content in a distributed environment
present challenges related to scalability, network bandwidth, and synchronization
 Scalability: Ensuring that the system can handle a large number of concurrent users and
efficiently distribute multimedia content across multiple nodes.
 Bandwidth and latency: Optimizing the use of available network bandwidth to deliver
multimedia content in real-time while minimizing latency.
 Synchronization: Maintaining synchronization between different media components
(e.g., audio and video) when distributed across multiple nodes.

Storage:
Distributed storage of multimedia content poses challenges in terms of capacity,
reliability, and efficient data management:
 Storage capacity: Managing large volumes of multimedia data across multiple storage
nodes and ensuring sufficient storage capacity.
 Data replication and consistency: Replicating multimedia content across distributed
storage nodes to improve availability and fault tolerance while maintaining data
consistency among replicas.
 Data management: Efficiently organizing and indexing multimedia content to enable
fast retrieval and search capabilities.

Retrieval:
Efficient retrieval of multimedia content from distributed systems requires addressing
challenges such as:
 Content indexing: Designing effective indexing mechanisms to facilitate fast search and
retrieval of multimedia content based on various attributes or metadata.
 Query processing: Developing efficient algorithms to process user queries across
distributed nodes and retrieve relevant multimedia content.

Processing:
Distributed multimedia systems may involve processing tasks such as transcoding,
content analysis, or real-time multimedia processing. Challenges include:
 Load balancing: Distributing processing tasks across multiple nodes to ensure efficient
resource utilization and load balancing.
  Real-time processing: Meeting strict timing requirements for real-time
multimedia processing to avoid delays or disruptions in playback.

Computing:
Distributed multimedia systems often require significant computing power for tasks such
as video encoding, decoding, and multimedia analytics. Challenges include:
 Resource management: Efficiently allocating and managing computing resources across
distributed nodes to meet the computational demands of multimedia processing.
 Task scheduling: Scheduling processing tasks across distributed nodes to optimize
performance and minimize processing delays.

1.6. MULTIMEDIA METADATA

Multimedia metadata refers to the descriptive information associated with multimedia

content, such as audio, video, images, and other related data. It provides additional context and
details about the content, facilitating organization, search, retrieval, and management of
multimedia assets.
Here are some key aspects of multimedia metadata:

Types of Metadata:
Multimedia metadata can include various types of information, including:
 Descriptive Metadata: Provides information about the content's title, author, description,
keywords, genre, and other attributes that help describe and categorize the multimedia
content.
 Technical Metadata: Describes technical characteristics of the content, such as file
format, resolution, duration, codec, sampling rate, and encoding parameters.
 Structural Metadata: Specifies the structure and relationships between different
components or parts of the multimedia content. For example, in a video, structural
metadata may define chapters, scenes, or timestamps.
 Rights Metadata: Covers information related to copyright, intellectual property rights,
usage rights, and licensing terms associated with the multimedia content.
 Administrative Metadata: Includes information about the content creation date,
modification history, versioning, and other administrative details.

Metadata Standards:
To ensure interoperability and consistent metadata representation, various metadata
standards have been developed. Examples include:
  EXIF (Exchangeable Image File Format): Primarily used for image metadata, EXIF
provides a standardized format for storing information such as camera settings,
date/time, GPS coordinates, and more.
 ID3 (used in MP3 files): Specifically for audio files, ID3 enables the storage of metadata
like artist, album, track title, and album artwork.
 IPTC (International Press Telecommunications Council): A standard for news and
media industries, IPTC metadata includes information about captions, keywords,
copyright, and usage rights.
 Dublin Core: A widely used standard for general resource description, Dublin Core
covers basic elements like title, creator, subject, description, and more.

Metadata Usage and Benefits:

Content Organization and Search: Metadata enables efficient organization and
categorization of multimedia assets, making it easier to locate and retrieve specific content
through search functionalities.
 Content Recommendation: Metadata can be used to generate personalized
recommendations and related content suggestions based on user preferences, historical
data, or content similarities.
 Copyright and Rights Management: Rights metadata helps track and manage copyright
information, usage permissions, licensing terms, and digital rights management (DRM)
for multimedia content.
 Workflow Automation: Metadata can automate various workflows by providing
contextual information, guiding content processing, and facilitating integration with other
systems or applications.
 Preservation and Archiving: Metadata supports the long-term preservation and archival
of multimedia content by documenting its characteristics, provenance, and historical
information.

Metadata Creation and Management:

 Manual Metadata Entry: Metadata can be manually entered by content creators or
administrators, ensuring accurate and specific descriptions for each multimedia asset.
 Automated Extraction: Metadata can be automatically extracted from the content itself
or derived from other sources, such as image recognition, speech-to-text conversion, or
automated content analysis techniques.
 Metadata Schema and Taxonomies: Implementing standardized metadata schemas and
taxonomies helps ensure consistency and interoperability across different systems and
facilitates effective metadata management.
 1.7. MULTIMEDIA DATABASES

A multimedia database consists of a member of different types of multimedia objects.

These may include relational database records, object-oriented databases with objects for
alphanumeric attributes, and s:orage servers for multimedia objects such &s images, still video,
audio, and full-motion video. It is feasible to include an image or a video object as a binary large
object (BLOB) in a relational database.
It is also feasible to include such an object as an attribute in an object.

Database Organization for Multimedia Applications

Optical disk storage technology has reduced the cost of multimedia document storage by
a significant factor. Distributed architectures have opened the way for a variety of applications
distributed around a network accessing the safe database in an independent manner. The
following discussion addresses some key issues of the data organization for multimedia systems.

Data Independence:
Flexible access to a variety of distributed databases for one or more applications requires that the
data be independent from the application so that future applications can access the data without
constraints related to a previous application. Important features of data independent design are:
 Storage design is independent of specific applications.
 Explicit data definitions are independent of application programs.
 Users need not know data formats or physical storage structures .
 Integrity assurance is independent of application programs.
 Recovery is independent of application programs .

Common Distributed Database Architecture:

Employment of Common Distributed database architecture is presented by the insulation
of data from an application and distributed application access.

Key features of this architecture are:

 The ability for multiple independent data structures to co-exist in the system (multiple
server classes).
 Uniform distributed access by clients.
 Single point for recovery of each database server.
 Convenient data re-organization to suit requirements.
 Tunability and creation of object classes.
 Expandibility.
Multiple Data Servers:
 A database server is a dedicated resource on a network accessible to a number of
applications, when a large number of users need to access the same resources, problem
arises
 This problem is solved by setting up multiple data servers that have copies of the same
resources,

Transaction management for Multimedia Systems

It is defined as the sequence of events that starts when a user makes a request to create,
render, edit, or print a hypermedia document. The transaction is complete when the user releases
the hypermedia document and stores back any edited versions or discards the copy in memory or
local storage.
Use of object classes provides an excellent way for managing and tracking hypermedia
documents, Given that all components of a hypermedia document can be referenced within an
object as attributes, we can find a solution for the three-dimensional transaction management
problem also in the concept of objects.
Andleigh and Gretzinger expand on the basic concepts developed for the object request
broker (ORB) by the Object Management Group (OMG) and combine it with their transaction
management approach.

Managing Hypermedia Records as Objects

Hypermedia records or documents are complex objects that contain multimedia
information objects within them. A hypermedia document can be stored in a document data base,
as a BLOB in a relational database, or in an object-oriented database. A Hyper media document
may contain multimedia objects embedded in it as special fields.
Object linking and embedding:
OLE provides an object oriented framework for compound documents. When a user
double clicks or click on an icon for an embedded object, the application that created the object
starts, and allows the user to view and or the object .

1.8. HYPERMEDIA
Multimedia is the medium that provides information to users in the form of text, audio,
video, animation, and graphics. The information is delivered to the users by digital or electronic
means. When a user is allowed to control the elements of multimedia then it becomes interactive
multimedia. Interactive multimedia is called hypermedia when the user is given the structure of
linked elements to control.
Hypermedia refers to an extension of the concept of hypertext, where multimedia
elements such as text, images, audio, video, and other media types are interconnected and linked
together to provide a rich and interactive user experience. It allows users to navigate and access
information in a non-linear manner by following links within the multimedia content.
Hypermedia is
commonly associated with the World Wide Web and is the foundation of the Web's
interconnected nature.
Here are some key aspects of hypermedia:
Linking:
 Hypermedia is characterized by the presence of hyperlinks, which are clickable elements
that connect different pieces of multimedia content.
 These links can be embedded within the text, images, buttons, or other interactive
elements, allowing users to navigate between related resources.
Non-Linearity:
 Unlike traditional linear media, hypermedia enables non-linear navigation.
 Users can choose their own paths, explore related content, and access information based
on their interests and needs.
 This flexibility enhances the interactive and user-driven nature of hypermedia.
Multimedia Integration:
 Hypermedia incorporates various multimedia elements, including text, images, audio,
video, animations, and interactive components.
 These elements can be seamlessly integrated within the content, providing a rich and
immersive user experience.
Interactivity:
 Hypermedia allows users to interact with the content and participate actively in the
navigation and exploration process.
 Users can follow links, perform actions, submit forms, interact with embedded media,
and engage with interactive elements to access additional information or trigger specific
functionalities.
Rich Media Presentation:
 Hypermedia supports the presentation of multimedia content in a visually appealing and
engaging manner.
 It enables the integration of different media types, facilitating the conveyance of
information through a combination of text, images, videos, and other media elements.
Contextual Information:
 Hypermedia often provides additional context and metadata about the linked resources.
 This can include descriptions, captions, annotations, and other forms of supplementary
information that enhance the understanding and interpretation of the content.
Web-based Hypermedia:
 The World Wide Web is a prime example of hypermedia, where web pages are
interconnected through hyperlinks.
 HTML (Hypertext Markup Language) is the standard markup language used to create
hypermedia documents on the web, allowing the inclusion of various media types and
supporting linking between web pages.
 1.9. MULTIMEDIA LEARNING
Multimedia learning refers to the process of acquiring knowledge and understanding
through the integration of multimedia elements, such as text, images, audio, video, animations,
and interactive components. It leverages the benefits of combining multiple sensory modalities to
enhance the learning experience and improve knowledge retention.
Here are some key aspects of multimedia learning:
Dual Coding Theory:
 Multimedia learning is based on the dual coding theory, which suggests thatpresenting
information through both visual and verbal channels can lead to better learning outcomes.
 By integrating text and visuals, learners can process information through multiple
channels, increasing comprehension and memory retention.
Visualization and Illustration:
 Multimedia learning utilizes visual elements, such as images, diagrams, charts, and
illustrations, to represent and explain concepts.
 Visualizations aid in clarifying complex ideas, supporting learners in forming mental
models and understanding abstract concepts.
Audio and Video Integration:
 Multimedia learning incorporates audio and video components to provide auditory and
visual representations of information.
 Audio narration, sound effects, and background music can enhance engagement and
create a more immersive learning environment.
 Video demonstrations, animations, and simulations help illustrate processes, experiments,
and real-world scenarios.
Interactivity and Engagement:
 Multimedia learning often includes interactive elements that allow learners to actively
engage with the content.
 Interactive quizzes, simulations, drag-and-drop exercises, and clickable elements foster
learner participation, problem-solving, and self-assessment.
Personalization and Adaptivity:
 Multimedia learning can be personalized and adaptive, catering to individual learner
preferences and needs.
 Learners can navigate through content at their own pace, choose different pathways, and
access supplementary resources based on their interests and skill levels.
Multimodal Integration:
 Multimedia learning integrates various modalities, such as visual, auditory, and textual
information, to cater to different learning styles and preferences.
 By providing information through multiple channels, it accommodates diverse learner
needs and optimizes learning outcomes.
Mobile and Online Learning:
 The rise of digital technologies and online platforms has facilitated the widespread
adoption of multimedia learning.
 Mobile devices, e-learning platforms, and online educational resources provide
convenient access to multimedia content, enabling anytime, anywhere learning
experiences.