0% found this document useful (0 votes)
19 views71 pages

(IP'22) Lecture 1 - Intro + Acquisition - G

Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
19 views71 pages

(IP'22) Lecture 1 - Intro + Acquisition - G

Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 71

CSC 447

Digital Image
Processing

10/3/2022 Dr. Maryam al-Bery1


maryam_nabil@cis.asu.edu.eg
10/3/2022 2
• 📣Tuesday 18 October at 10 am 📣 Job Opportunities
🧑 💻‍ Internships 📝Talks 🎤 Mentorship Circles💡
• https://fb.me/e/2QEuai6vc
• Registration for Computer Science and Engineering :
https://asucc.icareerhub.com/?fbclid=IwAR1iozmilOe2NRF
v6wZaDOPvXhxFUwWsXut5lQt6j74CL8qsd9UeOZmn35A
• Location: ASU Career Center office
https://www.google.com/maps/place/37HQ%2B5C9+ASU+
Career+Center+Office,+El-
Qobba+Bridge,+El+Weili,+Cairo+Governorate+4392003/@3
0.077933,31.288665,15z/data=!4m5!3m4!1s0x14583f2de2
4c26d5:0xffe0da80f1437766!8m2!3d30.077933!4d31.2886
65

10/3/2022 3
Team
• Teachers
– Dr. Maryam Al-Berry
maryam_nabil@cis.asu.edu.eg
• TAs
– Mohammed Ali
– Mohammed Rashad
– Mohammed Mostafa
– Mostafa Elkabeer
– Nadeen Halawa

10/3/2022 4
ILOs
• A working knowledge of the most commonly used
methods and procedures for image processing.
• Understanding of the mathematics/theory behind the
procedures as well as the ability to write software to
implement the mathematics.
• Make use of data structures, linear algebra, and signal
processing in the implementations.
• Given an image and a goal for its processing the student
should be able to select and implement an appropriate
procedure to achieve that goal.
• The ability to explain results in writing is essential for a
successful
10/3/2022 engineer→ reports/papers. 5
Introduction and
Image Acquisition
Today’s Contents

• What is a digital image


• How to acquire/represent a digital image
• Effects of sampling and quantization
• What is image processing
• Common IP operations and applications
• Course outline
What is a Digital Image?
• A digital image is a representation of a two-
dimensional picture.
• Digitization implies that a the image is an
approximation of a real scene.

Analog to Digital
Human Visual Perception
Structure of the Human Eye
Brightness adaptation and discrimination
Human Visual Perception – (cont.)
Image Formation in the Eye

10/3/2022 10
Human Visual Perception – (cont.)

10/3/2022 11
Digital Image Acquisition
• Digital Camera

10/3/2022 12
Digital Image Acquisition
• Digital Camera
• Color filter arrays - Bayer

10/3/2022 13
Digital Image Acquisition – (cont.)
The Electromagnetic Spectrum
• Light is a part of the EM spectrum that can
be sensed by the human eye.
Digital Image Acquisition – (cont.)
Digital Image Acquisition – (cont.)
• Incoming energy lands on a sensor material
responsive to that type of energy and this
generates a voltage.
• Collections of sensors are arranged to
capture images. Line of Image
Sensors

Array of Image Sensors


Imaging Sensor
Digital Image Acquisition – (cont.)
• Image (as a signal) is continuous in
x- and y-coordinates → requires sampling
and in amplitude → requires quantization

continuous color input


continuous colors
mapped to a finite,
discrete set of
colors.

discrete color output


Digital Image Acquisition – (cont.)
Sampling and Quantization

sample

sample sample
Digital Image Acquisition – (cont.)
Sampling and Quantization Q. Which?

10/3/2022 19
Digital Image Acquisition – (cont.)
Sampling and Quantization Example
• Quality depends on the
number of samples and
discrete intensity levels used
in sampling and quantization.
Digital Image Acquisition – (cont.)
• A digital image is a representation of a two-
dimensional picture as a finite set of digital
values, called picture elements or pixels.
y 1 pixel

(0,0)

x
10/3/2022 f(x,y) 21
Digital Image Acquisition – (cont.)
• Color image

10/3/2022 22
Digital Image Acquisition – (cont.)
Image Representation
• The image now is composed of M rows
and N columns of pixels each storing a
value f(x,y).
• In practice, the grey scale is shifted to
[0, L-1].
• x and y are called spatial coordinates.
Digital Image Acquisition – (cont.)
Image Representation
• The number L of discrete intensity
levels is typically a power of 2.
L = 2k
• k = bits required to store the image.
• k-bit image, e.g. 8-bit image.
Digital Image Acquisition – (cont.)
Image Representation
• That representation can take several forms.

• This affects the size, quality (resolution), and


data structure used to save the image on
disk.

• This does not necessarily correspond to the


file format.
10/3/2022 25
Digital Image Acquisition – (cont.)
Image Representation - Binary Image
• 2D array of integer numbers where each pixel
has two possible values.
(usually 0 and 1,
or 0 and 255 in an
8-bit image).

10/3/2022 26
Digital Image Acquisition – (cont.)
Image Representation - Gray-scale (intensity) Image
• 2D array of integer numbers where each pixel
has a value in the range [0-1], or most
commonly [0-255]
for an 8-bit image.

10/3/2022 27
Digital Image Acquisition – (cont.)
Image Representation - RGB (truecolor) Image
• 3D array that defines red, green, and blue
color components for each individual pixel.
• Each of the three values is in the range [0-1] or [0-255] for an 8-bit image.
Black = (0, 0, 0)
White = (1, 1, 1 )
or = (255, 255, 255)

10/3/2022 28
Digital Image Acquisition – (cont.)
Image Representation - Indexed Image
• 2D array of integer numbers (indexes)
representing a row in a color map.
• Each row of map specifies the red, green, and
blue components of a single color.

10/3/2022 29
Digital Image Acquisition – (cont.)
• An 8-bit image has a its grey scale [0,
255], however, not all images use the
whole range.
• The actual range used by an image is
called the dynamic range.
• Dynamic range affects contrast and the
contrast ratio.
Digital Image Acquisition – (cont.)
Contrast Examples
Digital Image Acquisition – (cont.)
Most Popular Image File Formats
Compressed Vs. raw

10/3/2022 32
Effects of Sampling & Quantization – (cont.)

Image Resolution
• A measure of quality of the image.
• How close the lines can be to each other
and still be visibly resolved.
• Depends strongly on the number of
• Samples → Pixel
• Device → Spatial Resolution
• Gray levels → Intensity Resolution
Effects of Sampling & Quantization – (cont.)

1- Pixel Resolution
• Refers to the pixel count of the image.
• Conventions:
The number of pixel columns (width) times the number of
pixel rows (height), e.g. as 640 by 480.

The total number of pixels in the image,


typically given as number of megapixels.
Effects of Sampling & Quantization – (cont.)

1- Pixel Resolution – Example 1

64 32
128
256

512

1024
Effects of Sampling & Quantization – (cont.)

1- Pixel Resolution – Example 1

1024×1024
Effects of Sampling & Quantization – (cont.)

1- Pixel Resolution – Example 1

512×512
Effects of Sampling & Quantization – (cont.)

1- Pixel Resolution – Example 1

256×256
Effects of Sampling & Quantization – (cont.)

1- Pixel Resolution – Example 1

128×128
Effects of Sampling & Quantization – (cont.)

1- Pixel Resolution – Example 1

64×64
Effects of Sampling & Quantization – (cont.)

1- Pixel Resolution – Example 1

32×32
Effects of Sampling & Quantization – (cont.)

1- Pixel Resolution – Example 2

10/3/2022 42
Effects of Sampling & Quantization – (cont.)

3- Intensity Resolution
• Refers to the number of intensity levels
used to represent the image.
– More intensity levels = finer discernable detail.
– In terms of number of bits used to store each
intensity level.
Effects of Sampling & Quantization – (cont.)

3- Intensity Resolution
256 grey levels (8 bits per pixel) 128 grey levels (7 bpp) 64 grey levels (6 bpp) 32 grey levels (5 bpp)

16 grey levels (4 bpp) 8 grey levels (3 bpp) 4 grey levels (2 bpp) 2 grey levels (1 bpp)
Effects of Sampling & Quantization – (cont.)

- Resolution: How much is enough?


• This all depends on what is in the image
and what you would like to do with it
• Key questions include
- Does the image look aesthetically pleasing?
- Can you see what you need to see within
the image?
Effects of Sampling & Quantization – (cont.)

- Resolution: How much is enough?

The picture on the right is fine for counting the


number of cars, but not for reading the plate
number.
Note on Video
• Sequence of images (frames) with specific
frame rate→ definitely needs compression→
affects quality.
Digital Image Processing
• DIP: Processing of a digital image by means
of a computer.

• Why?
–Improvement of pictorial information for
human interpretation (low-level).
–Processing of scene data for autonomous
machine perception (computer vision).
10/3/2022 48
Digital Image Processing

Image Image Machine


Processing Analysis Vision

Low Level Process Mid Level Process High Level Process


Input: Image Input: Image Input: Attributes
Output: Image Output: Attributes Output: Understanding
Examples: Noise Examples: Object Examples: Scene
removal, image recognition, understanding,
sharpening segmentation autonomous navigation

this course stops here

10/3/2022 49
Example Applications
- Image Enhancement/restoration: One of the
most common uses of DIP techniques: improve
quality, remove noise, etc.

10/3/2022 50
Example Applications – (cont.)
- Image Enhancement/restoration: One of the
most common uses of DIP techniques: improve
quality, remove noise, etc.

10/3/2022 51
Example Applications – (cont.)
- Medical Visualization:
Computerized Axial Tomography (CAT) scans.
Magnetic Resonance Imaging (MRI).

10/3/2022 52
Example Applications – (cont.)
- Industrial Inspection:
detecting anomalies.

10/3/2022 53
Example Applications – (cont.)
- Special Effects: make images more visually
appealing, or make composites.

10/3/2022 54
Example Applications – (cont.)
- Image Forensics: authentication and forgery
detection.

10/3/2022 55
Example Applications – (cont.)
- Image Forensics: authentication and forgery
detection.

10/3/2022 56
Example Applications – (cont.)
- Law Enforcement: automated detection,
tracking, and identification.

10/3/2022 57
Example Applications – (cont.)
- HCI: Try to make human computer interfaces
more natural
– Face recognition
– Gesture recognition
– Computer Graphics

10/3/2022 58
Most Common Topics in DIP
1. Image formation
2. Sampling and quantization
3. Point processing and equalization
4. Re-sampling and geometric transformations
5. Convolution and spatial filtering
7. Fourier transform and frequency filtering
8. Restoration and noise reduction
9. Morphology
10. Segmentation
10/3/2022 59
Fundamental Steps of DIP

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
10/3/2022 60
Fundamental Steps of DIP – (cont.)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
10/3/2022 61
Fundamental Steps of DIP – (cont.)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
10/3/2022 62
Fundamental Steps of DIP – (cont.)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
10/3/2022 63
Fundamental Steps of DIP – (cont.)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
10/3/2022 64
Fundamental Steps of DIP – (cont.)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
10/3/2022 65
Fundamental Steps of DIP – (cont.)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
10/3/2022 66
Course Outline
Wavelet and
Multi- Compression
resolution
Output is generally images

Color Image Morphological

Output is generally attributes


Processing Processing

Knowledge base
Restoration Segmentation

Representation
Enhancement and
Description

Object
Acquisition Recognition
Problem Domain
Winner
• Diagnose the image(s).
• Develop a solution/process.
• Describe the why.
• Know the how.
• Write about it. Assessment (CH)
Assessment (Old Bylaw) Final Test 50 %
Final Test 65 % Midterm 15 %
Midterm 10 % Practical 20%
Practical + Tasks 25%) Quizzes 5%
10/3/2022 68
Yearwork 10%
Textbook
• Digital Image Processing, 3rd edition, Rafael C.
Gonzalez and Richard E. Woods, Prentice Hall,
2008.
http://www.imageprocessingplace.com

10/3/2022 69
Next Lecture
Image Enhancement in the Spatial Domain

Assignment
- Textbook Chapter 1
Chapter 2: 1, 2, 3, 4, 4.1, 4.2, 4.3
- Check associated problems:
Chapter 2 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 22, 23

Choose your lab partners (teams of five).


10/3/2022 70
References
- Gonzalez and Woods, Digital Image Processing.
- Peters, Richard Alan, II, “Intro", Lectures on Image Processing, Vanderbilt University,
Nashville, TN, April 2008, Available on the web at the Internet Archive,
http://www.archive.org/details/Lectures_on_Image_Processing.
- Image Processing, Analysis and Machine Vision, Milan Sonka, Vaclav Hlavac, Roger
Boyle, Thomson, 2008.
- Matlab Image Processing Toolbox.
-http://www.scantips.com/basics09.html
-http://vimeo.com/videoschool/lesson/186/the-basics-of-image-resolution
-http://en.wikipedia.org/wiki/Display_resolution
-http://animoto.com/blog/news/hd-video-creation-sharing/

10/3/2022 71

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy