|
|
|
THEORETICAL N EUROSCIENCE:
The signal that describes the
irradiance at the photorreceptors (the input vector, a) undergoes a set of transforms as the signal
travels from the retina to the cortex. The aim of theoretical visual neuroscience is to propose computational models of this
image representation and deriving them from fundamental principles such
as the Barlow efficient encoding idea
. [Barlow01 ]
In most cases, our contributions in
this field have been related to technical questions to clarify the
formulation available in the literature [ Malo94
, Buades95 , Malo97a ]. Note that this is not a
trivial issue since many times the empirically derived models are very
poorly formulated. However, recently [ Malo06b ], this technical
background let us to obtain a more fundamental result: a new evidence that
the original Barlow efficient encoding idea not only accounts for the
linear part of the model (T and F), but also for the
non-linearities R. PUBLICATIONS
|
|
|
MEASURING D ISTANCES BETWEEN IMAGES The perception of distortions
added to a particular image depends on the nature of the noise and the
nature of the original image. In the example below, random signals of
the same energy but different frequency content are added on top of a
natural image and a synthetic image with different contrast. Note that
in each case the frequency content of the noise matches the frequency
of a particular patch of the synthetic image.
Basic perceptual facts:
Our contribution in this field is providing a Riemannian formulation of the perceptual geometry of the image space [Pons99 , Epifanio03 , Malo04a , Laparra10a]. Specifically, assuming a quadratic pooling of the distortion in each coefficient, the perceptual distance, d, between an original image, a , and its distorted version a+ Da , is:
where, the (Riemannian) perceptual metric matrix, Wa(a), depends on the transforms of the image in the retina-to-cortex model described above :
This way of computing the distances (together with the appropriate vision model for T, F and R) reproduces the basic perceptual facts described above. In the example below, the distances of the above distorted images (low contrast pattern, natural image, high contrast pattern) have been computed using the above framework with wavelet transform (for T), CSF (for F) and divisive normalization (for R).
In our
work for the Video Quality Experts Group ( VQEG ), we have applied
similar ideas to video quality assessment [ Watson02 ] analyzing what parameter
of the model is more relevant to accurately reproduce the subjective
opinion of observers. PUBLICATIONS
SOFTWARE FOR IMAGE QUALITY
ASSESSMENT
|
|
|
HUMAN O PTICS CHARACTERIZATION Back in 1994, Jesús Malo was the winner of the European Vistakon Research because of his project for an accurate evaluation of the optical quality of disposable contact lenses. However, not very interested in human eye optics , Jesús only worked in the first double-pass experiment carried out in Valencia by 1995/96 [Lorente97 ]. The aim of the double-pass method [Santamaria87] is obtaining the Modulation Transfer Function (MTF) of the human eye from the image of a spot projected in the retina of the observer. The experimental set up is described in the figure below:
Below, the typical outcome of the above system: (a) the image of the recordered spot, and (b) the corresponding MTF (with axis in cycl/deg)
During 1995/96 we carried out a study of the MTF of the human eye over a long period of time to quantify the standard fluctuations of the retinal image quality. We evaluated an MTF-based merit function on normal observers three times a day during a month. The standard deviation of these fluctuations (5%) can be chosen as an appropriate description of the behaviour of the average viewer. We used this result to study the behaviour of a time-variying compensation element: a disposable contact lens. The study of the eye + disposable contact lens system was carried out with four types of disposable contact lenses for one month. In spite of their general good behaviour, statistically significant differences from the standard pattern can be observed. This superimposed continuous fluctuation can be due to lens-dependent processes [ Lorente97 ]. Unfortunately, physiological
optics is not one of the current interests of (VI (S)TA). For more information about the double-pass
method implementation and results in our university, please contact Dr. A.M. Pons or Dr. A. Lorente
(Dept. d'Òptica, Universitat de València). PUBLICATIONS
|
|
|
|