by rupesh shet , k.h.lai dr. eran edirisinghe

Agenda1. Introduction to ACCR 2. Cascade Correlation Neural Network3. Capturing the Drawing Style of a Caricaturist 4. Conclusion 5. Questions

Automated Caricature Creation

Observation:The understanding between the mapping of input and output which is not necessary.Able to capture the non-linear relationships

Now to do this we suggested to Use Neural Network

Formulization of IdeaExaggerating the Difference from the Mean (EDFM) which is widely accepted among caricaturists to be the driving factor behind caricature generation

Cascade Correlation Neural Network

Cascade Correlation Neural NetworkArtificial neural networks are the combination of artificial neurons

After testing and analysing various neural networks we found that the CCNN is the best for the application domain under consideration.The CCNN is a new architecture and is a generative, feed forward, supervised learning algorithm.

An artificial neural network (ANN) is composed neurons, connections between neurons and layer.

Connection weights determine an organizational topology for a network and allow neurons to send activation to each other.

NN TerminologyThere are three layer:Input layer the problem being presented to the network.

Output layer the networks response to the input problem.

Hidden layer perform essential intermediate computations. Input function is a linear component which computes the weighted sum of the units input values.

Activation function is a non-linear component which transforms the weighted sum in to final output value

CCNN AlgorithmCascade-Correlation (CC) combines two ideas:The first is the cascade architecture, in which hidden neuron are added only one at a time and do not change after they have been added. The second is the learning algorithm, which creates and installs the new hidden neurons. For each new hidden neuron, the algorithm tries to maximize the magnitude of the correlation between the new neurons output and the residual error signal of the network.

CCNN Algorithm

The algorithm is realized in the following way:CC starts with a minimal network consisting only of an input and an output layer but with no hidden neuron. Both layers are fully connected with an adjustable weight and bias input is permanently set to +1.

Train all the connections ending at an output neuron with a usual learning algorithm until the error of the network no longer decreases.

CCNN Algorithm

CCNN AlgorithmGenerate the so-called candidate neurons. Every candidate neurons is connected with all input neuron and with all existing hidden neuron. Between the pool of candidate neuron and the output neuron there are no weights.I+1biasInput unitIIIIIIVVAdd Hidden Unit 1Output Unit

CCNN AlgorithmTry to maximize the correlation between the activation of the candidate neuron and the residual error of the net by training all the links leading to a candidate neuron. Learning takes place with an ordinary learning algorithm. The training is stopped when the correlation scores no longer improves.

Choose the candidate neuron with the maximum correlation freeze its incoming weights and add it to the network. To change the candidate neuron into a hidden neuron, generate links between the selected neuron and all the output neuron. Since the weights leading to the new hidden neuron are frozen, a new permanent feature detector is obtained.

Loop back to step 2.

This algorithm is repeated until the overall error of the net fall below a given value

A trained NN with Cascade Correlation Algorithm

Advantages of CCNN In addition the CCNN has several other advantages namely: It learns very quickly and is at least ten times faster than traditional back-propagation algorithms. The network determines its own size and topology and retains the structure. It is useful for incremental learning in which new information is added to the already trained network.

The Proposed Methodology:To capture the drawing style of a caricaturist

The Proposed Methodology

Step 1:Generating Mean FaceGenerating Mean Face: For the purpose of our present research which is focused only on a proof of concept, the mean face (and thus the facial components) was hand drawn for experimental use and analysis. However, in a real system one could use one of the many excellent mean face generator programs made available in the World Wide Web

Step 2: Extraction Facial Component Extraction/Separation: To extract/separate various significant facial components such as, ears, eyes, nose and mouth from the original, mean and caricature facial images Many such algorithms and commercial software packages exists that could identify facial components from images/sketches.

Step 3: Creating Training Data SetsCreating Data Sets for Training the Neural Network: The original, mean and caricature images of the component under consideration are overlappedSubsequently using cross sectional lines centred at the above point and placed at equal angular separations.

Step 4: Tabulating Data SetsTabulating Data Sets: The higher the number of cross sectional lines that are used, the more accurate the captured shape would be. However for ease of experimentation, we have only used four cross sectional lines, which results in eight data sets

Step 5,6: NN Training & Setting NN Neural Network Training: we consider the data points obtained from the caricature image above to be the output training dataset of the neural network.

The data sets obtained from the original and mean images to formulate input training dataset of the neural network.

[This follows the widely accepted strategy used by the human brain to analyse a given facial image in comparison to a known mean facial image. ]

Setting up the Neural Network Parameters:

We propose the use of the following training parameters for a simple, fast and efficient training process.

Step 7: Testing

TestingOnce training has been successfully concluded as described above, the relevant facial component of a new original image is sampled and fed as input to the trained neural network along with the matching data from the corresponding mean component.

Experiments and Analysis

Experiment : 1 This experiment is design to investigate the CCNN is capable for predicting orientation and direction.

Experiment: 2 This experiment is designed to prove that it is able to accurately predict exaggeration in addition to the qualities tested under experiment 1

Experiment: 3 (Training) Training1 Training 2 Training 3 Training 5 Training 6 Training 7This experiment we test CCNN on a more complicated shape depicting a mouth (encloses lower and upper lips).

Experiment: 3 (Results) Result 1 Result 6 Result 7The results demonstrate that the successful training of the CCNN has resulted in its ability to accurately predict exaggeration of non-linear nature in all directions. Note:An increase in the amount of the training data set would result in an increase of the prediction accuracy for a new set of test data.

Conclusion In this research we have identified an important shortcoming of existing automatic caricature generation systems in that their inability to identify and act upon the unique drawing style of a given artist.

We have proposed a CCNN based approach to identify the drawing style of an artist by training the neural network on unique non-linear deformations made by an artist when producing caricature of individual facial objects.

The trained neural network has been subsequently used successfully to generate the caricature of the facial component automatically.

ConclusionThe above research is a part of a more advanced research project that is looking at fully automatic, realistic, caricature generation of complete facial figures. One major challenge faced by this project includes, non-linearities and unpredictabilities of deformations introduced in exaggerations done between different objects within the same facial figure, by the same artist. We are currently extending the work of this paper in combination with artificial intelligence technology to find an effective solution to the above problem.

References[1] Susan e Brennan Caricature generator: the dynamic exaggeration of faces by computer, LEONARDO, Vol. 18, No. 3, pp170-178, 1985 [2] Z. Mo, J.P.Lewis, and U. Neumann, Improved Automatic Caricature by Feature Normalization and Exaggeration, SIGGRAPH 2003 Sketches and Applications, San Diego, CA: ACM SIGGRAPH, July (2003).[3] P.J. Benson, D.I. Perrett. Synthesising Continuous-tone Caricatures, Image & Vision Computing, Vol 9, 1991, pp123-129.[4] H. Koshimizu, M. Tominaga, T. Fujiwara, K. Murakami. On Kansei Facial Caricaturing System PICASSO, Proceedings of IEEE International Conference on Systems, Man, and Cybernetics, 1999, pp294-299.[5] G. Rhodes, T. Tremewan. Averageness, Exaggeration and Facial Attractiveness, Psychological Science, Vol 7, pp105-110, 1996.[6] J.H. Langlois, L.A. Roggman, L. Mussleman. What Is Average and What Is Not Average About Attractive Faces, Psychological Science, Vol 5, pp214-220, 1994.

References[7] L. Redman. How to Draw Caricatures, McGraw-Hill Publishers, 1984.[8] Neural Network http://library.thinkquest.org/C007395/tqweb/index.html (Access date 13th Oct 2004)[9] The Maths Works Inc, Users Gui