Occasional Topics
EJAMJP2_Fig.1_Hamaoka_Nuclear_Exhibition_Center_in_Omaezaki-city,Shizuoka OTjapan JSM 7th Annual Conference at Omaezaki, Shizuoka
OTJP3_Fig5_Visiting_Onagawa_Nuclear_Power_Plants OTjapanReport on "Maintenance Science Summer School 2010"
EJAMOT_CN3_Figure1_The_outside_view_of_CEFR OTChinaPlanning and Consideration on SFR R&D Activities in China
< All Occasional Topics

ICMST-Kobe 2014
Nov 2(Sun) - 5(Wed), 2014
Kobe, Japan
Nuclear Regulation Authority Outline of the New Safety Standards for Light Water Reactors for Electric Power Generation
For Public Comment
Outline of New Safety Standard (Design Basis)
For Public Comment
New Safety Standards (SA) Outline (Draft)
For Public Comment
Outline of New Safety Standard(Earthquake and Tsunami)(DRAFT)

  Vol.5 No.4(Feb-25)
Vol.5 No.3(Nov-25)
Vol.5 No.2(Aug-26)
Vol.5 No.1(May-27)
< Other Issues

Featured Articles
EJAM5-3NT58 "Development of Future Prediction of Animation by coupling of Principle Component Analysis and Singular Spectrum Analysis"
EJAM5-3NT58 Validation of Multifrequency and Window-Multifrequency Techniques using Remote Field Eddy Currents for ISI of FBR Tubes
EJAM5-3NT59 Remote Controlled Robot with expandable features

(in English)

Vol.5 No.3 previousAA72-73 -NT 60 -61- 62
Vol.5, No.4, NT60
Development of Future Prediction of Animation by coupling of Principle Component Analysis and Singular Spectrum Analysis
Kazuyuki DEMACHI, Hiroshi SAKAKIBARA, Kazuma KAMIAKA, : Department of Nuclear Engineering and Management, School of Engineering, The University of Tokyo
animation, image, prediction, principle component analysis, singular spectrum analysis
1. Technical summary

3 - A

Recently, the animation analysis technology is evolving rapidly. As one of its reasons, the improvement of the computer performance for processing the picture image data which is mass data can be mentioned. Now, animation photography is so familiar to us that mobile phones and smart phones are equipped standardly with the video function. A surveillance camera is most diffused as practical use of an animation. Especially the tendency is remarkable in urban areas in advanced nations. The main purpose of the surveillance camera is prevention of criminal acts, or their recording as the proof. As further advance, the future prediction of the animation photoed with the surveillance camera will be more effective for the prevention of the criminal acts.

In this research, the prediction technique of the future of the animation was developed by coupling the principal image extraction by Principal Component Analysis (PCA)[1] and the time-series data prediction by the Singular Spectrum Analysis (SSA) [2,3].

An animation is constituted by many still images which interchange by a time series. A still image in a certain time step is set to I (t). Each I (t) is a 2-dimensional array of pixel values of the equal number to the pixel count of an image. In PCA, the images I(1)~ I(N) are rearranged into 1-dimensional arrays X (1) ~ X(N) and combined to a matrix Y (see Fig. 1). The eigen analysis of YYt, which is the autocorrelation matrix of Y, gives the eigen vectors Vi (i =1 ~ N) that correspond to the principal images of the movie.

Development of Future Prediction of Animation by coupling of Principle Component Analysis and Singular Spectrum Analysis

Fig.1 Combination of 1-dimentionaly rearranged N images of a movie

Here, we assumed that the I(t) can be separated to the time-dependent coefficients ai(t) (i =1 ~ r, t = 1 ~ N) and the time-constant principle images Vi (i =1 ~ N) . Then, X(t) can be represented by eq. (1),

where L is a number smaller than N, and the condition of eigen vectors: is used for eq. (2) . If the future of time-dependent coefficients ai(t) (i =1 ~ L, t = 1 ~ N) can be predicted, its substitution to eq. (1) makes the predicted future of the movie : I(N+k) (k=1,2,3,…).

Development of Future Prediction of Animation by coupling of Principle Component Analysis and Singular Spectrum Analysis

Fig.2 Known and predicted coefficients a(t)

The Singular Spectrum Analysis (SSA) was used to predict the future of the time-series data ai(t) (i =1 ~ L, t = 1 ~ N). In SSA, as shown in Fig. 2, the vectors gi,1, gi,2, …, gi,N-M+1 are derived from the known ai(t) as,

The eigen vectors ui,k of the autocorrelation matrix ZZT, where Z = [gi,1 gi,2 … gi,N-M+1] for each i are the R eigen vectors u1, … , uR of the largest R eigen values are arranged horizontally as

The predicted coefficient ai(N+1) at the future time step t = N+1 can be obtained as the first component of the vector gi,N-M+2 which satisfies the following equation (4),

By repeating the above calculation, the coefficients ai(N+2), ai(N+3), ai(N+4), … can be calculated to make the future of the movie : I(N+1), I(N+2), I(N+3), I(N+4), … .

Fig. 3 shows the prediction simulation result of the animation by the Karman’s vortex calculation. The left is the original animation, the center is the prediction simulation result, and the right is the error of them. Little error were seen and it was shown that the animation prediction by this technique can be carrying out with sufficient accuracy.
Fig. 4 shows the prediction simulation result of a hand opening and closing. Little error is seen like prediction of the Karman’s vortex animation. Thus, the animation’s future prediction was succeeded with this technique also about the photoed animation.

The latest version of Adobe Flash Player is required to show this content.

Adobe Flash Player を取得

Fig. 3 Movie of prediction of the Karman’s vortex animation

This technique is expected for various applications, such as the criminal prevention with the surveillance camera, and the accident prevention with the in-vehicle camera. From now on, improvement of this technique will be continued aiming at the further accuracy improvement and the expansion of applicable fields.

The latest version of Adobe Flash Player is required to show this content.

Adobe Flash Player を取得

Fig. 4 Animation prediction results of a hand opening and closing
( left: original animation, center: prediction, right : error )

2. Development Phase

Phase 1:Research and Development Phase

3. Scope
  1. (1) Components: Every visible component
  1. (2) Location: Anywhere
  1. (3) Material: Anything
  1. (4) Condition: In the atmosphere
4. Features
  1. (1)A new technique was developed to predict future of animation
  1. (2)The Principal Component Analysis (PCA) is applied for the extraction of principle images of the animation.
  1. (3)The Singular Spectrum Analysis (SSA) was applied for the prediction of the time-series data prediction.
5. Examples of Application
  1. (2)Security Camera

6. Reference
  1. [1]M. Turk and A. Pentland, “Eigenfaces for Recognition”, Journal of Cognitive Neuro- science, Vol.3, NO.1, pp.71-86,(1991)
  2. [2]R. Vartard and M. Ghil,”Singular spectrum analysis in nonlinear dynamics, with applications to paleoclimatic time series,” Physica D, 35, pp.395-424,(1989).
  3. [3]M. Ghil, M. R. Allen, M. D. Dettinger, K. Ide, D. Kondrashov, M. E. Mann, et al., "Advanced spectral methods for climatic time series," Reviews of Geophysics, vol. 40, Aug-Sep 2002.
7. Contact

Japan Society of Maintenology (