Open Access Paper
28 March 2023 Pattern recognition of gait signals using φ-OTDR
Fanran Meng, Wenxiang Zhang, Guo Zhu, Xian Zhou, Fei Liu
Author Affiliations +
Proceedings Volume 12601, SPIE-CLP Conference on Advanced Photonics 2022; 126010P (2023) https://doi.org/10.1117/12.2667092
Event: SPIE-CLP Conference on Advanced Photonics 2022, 2022, Online Only
Abstract
Gait recognition is of great significance in many fields such as human identity recognition, medical rehabilitation, remote monitoring, and so on. In this paper, the gait signal pattern recognition as well as the identity recognition is achieved through machine learning based on the data obtained by phase sensitive time-domain reflectometer ( φ - OTDR). The dynamic phase variation caused by the pedaling directly acting on the fiber was recorded. By extracting the temporal-spatial features of the recorded signal, the recognition accuracy of the two experimenters can be resolved as high as 90% via a convolutional neural network (CNN). It provides an effective solution for human identity identification in perimeter security applications using φ-OTDR.

1.

INTRODUCTION

As a new biometric recognition technology, gait recognition can not only realize the recognition of individual identity[1]-[3] according to people’s walking posture but also can be used to detect people’s physiological and pathological characteristics[4]-[6]. In the future, it can be expanded to the security inspection of banks, stations, and other places. Thus the investigation of gait pattern recognition is of great significance. Depending on the type of sensor, the gait recognition methods can be divided into the video method[7], the force sensor method[8], infrared method, and acoustic method. Alessandro Manzi et al.[9] described a clustering approach to gait recognition by extracting skeletal data from a depth camera that was unaffected by external problems. Zifeng Wu et al.[10] learned similarity by deep convolutional neural network(CNN). A deep neural network can be trained to recognize the most significant changes in a person’s gait pattern from a small group of flagged multi-angle videos of pedestrians walking, and thus identify a person. Alharthi et al.[11] developed a biometric verification system to measure human gait and walking patterns. As long as an individual walks on a floor pressure mat, the system can analyze the 3D shape of the pedal steps and time-based perception data and successfully identify personal information. However, the structures of these two methods are complex and require a lot of calculation.

The φ -OTDR system has advantages including simple structure, high sensitivity, low computing burden, long detection distance, and so on. It has been widely used in perimeter safety, pipeline safety alarm, and other fields to realize external environment monitoring such as strain, temperature, and vibration. Nian Fang et al.[12] proposed a recognition method of walking intrusion signals based on gait characteristics in φ-OTDR. By using the special step period characteristic included in the vibration signal caused by a walking intruder, the signal of human intrusion is easily distinguished from animals or other random disturbances. Shi et al.[13] proposed a deep learning-based multi-radial distance event classification method. The method can distinguish both event types and radial distances by extracting the temporal-spatial data matrix.

This paper proposes a gait pattern recognition method based on the φ-OTDR system. The phase space-time image is obtained by recording the phase change caused by the pedal signal of two people on the optical fiber. In this paper, the phase, amplitude, and temporal-spatial characteristic information in the phase temporal-spatial image are used to achieve 90% accuracy by the ResNet50 classification algorithm. The experimental results show that this method can effectively identify the identity information of different people, and preliminarily verify the feasibility of the gait recognition method based on φ-OTDR system. This method provides a reliable approach for identity identification with high privacy.

2.

EXPERIMENT AND DATASETS

2.1

Experimental setup and method

The structure of φ-OTDR is shown in Figure 1(a). The prototype φ-OTDR instrument in experiment is shown in Fig 1(b) with the detailed principle described in [14]-[16]. Ultra-narrow linewidth laser is used as light source. The position, amplitude, and phase of the disturbance signal can be obtained by the corresponding digital signal processing. We can extract the perturbation waveform applied on the whole sensing fiber with a specific spatial resolution. The optical fiber was arranged on the floor in U-shape. The dynamic phase variation caused by the pedaling directly acting around the fiber was recorded. The location of pedaling signal is determined by the difference of Raileigh-backscattering signal (RBS), and the waveform of pedaling is extracted by demodulating the phase variation of the RBS.

Figure 1.

Experimental setup and φ-OTDR miniaturization real-time monitoring system. (AOM, acoustic-optic modulator; EDFA, erbium-doped fiber amplifier; BPD, balanced photoelectric detector; DAQ, data acquisition card; FUT, fiber under test.)

00323_PSISDG12601_126010P_page_2_1.jpg

2.2

Datasets

In the field test, the developed φ-OTDR instrument was used, and the optical fiber length was 1km. The probe pulse width was 100 ns corresponding to a spatial resolution of 10 m, and the repetition period was 22 us. The frequency shift of AOM is 80 MHz and the sampling rate of DAQ is 200MS/s. The details of the two experimenters are shown in Table 1.

Table 1

Experimenters’ information.

ItemGenderHeight (cm)Weight (kg)
Walker 1Women15853
Walker 2man18070

The phase temporal-spatial image, obtained from the demodulated phase, can be used to locate the signal, select the interval of signal disturbance, and reduce the computation of data preprocessing. The time-domain waveforms of single step are presented in Figure 2. Figure 2(a), Figure 3(a) and Figure 4(a) demonstrate the pedaling waveform from the female experimenter, and (b) the male experimenter. Figure. 3 shows the temporal-spatial image of a single step waveform. The operation period of a pedal signal is about 0.8s. The continuous pedal phase temporal-spatial image is shown in Figure 4. The output signals have intermittent and periodic gait characteristics.

Figure 2.

Single step time domain waveform.

00323_PSISDG12601_126010P_page_3_1.jpg

Figure3.

Single step phase temporal-spatial image.

00323_PSISDG12601_126010P_page_3_2.jpg

Figure4.

Continuous pedal phase temporal-spatial image.

00323_PSISDG12601_126010P_page_3_3.jpg

3.

RESULTS AND ANALYSIS

Deep learning methods such as CNN can automatically learn the features of data sets and fit the optimal classification algorithm. Therefore, they are suitable for φ -OTDR event classification. In this paper, ResNet50 network is used as the recognition classifier. The ResNet50 architecture consists of 4 blocks containing 50 conv2d. The learning rate is set at 0.003. The batch size can be understood as a batch processing parameter, and its limit value is the total number of training set samples. In deep learning, the principle of small-batch data processing is generally adopted. Each batch size is composed of 32 images randomly selected from the training data. The loss curve oscillation is significantly reduced and the convergence speed is accelerated. The model trained a total of 100 epochs. The ratio of training set to verification set is 7:3. In addition, we used the original temporal-spatial image to train the model to verify the effect of temporal-spatial on classification accuracy. The resultant validation accuracy curves are shown in Figure. 5. During the training on temporal-spatial images, the best test accuracy is 91%. The training results are shown in Table 2. The recognition accuracy of the two experimenters can be resolved as high as 90% via a ResNet50. The recall rate and f1 score of the input temporal-spatial images are both above 90%, indicating that the model has a good recognition effect on the phase temporal-spatial characteristics of the pedaling signal. The experimental results show that the gait temporal-spatial characteristics based on the φ-OTDR system can be effectively recognized.

Figure5.

Classification accuracy curve.

00323_PSISDG12601_126010P_page_4_1.jpg

Table 2.

The training results of pedaling.

 Precisionrecallf1-score
Walker 189.09%91.21%90.38%
Walker 290.12%90.39%91.56%

4.

CONCLUSION

In this work, a gait recognition method based on φ -OTDR system is proposed. Different experimenters can be accurately identified by using the phase, amplitude, and temporal-spatial characteristics of the pedal signals. The feasibility of φ-OTDR system in gait recognition is verified in this work. The method has the advantages of non-contact, long distance, and good privacy, which can be used in privacy-sensitive scenes such as identity identification and family health monitoring.

REFERENCES

[1] 

Lu. J, G. Wang, and P. Moulin, “Human Identity and Gender Recognition From Gait Sequences With Arbitrary Walking Directions,” IEEE Transactions on Information Forensics & Security, 9 (1), 51 –61 (2014). https://doi.org/10.1109/TIFS.2013.2291969 Google Scholar

[2] 

W. Sheng and X. Li, “Multi-task learning for gait-based identity recognition and emotion recognition using attention enhanced temporal graph convolutional network,” Pattern Recognition, 114 107868 (2021). https://doi.org/10.1016/j.patcog.2021.107868 Google Scholar

[3] 

X. Qiao, Y. Feng, T. Shan, and R. Tao, “Person Identification With Low Training Sample Based on Micro-Doppler Signatures Separation,” in IEEE Sensors Journal, 22 (9), 8846 –8857 (2022). https://doi.org/10.1109/JSEN.2022.3162590 Google Scholar

[4] 

Ali Saad et al., “Detection of freezing of gait for Parkinson’s disease patients with multi-sensor device and Gaussian neural networks,” International Journal of Machine Learning and Cybernetics, (2017). https://doi.org/10.1007/s13042-015-0480-0 Google Scholar

[5] 

J. Skidmore and P. Artemiadis, “A comprehensive analysis of sen-sorimotor mechanisms of inter-leg coordination in gait using the variable stiffness treadmill: Physiological insights for improved robot-assisted gait therapy,” in 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR), 28 –33 (2019). Google Scholar

[6] 

H. Ma and W.-H. Liao, “Human gait modeling and analysis using a semi-Markov process with ground reaction forces,” IEEE Trans. Neural Syst. Rehabil. Eng, 25 (6), 597 –607 (2017). https://doi.org/10.1109/TNSRE.7333 Google Scholar

[7] 

A. Kale, A. N. Rajagopalan, N. Cuntoor and V. Kruger, “Gait-based recognition of humans using continuous HMMs,” in Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition, 336 –341 (2002). https://doi.org/10.1109/AFGR.2002.1004176. Google Scholar

[8] 

M Köhle, Merkl D., “Identification of gait patterns with self-organizing maps based on ground reaction force[C],” in European Symposium on Esann. DBLP, (1996). Google Scholar

[9] 

Manzi A, Fiorini L, Limosani R, et al., “Two-person activity recognition using skeleton data,” Iet Computer Vision 12.1, 27 –35 (2018). https://doi.org/10.1049/cvi2.v12.1 Google Scholar

[10] 

Z. Wu, Y. Huang, L. Wang, X. Wang and T. Tan, “A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs,” in IEEE Transactions on Pattern Analysis and Machine Intelligence, 39 (2), 209 –226 (2017). https://doi.org/10.1109/TPAMI.2016.2545669 Google Scholar

[11] 

A. S. Alharthi, A. J. Casson and K. B. Ozanyan, “Spatiotemporal Analysis by Deep Learning of Gait Signatures From Floor Sensors,” in IEEE Sensors Journal, 21 (15), 16904 –16914 (2021). https://doi.org/10.1109/JSEN.2021.3078336 Google Scholar

[12] 

Fang N, Wang L, Jia D, et al., “Walking Intrusion Signal Recognition Method for Fiber Fence System[J],” in Proceedings of SPIE - The International Society for Optical Engineering, 7634 (2009). Google Scholar

[13] 

Y. Shi, Y. Li, Y. Zhang, Z. Zhuang, and T. Jiang, “An Easy Access Method for Event Recognition of φ-OTDR Sensing System Based on Transfer Learning,” in Journal of Lightwave Technology, 39 (13), 4548 –4555 (2021). https://doi.org/10.1109/JLT.2021.3070583 Google Scholar

[14] 

J.-X. Chen, H.-P. Gong, and S.-Z. Jin, “Principle and research progress of fiber intrusion sensor system based on φ-OTDR,” J.Laser, 30 (6), 4 –6 (2009). https://doi.org/10.1364/FIO.2009.FTuB4 Google Scholar

[15] 

C. Li, Z. N-S, and K. Qian, “Overview on analysis and application of the distributed intrusion system detection based on φ-OTDR,” J. Sci. Technol. Vis., 2016 (9), 35 –36 (2016). Google Scholar

[16] 

T. F. B. Marie, Y. Bin, H. Dezhi and A. Bowen, “Principle and Application State of Fully Distributed Fiber Optic Vibration Detection Technology Based on Φ-OTDR: A Review,” in IEEE Sensors Journal, 21 (15), 16428 –16442 (2021). https://doi.org/10.1109/JSEN.2021.3081459 Google Scholar
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Fanran Meng, Wenxiang Zhang, Guo Zhu, Xian Zhou, and Fei Liu "Pattern recognition of gait signals using φ-OTDR", Proc. SPIE 12601, SPIE-CLP Conference on Advanced Photonics 2022, 126010P (28 March 2023); https://doi.org/10.1117/12.2667092
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Gait analysis

Pattern recognition

Education and training

Data acquisition

Optical fibers

Sensors

Vibration

Back to Top