Illuminance Color Independent in Remote Photoplethysmography for Pulse Rate Variability and Respiration Rate Measurement

Suryasari Suryasari - Universitas Multimedia Nusantara, Tangerang, Indonesia, 15810
Aminuddin Rizal - Politeknik Negeri Semarang, Jl. Prof. H. Soedarto, Semarang, Indonesia , 50275
Sri Kusumastuti - Politeknik Negeri Semarang, Jl. Prof. H. Soedarto, Semarang, Indonesia , 50275
Taufiqqurrachman Taufiqqurrachman - Badan Riset dan Inovasi Nasional, Bandung, Indonesia


Citation Format:



DOI: http://dx.doi.org/10.30630/joiv.7.3.1176

Abstract


Remote photoplethysmography (rPPG) is now becoming a new trend method to measure human physiological parameters. Especially due to it noncontact measurement which safe dan suitable to use in this new era condition. Pulse rate variability (PRV) and respiration rate (RR) included as parameters can be measured by using rPPG. PRV and RR are used to measure both physical and psychological wellness of the subject. However, current performance challenges in rPPG algorithm in measuring PRV and RR are illuminance invariant and motion. Especially in different light condition which represent real-life environment, signal-to-noise ratio (SNR) will be affected and directly reduce the measurement accuracy. Therefore in this study, we develop rPPG algorithm and then investigate the performance rPPG in different illuminance scenarios. We perform PRV and RR measurement under each scenario. On this study, for the pulse signal extraction, we were using algorithm is based on the modification of plane orthogonal-to-skin (POS) algorithm. While, for respiration signal extraction is done in CIE Lab color space. Our experimental results show the mean absolute error (MAE) of each measured parameters are 3.25 BPM and 2 BPM for PRV and RR respectively compared with clinical apparatus.  The proposed method proved to be more reliable to use in real environments measurement. However, limitation of our proposed algorithm is still running in offline mode, hence for the future we want try to make our algorithm run in real time.

Keywords


CIELab; Pulse Rate Variability (PRV); Plane-orthogonal-to-skin (POS); Remote Photoplethysmography; Respiration Rate

Full Text:

PDF

References


Passavanti M, Argentieri A, Barbieri DM, Lou B, Wijayaratna K, Foroutan Mirhosseini AS, Wang F, Naseri S, Qamhia I, Tangerås M, Pelliciari M, Ho CH, “The psychological impact of COVID-19 and restrictive measures in the world†J Affect Disord, 2021

Mar 15;283:36-51, doi: 10.1016/j.jad.2021.01.020

Prinsloo, Gabriell E., HG Laurie Rauch, and Wayne E. Derman, “A brief review and clinical application of heart rate variability biofeedback in sports, exercise, and rehabilitation medicine,†The Physician and

sportsmedicine, vol. 42, no. 2, pp. 88-99, 2014.

Dasari, A., Prakash, S.K.A., Jeni, L.A. et al., “Evaluation of biases in remote photoplethysmography methodsâ€, npj Digital Medicine, vol 4 paper number 91

(2021), https://doi.org/10.1038/s41746-021-00462-z

A. B. Hertzman and C. R. Spealman, “Observations on

the finger volume pulse recorded photoelectrically,â€

Amer. J. Physiol. Meas., vol. 119, pp. 334-335, 1937.

Schäfer A, Vagedes J., “How accurate is pulse rate variability as an estimate of heart rate variability? A review on stud‑ies comparing photoplethysmographic technology with an electrocardiogram.†Int J Cardiol.,

;166(1):15–29.

Melchor Rodríguez, Angel, and J. Ramos-Castro., “Video Pulse Rate Variability Analysis in Stationary and Motion Conditions.†BioMedical Engineering,

OnLine 17 (2018): 11. PMC. Web. 14 Aug. 2018.

W. Wang, A. C. den Brinker, S. Stuijk and G. de Haan, “Algorithmic Principles of Remote PPG,†IEEE Transactions on Biomedical Engineering, vol. 64, no.

, pp. 1479-1491, July 2017.

Y. -C. Chou, B. -Y. Ye, H. -R. Chen and Y. -H. Lin, "A Real-Time and Non-contact Pulse Rate Measurement System on Fitness Equipment," IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1-11, 2022, Art no. 5002711, doi:

1109/TIM.2021.3136173.

A. Rizal, K. Chiang, J. Lin and Y. Lin, "An SoC-Based System for Real-time Contactless Measurement of Human Vital Signs and Soft Biometrics," 2019 6th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), 2019, pp.

-59, doi: 10.23919/EECSI48112.2019.8976953.

D. Shao, Y. Yang, C. Liu, F. Tsow, H. Yu and N. Tao, “Noncontact Monitoring Breathing Pattern, Exhalation Flow Rate and Pulse Transit Time,†IEEE Transactions on Biomedical Engineering, vol. 61, no. 11, pp. 2760-

, Nov. 2014.

D. Shao et al., “Noncontact Monitoring of Blood

Oxygen Saturation Using Camera and Dual-

Wavelength Imaging System,†in IEEE Transactions on Biomedical Engineering, vol. 63, no. 6, June 2016.

Rizal, A. (2019)†Study: Pengukuran Saturasi Oksigen dengan Konsumer Grade RGB Kamera†Ultima

Computing : Jurnal Sistem Komputer, 11(1), 29-33. https://doi.org/https://doi.org/10.31937/sk.v11i1.1038

A. Rizal, Y. Lin and Y. Lin, "Contactless vital signs measurement for self-service healthcare kiosk in intelligent building," 2018 3rd International Conference on Intelligent Green Building and Smart

Grid (IGBSG), Yi-Lan, 2018, pp. 1-4.

F. Tabei, J. M. Gresham, B. Askarian, K. Jung and J.

W. Chong, "Cuff-Less Blood Pressure Monitoring System Using Smartphones," in IEEE Access, vol. 8, pp. 11534-11545, 2020, doi:

1109/ACCESS.2020.2965082.

K. Alghoul, S. Alharthi, H. Al Osman and A. El Saddik, “Heart Rate Variability Extraction From Videos Signals: ICA vs. EVM Comparison,†in IEEE Access,

vol. 5, pp. 4711-4719, 2017.

Yu SG, Kim SE, Kim NH, Suh KH, Lee EC. â€Pulse Rate Variability Analysis Using Remote Photoplethysmography Signals.†Sensors (Basel). 2021

Sep 17;21(18):6241. doi: 10.3390/s21186241. PMID: 34577448; PMCID: PMC8471146.

M. M. Shoushan, B. A. Reyes, A. R. M. Rodríguez and

J. W. Chong, "Contactless Monitoring of Heart Rate Variability During Respiratory Maneuvers," in IEEE Sensors Journal, vol. 22, no. 14, pp. 14563-14573, 15 July15, 2022, doi: 10.1109/JSEN.2022.3174779.

M. Poh, D. J. McDuff and R. W. Picard, "Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam," in IEEE Transactions on Biomedical Engineering, vol.

, no. 1, pp. 7-11, Jan. 2011.

Van Gastel, M., Stuijk, S., & de Haan, G. (2016). Robust respiration detection from remote photoplethysmography. Biomedical Optics Express,

(12), 4941–4957.

A Yang, Yuting et al. “Motion Robust Remote Photoplethysmography in CIELab Color Space.â€

Journal of Biomedical Optics. 2016;21(11):117001

S. Sanyal and K. K. Nundy, “Algorithms for Monitoring Heart Rate and Respiratory Rate From the Video of a User’s Face,†in IEEE Journal of Translational Engineering in Health and Medicine, vol.

, pp. 1-11, 2018.

M. Hulsbusch, “An image-based functional method for opto-electronic detection of skin-perfusion (in

German),†Ph.D. dissertation, RWTH Aachen, 2008.

M. van Gastel, S. Stuijk and G. de Haan, “Motion Robust Remote-PPG in Infrared,†in IEEE Transactions on Biomedical Engineering, vol. 62, no.

, pp. 1425-1433, May 2015.

Carlo Tomasi and Takeo Kanade. Detection and Tracking of Point Features. Carnegie Mellon

University Technical Report CMU-CS-91-132, April 1991.

X. Yu, T. Laurentius, C. Bollheimer, S. Leonhardt and

C. H. Antink, "Noncontact Monitoring of Heart Rate and Heart Rate Variability in Geriatric Patients Using Photoplethysmography Imaging," in IEEE Journal of Biomedical and Health Informatics, vol. 25, no. 5, pp. 1781-1792, May 2021, doi:

1109/JBHI.2020.3018394.

S. Sanyal and K. K. Nundy, "Algorithms for Monitoring Heart Rate and Respiratory Rate From the Video of a User’s Face," in IEEE Journal of Translational Engineering in Health and Medicine, vol.

, pp. 1-11, 2018, Art no. 2700111, doi:

1109/JTEHM.2018.2818687.

G. Bai, J. Huang and H. Liu, "Real-Time Robust Noncontact Heart Rate Monitoring With a Camera," in

IEEE Access, vol. 6, pp. 33682-33691, 2018, doi: 10.1109/ACCESS.2018.2837086.

J. Lin, M. Lu and Y. Lin, "A Contactless Healthcare System with Face Recognition," 2019 4th International Conference on Intelligent Green Building and Smart Grid (IGBSG), 2019, pp. 296-299, doi:

1109/IGBSG.2019.8886237.

Y. Lin and Y. Lin, "Step Count and Pulse Rate Detection Based on the Contactless Image Measurement Method," in IEEE Transactions on Multimedia, vol. 20, no. 8, pp. 2223-2231, Aug. 2018,

doi: 10.1109/TMM.2018.2790172.

S. Yu, Y. Lin and Y. Lin, "Contactless pulse rate measurement based on smart TV," 2017 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW), 2017, pp. 397-398, doi:

1109/ICCE-China.2017.7991163.

Lin, S.-T., Chen, W.-H., & Lin, Y.-H. â€A Pulse Rate Detection Method for Mouse Application Based on

Multi-PPG Sensorsâ€. Sensors, 17(7). 2017