Characterization of Human Balance Through a Reinforcement Learning-Based Muscle Controller

Details

• Journal Article:
  PLoS One
• Personal Author:
  Akbas, Kubra ; Mummolo, Carlotta ; Zhou, Xianlian
• Description:
  Objective characterization of human balance remains a challenge and clinical observation-based balance tests during physical rehabilitation are often affected by subjectivity. On the other hand, computational approaches mostly rely on center of pressure (COP) tracking and inverted pendulum models, which do not capture the multi-joint and muscle contributions to whole-body balance. This study proposes a novel musculoskeletal modeling and control methodology to investigate human balancing capabilities in the center of mass (COM) state space. A musculoskeletal model is integrated with a balance controller trained through reinforcement learning (RL) to explore the limits of dynamic balance during postural sway. The RL framework consists of two interlinked neural networks (balance recovery and muscle coordination) and is trained using Proximal Policy Optimization (PPO) under multiple training strategies. By exploring recovery from random initial COM states with a trained controller, a balance region (BR) is obtained that encloses successful state-space trajectories. Comparing BRs obtained from different trained controllers with the analytical postural stability limits of a linear inverted pendulum model, we observe a similar trend in COM balanced states, but reduced recoverable areas. Furthermore, the effects of muscle weakness and neural excitation delay on the BRs are investigated, revealing reduced balancing capability in the COM state space. The novel approach of determining regions of stability through learning muscular balance controllers provides a promising avenue for personalized balance assessments and objective quantification of balance capability in humans with different health conditions.
• Subjects:
  Biomechanical Phenomena Musculoskeletal System Occupational Health Safety
• Keywords:
  Motion studies; Biomechanics; Biomechanical modeling; Biomedical engineering; Musculoskeletal system
• Source:
  PLoS One 2025 Apr; 20(4):e0320211
• ISSN:
  1932-6203
• Document Type:
  Text
• Funding:
  Contract
• Genre:
  Journal Article
• Place as Subject:
  New Jersey ; New York City Region [OSHA]
• CIO:
  National Institute for Occupational Safety and Health (NIOSH)
• Topic:
  Workplace Safety & Health
• Location:
  North America
• Pages in Document:
  22 pdf pages
• Volume:
  20
• Issue:
  4
• NIOSHTIC Number:
  nn:20071224
• Contact Point Address:
  Xianlian Zhou, Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, New Jersey, United States of America
• Email:
  alexzhou@njit.edu
• Federal Fiscal Year:
  2025
• Performing Organization:
  New Jersey Institute of Technology
• Peer Reviewed:
  True
• Start Date:
  20200901
• End Date:
  20240630
• Collection(s):
  National Institute for Occupational Safety and Health
• Main Document Checksum:
  urn:sha-512:4606c1ba5e4a73b367592802d9a36d3bfc834d184d8f42d22df0fef186dc5a93d10119c6eeeb68ac082fcd61540531b207f1ab4f1e49b1a2743b6bbcc12ebeb1
• Download URL:
  https://stacks.cdc.gov/view/cdc/258703/cdc_258703_DS1.pdf
• File Type:
  [PDF - 2.13 MB ]