A survey on robotic devices for upper limb rehabilitation

1An individual’s capacity to move is necessary to perform basic activities of daily living (ADL). Movement disorders significantly reduce a patient’s quality of life. Disorders of the upper extremities specifically limit the independence of affected subjects. Fortunately, there are various approaches to restore the functionality of the upper extremity, e.g., orthoses, functional electrical stimulation, and physical therapy. Positive outcome of physical rehabilitation, in the case of neurologically based disorders, depends heavily on: onset, duration, intensity and task-orientation of the training, as well as the patient’s health condition, attention and effort. Intense repetitions of coordinated motor activities constitute a significant burden for the therapists assisting patients. In addition and due to economical reasons, the duration of primary rehabilitation is getting shorter and shorter. These problems will probably exacerbate in the future as life expectancy continues to increase accompanied by the prevalence of both moderate and severe motor disabilities in the elderly population and consequently increasing their need of physical assistance. To counteract these problems, prevailing research studies present a wide variety of devices specifically assisting physical rehabilitation. Robotic devices with the ability to perform repetitive tasks on patients are among these technically advanced devices. In fact, robotic devices are already used in clinical practice as well as clinical evaluation. However, considering the number of devices described in the literature, so far only a few of them have succeeded to target the subject group — for more details see Table 1. Furthermore, it seems that the outcome of the use of devices already in clinical practice is not as positive as expected. New solutions are being considered. Most of the literature reviews on robotic devices for upper extremity rehabilitation (e.g.) concentrate on devices that have already undergone clinical evaluation. Gopura and Kiguchi compared the mechanical design of selected robotic devices for upper extremity rehabilitation. However, no other publication presents a summary of different robotic solutions for upper extremity rehabilitation, including those being in the development phase. An assessment of different technical solutions would provide developers of robotic devices for upper limb rehabilitation an evaluation of solutions that have already been considered, and thus learn from successes as well as shortfalls from other research teams. Hence, a comparison of various robotic devices would facilitate the development of new and improved devices for robotic upper limb rehabilitation. The aim of this paper is to summarize existing technical solutions for physical therapy of the upper limb.

2The survey of robotic devices is comprised of advanced technology systems. As defined in this report, the design of advance technology systems includes sensors, actuators, and control units; purely mechanical solutions are excluded from this survey. Although the research team made an effort to identify as many systems as possible, it is reasonable to acknowledge that many systems are left unmentioned. Nevertheless, this documentation is intended to be a valuable source of information for engineers, scientists and physiotherapists working on new solutions for physical rehabilitation.

3At the outset, the research team identified literature associated with the subject matter based on searches in PubMed, the Institute of Electrical and Electronics Engineers (IEEE), Science Direct and Google Scholar databases using various combinations of the following keywords: upper extremity, arm, hand, rehabilitation, therapy, training, movement, motion, assistance, support, robot, robotized, robotic, mechatronic, and motorized. Additionally, referenced literature from the selected publications was included in the survey as well. The information obtained from this literature compendium is supplemented with the data acquired from professional caregivers and manufacturers’ catalogs and websites, as well as direct communications with rehabilitation professionals, manufacturers and patients. Over 120 systems are summarized and compared in Table 1; this tabulated summary constitutes the reference for information provided in subsequent sections. As previously mentioned, the scope of this report is generally limited to the devices that support or retrain movement or manipulation abilities of disabled individuals. This survey excludes systems developed for movement assessment, occupational purposes or boosting physical abilities of healthy people. We however considered some academic, not yet specialized systems, supporting upper-extremity movements, especially if they have potential to be used for rehabilitation purposes (e.g. CADEN-7). This survey also excludes devices that substitute movements of the disabled extremity but do not replace the movement itself (e.g. wheelchair mounted manipulators or autonomous robots). Although these devices improve the patient’s quality of life, they differ significantly from systems described in this survey and constitute a separate category of devices. Some companies (e.g. CSMi Computer Sports Medicine, Inc.; Biodex Medical Systems, Inc.; BTE Technologies, Inc.) manufacture sensorized equipment for rehabilitation of various joints and muscles and whose principle of operation often resembles that of exercising devices found at fitness centers. Those devices are used mainly to strengthen muscles and joints and provide some predefined resistance (e.g. isotonic, isometric or isokinetic exercises) or active force (e.g. continuous passive motion exercises). These devices also constitute a different category from the systems included in this survey because their functions are performed along a predefined operation pathway. Although difficult to clearly identify, the aforementioned were also excluded from this review.

4Throughout this report, the term “number of degrees of freedom (DOF)” describes the sum of all independent movements (i.e. displacements or rotations) that can be performed in all the joints of the device. The number of DOF is defined in order to determine the exact position and orientation of all segments of the device. Also, some sections in this report are supplemented by an explanation of the most important terminology for readers who are not familiar with the technical vocabulary.

5A description of the specific field of application for upper limb rehabilitation devices often determines solutions for which the device itself may be applied. Upper-extremity rehabilitation involves actions that stimulate patients’ independence and quality of life. Two main application fields of robotic devices stand out: support to perform some ADLs (e.g. by power assistance or tremor suppression) and providing physical training (therapy). Although there is a significant need for powered devices supporting basic ADL at home, there are only a few of such devices proposed so far (see sixth column in Table 1). This is mainly due to technical and economical restrictions. Such devices should significantly improve the lives of their users, otherwise patients become dissatisfied and discontinue their use shortly after. They should be also safe, easily to handle and inexpensive. Portability is also often expected from devices assisting patients to perform basic ADL; in such cases the amount of available energy is limited by the capacity to store energy. Furthermore, if the device is supposed to support movements of multiple joints, the number of needed actuators increases as well as the weight of the device. Therefore, the number of portable actuated devices supporting upper extremity movements is typically low. Instead, purely mechanical solutions are used for that purpose. A few examples of portable powered devices for upper extremity assistance used in daily living are PowerGrip system (Broaden Horizons, Inc., USA) and a system proposed by Hasegawa, et al. (both for grasp assistance), as well as WOTAS orthosis and a system proposed by Loureiro, et al. (both for tremor suppression). However, portability is not always necessary. Often, especially after a stroke or a spinal cord injury, disorders of the upper extremity are accompanied by lower extremity disabilities. These scenarios are typically characterized by immobilized conditions and require a wheelchair. Therefore, many systems assisting upper limb movements are installed close to the patient (e.g. modular wheelchair-mounted system MUNDUS).

6Another group of the robotic devices used for rehabilitation purposes, much bigger than the group of devices supporting basic ADLs, constitute devices providing physical therapy. These may be designed for either specialized therapeutic institutes or home-based conditions. A vast majority of these devices may be used only at therapeutic institutes since they require supervised assistance from qualified personnel. Their price is often prohibitive for personal use due to their complexity. The patient demand for home-based therapy is expected to increase. Along this context, the concept of the Gloreha system (Idrogenet srl) is provided in two versions: (1) a more complex and more adaptable professional version intended for use at hospitals and rehabilitation centers and (2) a simplified low-cost version intended for patient use at home. However, according to Dijkers, et al., many therapists may stop using devices if set-up takes more than 5 minutes. Thus new developed devices for physical training should be intuitive, easy and fast to set-up and have a reasonable price.

7Stroke is the most common cause among diseases and injuries for upper limb movement disorders. It is estimated that by 2030, stroke will be the fourth leading cause of reduced disability-adjusted life-years (DALY) in western countries. DALY takes into account years of life lost due to premature death as wells as years of life lived in less than full health. Other causes include traumatic brain injury, spinal cord injury and injuries to motoneurons, as well as certain neurological diseases such as multiple sclerosis, cerebral palsy, Guillain-Barre syndrome, essential tremor and Parkinson’s disease. Currently proposed robotic systems for upper limb rehabilitation are typically tested on stroke patients. Only a fraction of these systems are investigated on subjects suffering from other diseases (see last column of Table 1).

8The most important terminology introduced in this section is explained in Table 2. Devices for upper limb rehabilitation may provide different types of motion assistance: active, passive, haptic and coaching. Active devices provide active motion assistance and possess at least one actuator, thus they are able to produce movement of the upper-extremity. Most of the devices discussed in this survey are active (see Table 1). Such assistance of movements is required if patient is too weak to perform specific exercises. However, even with active devices, an exercise is considered passive when a patient’s effort is not required. For example, devices providing continuous passive motion exercises are active, but those exercises are categorized as passive because the subject remains inactive while the device actively moves the joint through a controlled range of motion. It is not necessary to apply active assistance to resist patient’s movement, to increase patient’s force or to ensure the patient is following the desired trajectory. Instead, passive devices may be applied that are equipped with actuators providing resistive force only (i.e. brakes). Such actuators consume less energy and are cheaper than the heavier actuators for active assistance. Devices using only resistive actuators include both devices for physical therapy, e.g. MEM-MRB and PLEMO, and systems for tremor suppression, e.g. WOTAS orthosis and a system proposed by Loureiro, et al..

9Haptic devices constitute another group of systems interacting with the user through the sense of touch. Haptic devices are similarly classified as either active or passive, depending on their type of actuator. In this report, haptic devices are independently categorized because their main function is not to cause or resist movement but rather to provide tactile sensation to the user. Other non-actuated devices for upper limb rehabilitation do not generate any forces but provide different feedback. These systems are labeled coaching devices throughout this report. Because coaching devices are sensorized, they serve as input interface for interaction with therapeutic games in virtual reality (VR) (e.g. T-WREX, ArmeoSpring from Hocoma AG) or for telerehabilitation (i.e. remotely supervised therapy). Coaching systems using video-based motion recognition (e.g. Microsoft Kinect) would also belong to this category if it were not for their lack of any mechanical part in contact with the patient. Therefore, these systems will not be further discussed in this survey.

10Passive and non-actuated systems are less complex, safer and cheaper than their active counterparts. However, they are often modified in the development process with more active characteristics. Still, the main characteristic that identifies a non-actuated or passive device is the lack of the ability to perform movement; they may be an option for continuation of the rehabilitation process, rather than for training of people with significant movement disorders at an early stage of rehabilitation.

11The most important terminology introduced in this section is explained in Table 3. When comparing the mechanical structure of robotic devices for movement rehabilitation often two categories of devices are considered: end-effector-based and exoskeleton-based. The difference between the two categories is how the movement is transferred from the device to the patient’s upper extremity. End-effector-based devices contact the patient’s limb only at its most distal part that is attached to patient’s upper extremity (i.e. end effector). Movements of the end effector change the position of the upper limb to which it is attached. However, segments of the upper extremity create a mechanical chain. Thus, movements of the end effector also indirectly change the position of other segments of the patient’s body as well. Compared to end effectors, exoskeleton-based devices have a mechanical structure that mirrors the skeletal structure of patient’s limb. Therefore movement in the particular joint of the device directly produces a movement of the specific joint of the limb.

12The advantage of the end-effector-based systems is their simpler structure and thus less complicated control algorithms. However, it is difficult to isolate specific movements of a particular joint because these systems produce complex movements. The manipulator allows up to six unique movements (i.e. 3 rotations and 3 translations). Control of the movements of the patients upper limb is possible only if the sum of possible anatomical movements of patient arm in all assisted joints is limited to six. Increasing the number of defined movements for the same position of the end-point of the manipulator results in redundant configurations of the patient’s arm, thus inducing risk of injuries and complicated control algorithms.

13The typical end-effector-based systems include serial manipulators (e.g. MIT Manus - Figure 1B, ACRE), parallel (e.g. CRAMER and a system proposed by Takaiwa and Noritsugu, both for wrist rehabilitation), and cable-driven robots (e.g. NeReBot - Figure 1C, MACARM). The mechanical structure of HandCARE may be also recognized as the series of end-effector-based cable-driven robots, each of which induce movement of one finger. In this system a clutch system allows independent movement of each finger using only one actuator.

14Application of the exoskeleton-based approach allows for independent and concurrent control of particular movement of patient’s arm in many joints, even if the overall number of assisted movements is higher than six. However, in order to avoid patient injury, it is necessary to adjust lengths of particular segments of the manipulator to the lengths of the segments of the patient arm. Therefore setting-up such device for a particular patient, especially if the device has many segments, may take a significant amount of time. Furthermore, the position of the center of rotation of many joints of human body, especially of the shoulder complex, may change significantly during movement. Special mechanisms are necessary to ensure patient safety and comfort when an exoskeleton-based robot assists the movements of these joints. For this reason, the mechanical and control algorithm complexity of such devices is usually significantly higher than of the end-effector-based devices. The complexity escalates as the number of DOF increases.

15In case of systems for the rehabilitation of the whole limb the number of DOF reaches nine (ESTEC exoskeleton) or ten (IntelliArm). Some systems for fingers or hand rehabilitation have an even higher number of DOF. Examples include the system proposed by Hasegawa, et al. with eleven DOF and the hand exoskeleton developed at the Technical University (TU) of Berlin with twenty DOF. Even at such a high number of DOF some of these devices still remain wearable (i.e. the user is able to walk within a limited area due to connections to power source and control unit, e.g. ESTEC and hand exoskeleton developed at the TU Berlin) or portable (i.e. the area within which the user may walk is not limited, e.g. the system proposed by Hasegawa).

16Apart from purely exoskeleton- or end-effector-based devices, there are many systems combining a few approaches. In the ArmeoSpring system (Hocoma AG) for example, only the distal part – comprising the elbow, forearm and wrist – is designed as an exoskeleton. Therefore the limb posture is statically fully determined (as in exoskeleton-based systems) and the shoulder joint is not constrained, allowing easy individual system adaptation to different patients. A similar concept was applied in Biomimetic Orthosis for the Neurorehabilitation of the Elbow and Shoulder – BONES. In that case, a parallel robot consisting of passive sliding rods pivoting with respect to a fixed frame provides shoulder movements. Such application of sliding rods allows internal/external rotation of the arm without any circular bearing element. The distal part allowing for flexing/extending the elbow resembles the exoskeleton structure. In the MIME-RiceWrist rehabilitation system the end-effector-based MIME system for shoulder and elbow rehabilitation is integrated with the parallel wrist mechanism used in the MAHI exoskeleton (known as RiceWrist).

17Another example is the 6 DOF Gentle/S system allowing for relatively large reaching movements (three actuated DOF of the end-effector-based commercial haptic interface HapticMaster, Moog in the Netherlands BV) and arbitrary positioning of the hand (connection mechanism with three passive DOF). The Gentle/S system was further supplemented with a three-active-DOF hand exoskeleton to allow grasp and release movements. This new nine DOF system is known as Gentle/G.

18The HEnRiE is a similar system based on the Gentle/S system. In addition to the three active DOF of HapticMaster, HEnRiE includes a connection mechanism with two passive DOF for positioning of the hand and grasping device (two parallelogram mechanisms allowing parallel opening and closing of fingers attachments) with only one active DOF.

19Some systems combine more than one robot at the same time. This approach may be considered as the combination of end-effector-approach, where only the most distal parts of robots are attached to the patient’s upper limb, with the exoskeleton-based approach, where movements of few segments are directly controlled at the same time. Use of two robots to control the movements of the limb may allow for mimicking the operations performed by therapist using two hands. Examples of systems using two-robot-concept include REHAROB (using two six-DOF manipulators), iPAM and UMH (both having six DOF in total). Researchers at the University of Twente, in Enschede, Netherlands, made an attempt to use two HapticMaster systems to provide coordinated bilateral arm training, but limitations in hardware and software caused the virtual exercise to behave differently to the real-life. In some cases industrial robots have also been used. The REHAROB uses IRB 140 and IRB 1400H from ABB Ltd., while MIME uses PUMA 560 robot. In general, industrial robots reduce costs; however, such robots have significantly higher impedance than the human upper limb and, according to Krebs, et al., should not be in close physical contact with patients. Therefore most of the robots used for the rehabilitation of the upper limb are designed with a low intrinsic impedance. Some of those devices are also back drivable (e.g. HWARD and RehabExos), meaning that the patient’s force is able to cause movement of those devices when they are in passive state. Back-drivability further increases safety of the patient because the device does not constrain patient movements. It also allows for using the device as an assessment tool to measure patient’s range of motion.

20The majority of the devices presented in Table 1 allow movements in three dimensions; however there are also planar robots, i.e., systems allowing movements only on a specified plane (e.g. MEMOS and PLEMO). Also the MIT Manus system initially allowed movements only on one plane. Subsequently, an anti-gravity module added possibility to perform vertical movements (Figure 1B). Designing the device as a planar robot reduces the range of movements that can be exercised for particular joint. It also reduces the cost of the device. Furthermore, when the working plane is well selected, the range of training motion may suffice in most of therapeutic scenarios. Some of such planar devices allow changes in the working space between horizontal and vertical (Braccio di Ferro) or even almost freely selecting the working plane (e.g. PLEMO and Hybrid-PLEMO). It further increases the range of possible exercise scenarios while keeping the cost of the device at a minimum.

21In the ARM Guide (Figure 1A) and ARC-MIME systems, with which patients practice reaching movements, the working space is limited to linear movements because the forearm typically follows a straight-line trajectory. However the orientation of the slide that assists forearm movements can be adjusted to reach multiple workspace regions and fit different scenarios.

22Modularity and reconfigurability are concepts that could reduce therapy costs by adopting therapeutic devices for various disabilities or stages in patient recovery. However there are still only a few systems using these concepts. For example, InMotion ARM robot (the commercial version of MIT Manus, previously called InMotion 2.0) from Interactive Motion Technologies, Inc., may be extended by InMotion WRIST robot (previously InMotion 3.0), developed at MIT as a stand-alone system, and InMotion HAND add-on module (previously InMotion 5.0) for grasp and release training. Another example of modular system is MUNDUS, consisting of various modules that may be included depending on the patient condition, starting from muscle weakness to complete lost of residual muscle function. For example as command input residual voluntary muscular activation, head/eye motion, or brain signals may be used. However, this system’s complexity might make commercialization of the device very difficult.

23A very interesting solution was implemented in the Universal Haptic Drive (UHD). It has only two DOF and, depending on the chosen configuration, it can train either shoulder and elbow during reaching tasks or forearm (flexion/extension) and wrist. For the latter setting option, it is also possible to select a flexion/extension or pronation/supination training for the wrist. See Figure 2 for an explanation of anatomical terms used for description of upper limb motion.

24The most important terminology introduced in this section is explained in Table 4. Traditionally, energy to the actuators is provided in three forms: electric current, hydraulic fluid or pneumatic pressure. The selection of the energy source determines the type of actuators used in the system. Most of the devices for upper extremity rehabilitation use electric actuators but there are also other systems with pneumatic and hydraulic actuators. The electric actuators are most common because of their ease to provide and store electrical energy as well as their relatively higher power. Various types and sizes of electrical motors and servomotors are currently commercially available. Some authors (e.g. Caldwell and Tsagarakis) argue that electric actuators are too heavy, compared to their pneumatic counterparts, and their impedance is too high to be used in rehabilitation applications. However, the relatively high power-to-weight ratio of pneumatic actuators is achieved by neglecting the weight of the power source. Adding an elastic element in series with the actuator may also mitigate the high impedance of electric motors. This concept lead to the development of the so called Series Elastic Actuators (SEAs). SEAs decrease inertia and user interface impedance to provide an accurate and stable force control, thus increasing the safety of the patient. The disadvantage of application with an elastic element is the lower functional bandwidth. Still, the field of rehabilitation does not usually require high bandwidths. SEAs with electric motors are investigated in MARIONET and UHD systems, as well as in systems proposed by Vanderniepen, et al. (referred to as MACCEPA actuators) and Rosati, et al..

25A few systems use pneumatic actuators. Pneumatic actuators are lighter and have lower inherent impedance than the electric counterparts. Because such actuators require pneumatic pressure, the system is generally either stationary (e.g. Pneu-WREX), its service area is limited (e.g. ASSIST) or the compressor is installed on the patient’s wheelchair (e.g. system proposed by Lucas, et al.). Special type of pneumatic actuators, called Pneumatic Artificial Muscles (PAMs), Pneumatic Muscle Actuators or McKibben type actuators are often used in rehabilitation robotics (e.g. Salford Arm Rehabilitation Exoskeleton or system proposed by Kobayashi and Nozaki). Such actuators consist of an internal bladder surrounded by braided mesh shell with flexible, but non-extensible, threads. When the bladder is pressurized, the actuator increases its diameter and shortens according to its volume, thus providing tension at its ends. Due to such physical configuration, PAMs’ weight is generally light compared to other actuators, but also have slow and non-linear dynamic response (especially large PAMs), in consequence they are not practical for clinical rehabilitation scenarios. In addition, at least two actuators are necessary in order to provide antagonistic movements due to the unidirectional contracting. The ASSIST system has a special type of PAM with rotary pneumatic actuators that allows bending movements.

26A total of four systems using hydraulic actuators were identified in this survey. All four of them are not standard and use actuators developed specially for that purpose. Reasons to evade industrial hydraulic actuators include weight, impedance, fluid leakages and difficulties to provide fluid. Large, noisy systems are usually necessary for that purpose. Mono-and bi-articular types of Hydraulic Bilateral Servo Actuators (HBSAs) are used in the wheelchair-mounted exoskeleton proposed by Umemura, et al.. Miniaturized and flexible fluidic actuators (FFA) were applied in the elbow orthosis proposed by Pylatiuk, et al.. Hydraulic SEAs are used in two other systems: the Dampace system is equipped with powered hydraulic disk brakes; the Limpact system, developed by the same group, uses an active rotational Hydro-Elastic Actuator (rHEA).

27In passive systems, it is often desired to modify the amount of resistance during the exercise. This modification increases the resistance when the patient departs from the desired trajectory or to provide haptic feedback for VR interactions. In existing systems, different solutions for provision of adjustable resistive force have been implemented. Powered hydraulic brakes, for example, controlled by electromotors in a SEA are used in Dampace system. Magnetic particle brakes are used in ARM Guide (Figure 1A), in its successor ARC-MIME to resist other than longitudinal movements of the forearm, and in the device for training of multi-finger twist motion proposed by Scherer, et al.. A few groups have also investigated the application of brakes incorporating magnetorheological (MRF brakes) and electrorheological fluids (ERF brakes). These fluids change their rheological properties (i.e. viscosity) depending on the applied magnetic or electric field, respectively. Thanks to those properties it is possible to achieve brakes with high-performance (with rapid and repeatable brake torque). MRF brakes are used in MRAGES and MEM-MRB systems. ERF brakes are used in PLEMO and MR_CHIROD v.2 systems. The same group that developed the PLEMO also proposed ERF clutches to control the force provided by an electric motor in active systems. Such an actuation system was implemented in EMUL, Robotherapist and Hybrid-PLEMO devices.

28The natural actuators of body muscles can be used instead of external actuators. For this purpose, an electrical stimulation of the muscles leading to their contraction can be applied. This specific electrical stimulation is known as Functional Electrical Stimulation (FES). FES significantly reduces the weight of the device. From a therapeutic point of view, FES allows patients to exercise muscles, improving muscle bulk and strength and preventing muscular atrophy. It has been also shown that FES, complemented by conventional physiotherapy, may enhance the rehabilitation outcome. However, FES may cause strong involuntary muscle contractions and can be painful for patient. Furthermore, it is difficult to control movements using FES because of the non-linear force characteristic of contracting muscles, muscles fatigue and dependency of the achieved contraction on the quality of the contact between stimulating electrodes and the body tissue. There are two commercial systems using FES for upper limb rehabilitation: Ness H200 (Bioness, Inc., US) and NeuroMove (Zynex Medical, Inc., US). Two other systems combining FES with assistive force were proposed by Freeman, et al. and Li, et al..

29When selecting actuators, it is also important to consider their location, especially with exoskeleton-based mechanical structures. The actuators can be placed distally, close to the joints on which they actuate (e.g. ArmeoPower system, Figure 1D). This specification simplifies the power transmission by using direct drives. However, it increases the weight of the distal part of the device and inertia and makes it more difficult to control the system. On the other hand, locating the actuators in the proximal part of the device, often in the part that remains constrained, reduces the weight and inertia of the distal part. However, a power transmission mechanism complicates the mechanical structure and may lead to difficulties with control due to friction. For example, the same group who developed InMotion HAND system proposed an earlier prototype of the hand module with eight active DOF and cable-driven mechanism for power transmission. The friction in that mechanism and its level of complexity was too high for clinical scenarios. Nevertheless, there are systems, in which power transmission using cables and gear drives was successfully applied, like for example CADEN-7 and SUEFUL-7.

30The most important terminology introduced in this section is explained in Table 5. Various signals may be used as control input of the device. Switches are often used to simplify design. Examples include the PowerGrip system from Broaden Horizons, Inc., hand held triggers (e.g. FES based system for grasp assistance proposed by Nathan, et al.) and a joystick (e.g.MULOS). Most of the systems having more complex control strategies use either kinematic, dynamic or a mix of both input signals (see Table 1 for a comparison). The type of the signal used as control input is partially determined by the low-level control strategy and vice-versa. In some cases, signals provided by actuator encoders (concerning position or torque) may be directly used for control purposes. However, usually torque measured by the encoder is a sum of the torque exerted by the user on device and internal torques in the device. Therefore, for better control of forces between patient and device, it is useful to apply additional sensors that will measure those forces directly.

31Some systems use surface electromyography (sEMG) as an input signal, which provides information about intention of the person to perform particular movement. Therefore it is possible to detect and support it. Most of such systems support elbow movements, as sEMG signals from muscles controlling this joints (i.e. biceps brachii or triceps brachii) are relatively easily measured. Among proposed solutions are both stationary (e.g. systems proposed by Rosen, et al. and Kiguchi, et al.) and portable systems (e.g. systems proposed by Ögce and Özyalçin and Pylatiuk, et al.). So far the most successful of those systems is the one DOF portable orthosis developed at the Massachusetts Institute of Technology (MIT), Cambridge, US. The system successfully sustained clinical trials, received FDA approval and was commercialized as Myomo e100 system (Myomo, Inc.). Examples of sEMG-controlled systems supporting movements of other joints include those proposed by Kiguchi, et al. for shoulder rehabilitation, W-EXOS for forearm and wrist rehabilitation, PolyJbot for wrist rehabilitation, SUEFUL-7 exoskeleton for whole limb (excluding fingers) movement assistance, TU Berlin Hand Exoskeleton for fingers rehabilitation, as well as 11-DOF portable orthosis for grasp assistance proposed by Hasegawa, et al.. The sEMG signals from the contralateral healthy limb have been also used to control movements of the affected one (see system proposed by Li, et al.). The concept of using movements of the not affected limb to control motion of the affected one has been also implemented in Bi-Manu-Track system (Reha-Stim, Germany), ARMOR exoskeleton and device proposed by Kawasaki, et al.. Using the other limb to control the affected one is especially useful during rehabilitation after stroke. In cases of hemiparesis (or hemiplegia), often only one side of the body is affected.

32In some systems also contact-less movement detection methods have been used. For example, Ding, et al. proposed a system to assist the load of arbitrary selected muscles using motion capture systems in order to calculate the actual muscle force.

33Different types of feedback may be provided to the user, among them: visual, tactile, audio and in the form of electrical stimulation. Some systems, for example those proposed by Lam, et al. and Nathan, et al., use vibrational stimulation of the muscle tendons to support their contraction. It was also suggested that providing tactile feedback to flexor and extensor surfaces of the skin at the appropriate location could produce more naturalistic movements and improve clinical outcomes. Some other systems combine other types of the feedback, for example system proposed by Casellato, et al. combines visual and haptic feedback to improve motor performance of children with dystonia.

34A significant number of systems provide training in virtual reality (VR) scenarios. VR provides a much more interesting training surrounding to the patient, compared to the typically available conditions presented in therapeutic units. Furthermore, it allows for fast modification of training scenarios, increasing patient attention and motivation to perform the exercise. Therefore it may also improve positive outcome of the therapy. It also adapts the system for various patients in a very short time frame and restarts the task if the object was dropped or misplaced. Haptic devices are especially well suited for provision of therapy in VR because they provide an impression of manipulating the virtual objects. Some groups developed own versions of haptic systems. For example Takahashi, et al. proposed haptic device for arm rehabilitation, which can apply multiple types of force including resistance, assistance, elasticity, viscosity and friction. Other examples are: a two DOF Haptic Interface for Finger Exercise (HAFI), which provides rehabilitation of only one finger at a time; a force reflecting glove, named MRAGES, using magneto-rheological fluid; MR_CHIROD v.2, a one DOF grasp exercise device for functional magnetic resonance imaging and force-feedback glove Rutgers Master II-ND, developed at the Rutgers University (Piscataway, US) and used in hand therapy scenarios (e.g.).

35Many groups have investigated application of a few of commercial haptic devices for rehabilitation of upper extremity. Among such haptic interfaces are: - HapticMaster incorporated for example in Gentle/S (for other examples see Table 1),- in-parallel robots Phantom Omni and Premium (Geomagic, Inc., US) - used e.g. in experiments performed by Casellato, et al., Brewer, et al., and Xydas and Louca, - parallel robot Falcon (Novint Technology, Inc., US) - used in My Scrivener system for hand writing training (Obslap Research LLC, US),- force-feedback glove CyberGrasp (CyberGlove Systems LLC,US) - used among others in therapeutic scenarios investigated by Adamovich, et al..

36Because the entertainment industry have recently introduced many new devices to capture motion of the healthy people for interaction with VR-based games, it may be expected that soon some of those devices will be also adapted for rehabilitation purposes, providing so called “serious games”.

37The most important terminology introduced in this section is explained in Table 6. Following the example of Marchal-Crespo and Reinkensmeyer we will consider “high-” and “low-level” control strategies used by rehabilitation robots. “High-level” control algorithms are explicitly designed to provoke motor plasticity whereas “low-level” strategies control the force, position, impedance or admittance factors of the “high-level” control strategies.

38There is a myriad of “high-level” control strategies for robotic movement training. This section briefly summarizes the classification of those strategies presented by Marchal-Crespo and Reinkensmeyer. They identify four categorizes of control strategies: (a) assistive control, (b) challenge-based control, (c) haptic stimulation, and (d) non-contacting coaching. Although some systems may fall into a few of these categorizes, this classification well illustrates main notions in the “high-level” control of robotic devices for upper limb rehabilitation. Those control strategies in most cases correspond also to active, passive, haptic and coaching types of motion assistance described before.

39The assistive control strategy makes tasks safer and easier to accomplish, allowing more repetitions. There are four types of assistive strategies: impedance-based, counterbalance-based, EMG-based and performance-based adaptive control. In the impedance-based strategy, the patient follows a particular trajectory. The device does not intervene as long as the patient follows this trajectory. However, as the patient leaves the trajectory, the device produces a restoring force that increases along with the deviation from the desired trajectory. Often some margin of deviation from allowed trajectory is accepted before restoring force is provided. Counterbalance-based strategies provide a partial, passive or active weight counterbalance to a limb, those making the exercises easier, as the amount of force needed to move the limb against the gravity may be significantly reduced. EMG-based approach uses the patient’s own sEMG signals to either trigger or proportionally control the assistance. Both of those approaches encourage patients’ effort. However, the triggered method is more susceptible to slacking, as the patient may learn to provide only the amount of force needed to trigger the assistance. Finally, the performance-based adaptive control strategies monitor the performance of the patient and adapt some aspects of the assistance (e.g. force, stiffness, time, path) according to the current performance of the patient, as well as performance during particular number of preceding task repetitions.

40fall into three groups: resistive, amplifying error and constraint-induced. The resistive strategies resist the desired movements, those increasing the effort and attention of the patient. The error amplifying strategies are based on the theory that faster improvements are achieved when error is increased. Therefore they track the deviations from the desired trajectories and either increase the observed kinematic error or amplify its visual representation on the screen. The constraint-induced robotic rehabilitation strategy, similarly to conventional constraint-induced therapy, promotes the use of the affected limb by constraining the not affected one.

41make use of haptic devices described above, providing tactile sensation for interactions with virtual reality objects. These strategies support training of basic ADLs in safe conditions and without long set-up. They provide alternate tasks in various environments, attracting attention and providing conditions for implicit learning.

42is applied in systems that do not contact participants but rather monitor their activity and provide instructions to the patient. Instructions indicate how to perform particular activities or what should be improved. Since such devices do not contact the patient, they are not applicable for systems described herein. However, this category may be extended to include also some sensorized, but not-actuated exoskeletons, such as the gravity balancing orthosis T-WREX.

43Different “low-level” control strategies are combined to develop “high-level” rehabilitation strategies. Many “low-level” control strategies may be proposed during following stages of development of a robotic rehabilitation device. This report provides a short description of basic approaches and does not include a comprehensive comparison of “low-level” control strategies. General books on control engineering provide a more detailed description, in addition to articles referenced in Table 1.

44As the rehabilitation robots interact with human body, it is necessary to consider the manipulator and patient as a coupled mechanical system. The application of force or position control is not enough to ensure appropriate and safe dynamic interaction between human and robot. Other control strategies, such as impedance or admittance control are implemented in most of the robots for upper limb rehabilitation. In the impedance control approach the motion of the limb is measured and the robot provides the corresponding force feedback, whereas in the admittance control approach the force exerted by the user is measured, and the device generates the corresponding displacement. The advantages and disadvantages of the impedance and admittance control systems are complementary. In general, robots with impedance control have stable interaction but poor accuracy in free-space due to friction. This low accuracy can be improved using inner loop torque sensors and low-friction joints or direct drives. Admittance control in contrast compensates the mass and friction of the device and provides higher accuracy in non-contact tasks, but can be unstable during dynamic interactions. This problem is eliminated using SEAs. Devices using admittance control require also high transmission ratios (e.g. harmonic drives) for precise motion control. In some cases both of theses approaches may be combined together. Impedance control strategy has been implemented for example in MIT Manus (Figure 1B) and L-Exos exoskeleton, admittance control is found in MEMOS and iPAM.

45As previously discussed, there has been a significant effort during last two decades to improve the design and control strategy of robotic rehabilitation devices. Yet, less has been done to prove the efficacy of such systems in rehabilitation settings. Although the results of clinical evaluation of therapy applying robots are still sparse, the problem is slowly being recognized. The focus in rehabilitation robotics is starting to move from technical laboratories to clinics. References to clinical trials in which robotic rehabilitation devices have been used are provided in the last column of Table 1. The classification of clinical trials used in this review is summarized in Table 7.

46From the developer and manufacturer’s point of view, there may be at least three objectives in performing clinical trials. The first one is to address regulatory requirements. The devices described in this review are considered medical devices in most countries and as such the studies proving device efficacy and safety may be required before they are authorized for distribution. Although in some cases the exemption from providing the clinical data may be granted, e.g. if the device is recognized as low risk (Class 1 device in the European Union and the USA) or if equivalent device has been already approved for commercialization, the clinical data may be required by health insurance authorities in order to provide reimbursement. In this case the objective of the trial is to obtain a proof of clinical or financial benefit of the use of the device as compared to the existing modes of therapy. The third objective of clinical trials is to provide the professional community with the clinical evidence of device’s efficacy. Although, the three objectives may seem to be similar, the requirements are not the same, therefore when designing a clinical trial it should be considered if the obtained results will allow to satisfy requirements of those three objectives. For the study design requirements to satisfy the marketing and reimbursement objectives, we refer the readers to the legal regulations in the country of interest. Whereas, for a review on the process to design a clinical train with sound scientific results we refer to Lo.

47From the clinical point of view, the objective of the clinical study may be different than to validate a particular device. For therapists the robotic device is a tool that provides a therapy protocol rather than an end product, thus they are rather interested in responses to questions concerning optimal training intensity, disorders for which such form of training may be beneficial, and whether robotic therapy should substitute or complement other forms of therapy.

48This survey includes a search into the US Clinical Trials database (http://clinicaltrials.gov/) from October 2013 using a combination of keywords: robotic, robot, therapy and rehabilitation. This is an web-based database existing since 1997 and maintained by the US National Library of Medicine at the National Institutes of Health. Under the American Food and Drug Administration Amendments Act (FDAAA) of 2007 all the applicable clinical trials (what concerns category II and III/IV studies in our survey) performed in the USA and starting after 2007 have to be registered in this database. However, it includes also some category I studies and many other studies performed in other countries. Results of this search identified 197 clinical trials out of which 62 are relevant to this survey. The selected trials are divided into two categories. The main objective of the first category is to proof the efficacy or safety of the device, therefore there was either no control group or a control group was undergoing the standard form of the therapy. The main objective of the second category is to determine a more efficient form of the therapy. In the latter category, the participants were assigned to groups undergoing similar forms of therapy, but at different intensities, using various devices or undergoing various forms of therapy in different order. A total of 31 studies aim at device safety or efficacy validation while 27 address better forms of therapy. A total of four trials were excluded. The objective of these trials was to validate other forms of therapy; devices described in this review have only been used as a reference. As indicated in Figure 3, the number of participants enrolled in studies for therapy improvement significantly increased during last three years compared to the number of participants in the device safety/efficacy validation studies. This suggests that the objective of the studies changes from validating forms of therapy to finding optimal applications methods. This survey identified a total of 21 devices out of the 58 clinical studies. However, it was not possible to determine the robotic device in 11 studies. Surprisingly, almost only stroke survivors (54 studies) were enrolled. In the remaining four studies subjects with cerebral palsy, spinal cord injury, traumatic brain injury and rotator cuff tear were involved.

49Many questions concerning effective robotic upper-limb rehabilitation still remain unanswered. One of the most important reasons is that the most effective interventions to optimize neural plasticity are still not clear and it is not possible to implement them in rehabilitation robotics. The other is that the results of the clinical controlled trials remains limited and those already available are difficult to compare with each other. It is also questionable which measures should be used to evaluate the effects of therapy and which outcome should be compared: short-term or long-term. Scales based on evaluation of abilities influencing the quality of life are often not objective enough, since they rely on therapist expertise.

50Although it is not possible to indicate the best control strategy for the rehabilitation, there is already some evidence showing that some strategies are producing better outcomes, whereas some can even decrease recovery time compared to possible non-robotic strategies.

51are clear: The goal of the rehabilitation training is not only to maximize the number of repetition but to maximize the patients attention and effort as well. The monotonous exercises provide worse retention of a skill compared with alternate training. Adaptive therapy and assistance as needed provide better results as fixed pattern therapy. Robotic therapy can possibly decrease recovery if it encourages slacking since the patient may decrease effort and attention due to the use of adaptive algorithm. Because learning is error based, faster improvement may be achieved when error is increased. Implicit learning, allowing patients to learn skills without awareness, may result in greater learning effect. Many functional gains are more dependent on wrist and hand movements than on the mobility of shoulder and elbow. It is not the maximal voluntary contraction (strength of the muscles) but appropriately timed activity of agonist and antagonist (coordination of the movements) that significantly improve the rehabilitation.

52As previously stated, the objective of this report is not to review the results of clinical studies performed so far. A detailed review of clinical studies is referenced in other publications. The most important results are still worth mentioning. Systematic review and meta-analysis of the trials performed in stroke patients suggest that robotic training improves motor impairment and strength but do not improve ability to perform ADLs. The results of the first large randomized multicenter study in which training with MIT-Manus robotic system have been compared with intensive therapist-provided therapy and usual care have revealed that there is no significant difference in the outcomes of the two intensive forms of the therapy. Thus the most important advantage of robotic systems is their ability to provide intensive repetitive training without over-burdening therapists. Another advantage is the ability to provide more motivating training context, by means of a computer gaming environment with quantitative feedback to motivate practice. Concerning cost-effectiveness of robotic rehabilitation, the results of the previously mentioned multicenter trial have shown that when the total cost of the therapy is compared, i.e. the cost of the therapy plus the cost of all the other health care use, the costs of the two forms of the intensive therapy (i.e. robot-assisted and therapist-provided) are similar. However, the cost of technology is expected to decrease, as opposed to the cost of human labor. Therefore cost-effective advantage toward robot-therapy may be expected.

53Due to population changes, shortage of professional therapists, and the increasing scientific and technical potential, many research groups have proposed devices with the potential to facilitate the rehabilitation process. Many devices for upper limb rehabilitation have already been proposed. A vast majority of these proposed devices are technically advanced and are designed for clinical settings. However, there is still significant need to improve efficiency and reduce cost of home-based devices for therapy and ADLs assistance. The effectiveness of robotic over conventional therapy is arguable and the best therapy strategy is still not clear. The situation may change soon, because more and more devices are being commercialized and more scientific results will be available. It may encourage next groups to propose their own solutions. Developing new devices and improving those already in the market will be easier, when taking advantage from the already existing solutions. We hope that this survey will help to navigate between those solutions and select best of them, thus facilitating development of new and better systems for robotic upper limb rehabilitation. We also hope that it will be a valuable source of information for all the professionals looking for a comprehensive reference.

54The authors declare that they have no competing interests.

55PM performed systematical review of papers and drafted the manuscript. JE, KGH, and AJ contributed to the review of various systems and revised the manuscript. SL contributed to the concept, paper structure and revised the manuscript. All authors read and approved the manuscript.