|
Sign In to gain access to subscriptions and/or personal tools.
|
Progressive Staging of Pilot Studies to Improve Phase III Trials for Motor Interventions
Bruce H. Dobkin, MD
Department of Neurology, Geffen School of Medicine, University of California Los Angeles, bdobkin{at}mednet.ucla.edu
Based on the suboptimal research pathways that finally led to multicenter randomized clinical trials (MRCTs) of treadmill training with partial body weight support and of robotic assistive devices, strategically planned successive stages are proposed for pilot studies of novel rehabilitation interventions. Stage 1, consideration-of-concept studies, drawn from animal experiments, theories, and observations, delineate the experimental intervention in a small convenience sample of participants, so the results must be interpreted with caution. Stage 2, development-of-concept pilots, should optimize the components of the intervention, settle on most appropriate outcome measures, and examine dose-response effects. A well-designed study that reveals no efficacy should be published to counterweight the confirmation bias of positive trials. Stage 3, demonstration-of-concept pilots, can build out from what has been learned to test at least 15 participants in each arm, using random assignment and blinded outcome measures. A control group should receive an active practice intervention aimed at the same primary outcome. A third arm could receive a substantially larger dose of the experimental therapy or a combinational intervention. If only 1 site performed this trial, a different investigative group should aim to reproduce positive outcomes based on the optimal dose of motor training. Stage 3 studies ought to suggest an effect size of 0.4 or higher, so that approximately 50 participants in each arm will be the number required to test for efficacy in a stage 4, proof-of-concept MRCT. By developing a consensus around acceptable and necessary practices for each stage, similar to CONSORT recommendations for the publication of phase III clinical trials, better quality pilot studies may move quickly into better designed and more successful MRCTs of experimental interventions.
Key Words: Stroke rehabilitation Spinal cord injury Motor control Clinical trials Robotics Treadmill training
References
- Cheeran B., Cohen L., Dobkin B., et al. The future restorative neurosciences in stroke: driving the translational research pipeline from basic science to the rehabilitation of people after stroke. Neurorehabil Neural Repair. 2009: 23,97-107.
- Dobkin B., Apple D., Barbeau H., et al. Methods for a randomized trial of weight-supported treadmill training versus conventional training for walking during inpatient rehabilitation after incomplete traumatic spinal cord injury. Neurorehabil Neural Repair. 2003;17:153-167.[Abstract/Free Full Text]
- Duncan P., Studenski S., Richards L., et al. Randomized clinical trial of therapeutic exercise in subacute stroke. Stroke. 2003;34:2173-2180.[Abstract/Free Full Text]
- Duncan PW, Sullivan KJ, Behrman AL, et al. Protocol for the Locomotor Experience Applied Post-stroke (LEAPS) trial: a randomized controlled trial. BMC Neurol. 2007;7:39.[CrossRef][Medline]
[Order article via Infotrieve]
- Winstein C., Miller J., Blanton S., et al. Methods for a multi-site randomized trial to investigate the effect of constraint-induced movement therapy in improving upper extremity function among adults recovering from a cerebrovascular stroke. Neurorehabil Neural Repair. 2003;17:137-152.[Abstract/Free Full Text]
- Harvey R., Winstein C. Design for the Everest randomized trial of cortical stimulation and rehabilitation for arm function following stroke. Neurorehabil Neural Repair. 2009;.23:32-44.
- Hass CJ, Collins MA, Juncos JL Resistance training with creatine monohydrate improves upper-body strength in patients with Parkinson disease: a randomized trial. Neurorehabil Neural Repair. 2007;21:107-115.[Abstract/Free Full Text]
- Moseley A., Stark A., Cameron I., Pollack A. Treadmill training and body weight support for walking after stroke. Cochrane Database Syst Rev. October 2005:CD002840.
- Mehrholz J., Werner C., Kugler J., Pohl M. Electromechanical-assisted training for walking after stroke. Cochrane Database Syst Rev. October 2007:CD006185.
- Kwakkel G., Kollen BJ, Krebs HI Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review. Neurorehabil Neural Repair. 2008;22:111-121.[Abstract/Free Full Text]
- Dobkin B. Rehabilitation after stroke. New Engl J Med. 2005;352: 1677-1684.[Free Full Text]
- Dobkin B. Overview of treadmill locomotor training with partial body weight support: a neurophysiologically sound approach whose time has come for randomized clinical trials. Neurorehabil Neural Repair. 1999;13:157-165.[Abstract/Free Full Text]
- Broeren J., Rydmark M., Bjorkdahl A., Sunnerhagen KS Assessment and training in a 3-dimensional virtual environment with haptics: a report on 5 cases of motor rehabilitation in the chronic stage after stroke. Neurorehabil Neural Repair. 2007;21:180-189.[Abstract/Free Full Text]
- Jonsdottir J., Cattaneo D., Alberto Regola A., et al. Concepts of motor learning applied to a rehabilitation protocol using biofeedback to improve gait in a chronic stroke patient: an A-B system study with multiple gait analyses. Neurorehabil Neural Repair. 2007;21:190-195.[Abstract/Free Full Text]
- Silva A. The science of research (SR): the search for cognitive mechanisms. J Physiol Paris. 2007;101:203-213.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Dobkin B., Barbeau H., Deforge D., et al. The evolution of walking-related outcomes over the first 12 weeks of rehabilitation for incomplete traumatic spinal cord injury: The multicenter randomized Spinal Cord Injury Locomotor Trial. Neurorehabil Neural Repair. 2007;21:25-35.[Abstract/Free Full Text]
- Dobkin BH, Apple D., Barbeau H., et al. Weight-supported treadmill vs over-ground training for walking after acute incomplete SCI. Neurology. 2006;66:484-493.[Abstract/Free Full Text]
- Wolf SL, Winstein CJ, Miller JP, et al. Effect of constraint-induced movement therapy on upper extremity function 3 to 9 months after stroke: the EXCITE randomized clinical trial. JAMA. 2006;296:2095-2104.[Abstract/Free Full Text]
- Kwakkel G., Wagenaar R., Twisk J., Lankhorst G., Koetsier J. Intensity of leg and arm training after primary middle cerebral artery stroke: a randomized trial. Lancet. 1999;354:191-196.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Dickstein R. Rehabilitation of gait speed after stroke: a critical review of intervention approaches. Neurorehabil Neural Repair. 2008;22:649-660.[Abstract/Free Full Text]
- Wolf S., Winstein C., Miller J., Blanton S., Clark P., Nichols-Larsen D. Looking in the rear view mirror when conversing with back seat drivers: the EXCITE trial revisited. Neurorehabil Neural Repair. 2007;21:379-387.[Abstract/Free Full Text]
- Dobkin BH Confounders in rehabilitation trials of task-oriented training: lessons from the designs of the EXCITE and SCILT multicenter trials. Neurorehabil Neural Repair. 2007;21:3-13.[Abstract/Free Full Text]
- Scivoletto G., Ivanenko Y., Morganti B., et al. Plasticity of spinal centers in spinal cord injury patients: new concepts for gait evaluation and training. Neurorehabil Neural Repair. 2007;21:358-365.[Abstract/Free Full Text]
- Sullivan K., Knowlton B., Dobkin B. Step training with body weight support: effect of treadmill speed and practice paradigms on post-stroke locomotor recovery. Arch Phys Med Rehabil. 2002;83:683-691.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Plummer P., Behrman AL, Duncan PW, et al. Effects of stroke severity and training duration on locomotor recovery after stroke: a pilot study. Neurorehabil Neural Repair. 2007;21:137-151.[Abstract/Free Full Text]
- Barbeau H., Elashoff R., Deforge D., Ditunno J., Saulino M., Dobkin BH Comparison of speeds used for the 15.2-meter and 6-minute walks over the year after an incomplete spinal cord injury: The SCILT trial. Neurorehabil Neural Repair. 2007;21:302-306.[Abstract/Free Full Text]
- Pohl P., Perera S., Duncan P., Maletsky R., Whitman R., Studenski S. Gains in distance walking in a 3-month follow-up poststroke: what changes? Neurorehabil Neural Repair. 2004;18:30-36.[Abstract/Free Full Text]
- Bowden MG, Balasubramanian CK, Behrman AL, Kautz SA Validation of a speed-based classification system using quantitative measures of walking performance poststroke. Neurorehabil Neural Repair. 2008;22: 672-675.[Abstract/Free Full Text]
- van Hedel HJ, Dietz V., Curt A. Assessment of walking speed and distance in subjects with an incomplete spinal cord injury. Neurorehabil Neural Repair. 2007;21:295-301.[Abstract/Free Full Text]
- van Hedel H., Dietz V. Walking during daily life can be validly and responsively assessed in subjects with a spinal cord injury. Neurorehabil Neural Repair. 2009;23:117-124.[Abstract/Free Full Text]
- Mehrholz J., Kugler J., Pohl M. Locomotor training for walking after spinal cord injury. Cochrane Database Syst Rev. April 2008:CD006676.
- Barbeau H. Locomotor training in neurorehabilitation: emerging rehabilitation concepts. Neurorehabil Neural Repair. 2003;17:3-11.[Free Full Text]
- Bayat R., Barbeau H., Lamontagne A. Speed and temporal-distance adaptations during treadmill and over-ground walking following stroke. Neurorehabil Neural Repair. 2005;2:115-124.[Medline]
[Order article via Infotrieve]
- Field-Fote E. Combined use of body weight support, functional electrical stimulation, and treadmill training to improve walking ability in individuals with chronic incomplete spinal cord injury. Arch Phys Med Rehabil. 2001;82:818-824.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Harris-Love ML, Forrester LW, Macko RF, Silver KH, Smith GV Hemiparetic gait parameters in over-ground versus treadmill walking. Neurorehabil Neural Repair. 2001;15:105-112.[Abstract/Free Full Text]
- Kosak M., Reding M. Comparison of partial body weight-supported treadmill gait training versus aggressive bracing assisted walking post stroke. Neurorehabil Neural Repair. 2000;14:13-19.[Abstract/Free Full Text]
- Lam T., Wirz M., Lunenburger L., Dietz V. Swing phase resistance enhances flexor muscle activity during treadmill locomotion in incomplete spinal cord injury. Neurorehabil Neural Repair. 2008;22:438-446.[Abstract/Free Full Text]
- Werner C., Lindquist AR, Bardeleben A., Hesse S. The influence of treadmill inclination on the gait of ambulatory hemiparetic subjects. Neurorehabil Neural Repair. 2007;21:76-80.[Abstract/Free Full Text]
- Luft AR, Macko RF, Forrester LW, et al. Treadmill exercise activates subcortical neural networks and improves walking after stroke. A Randomized Controlled Trial. Stroke. 2008;39:3341-3350.[Abstract/Free Full Text]
- Mayr A., Kofler M., Quirbach E., Matzak H., Frohlich K., Saltuari L. Prospective, blinded, randomized crossover study of gait rehabilitation in stroke patients using the Lokomat gait orthosis. Neurorehabil Neural Repair. 2007;21:307-314.[Abstract/Free Full Text]
- Hesse S., Werner C., Uhlenbrock D., Frankenberg S., Bardeleben A., Brandl-Hesse B. An electromechanical gait trainer for restoration of gait in hemiparetic stroke patients. Neurorehabil Neural Repair. 2001;15:39-50.[Abstract/Free Full Text]
- de Bode S., Mathern GW, Bookheimer S., Dobkin B. Locomotor training remodels fMRI sensorimotor cortical activations in children after cerebral hemispherectomy. Neurorehabil Neural Repair. 2007;21:497-508.[Abstract/Free Full Text]
- Winchester P., McColl R., Querry R., et al. Changes in supraspinal activation patterns following robotic locomotor therapy in motor-incomplete spinal cord injury. Neurorehabil Neural Repair. 2005;19:313-324.[Abstract/Free Full Text]
- Byl NN, Pitsch EA, Abrams GM Functional outcomes can vary by dose: learning-based sensorimotor training for patients stable poststroke. Neurorehabil Neural Repair. 2008;22:494-504.[Abstract/Free Full Text]
- Buurke JH, Nene AV, Kwakkel G., Erren-Wolters V., Ijzerman MJ, Hermens HJ Recovery of gait after stroke: what changes? Neurorehabil Neural Repair. 2008;22:676-683.[Abstract/Free Full Text]
- Lo AC, Triche EW Improving gait in multiple sclerosis using robot-assisted, body weight supported treadmill training. Neurorehabil Neural Repair. 2008;22:661-671.[Abstract/Free Full Text]
- Hidler J., Nichols D., Pelliccino M., et al. Multicenter randomized clinical trial evaluating the effectiveness of the Lokomat in subacute stroke. Neurorehabil Neural Repair. 2009;23:5-13.[Abstract/Free Full Text]
- Regnaux JP, Saremi K., Marehbian J., Bussel B., Dobkin BH An accelerometry-based comparison of 2 robotic assistive devices for treadmill training of gait. Neurorehabil Neural Repair. 2008;22:348-354.[Abstract/Free Full Text]
- Saremi K., Marehbian J., Regnaux J., et al. Reliability and validity of bilateral thigh and foot accelerometry measures of walking In healthy and hemiparetic subjects. Neurorehabil Neural Repair. 2006;20:297-305.[Abstract/Free Full Text]
- Boyd LA, Quaney BM, Pohl PS, Winstein CJ Learning implicitly: effects of task and severity after stroke. Neurorehabil Neural Repair. 2007;21:444-454.[Free Full Text]
- Maldonado M., Allred R., Felthauser E., Jones T. Motor skill training, but not voluntary exercise, improves skilled reaching after unilateral ischemic lesions of the sensorimotor cortex in Rats. Neurorehabil Neural Repair. 2008;22:250-262.[Abstract/Free Full Text]
- Boake C., Noser EA, Ro T., et al. Constraint-induced movement therapy during early stroke rehabilitation. Neurorehabil Neural Repair. 2007;21: 14-24.[Abstract/Free Full Text]
- Dong Y., Dobkin BH, Cen SY, Wu AD, Winstein CJ Motor cortex activation during treatment may predict therapeutic gains in paretic hand function after stroke. Stroke. 2006;37:1552-1555.[Abstract/Free Full Text]
- Dong Y., Winstein CJ, Albistegui-DuBois R., Dobkin BH Evolution of fMRI activation in the perilesional primary motor cortex and cerebellum with rehabilitation training-related motor gains after stroke: a pilot study. Neurorehabil Neural Repair. 2007;21:412-428.[Abstract/Free Full Text]
- Sawaki L., Butler AJ, Xiaoyan L., et al. Constraint-induced movement therapy results in increased motor map area in subjects 3 to 9 months after stroke. Neurorehabil Neural Repair. 2008;22:505-513.[Abstract/Free Full Text]
- Lin K., Wu C., Liu J., et al. Constraint-induced therapy versus dose-matched control intervention to improve motor ability, basic/extended daily functions, and quality of life in stroke. Neurorehabil Neural Repair. 2009; 23:160-165.[Abstract/Free Full Text]
- Colombo R., Pisano F., Micera S., et al. Assessing mechanisms of recovery during robot-aided neurorehabilitation of the upper limb. Neurorehabil Neural Repair. 2008;22:50-63.[Abstract/Free Full Text]
- Mehrholz J., Platz T., Kugler J., Pohl M. Electromechanical and robot-assisted arm training for improving arm function and activities of daily living after stroke. Cochrane Database Syst Rev. October 2008:CD006876.
- Takahashi CD, Der-Yeghiaian L., Le V., Motiwala RR, Cramer SC Robot-based hand motor therapy after stroke. Brain. 2008;131:425-437.[Abstract/Free Full Text]
- Coote S., Murphy B., Harwin W., Stokes E. The effect of the GENTLE/s robot-mediated therapy system on arm function after stroke. Clin Rehabil. 2008;22:395-405.[Abstract/Free Full Text]
- Volpe BT, Lynch D., Rykman-Berland A., et al. Intensive sensorimotor arm training mediated by therapist or robot improves hemiparesis in patients with chronic stroke. Neurorehabil Neural Repair. 2008;22:305-310.[Abstract/Free Full Text]
- Hsueh IP, Hsu MJ, Sheu CF, Lee S., Hsieh CL, Lin JH Psychometric comparisons of 2 versions of the Fugl-Meyer motor scale and 2 versions of the stroke rehabilitation assessment of movement. Neurorehabil Neural Repair. 2008;22:737-744.[Abstract/Free Full Text]
- Prabhakaran S., Zarahn E., Riley C., et al. Inter-individual variability in the capacity for motor recovery after ischemic stroke. Neurorehabil Neural Repair. 2008;22:64-71.[Abstract/Free Full Text]
- Moher D., Schultz K., Altman D. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group trials. Lancet. 2001;357:1191-1194.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- McDonnell MN, Hillier SL, Miles TS, Thompson PD, Ridding MC Influence of combined afferent stimulation and task-specific training following stroke: a pilot randomized controlled trial. Neurorehabil Neural Repair. 2007;21:435-443.[Abstract/Free Full Text]
- Simmons L., Sharma N., Baron JC, Pomeroy VM Motor imagery to enhance recovery after subcortical stroke: who might benefit, daily dose, and potential effects. Neurorehabil Neural Repair. 2008;22:458-467.[Abstract/Free Full Text]
- Pomeroy VM, Cloud G., Tallis RC, Donaldson C., Nayak V., Miller S. Transcranial magnetic stimulation and muscle contraction to enhance stroke recovery: a randomized proof-of-principle and feasibility investigation. Neurorehabil Neural Repair. 2007;21:509-517.[Abstract/Free Full Text]
- Cleophas T., Zwinderman A. Limitations of randomized clinical trials: Proposed alternative designs. Clin Chem Lab Med. 2000;38:1217-1223.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Dobkin BH Rehabilitation and functional neuroimaging dose-response trajectories for clinical trials. Neurorehabil Neural Repair. 2005;19:276-282.[Abstract/Free Full Text]
- Dobkin BH Curiosity and cure: translational research strategies for neural repair-mediated rehabilitation. Dev Neurobiol. 2007;67:1133-1147.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Dobkin BH Training and exercise to drive poststroke recovery. Nat Clin Pract Neurol. 2008;4:76-85.[Web of Science][Medline]
[Order article via Infotrieve]
- Blicher J., Nielsen J. Cortical and spinal excitability changes after robotic gait training in healthy participants. Neurorehabil Neural Repair. 2009;23:143-159.[Abstract/Free Full Text]
- Poldrack RA, Fletcher PC, Henson RN, Worsley KJ, Brett M., Nichols TE Guidelines for reporting an fMRI study. Neuroimage. 2008;40:409-414.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Dobkin B., Firestine A., West M., Saremi K., Woods R. Ankle dorsiflexion as an fMRI paradigm to assay motor control for walking during rehabilitation. NeuroImage. 2004;23:370-381.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Pomeroy VM, Cooke E., Hamilton S., Whittet A., Tallis RC Development of a schedule of current physiotherapy treatment used to improve movement control and functional use of the lower limb after stroke: a precursor to a clinical trial. Neurorehabil Neural Repair. 2005;19:350-359.[Abstract/Free Full Text]
- Hiscock A., Miller S., Rothwell J., Tallis RC, Pomeroy VM Informing dose-finding studies of repetitive transcranial magnetic stimulation to enhance motor function: a qualitative systematic review. Neurorehabil Neural Repair. 2008;22:228-249.[Abstract/Free Full Text]
- Tyson SF Measurement error in functional balance and mobility tests for people with stroke: what are the sources of error and what is the best way to minimize error? Neurorehabil Neural Repair. 2007;21:46-50.[Abstract/Free Full Text]
- Richards LG, Senesac CR, Davis SB, Woodbury ML, Nadeau SE Bilateral arm training with rhythmic auditory cueing in chronic stroke: not always efficacious. Neurorehabil Neural Repair. 2008;22:180-184.[Abstract/Free Full Text]
- Park SW, Wolf SL, Blanton S., Winstein C., Nichols-Larsen DS The EXCITE trial: predicting a clinically meaningful motor activity log outcome. Neurorehabil Neural Repair. 2008;22:486-493.[Abstract/Free Full Text]
- Hsieh YW, Wang CH, Sheu CF, Hsueh IP, Hsieh CL Estimating the minimal clinically important difference of the stroke rehabilitation assessment of movement measure. Neurorehabil Neural Repair. 2008;22: 723-727.[Abstract/Free Full Text]
- Hsieh YW, Wang CH, Wu SC, Chen PC, Sheu CF, Hsieh CL Establishing the minimal clinically important difference of the Barthel Index in stroke patients. Neurorehabil Neural Repair. 2007;21:233-238.[Abstract/Free Full Text]
- Jette AM, Tao W., Norweg A., Haley S. Interpreting rehabilitation outcome measures. J Rehabil Med. 2007;39:585-590.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Ridker PM, Danielson E., Fonseca F., et al. Rosuvastatin to prevent vascular events in men and women with elevated C-reactive protein. N Engl J Med. 2008;359:2195-2207.[Abstract/Free Full Text]
- Goldman B., LeBlanc M., Crowley J. Interim futility analysis with intermediate endpoints. Clin Trials. 2008;5:14-22.[Abstract/Free Full Text]
- Gordon P., Cheung Y., Levin B., et al. A novel, efficient, randomized selection trial comparing combinations of drug therapy for ALS. Amyotroph Lateral Scler. 2008;9:212-22.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Schmidli H., Bretz F., Racine-Poon A. Bayesian predictive power for interim adaptation in seamless phase II/III trials where the endpoint is survival up to some specified time point. Stat Med. 2007;26:4925-4938.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
Neurorehabilitation and Neural Repair, Vol. 23, No. 3,
197-206 (2009)
DOI: 10.1177/1545968309331863

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
B. H. Dobkin
Collaborative Models for Translational Neuroscience and Rehabilitation Research
Neurorehabil Neural Repair,
September 1, 2009;
23(7):
633 - 640.
[Abstract]
[PDF]
|
 |
|
|
|