RAND Corporation

Scoping reviews, a type of knowledge synthesis, follow a systematic approach to map evidence on a topic and identify main concepts, theories, sources, and knowledge gaps. Although more scoping reviews are being done, their methodological and reporting quality need improvement. This document presents the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) checklist and explanation. The checklist was developed by a 24-member expert panel and 2 research leads following published guidance from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network. The final checklist contains 20 essential reporting items and 2 optional items. The authors provide a rationale and an example of good reporting for each item. The intent of the PRISMA-ScR is to help readers (including researchers, publishers, commissioners, policymakers, health care providers, guideline developers, and patients or consumers) develop a greater understanding of relevant terminology, core concepts, and key items to report for scoping reviews.

A 36-item short-form (SF-36) was constructed to survey health status in the Medical Outcomes Study. The SF-36 was designed for use in clinical practice and research, health policy evaluations, and general population surveys. The SF-36 includes one multi-item scale that assesses eight health concepts: 1) limitations in physical activities because of health problems; 2) limitations in social activities because of physical or emotional problems; 3) limitations in usual role activities because of physical health problems; 4) bodily pain; 5) general mental health (psychological distress and well-being); 6) limitations in usual role activities because of emotional problems; 7) vitality (energy and fatigue); and 8) general health perceptions. The survey was constructed for self-administration by persons 14 years of age and older, and for administration by a trained interviewer in person or by telephone. The history of the development of the SF-36, the origin of specific items, and the logic underlying their selection are summarized. The content and features of the SF-36 are compared with the 20-item Medical Outcomes Study short-form.

I. Are there uncertainties that are not risks? 643. — II. Uncertainties that are not risks, 647. — III. Why are some uncertainties not risks? — 656.

This paper gives an account of an experiment in the use of the so-called DELPHI method, which was devised in order to obtain the most reliable opinion consensus of a group of experts by subjecting them to a series of questionnaires in depth interspersed with controlled opinion feedback.

(2013). College Admissions and the Stability of Marriage. The American Mathematical Monthly: Vol. 120, No. 5, pp. 386-391.

Theme identification is one of the most fundamental tasks in qualitative research. It also is one of the most mysterious. Explicit descriptions of theme discovery are rarely found in articles and reports, and when they are, they are often relegated to appendices or footnotes. Techniques are shared among small groups of social scientists, but sharing is impeded by disciplinary or epistemological boundaries. The techniques described here are drawn from across epistemological and disciplinary boundaries. They include both observational and manipulative techniques and range from quick word counts to laborious, in-depth, line-by-line scrutiny. Techniques are compared on six dimensions: (1) appropriateness for data types, (2) required labor, (3) required expertise, (4) stage of analysis, (5) number and types of themes to be generated, and (6) issues of reliability and validity.

BACKGROUND: We have little systematic information about the extent to which standard processes involved in health care--a key element of quality--are delivered in the United States. METHODS: We telephoned a random sample of adults living in 12 metropolitan areas in the United States and asked them about selected health care experiences. We also received written consent to copy their medical records for the most recent two-year period and used this information to evaluate performance on 439 indicators of quality of care for 30 acute and chronic conditions as well as preventive care. We then constructed aggregate scores. RESULTS: Participants received 54.9 percent (95 percent confidence interval, 54.3 to 55.5) of recommended care. We found little difference among the proportion of recommended preventive care provided (54.9 percent), the proportion of recommended acute care provided (53.5 percent), and the proportion of recommended care provided for chronic conditions (56.1 percent). Among different medical functions, adherence to the processes involved in care ranged from 52.2 percent for screening to 58.5 percent for follow-up care. Quality varied substantially according to the particular medical condition, ranging from 78.7 percent of recommended care (95 percent confidence interval, 73.3 to 84.2) for senile cataract to 10.5 percent of recommended care (95 percent confidence interval, 6.8 to 14.6) for alcohol dependence. CONCLUSIONS: The deficits we have identified in adherence to recommended processes for basic care pose serious threats to the health of the American public. Strategies to reduce these deficits in care are warranted.

BACKGROUND: Identifying, developing, and testing implementation strategies are important goals of implementation science. However, these efforts have been complicated by the use of inconsistent language and inadequate descriptions of implementation strategies in the literature. The Expert Recommendations for Implementing Change (ERIC) study aimed to refine a published compilation of implementation strategy terms and definitions by systematically gathering input from a wide range of stakeholders with expertise in implementation science and clinical practice. METHODS: Purposive sampling was used to recruit a panel of experts in implementation and clinical practice who engaged in three rounds of a modified Delphi process to generate consensus on implementation strategies and definitions. The first and second rounds involved Web-based surveys soliciting comments on implementation strategy terms and definitions. After each round, iterative refinements were made based upon participant feedback. The third round involved a live polling and consensus process via a Web-based platform and conference call. RESULTS: Participants identified substantial concerns with 31% of the terms and/or definitions and suggested five additional strategies. Seventy-five percent of definitions from the originally published compilation of strategies were retained after voting. Ultimately, the expert panel reached consensus on a final compilation of 73 implementation strategies. CONCLUSIONS: This research advances the field by improving the conceptual clarity, relevance, and comprehensiveness of implementation strategies that can be used in isolation or combination in implementation research and practice. Future phases of ERIC will focus on developing conceptually distinct categories of strategies as well as ratings for each strategy's importance and feasibility. Next, the expert panel will recommend multifaceted strategies for hypothetical yet real-world scenarios that vary by sites' endorsement of evidence-based programs and practices and the strength of contextual supports that surround the effort.

The paper is concerned with the optimum routing of a fleet of gasoline delivery trucks between a bulk terminal and a large number of service stations supplied by the terminal. The shortest routes between any two points in the system are given and a demand for one or several products is specified for a number of stations within the distribution system. It is desired to find a way to assign stations to trucks in such a manner that station demands are satisfied and total mileage covered by the fleet is a minimum A procedure based on a linear programming formulation is given for obtaining a near optimal solution. The calculations may be readily performed by hand or by an automatic digital computing machine. No practical applications of the method have been made as yet. A number of trial problems have been calculated, however.

The widespread use of standardized health surveys is predicated on the largely untested assumption that scales constructed from those surveys will satisfy minimum psychometric requirements across diverse population groups. Data from the Medical Outcomes Study (MOS) were used to evaluate data completeness and quality, test scaling assumptions, and estimate internal-consistency reliability for the eight scales constructed from the MOS SF-36 Health Survey. Analyses were conducted among 3,445 patients and were replicated across 24 subgroups differing in sociodemographic characteristics, diagnosis, and disease severity. For each scale, item-completion rates were high across all groups (88% to 95%), but tended to be somewhat lower among the elderly, those with less than a high school education, and those in poverty. On average, surveys were complete enough to compute scales scores for more than 96% of the sample. Across patient groups, all scales passed tests for item-internal consistency (97% passed) and item-discriminant validity (92% passed). Reliability coefficients ranged from a low of 0.65 to a high of 0.94 across scales (median = 0.85) and varied somewhat across patient subgroups. Floor effects were negligible except for the two role disability scales. Noteworthy ceiling effects were observed for both role disability scales and the social functioning scale. These findings support the use of the SF-36 survey across the diverse populations studied and identify population groups in which use of standardized health status measures may or may not be problematic.

BACKGROUND: Depression and anxiety are common in medical patients and are associated with diminished health status and increased health care utilization. This article presents a quantitative review and synthesis of studies correlating medical patients' treatment noncompliance with their anxiety and depression. METHODS: Research on patient adherence catalogued on MEDLINE and PsychLit from January 1, 1968, through March 31, 1998, was examined, and studies were included in this review if they measured patient compliance and depression or anxiety (with n>10); involved a medical regimen recommended by a nonpsychiatrist physician to a patient not being treated for anxiety, depression, or a psychiatric illness; and measured the relationship between patient compliance and patient anxiety and/or depression (or provided data to calculate it). RESULTS: Twelve articles about depression and 13 about anxiety met the inclusion criteria. The associations between anxiety and noncompliance were variable, and their averages were small and nonsignificant. The relationship between depression and noncompliance, however, was substantial and significant, with an odds ratio of 3.03 (95% confidence interval, 1.96-4.89). CONCLUSIONS: Compared with nondepressed patients, the odds are 3 times greater that depressed patients will be noncompliant with medical treatment recommendations. Recommendations for future research include attention to causal inferences and exploration of mechanisms to explain the effects. Evidence of strong covariation of depression and medical noncompliance suggests the importance of recognizing depression as a risk factor for poor outcomes among patients who might not be adhering to medical advice.

This study aimed to review the literature describing and quantifying time lags in the health research translation process. Papers were included in the review if they quantified time lags in the development of health interventions. The study identified 23 papers. Few were comparable as different studies use different measures, of different things, at different time points. We concluded that the current state of knowledge of time lags is of limited use to those responsible for R&D and knowledge transfer who face difficulties in knowing what they should or can do to reduce time lags. This effectively 'blindfolds' investment decisions and risks wasting effort. The study concludes that understanding lags first requires agreeing models, definitions and measures, which can be applied in practice. A second task would be to develop a process by which to gather these data.

Abstract Each of a collection of items are to be produced on two machines (or stages). Each machine can handle only one item at a time and each item must be processed through machine one and then through machine two. The setup time plus work time for each item for each machine is known. A simple decision rule is obtained in this paper for the optimal scheduling of the production so that the total elapsed time is a minimum. A three‐machine problem is also discussed and solved for a restricted case.

Recently, Ware and Sherbourne published a new short-form health survey, the MOS 36-Item Short-Form Health Survey (SF-36), consisting of 36 items included in long-form measures developed for the Medical Outcomes Study. The SF-36 taps eight health concepts: physical functioning, bodily pain, role limitations due to physical health problems, role limitations due to personal or emotional problems, general mental health, social functioning, energy/fatigue, and general health perceptions. It also includes a single item that provides an indication of perceived change in health. The SF-36 items and scoring rules are distributed by MOS Trust, Inc. Strict adherence to item wording and scoring recommendations is required in order to use the SF-36 trademark. The RAND 36-Item Health Survey 1.0 (distributed by RAND) includes the same items as those in the SF-36, but the recommended scoring algorithm is somewhat different from that of the SF-36. Scoring differences are discussed here and new T-scores are presented for the 8 multi-item scales and two factor analytically-derived physical and mental health composite scores.

In this paper a method is presented for determining the complex permittivity and permeability of linear materials in the frequency domain by a single time-domain measurement; typically, the frequency band extends from VHF through X band. The technique described involves placing an unknown sample in a microwave TEM-mode fixture and exciting the sample with a subnanosecond baseband pulse. The fixture is used to facilitate the measurement of the forward- and back-scattered energy, s21(t) and s11(t), respectively. It is shown in this paper that the forward- and back-scattered time-domain "signatures" are uniquely related to the intrinsic properties of the materials, namely, ϵ* and μ*. By appropriately interpreting s21(t) and s11(t), one is able to determine the real and imaginary parts of ϵ and μ as a function of frequency. Experimental results are presented describing several familiar materials.

A new approach to the problem of evaluating the complexity ("randomness") of finite sequences is presented. The proposed complexity measure is related to the number of steps in a self-delimiting production process by which a given sequence is presumed to be generated. It is further related to the number of distinct substrings and the rate of their occurrence along the sequence. The derived properties of the proposed measure are discussed and motivated in conjunction with other well-established complexity criteria.

Preface Acknowledgments PART I. THE BASICS Chapter 1. Introduction to Text: Qualitative Data Analysis Chapter 2. Collecting Data Chapter 3. Finding Themes Chapter 4. Codebooks and Coding Chapter 5. Introduction to Data Analysis Chapter 6. Conceptual Models PART II. THE SPECIFICS Chapter 7. First Steps in Analysis: Comparing Attributes of Variables Chapter 8. Cultural Domain Analysis: Free Lists, Judged Similarities, and Taxonomies Chapter 9. KWIC Analysis, Word Counts, and Semantic Network Analysis Chapter 10. Discourse Analysis: Conversation and Performance Chapter 11. Narrative Analysis Chapter 12. Grounded Theory Chapter 13. Content Analysis Chapter 14. Schema Analysis Chapter 15. Analytic Induction and Qualitative Comparative Analysis Chapter 16. Ethnographic Decision Models Chapter 17. Sampling Appendix: Resources for Analyzing Qualitative Data References Author Index Subject Index About the Authors

Introduction. The problem discussed in this paper was formulated by T. Harris as follows: “Consider a rail network connecting two cities by way of a number of intermediate cities, where each link of the network has a number assigned to it representing its capacity. Assuming a steady state condition, find a maximal flow from one given city to the other.”

Abstract The smearing estimate is proposed as a nonparametric estimate of the expected response on the untransformed scale after fitting a linear regression model on a transformed scale. The estimate is consistent under mild regularity conditions, and usually attains high efficiency relative to parametric estimates. It can be viewed as a low-premium insurance policy against departures from parametric distributional assumptions. A real-world example of predicting medical expenditures shows that the smearing estimate can outperform parametric estimates even when the parametric assumption is nearly satisfied.

BACKGROUND: The use of global health items permits an efficient way of gathering general perceptions of health. These items provide useful summary information about health and are predictive of health care utilization and subsequent mortality. METHODS: Analyses of 10 self-reported global health items obtained from an internet survey as part of the Patient-Reported Outcome Measurement Information System (PROMIS) project. We derived summary scores from the global health items. We estimated the associations of the summary scores with the EQ-5D index score and the PROMIS physical function, pain, fatigue, emotional distress, and social health domain scores. RESULTS: Exploratory and confirmatory factor analyses supported a two-factor model. Global physical health (GPH; 4 items on overall physical health, physical function, pain, and fatigue) and global mental health (GMH; 4 items on quality of life, mental health, satisfaction with social activities, and emotional problems) scales were created. The scales had internal consistency reliability coefficients of 0.81 and 0.86, respectively. GPH correlated more strongly with the EQ-5D than did GMH (r = 0.76 vs. 0.59). GPH correlated most strongly with pain impact (r = -0.75) whereas GMH correlated most strongly with depressive symptoms (r = -0.71). CONCLUSIONS: Two dimensions representing physical and mental health underlie the global health items in PROMIS. These global health scales can be used to efficiently summarize physical and mental health in patient-reported outcome studies.