Performance of Osteoporosis Risk Assessment Tools in Iranian Postmenopausal Women
Subgroup: Volume 5, Issue 1, Winter
Date: January 2007
Type: Original Article
Start Page: 26
End Page: 32
- MH Dabbaghmanesh Endocrine and Metabolism Research Center, Nemazee Hospital, Shiraz, IR.Iran
- R Sabet Department of Physical Medicine and Rehabilitation, Faghihi hospital, Shiraz University of Medical Sciences, Shiraz, IR.Iran
- A Aria Endocrine and Metabolism Research Center, Nemazee Hospital, Shiraz, IR.Iran
- GR R Omrani Endocrine and Metabolism Research Center, Nemazee Hospital, Shiraz, IR.Iran
City, Province: Shiraz,
E-mail: dabbaghm@ sums.ac.ir
Risk indices have been developed to identify postmenopausal women at risk of low bone mineral density who need to undergo BMD test-ing. The aim of study was to compare perform-ance of three decision rules for identifying women with primary osteoporosis in an Iranian post-menopausal population. Materials and Methods: Three osteoporosis risk indices- the osteoporosis self assessment tool (OST), the osteoporosis risk assessment instru-ment (ORAI), and body weight criterion were calculated for 5573 out patients without risk fac-tors for secondary osteoporosis or receiving ac-tive bone medication. BMD at spine and femoral neck were measured via dual x-ray absorpti-omety. The sensitivity, specificity, positive pre-dictive value, negative predicative value and area under receiver operating characteristic curve to identify those with osteoporosis were deter-mined for each decision rule; these were then compared. Results: The sensitivity of these risk indices ranged from 70% to 84/1% and specificity from 44.6 to 65.6%. The area under curve (ROC) in identifying patients with osteoporosis were sig-nificantly better for OST (0.75) and ORAI (0.74) compared with the body weight criteria (0.66). The negative predicative values ranged from 80 to 93%, while positive predication values ranged from 33 to 45%. Conclusion: Our data provide evidence for the application of OST, ORAI as useful clinical tools in making decision about which women need to be referred for BMD testing; more evidence however is needed to confirm validity of the body weight criterion. Of the three tools evalu-ated, the OST is the simplest and has the best potential for use in clinical practice.
Keywords: Osteoporosis;Postmenopausal women;Osteoporosis risk indices;Screening
Osteoporosis is a systemic disorder characterized by decreasing bone density and micro-architectural deterioration of bone, which leads to fragile bone and susceptibility to fracture. It usually has no signs.1 The method most commonly used to diagnose osteoporosis is measuring of bone mineral density (BMD) with “DXA” method in the pelvis region and lumbar vertebrae,2-4 however because of limitations in the availability of BMD technology and economical factors in developing countries, it has been suggested that this be done based on assessing the risk factors of patients.5-6 Various researches have identified risk factors for osteoporosis 7-8 and on the basis of these the risk factors the “Risk Assessment Tools” have been defined.9-14
The Risk Assessment Tools cannot distinguish all subjects with osteoporosis, but do increase the capability of bone mineral density measurement to identify women with osteoporosis. It is necessary to assess the validity of these decision rules as suitable guidelines for the identification of patients that would most likely benefit from BMD testing in different communities.15 While these rules use a single cut point for deciding whether to test or not, it has suggested that two cut points be used in order to classify the likelihood of osteoporosis as low, moderate or high.16-18 The purpose of this research was to evaluate the efficacy of these methods in screening postmenopausal women in Iran. Our goals were to assess the validity and performance of the Osteoporosis Risk Assessment Instrument (ORAI), the Osteoporosis Self Assessment Tool (OST) and Body Weight Index to increase the efficiency of BMD measurement in identifying asymptomatic women who are at increased risk.
Materials and Methods
We used the medical database of women,aged 45 years or over, referred between March 2001 to January 2006 by physicians to the Bone Mineral Density Measurement Center of the Shiraz Medical School in Iran. Women with major risk factors for secondary osteoporosis e.g. menopause before age 45, hyperthyroidism, hyperparathyroidism, long-term glucocorticoid use, rheumatological disorder and malabsorptive syndromes were excluded from the study. Moreover, those patients taking medications other than estrogen with direct effect on bone and with a prior fragility fracture were also excluded. BMD measurements using DXA (Dual x-ray absorptiometry) Technology (Lunar Corporation, Madison, WI), were obtained from the femoral neck and lumbar spine (L2-L4). According to WHO classification, subjects were categorized as normal (T score>-1), osteopenic (-18 for ORAI. Also according to risk assessment, the patients were categorized as low, moderate or high risk.
Table 1. Decision rules for bone mineral density testing
||Calculation||BMD testing suggestion||Risk levels|
|ORAI||Points are given if:||Low: <9|
|Age (years): >75
|Age (years): 65-74
||+9||Moderate: 9 to 17|
|Age (years): 55-64||+5||ORAI>8|
|Weight (kg) < 60||+9||High:>17|
|Weight (kg): 60-70
|Add two points if estrogen is not
|Body weight index (kg)||Weight<70||Moderate :57-70|
||0.2[weight(KG)-age(years)]; truncate to yield integer||OST<2||Moderate: 1 to-3|
BMD measurement was also recommended if body weight was less than 70 kilograms.19 However, a value< 57.6, previously considered as an important risk factor,20 was used as another cut point to classify subjects in to three groups based on body weight index. Table 1 shows these indices in detail. The specificity and sensitivity of each decision rule for selecting women with osteoporosis were identified. The receiver operating characteristic (ROC) curve of each decision rule was determined and compared. Positive and negative predictive values for identifying osteoporosis and helping the selection of patients for BMD testing were determined. We used SPSS (version 11.5) for statistic analyses.
A total number of 5573 women were evaluated. The mean age of the women in our sample was 57.2+8.3 ranging from 45 to 88 years. The average weight, height and body mass index of the sample were 66.9+11.3 kg, 158+6.1 cm and 26.8+5.9 kg/m2, respectively. Prevalence of osteoporosis was 30.8% at the lumbar spine and 20% at the femoral neck. The percentage of women with osteoporosis at either lumbar spine or femoral neck was 36.6%. Osteopenia was 39.7% at lumbar spine and 48.6% at femoral neck. The percentage of women with osteoporosis or osteopenia at either lumbar spine or femoral neck was 64.3%.Prevalence rate of osteoporosis and osteopenia in different age group are shown in Table 2.According to suggested cut points (OST score <2, ORAI score >8 and body weight <70 kg), OST recommended 47% women for BMD testing compared with ORAI (51%) and Body Weight index (60.5%). At the considered thresholds of OST, ORAI and Body Weight index, they selected 19.2%, 22% and 43.5% of the patients with normal BMD who were recommended for densitometry with DXA in which body weight criterion was selected significantly more.Table 3 shows the sensitivity and specificity of each method for selecting women with osteoporosis in lumbar region and femoral neck separately. The sensitivity ranged from 70% to 74.9% for lumbar spine and 80.5% to 84% for femoral neck. Corresponding specificity values ranged from 45.9% to 62.6% for the lumbar spine and 44.6% to 60.6% for the femoral neck. It also summarized the sensitivity and specificity of these methods for women with osteoporosis at either lumbar spine or femoral neck, its sensitivity being between 70.7% and 74.2% and specificity between 47.4% and 65.6%. Negative predictive value was between 80% and 83% for lumbar vertebrae and ranged from 90% to 93% for the femoral neck; it was between 76% and 80% for osteoporosis at either lumbar spine or femoral neck.
Table 2. Prevalence of osteoporosis and osteopenia in different ages by BMD measurement site
at the lumbar
at the femoral
at the lumbar
Table 3. Performance of decision rules for selecting women with osteoporosis
|Lumbar spine||Femoral neck||Lumbar spine or Femoral neck|
*: Positive predictive Value; †: Negative Predictive Value; ‡ All numbers are in percent
Table 4. Area under the ROC curves for three decision rules in different sites
|Lumbar spine or
These values indicate the efficiency of these indices for recommendation of BMD testing with DXA. Table 3 shows positive predictive value in different assessment methods.When considering the area under the ROC curve for assessing capability of these methods for selecting women with osteoporosis for BMD testing, it seems that most of the area under the ROC curve for all considered parts is higher for OST and this area is meaningfully better and more suitable for OST and ORAI than the body weight index (Table 4).
The subjects were categorized into three groups based on risk indices. Increased
prevalence of osteoporosis with ascending risk category (low, moderate, high) was obvious for all three-risk tools. Of the women classified as high risk (3.6 %) based on OST risk levels, 90.5% had osteoporosis in the lumbar spine or femoral neck. Based on ORAI, in which 8.6 % of women were considered as high risk, 84.9% had osteoporosis in lumbar spine or femoral neck, but considering weight index, only 60.9% of high-risk women had osteoporosis.
Low risk postmenopausal women were 52.3%, 49% and 39.5% for the OST, ORAI and body weight index, respectively. Nearly 80% of women with low risk in OST and ORAI had no osteoporosis on BMD testing with DXA. This was 77% for low risk women based on body weight index.
Osteoporosis, a skeletal disease with significantly increasing morbidity and mortality worldwide, due to susceptibility to fracture, usually has no signs. With the fast increasing populations of Asian countries, it is predicted that 50% of hip fractures will occur in these countries by 2050.21 In the last decade, effective treatments for decreasing loss of bone density and cure of osteoporosis have been introduced.22 Moreover, DXA is recommended for measurement of bone mineral density and fracture risk assessment. Unfortunately, in most developing countries, these devices for BMD measuring are not available and BMD testing costs too much. Mass screening for osteoporosis is not recommended.3 Although most physicians are aware of osteoporosis, treatment significance and introduction of different ways to select high-risk subjects to measure BMD,2,20,23 osteoporosis is diagnosed and appropriately treated,24-25only in a small proportion of patients, in which case using decision rules for identifying osteoporosis is helpful. In our study, the sensitivity for OST and ORAI to identify osteoporosis is between 70-80% with a negative predictive value between 80-90% and the under curve area is between 0.7-0.8, which showed the efficiency of these two tools for identifying subjects with osteoporosis. On the other hand, less than 30% of women without osteoporosis were introduced to BMD measurement center with these two tools. Although the sensitivity of the body weight index was close to previous methods, it indicated that 43.5% of women without osteoporosis for BMD testing. In addition, consistent with findings of other studies 11, the area under the ROC curve for body weight index was less than that for OST and ORAI, which demonstrates the lower validity of this index.In one study of Asian countries, sensitivity, specificity and the area under the ROC curve were 91%, 45% and 0.79 respectively for OST 9. The sensitivity was 90% and specificity 52% for the ORAI in identifying women with osteoporosis at the femoral neck which was similar to our study findings.16In a study involving 644 postmenopausal women in Canada, the sensitivity ranged from 92% to 95% and the specificity from 35% to 64% to identify women with osteoporosis. Moreover, the area under the ROC curve was significantly better for OST and ORAI indices than for body weight index.26 In another study conducted at the university of Liege in Belgium, the OST sensitivity ranged from 85% at the lumbar spine to 97% at the femoral neck and specificity was 34% at the femoral neck and lumbar spine to detect osteoporosis. In addition, negative predictive value was 89% at the lumbar spine and 95% at the femoral neck, values which were almost consistent with our findings in the current study, demonstrating the efficiency of OST in selecting women with osteoporosis. ORAI sensitivity was 79% at the lumbar spine and 82% at the femoral neck and specificity was 45% at the lumbar spine and femoral neck.27It seems that categorizing postmenopausal women to low, moderate and high-risk groups based on OST or ORAI is helpful for physicians, because 90.5% of high-risk women based on OST and 84.5% based on ORAI had osteoporosis whereas this value was 60.9% for body weight index.As with most studies, our finding has some limitations, our data were collected from women attending clinics and may differ in some ways from the general Iranian postmenopausal population so the results may not be generalizable.
In conclusion, measuring BMD is the best method of identifying patients with osteoporosis but measuring BMD in all postmenopausal women is not feasible in most developing countries. It seems that OST and ORAI are effective screening tools for BMD testing in this study but further studies are needed to confirm the efficiency of body weight index. The OST and ORAI tools were very effective in this Iranian population and the high negative predictive value allows for the safe exclusion of healthy women, in order to allocate BMD test resources to those most likely to benefit.
- NIH consensus development conference. Diagnosis, prophylaxis and treatment of osteoporosis. Am J Med 1993; 94: 646-50.
- Genant HK, Cooper C, Poor G, Reid I, Ehrlich G, Kanis J, et al. Iterim report and recommendations of the World Health Organization task- force for osteoporosis. Osteoporos Int 1999; 10: 259-64.
- US Preventive Services Task Force Screening for Osteoporosis in postmenopausal women: Recommendation and rationale. Ann Int Med 2002; 137: 526-8.
- Nelson HD, Helfand M, Woolf SH, Allan JD. Screening for postmenopausal osteoporosis: a review of the evidence for the US Preventive Services Task Force. Ann Int Med 2002; 137: 529-41.
- Kanis JA, Delmas P, Burckhardt P, Cooper C, Torgerson D.. Guidelines for diagnosis and management of osteoporosis: the European Foundation for Osteoporosis and Bone Disease. Osteoporos Int 1997; 7: 390-406.
- Raisz LG. Screening for Osteoporosis. N Engl J Med.2005; 14; 353: 164-71.
- Ribot C, Pouilles JM, Bonneu M, Tremollieres F.. Assessment of the Risk of Post –Menopausal Osteoporosis Using Clinical Factors. Clin Endocrinol 1992; 36: 225-8.
- Bauer DC, Browner WS, Cauley JA, Orwoll ES, Scott JC, Black DM, et al. Factor Associated with Appendicular Bone Mass in Older Women. Ann Int Med 1993; 118: 657-65.
- Koh LK, Sedrine WB, Torralba TP, Kung A, Fujiwara S, Chan SP, et al. A simple tool to identify asian women at increased risk of osteoporosis. Osteoporos Int 2001; 12: 699-705.
- Cadarette SM, Jaglal SB, Kreiger N, McIsaac WJ, Darlington GA, Tu JV. Development and validation of the osteoporosis Risk Assessment Instrument to facilitate selection of women for bone densitometry. CMAJ 2000; 162: 1289-94.
- Cadarette SM, Jaglal SB, Murray TM, McIsaac WJ, Joseph L, Brown JP; et al. Evaluation of decision rules for referring women for bone densitometry by dual- energy X-ray absorptiometry. JAMA 2001; 286: 57-63.
- Van der Voort DJ, Dinant GJ, Rinkens PE, van der Voort-Duindam CJ, van Wersch JW, Geusens PP. Construction of an algorithm for quick detection of patients with low bone mineral density and its applicability in daily general practice. J Clin Epidemiol 2000; 53: 1095-3.
- Lydick E, Cook K, Turpin J, Melton M, Stine R, Byrnes C. Development and validation of simple questionnaire to facilitate identification of women likely to have low bone facilitate identification of women likely to have low bone density. Am J Manag Care 1998; 4: 37-48.
- Black DM, Palermo L, Abbott T, et al. SOFSURF: A simple, useful risk factor system can identify the large majority of women with osteoporosis. Bone.1998; S605: abstract SA333.
- McGinn TG, Guyatt GH, Wyer PC et al. Users ' guides to the medical literature. XXII: How to use articles about clinical decision rules. JAMA 2002; 284: 79-84.
- Geusens P, Hochberg MC, van der Voort DJ, Pols H, van der Klift M, Siris E, et al. Performance of risk indices for identifying low bone density in postmenopausal women. Mayo Clin Proc 2002; 77: 629-37.
- Fujiwara S, Masunnari N, Suzuki G, et al. Performance of osteoporosis risk in a Japanese population. Curr Ther Res 2001; 62: 586-94.
- Sedrine WB, Chevallier T, Zegels B, Kvasz A, Micheletti MC, Gelas B, et al. Development and assessment of the Osteoporosis Index of Risk (OSIRIS) to facilitate selection of women for bone densitometry. Gynecol Endocrinol 2002; 16: 245-50.
- Michaelsson K, Bergstrom R, Mallmin H, Holmberg L, Wolk A, Ljunghall S. Screening for Osteopenia and osteoporosis: selection by body composition. Osteoporos Int 1996; 6: 120-6.
- National osteoporosis Foundation .Physician’s guide to prevention and treatment of Osteoporosis. [http://www.nof.org/] Accessed 22 June 2003.
- Cooper C, Campion G, Melton LJ. Hip fractures in the elderly: A worldwide projection. Osteoporos Int 1992; 2: 285-9.
- Rosen CJ. Postmenopausal Osteoporosis. N Engl J Med 2005; 353: 595-603.
- North American Menopause Society. A decision tree for the use of estrogen replacement therapy or hormone replacement therapy in postmenopausal women: Consensus opinion of the North American menopause society. Menopause 2000; 7: 76-86.
- Looker AC, Wahner HW, Dunn WL, Calvo MS, Harris TB, Heyse SP, et al. Updated data on proximal femur bone mineral levels of US adults. Osteoporos Int 1998; 8: 468-89.
- Pal B. Questionnaire survey of advice given to patients with fracture. Br Med J 1999; 318: 500-1.
- Cadarette SM, McIsaac WJ, Hawker GA, Jaakkimainen L, Culbert A, Zarifa G, et al. The validity of decision rules for selecting women with primary osteoporosis for bone mineral density testing. Osteoporos Int 2004; 15: 361-6.
- Richy F, Gourlay M, Ross PD, Sen SS, Radican L, De Ceulaer F, et al. Validation and comparative evaluation of the osteoporosis self- assessment tool (OST) in a Caucasian population from Belgium. QJM 2004; 97: 39-46.