Bone disease is one of the most debilitating manifestations of multiple myeloma. A complex interdependence exists between myeloma bone disease and tumor growth, creating a vicious circle of extensive bone destruction and myeloma progression. Proteasome inhibitors have recently been shown to promote bone formation in vitro and in vivo. Preclinical studies have demonstrated that proteasome inhibitors, including bortezomib, which is the first-in-class such agent, stimulate osteoblast differentiation while inhibiting osteoclast formation and bone resorption. Clinical studies are confirming these observations. Bortezomib counteracts the abnormal balance of osteoclast regulators (receptor activator of nuclear factor-κB ligand and osteoprotegerin), leading to osteoclast inhibition and decreased bone destruction, as measured by a reduction in markers of bone resorption. In addition, bortezomib stimulates osteoblast function, possibly through the reduction of dickkopf-1, leading to increased bone formation, as indicated by the elevation in bone-specific alkaline phosphatase and osteocalcin. The effect of bortezomib on bone disease is thought to be direct and not only a consequence of the agent's antimyeloma properties, making it an attractive agent for further investigation, as it may combine potent antimyeloma activity with beneficial effects on bone. However, the clinical implication of these effects requires prospective studies with specific clinical end points.

Myeloma bone disease is the result of increased destruction of bone that cannot be compensated for by new bone formation. Approximately 80% of patients with multiple myeloma (MM) develop skeletal complications including bone pain, osteolytic lesions, pathologic fractures, and hypercalcemia.1  Osteolytic bone destruction is the most debilitating manifestation of MM and has a severe impact on patients' quality of life. Moreover, myeloma-associated lytic bone lesions do not repair, even in patients who are disease free for years.2,3 

Mechanisms of myeloma bone disease

The pathophysiology of myeloma bone disease has been studied extensively over recent years. This has led to new insights into the complex interactions between myeloma cells and osteoclasts and osteoblasts. Histomorphometric studies have revealed that myeloma cells promote osteoclastic bone resorption and suppress osteoblast activity,4,5  thereby causing an imbalance between the processes of bone resorption and formation, which is so characteristic of myeloma bone disease6–9  (Figure 1).

Figure 1

Pathophysiology of myeloma bone disease and the suggested sites of action of bortezomib. (1) Myeloma cells produce RANKL and (2) cause stromal cells to overexpress RANKL. Bortezomib reduces levels of RANKL. (3) OPG is the soluble RANKL antagonist. (4) Myeloma cells inhibit OPG production and also bind circulating OPG by syndecan-1, thus facilitating its internalization and degradation. Bortezomib restores the RANKL/OPG balance. (5) Myeloma cells express MIP-1α, MIP-1β, and SDF-1α, which recruit osteoclast precursors and enhance osteoclast activity. (6) Myeloma cells secrete Dkk1 and sFRP-2, which inhibit osteoblast differentiation and function. Bortezomib inhibits Dkk1 expression and increases osteoblast differentiation and activity. (7) The resulting enhanced bone resorption releases cytokines and growth factors that in turn promote myeloma cell proliferation and survival. Adapted from Heider et al7  with permission.

Figure 1

Pathophysiology of myeloma bone disease and the suggested sites of action of bortezomib. (1) Myeloma cells produce RANKL and (2) cause stromal cells to overexpress RANKL. Bortezomib reduces levels of RANKL. (3) OPG is the soluble RANKL antagonist. (4) Myeloma cells inhibit OPG production and also bind circulating OPG by syndecan-1, thus facilitating its internalization and degradation. Bortezomib restores the RANKL/OPG balance. (5) Myeloma cells express MIP-1α, MIP-1β, and SDF-1α, which recruit osteoclast precursors and enhance osteoclast activity. (6) Myeloma cells secrete Dkk1 and sFRP-2, which inhibit osteoblast differentiation and function. Bortezomib inhibits Dkk1 expression and increases osteoblast differentiation and activity. (7) The resulting enhanced bone resorption releases cytokines and growth factors that in turn promote myeloma cell proliferation and survival. Adapted from Heider et al7  with permission.

Close modal

The molecular mechanisms responsible for the increased osteoclastic bone resorption are also becoming clear. Under normal circumstances, receptor activator of nuclear factor-kappa B ligand (RANKL) and its decoy receptor osteoprotegerin (OPG) regulate osteoclast formation, activity, and bone resorption. Myeloma cells disrupt the balance between RANKL and OPG by increasing the expression of RANKL and decreasing the expression of OPG.10–12  The resulting increase in RANKL favors the formation and activation of osteoclasts, leading to increased bone resorption.10,11,13–15  Altering the balance in this system with OPG or soluble RANK constructs has been shown to prevent the development of myeloma bone disease.11,13,16  In addition to RANKL and OPG, macrophage inflammatory protein-1α (MIP-1α) and MIP-1β have been shown to be produced by myeloma cells and promote osteoclastic bone resorption.17–23  MIP-1α may act in a RANKL-dependent manner.21  Additional factors, including stromal cell-derived factor-1α (SDF-1α),24  interleukin 3 (IL-3),25  and hepatocyte growth factor,26  have also been implicated in regulating the increase in osteoclast formation or activity. The bone destruction brought about by the myeloma cells results in the release of cytokines and growth factors, either from osteoclasts themselves or present in bone matrix that may further promote myeloma cell growth and survival, thus establishing a cycle of dependence between the tumor cells and osteoclastic bone destruction.27 

In addition to their stimulatory effect on osteoclasts, myeloma cells have been shown to suppress bone formation.4,5  In vitro studies have confirmed that myeloma cells can inhibit the differentiation of osteoblast precursors and can induce apoptosis in mature osteoblasts.28–31  Although our understanding of the molecular mechanisms responsible for increased osteoclastic resorption has improved, our grasp of the molecular mechanisms responsible for the inhibition of bone formation is less clear. The Wingless-type (Wnt) signaling pathway is one pathway that has been shown to play a key role in osteoblast differentiation32  and has been implicated in osteoblast suppression in myeloma. Tian et al33  have shown that dickkopf-1 (Dkk1), an inhibitor of the Wnt signaling pathway, is secreted by myeloma cells and may inhibit osteoblast differentiation and activity in vitro. Dkk1 has also been found to be increased in the serum of patients with myeloma but not in patients with monoclonal gammopathy of undetermined significance (MGUS).33,34  However, these studies require independent confirmation, as not all investigators have seen that Dkk1 regulates bone formation in MM30  and been able to show that serum concentrations are increased. Soluble frizzle-related protein-2 (sFRP-2), another inhibitor of Wnt signaling, has also been implicated in suppression of bone formation in myeloma.35  Furthermore, other molecules, including IL-7 and IL-3, have been reported to be elevated in myeloma and block osteoblast differentiation either directly or indirectly in vitro.30,36  The precise role of each of these molecules has not been established and their role in vivo is often less clear; however, the result of these multiple interactions is the inhibition of osteoblast differentiation and reduced bone formation.

Current management of myeloma bone disease

Bisphosphonates are specific inhibitors of osteoclast activity and are the current mainstay of therapy for myeloma bone disease.37–39  Clinically, bisphosphonates reduce, but do not completely prevent, skeletal damage. Bisphosphonates inhibit osteoclast recruitment and maturation, prevent differentiation, and induce osteoclast apoptosis.40  Furthermore, antimyeloma activity of pamidronate and zoledronic acid has been suggested.41,42  However, these agents impact on osteoclast activity only and do not restore bone formation. Thus, new approaches to inhibiting osteoclastic resorption and preventing the inhibition of bone formation are still required to prevent the development of myeloma bone disease.

The ubiquitin-proteasome pathway is the major intracellular mechanism for the degradation of proteins that are involved in a range of normal cellular processes including the control of the cell cycle, transcriptional activation, apoptosis, and cell signaling. Many of these biologic pathways are directly related to the development and progression of cancer and may also be directly involved in regulating bone turnover.43,44  In patients with active myeloma, serum proteasome concentrations are significantly elevated and reduced in responders to chemotherapy.45  Furthermore, circulating proteasome levels have been identified as an independent prognostic factor in patients with active MM,45  even though there is no evidence that there is any correlation between the inhibition of proteasome activity and a response to therapy.

Proteasome inhibition has been implicated in the regulation of bone metabolism through the reduction of RANKL-mediated osteoclast differentiation via the inhibition of nuclear factor-kappa B (NFκB) signaling. Binding of RANKL to RANK on the surface of osteoclast precursors induces NFκB activation, which leads to osteoclast differentiation and bone resorption. However, in the presence of proteasome inhibitors, IκB, the inhibitor of NFκB, which is normally degraded by the proteasome, remains bound to NFκB and prevents the activation of NFκB.46  Consequently, proteasome inhibition would be predicted to prevent bone resorption. In accordance with this hypothesis, Zavrski et al47  showed that treatment of osteoclast precursors with the proteasome inhibitors MG-132 and MG-262 inhibited RANKL-mediated osteoclast formation at nanomolar, subapoptotic concentrations. This reduction was accompanied by a reduction of the resorption capacity of osteoclasts. Furthermore, osteoclasts treated with proteasome inhibitors exhibited a dose-dependent reduction of NFκB activation, which strongly correlated with the diminished osteoclast differentiation.47  Thus, proteasome inhibition may inhibit osteoclastic bone resorption directly.

In addition to modifying bone resorption, Garrett et al48  found that the ubiquitin-proteasome pathway is also involved in the regulation of osteoblast differentiation and bone formation. Proteasome inhibitors, such as epoxomicin, proteasome inhibitor-1 (PS-1), and lactacystin, at low nanomolar concentrations, were shown to promote bone formation and increase osteoblast numbers in a dose-dependent manner in bone organ culture systems. In that study, only proteasome inhibitors and not inhibitors of nonproteasomal proteases or other inhibitors of NF-κB showed this beneficial effect on bone formation in vitro. But, more importantly, 5 days of treatment with the proteasome inhibitors epoxomicin or PS-1 promoted an increase in bone formation rate and new bone formation in vivo. The effect of proteasome inhibitors on bone formation was reported to be mediated by increased bone morphogenetic protein-2 (BMP-2) expression in osteoblasts. BMPs act predominantly on osteoblasts and promote their differentiation in an autocrine manner.48 

These data strongly suggest that the proteasome system may play a key role in regulating bone remodeling by inhibiting osteoclast formation and stimulating new bone formation, and therefore proteasome inhibitors have been tested in both preclinical and clinical settings for their potential effect on bone metabolism in myeloma-related bone disease.

Bortezomib is the first-in-class potent and reversible inhibitor of the proteasome that has demonstrated efficacy in the treatment of both relapsed/refractory and newly diagnosed MM.49–51  In multiple myeloma, bortezomib has been approved for the treatment of patients who have received 1 prior therapy and is being investigated in the front-line setting as a single agent or in combination with other agents. Since proteasome inhibition has been shown to regulate bone turnover, an increasing number of studies have examined the effect of bortezomib in myeloma-related bone disease. These data are discussed in “Preclinical studies” and “Clinical studies.”

Effect of bortezomib on bone formation

Oyajobi et al52  first reported that bortezomib could stimulate new bone formation in neonatal mouse calvariae organ culture. The increased bone formation was associated with an inhibition of the Wnt signaling antagonist Dkk1 in both stromal cell lines and in the organ culture system.52  Giuliani et al53  reported that bortezomib could induce osteoblast differentiation in human mesenchymal cells and this was associated with increased Runx2/cbfa1 expression but not Wnt signaling. In contrast, bortezomib was shown not to effect the proliferation of more mature osteoblast-like cells or alter levels of apoptosis. Furthermore, expression of Runx2/Cba1 was not affected in these cells.53  Mukherjee et al54  demonstrated that bortezomib promoted an increase in the size of osteoblastic colony-forming units but had no effect on their number. These cells were CD45/CD51+, expressed collagen type I and alkaline phosphatase (ALP), and formed bone nodules, suggesting that they were of osteoblastic lineage. Mice treated with bortezomib also had increased numbers of bone marrow CD45/CD51+ cells.54  These data suggest that bortezomib may promote bone formation by stimulating progenitor proliferation and osteoblast differentiation rather than mature cell activity.

The effect of bortezomib has also been examined in vivo in the SCID-rab model of myeloma.55  Treatment of nonmyeloma-bearing mice with bortezomib (0.5 mg/kg twice a week) resulted in an increase in bone mineral density (BMD). In myeloma-bearing mice that were responsive to treatment, there was also an increase in BMD (20% ± 14%); however, this was not seen in nonresponsive mice, and BMD decreased (13% ± 12%). The increase in BMD was not seen in dexamethasone-responsive mice and was associated with increased numbers of osteocalcin (OC)-expressing osteoblasts and reduced numbers of tartrate-resistant acid phosphatase (TRACP)–expressing osteoclasts.55  Separating the direct effect of bortezomib on osteoblast differentiation and indirect effects via the inhibition of tumor growth in vivo is difficult; however, it does highlight a potential interdependence between myeloma growth and osteoblasts.

Effect of bortezomib on bone resorption

In addition to promoting bone formation, bortezomib has been reported to affect osteoclast differentiation and function. Oyajobi et al52  reported that bortezomib could prevent IL-1-stimulated bone resorption in a murine system. Furthermore, Kawanabe et al56  demonstrated that bortezomib could inhibit osteoclast formation in murine bone marrow cultures in a dose-dependent manner. In addition, bortezomib was shown to reduce resorption pit formation, which suggests it was able to inhibit both osteoclast formation as well as bone resorption.56  These data are supported by recent studies showing that bortezomib also inhibits the formation of human osteoclasts derived from either peripheral blood mononuclear cells or purified CD14+ precursors,57,58  and this was associated with a down-regulation of NFκB activity and an inhibition of the p38 mitogen-activated protein kinase pathway.55,57  Furthermore, bortezomib has been shown to inhibit osteoclast formation synergistically with the histone deacetylase (HDAC) inhibitor PXD101.59  This followed a previous observation that HDAC inhibitors block osteoclastogenesis60  and was based on the hypothesis that simultaneous targeting of different pathways may constitute a more effective approach for the suppression of osteoclast formation and the reduction of subsequent bone resorption.

In vivo, bortezomib treatment of SCID-rab mice bearing myeloma was associated with a reduction in osteoclast number.55  In a number of these studies, bortezomib treatment reduced the resorptive activity of mature human osteoclasts,57,58,61  although these effects were reported to be transient.61  However, separating the direct effect of bortezomib on osteoclast numbers and indirect effects via the inhibition of myeloma cells in vivo is difficult. In this point, we have to mention that the concentrations of bortezomib used in these studies were typically less than that required to induce tumor cell apoptosis.

Bortezomib increases osteoblast activity

An increasing number of studies are reporting the effects of bortezomib on bone formation in the clinical setting, confirming preclinical observations.

One of the first indications that bortezomib may have a positive effect on bone formation came from Zangari et al,62  who observed a significant increase in serum ALP levels in a patient who responded to treatment with bortezomib. Another case report was published by Shimazaki et al,63  who treated a patient with refractory MM with bortezomib, dexamethasone, and incadronate. The response to treatment was accompanied by increases in serum ALP level as well as bone-specific ALP (bALP), suggesting that bortezomib may have a direct effect on osteoblastic activity.

Elevations in ALP levels were also noted in patients responding to the combination of bortezomib, thalidomide, and dexamethasone but not in nonresponders to this treatment.64  These observations prompted the analysis of ALP levels in 2 large bortezomib trials, Study of Uncontrolled Multiple Myeloma managed with Proteasome Inhibition Therapy (SUMMIT) and Assessment of Proteasome Inhibition for Extending Remissions (APEX).62  A significant increase in ALP levels from baseline was observed in patients responding to bortezomib (complete responses [CRs] and partial responses [PRs]) within 3 cycles of therapy. A parallel increase in bALP and parathyroid hormone levels was noted and suggested that the response to bortezomib was associated with osteoblast activation. On the other hand, in patients responding to dexamethasone, no increase in ALP level was observed, possibly due to the toxic effect of dexamethasone on osteoblasts.

A more detailed analysis of data from the phase-3 APEX trial assessed the relationship between quantitative total ALP changes and response, and with time to progression during therapy with bortezomib. The analysis found that a 25% increase in total ALP levels at 6 weeks was strongly associated with patients achieving a response (CR + PR) and longer time to myeloma progression.65,66  The investigators concluded that markers of osteoblast activation may be useful in predicting response to bortezomib and duration of response. The results also suggest that bone anabolism may affect myeloma growth. Interestingly, the antimyeloma effect of osteoblasts was recently demonstrated in vitro and in vivo by Yaccoby et al, 67  who concluded that treatment with bone anabolic agents may benefit patients with MM.

Osteoblast stimulation with bortezomib was also observed by Heider et al,68  who measured changes in serum bALP and OC levels in patients receiving bortezomib ± dexamethasone (n = 25) and in a control group of patients who received adriamycin/dexamethasone-, melphalan/prednisone-, or thalidomide-containing regimens (n = 58). Significant increases in bALP and OC levels following bortezomib treatment were observed (Table 1). Interestingly, increases in markers of osteoblast activity were seen in responders and nonresponders, irrespective of whether dexamethasone was included in the treatment regimen. Conversely, in the control group of patients who did not receive bortezomib, no increase in osteoblast markers was seen, suggesting that the effect on osteoblasts is mainly due to the proteasome inhibitor.

Table 1

bALP and OC levels before and after treatment with bortezomib or alternative therapy

Bortezomib
Control group
Mean ± SDPMean ± SDP
bALP, U/L  <.001  NS 
    Before treatment 19.7 ± 19.8  24.8 ± 21.5  
    After treatment 30.2 ± 29.5  23.3 ± 23.7  
Osteocalcin, μg/L  .024  NS 
    Before treatment 6.3 ± 13.6  6.97 ± 7.7  
    After treatment 10.8 ± 21.5  6.6 ± 9.5  
bALP, U/L     
    Responders, n=14  .004  — 
        Before bortezomib 22.0 ± 26.2  —  
        After bortezomib 35.3 ± 36.5  —  
    Nonresponders, n=11  .016  — 
        Before bortezomib 16.7 ± 5.8  —  
        After bortezomib 23.6 ± 16.5  —  
    Bortezomib monotherapy, n=13  .004  — 
        Before bortezomib 22.2 ± 27.3  —  
        After bortezomib 33.2 ± 38.3  —  
    Bortezomib/dexamethasone, n=12  .021  — 
        Before bortezomib 17.0 ± 5.4  —  
        After bortezomib 26.9 ± 16.5  —  
Bortezomib
Control group
Mean ± SDPMean ± SDP
bALP, U/L  <.001  NS 
    Before treatment 19.7 ± 19.8  24.8 ± 21.5  
    After treatment 30.2 ± 29.5  23.3 ± 23.7  
Osteocalcin, μg/L  .024  NS 
    Before treatment 6.3 ± 13.6  6.97 ± 7.7  
    After treatment 10.8 ± 21.5  6.6 ± 9.5  
bALP, U/L     
    Responders, n=14  .004  — 
        Before bortezomib 22.0 ± 26.2  —  
        After bortezomib 35.3 ± 36.5  —  
    Nonresponders, n=11  .016  — 
        Before bortezomib 16.7 ± 5.8  —  
        After bortezomib 23.6 ± 16.5  —  
    Bortezomib monotherapy, n=13  .004  — 
        Before bortezomib 22.2 ± 27.3  —  
        After bortezomib 33.2 ± 38.3  —  
    Bortezomib/dexamethasone, n=12  .021  — 
        Before bortezomib 17.0 ± 5.4  —  
        After bortezomib 26.9 ± 16.5  —  

Adapted from Heider et al68  with permission.

NS indicates not significant; —, not applicable.

Terpos et al69  also showed that bortezomib significantly increased serum levels of bALP and OC in 34 patients with relapsed MM (Table 2). Patients who achieved a CR or very good PR (VGPR) after 4 cycles of bortezomib had greater elevations of bALP levels than those not achieving a CR or VGPR. Interestingly, 75% of nonresponders also had an increase in bALP levels following 4 cycles of bortezomib treatment. The increase in bone formation markers was accompanied by a reduction in Dkk1 serum levels, which was similar among responders and nonresponders after bortezomib therapy.69  Although no healing of lytic bone lesions was observed, even in patients who achieved a CR, longer follow-up or prolonged bortezomib therapy may be needed to demonstrate a radiographic improvement after increased bone formation.69  Finally, Giuliani et al53  have recently reported clinical evidence for the role of bortezomib in increasing osteoblast differentiation. These investigators treated 21 patients with relapsed/refractory MM with single-agent bortezomib and analyzed bone marrow biopsies. Significant increases in the number of osteoblastic cells/mm2 of bone tissue and Runx2/Cbfa1-positive osteoblastic cells were found in responding patients but not in those who did not respond. Although it cannot be excluded that the increase in osteoblast differentiation and numbers and the subsequent increase in bone formation could be due to the reduction in myeloma burden, it should be noted that this beneficial effect has not previously been observed with other antimyeloma regimens that effectively reduce tumor burden. It is likely that bortezomib stimulates bone formation by both directly inducing osteoblast function and indirectly reducing myeloma cell burden. However, when bortezomib is combined with other antimyeloma agents such as thalidomide and melphalan, it appears to lose its beneficial effect on osteoblasts. Terpos et al70  have recently reported that the VMDT regimen (combination of bortezomib with melphalan, dexamethasone, and intermittent thalidomide) produces no increase in bone formation markers (bALP and OC) although it reduces Dkk1 levels and tumor burden. The reason for the lack of effect is unclear and the study is difficult to interpret due to the presence of 4 agents. However, dexamethasone, an important component of MM therapy, is known to induce osteoporosis by reducing the lifespan of osteoblasts.71  Recent studies have shown that exposing osteoblasts to dexamethasone results in increased Dkk1 expression,72  indicating that the agent may inhibit osteoblast differentiation through a mechanism involving up-regulation of Dkk1, thereby blocking bone formation. Dexamethasone may thus inhibit the positive effect of bortezomib on osteoblasts in MM. Indeed, Heider et al68  found a lower increase in bALP levels in patients who received the combination of bortezomib with dexamethasone compared with patients who received bortezomib alone. Such studies highlight the requirement for single-agent studies investigating the effect of proteasome inhibition on bone.

Table 2

Markers of bone metabolism prior to and following bortezomib treatment (median values)

BaselineAfter 4 cycles of bortezomibP vs baselineAfter 8 cycles of bortezomibP vs baseline
Osteoblast inhibitor: Dkk1, ng/mL 76.6 53.6 .035 25.8 .001 
Osteoclast regulators      
    sRANKL, pM 0.47 0.25 .01 .09 <.001 
    OPG, pM 3.54 3.31 .249 2.29 .151 
    sRANKL/OPG 0.12 0.05 .126 .03 .01 
Markers of bone resorption      
    CTX, ng/mL 0.7 0.33 <.001 .25 .001 
    TRACP-5b, U/L 2.59 1.86 <.001 2.04 .003 
Markers of bone formation      
    bALP, U/L 17.3 23.7 <.001 26 <.01 
    OC, ng/mL 7.46 12.5 <.01 19 <.01 
BaselineAfter 4 cycles of bortezomibP vs baselineAfter 8 cycles of bortezomibP vs baseline
Osteoblast inhibitor: Dkk1, ng/mL 76.6 53.6 .035 25.8 .001 
Osteoclast regulators      
    sRANKL, pM 0.47 0.25 .01 .09 <.001 
    OPG, pM 3.54 3.31 .249 2.29 .151 
    sRANKL/OPG 0.12 0.05 .126 .03 .01 
Markers of bone resorption      
    CTX, ng/mL 0.7 0.33 <.001 .25 .001 
    TRACP-5b, U/L 2.59 1.86 <.001 2.04 .003 
Markers of bone formation      
    bALP, U/L 17.3 23.7 <.001 26 <.01 
    OC, ng/mL 7.46 12.5 <.01 19 <.01 

Adapted from Terpos et al69  with permission.

Bortezomib inhibits osteoclast activity

Results from a prospective study on markers of bone resorption by Peles et al73  suggest an inhibitory effect of bortezomib on osteoclastic bone resorption in patients receiving the agent as consolidation treatment following transplantation. Patients (n = 33) were treated with bortezomib 1.3 mg/m2 once weekly for 4 of every 5 weeks, 90 to 120 days after transplantation, for 6 cycles. Patients did not receive bisphosphonates from 42 days prior to stem cell collection until cycle 3 of bortezomib therapy. Following 2 cycles of consolidation therapy, a 32% reduction in urinary N-terminal cross-linking telopeptide of collagen type-I (NTX) excretion, a highly specific marker of bone resorption, was observed. This reduction suggests that bortezomib has an inhibitory effect on osteoclast activity and bone resorption, which was seen even in patients at a plateau phase of their disease. Interestingly, the only patient with an increase in NTX of more than 30% was also the only patient with evidence of disease progression. However, contrary to recent reports on the positive effect of bortezomib on osteoblastic bone formation, a decline in OC levels was observed in this study.73 

Furthermore, Terpos et al69  have recently reported in 34 patients with relapsed myeloma that bortezomib administration, at the standard dosage, resulted in a significant reduction in serum RANKL levels, after 4 and 8 cycles of therapy, with concomitant reduction in osteoclast function and bone resorption, as assessed by the serum levels of TRACP type-5b (TRACP-5b) and C-terminal cross-linking telopeptide of collagen type-I (CTX), respectively (Table 2). The reduction in osteoclast function and bone resorption occurred irrespective of response to therapy in this study.69 

At this point, it is crucial to mention that different effective antimyeloma regimens in combination with bisphosphonates can also reduce bone resorption through the reduction of tumor burden and the inhibition of osteoclast function in MM.74–77  Randomized trials are needed to explore if bortezomib alone or in combination with other agents, including bisphosphonates, can inhibit bone resorption more effectively.

With approximately 70% to 80% of patients with MM developing skeletal complications, bone disease is a major problem in the management of this malignancy. Increased understanding of the pathophysiology of bone disease is helping to identify new therapeutic targets for this debilitating complication of MM. The ubiquitin-proteasome pathway is one system that has been implicated in bone remodeling and may play a key role in regulating both the growth and survival of myeloma cells, as well as modulating the development of myeloma bone disease.

Bortezomib, the first-in-class proteasome inhibitor, has multiple targets in MM. The agent is effective against myeloma cells and is now being investigated for its positive effect on myeloma bone disease. The data available to date strongly suggest that bortezomib is able to regulate bone remodeling by inhibiting osteoclast differentiation and resorption and promoting bone formation. Separating the potential direct effect of bortezomib on bone metabolism from an indirect effect on bones due to the reduction of tumor burden is very difficult. However, the effect of bortezomib on bone formation is notable and distinguishes this agent from bisphosphonates and other myeloma treatments that act only to inhibit bone resorption. Increased bone formation will not only reduce skeletal complications but may also help to control MM progression. Therefore, bortezomib may be the first agent that combines potent antimyeloma activity with potential beneficial effects on bone. However, to date, evidence of the effect of bortezomib on clinical end points specific to bone, such as skeletal-related events (SREs) and BMD, is limited, possibly as a result of relatively short follow-up periods. It is therefore essential to design prospective trials that investigate end points related to bone formation. Initially, it would be important to focus on studies with single-agent bortezomib to clearly establish the effect of the agent by itself on BMD and SREs. Maintenance therapy would be a useful setting to investigate this single-agent activity. An increase in BMD in patients receiving bortezomib maintenance treatment would suggest that the effect of bortezomib on bone is mainly via a direct effect on bone and not only due to a reduction in tumor burden. The results of such studies are eagerly anticipated.

Note added in proof.

After completion of this review, von Metzler et al78  published the first study showing that bortezomib inhibits human osteoclast differentiation, activation, and resorptional activity in a dose- and time-dependent manner.

O.S. was supported by the Deutsche Forschungsgemeinschaft (DFG; Klinische Forschergruppe KFO 105).

Contribution: All authors have participated in the acquisition of data; E.T. and O.S. participated in the analysis and interpretation of preclinical and clinical data; E.T. and M.-A.D. wrote the clinical part of this review; and E.T., P.C., and O.S. wrote the section on preclinical studies. All authors have given final approval of the version to be published.

Conflict-of-interest disclosure: All authors have participated in Advisory Boards of Janssen-Cilag with honoraria. E.T. has been supported with an unrestricted educational grant by Janssen-Cilag.

Correspondence: Evangelos Terpos, Department of Hematology and Medical Research, 251 General Airforce Hospital, 3 Kanellopoulou Street, GR-11525, Athens, Greece; e-mail: e.terpos@imperial.ac.uk; eterpos@hotmail.com.

1
Kyle
RA
,
Multiple myeloma: review of 869 cases.
,
Mayo Clin Proc
,
1975
, vol.
50
(pg.
29
-
40
)
2
Epstein
J
Walker
R
,
Myeloma and bone disease: “the dangerous tango”.
,
Clin Adv Hematol Oncol
,
2006
, vol.
4
(pg.
300
-
306
)
3
Terpos
E
Politou
M
Rahemtulla
A
,
New insights into the pathophysiologyand management of bone disease in multiple myeloma.
,
Br J Haematol
,
2003
, vol.
123
(pg.
758
-
769
)
4
Taube
T
Beneton
MN
McCloskey
EV
Rogers
S
Greaves
M
Kanis
JA
,
Abnormal bone remodelling in patients with myelomatosis and normal biochemical indices of bone resorption.
,
Eur J Haematol
,
1992
, vol.
49
(pg.
192
-
198
)
5
Bataille
R
Chappard
D
Marcelli
C
et al.
,
Recruitment of new osteoblasts and osteoclasts is the earliest critical event in the pathogenesis of human multiple myeloma.
,
J Clin Invest
,
1991
, vol.
88
(pg.
62
-
66
)
6
Heider
U
Hofbauer
LC
Zavrski
I
Kaiser
M
Jakob
C
Sezer
O
,
Novel aspects of osteoclast activation and osteoblast inhibition in myeloma bone disease.
,
Biochem Biophys Res Commun
,
2005
, vol.
338
(pg.
687
-
693
)
7
Heider
U
Fleissner
C
Zavrski
I
et al.
,
Bone markers in multiple myeloma.
,
Eur J Cancer
,
2006
, vol.
42
(pg.
1544
-
1553
)
8
Terpos
E
Dimopoulos
MA
,
Myeloma bone disease: pathophysiology and management.
,
Ann Oncol
,
2005
, vol.
16
(pg.
1223
-
1231
)
9
Sezer
O
Heider
U
Zavrski
I
Kühne
CA
Hofbauer
LC
,
RANK ligand and osteoprotegerin in myeloma bone disease.
,
Blood
,
2003
, vol.
101
(pg.
2094
-
2098
)
10
Giuliani
N
Bataille
R
Mancini
C
et al.
,
Myeloma cells induce imbalance in the osteoprotegerin/osteoprotegerin ligand system in the human bone marrow environment.
,
Blood
,
2001
, vol.
98
(pg.
3527
-
3533
)
11
Pearse
RN
Sordillo
EM
Yaccoby
S
et al.
,
Multiple myeloma disrupts the TRANCE/osteoprotegerin cytokine axis to trigger bone destruction and promote tumor progression.
,
Proc Natl Acad Sci U S A
,
2001
, vol.
98
(pg.
11581
-
11586
)
12
Standal
T
Seidel
C
Hjertner
O
et al.
,
Osteoprotegerin is bound, internalized, and degraded by multiple myeloma cells.
,
Blood
,
2002
, vol.
100
(pg.
3002
-
3007
)
13
Croucher
PI
Shipman
CM
Lippitt
J
et al.
,
Osteoprotegerin inhibits the development of osteolytic bone disease in multiple myeloma.
,
Blood
,
2001
, vol.
98
(pg.
3534
-
3540
)
14
Heider
U
Langelotz
C
Jakob
C
et al.
,
Expression of receptor activator of nuclear factor kappaB ligand on bone marrow plasma cells correlates with osteolytic bone disease in patients with multiple myeloma.
,
Clin Cancer Res
,
2003
, vol.
9
(pg.
1436
-
1440
)
15
Terpos
E
Szydlo
R
Apperley
JF
et al.
,
Soluble receptor activator of nuclear factor {kappa}B ligand (RANKL)/osteoprotegerin (OPG) ratio predicts survival in multiple myeloma: proposal for a novel prognostic index.
,
Blood
,
2003
, vol.
102
(pg.
1064
-
1069
)
16
Yaccoby
S
Pearse
RN
Johnson
CL
Barlogie
B
Choi
Y
Epstein
J
,
Myeloma interacts with the bone marrow microenvironment to induce osteoclastogenesis and is dependent on osteoclast activity.
,
Br J Haematol
,
2002
, vol.
116
(pg.
278
-
290
)
17
Choi
SJ
Cruz
JC
Craig
F
et al.
,
Macrophage inflammatory protein 1-alpha is a potential osteoclast stimulatory factor in multiple myeloma.
,
Blood
,
2000
, vol.
96
(pg.
671
-
675
)
18
Choi
SJ
Oba
Y
Gazitt
Y
et al.
,
Antisense inhibition of macrophage inflammatory protein 1-alpha blocks bone destruction in a model of myeloma bone disease.
,
J Clin Invest
,
2001
, vol.
108
(pg.
1833
-
1841
)
19
Abe
M
Hiura
K
Wilde
J
et al.
,
Role for macrophage inflammatory protein (MIP)-1alpha and MIP-1beta in the development of osteolytic lesions in multiple myeloma.
,
Blood
,
2002
, vol.
100
(pg.
2195
-
2202
)
20
Terpos
E
Politou
M
Szydlo
R
et al.
,
Serum levels of macrophage inflammatory protein-1 alpha (MIP-1α) correlate with the extent of bone disease and survival in patients with multiple myeloma.
,
Br J Haematol
,
2003
, vol.
123
(pg.
106
-
109
)
21
Oyajobi
BO
Franchin
G
Williams
PJ
et al.
,
Dual effects of macrophage inflammatory protein-1alpha on osteolysis and tumor burden in the murine 5TGM1 model of myeloma bone disease.
,
Blood
,
2003
, vol.
102
(pg.
311
-
319
)
22
Oba
Y
Lee
JW
Ehrlich
LA
et al.
,
MIP-1alpha utilizes both CCR1 and CCR5 to induce osteoclast formation and increase adhesion of myeloma cells to marrow stromal cells.
,
Exp Hematol
,
2005
, vol.
33
(pg.
272
-
278
)
23
Masih-Khan
E
Trudel
S
Heise
C
et al.
,
MIP-1alpha (CCL3) is a downstream target of FGFR3 and RAS-MAPK signaling in multiple myeloma.
,
Blood
,
2006
, vol.
108
(pg.
3465
-
3471
)
24
Zannettino
AC
Farrugia
AN
Kortesidis
A
et al.
,
Elevated serum levels of stromal-derived factor-1alpha are associated with increased osteoclast activity and osteolytic bone disease in multiple myeloma patients.
,
Cancer Res
,
2005
, vol.
65
(pg.
1700
-
1709
)
25
Lee
JW
Chung
HY
Ehrlich
LA
et al.
,
IL-3 expression by myeloma cells increases both osteoclast formation and growth of myeloma cells.
,
Blood
,
2004
, vol.
103
(pg.
2308
-
2315
)
26
Borset
M
Hjorth-Hansen
H
Seidel
C
Sundan
A
Waage
A
,
Hepatocyte growth factor and its receptor c-met in multiple myeloma.
,
Blood
,
1996
, vol.
88
(pg.
3998
-
4004
)
27
Abe
M
Hiura
K
Wilde
J
et al.
,
Osteoclasts enhance myeloma cell growth and survival via cell-cell contact: a vicious cycle between bone destruction and myeloma expansion.
,
Blood
,
2004
, vol.
104
(pg.
2484
-
2491
)
28
Silvestris
F
Cafforio
P
Tucci
M
Grinello
D
Dammacco
F
,
Upregulation of osteoblast apoptosis by malignant plasma cells: a role in myeloma bone disease.
,
Br J Haematol
,
2003
, vol.
122
(pg.
39
-
52
)
29
Silvestris
F
Cafforio
P
Calvani
N
Dammacco
F
,
Impaired osteoblastogenesis in myeloma bone disease: role of upregulated apoptosis by cytokines and malignant plasma cells.
,
Br J Haematol
,
2004
, vol.
126
(pg.
475
-
486
)
30
Giuliani
N
Colla
S
Morandi
F
et al.
,
Myeloma cells block RUNX2/CBFA1 activity in human bone marrow osteoblast progenitors and inhibit osteoblast formation and differentiation.
,
Blood
,
2005
, vol.
106
(pg.
2472
-
2483
)
31
Giuliani
N
Rizzoli
V
Roodman
GD
,
Multiple myeloma bone disease: pathophysiology of osteoblast inhibition.
,
Blood
,
2006
, vol.
108
(pg.
3992
-
3996
)
32
Day
TF
Guo
X
Garrett-Beal
L
Yang
Y
,
Wnt/beta-catenin signaling in mesenchymal progenitors controls osteoblast and chondrocyte differentiation during vertebrate skeletogenesis.
,
Dev Cell
,
2005
, vol.
8
(pg.
739
-
750
)
33
Tian
E
Zhan
F
Walker
R
et al.
,
The role of the Wnt-signaling antagonist DKK1 in the development of osteolytic lesions in multiple myeloma.
,
N Engl J Med
,
2003
, vol.
349
(pg.
2483
-
2494
)
34
Politou
MC
Heath
DJ
Rahemtulla
A
et al.
,
Serum concentrations of Dickkopf-1 protein are increased in patients with multiple myeloma and reduced after autologous stem cell transplantation.
,
Int J Cancer
,
2006
, vol.
119
(pg.
1728
-
1731
)
35
Oshima
T
Abe
M
Asano
J
et al.
,
Myeloma cells suppress bone formation by secreting a soluble Wnt inhibitor, sFRP-2.
,
Blood
,
2005
, vol.
106
(pg.
3160
-
3165
)
36
Ehrlich
LA
Chung
HY
Ghobrial
I
et al.
,
IL-3 is a potential inhibitor of osteoblast differentiation in multiple myeloma.
,
Blood
,
2005
, vol.
106
(pg.
1407
-
1414
)
37
UK myeloma forum.
,
British Committee for Standards in Haematology. Diagnosis and management of multiple myeloma.
,
Br J Haematol
,
2001
, vol.
115
(pg.
522
-
540
)
38
Berenson
JR
Hillner
BE
Kyle
RA
et al.
,
American Society of Clinical Oncology clinical practice guidelines: the role of bisphosphonates in multiple myeloma.
,
J Clin Oncol
,
2002
, vol.
20
(pg.
3719
-
3736
)
39
Lacy
MQ
Dispenzieri
A
Gertz
MA
et al.
,
Mayo clinic consensus statement for the use of bisphosphonates in multiple myeloma.
,
Mayo Clin Proc
,
2006
, vol.
81
(pg.
1047
-
1053
)
40
Terpos
E
Rahemtulla
A
,
Bisphosphonate treatment for multiple myeloma.
,
Drugs Today
,
2004
, vol.
40
(pg.
29
-
40
)
41
Croucher
PI
De Hendrik
R
Perry
MJ
et al.
,
Zoledronic acid treatment of 5T2MM-bearing mice inhibits the development of myeloma bone disease: evidence for decreased osteolysis, tumor burden and angiogenesis, and increased survival.
,
J Bone Miner Res
,
2003
, vol.
18
(pg.
482
-
492
)
42
Gordon
S
Helfrich
MH
Sati
HI
et al.
,
Pamidronate causes apoptosis of plasma cells in vivo in patients with multiple myeloma.
,
Br J Haematol
,
2002
, vol.
119
(pg.
475
-
483
)
43
Kropff
M
Bisping
G
Wenning
D
Berdel
WE
Kienast
J
,
Proteasome inhibition in multiple myeloma.
,
Eur J Cancer
,
2006
, vol.
42
(pg.
1623
-
1639
)
44
Zavrski
I
Kleeberg
L
Kaiser
M
et al.
,
Proteasome as an emerging therapeutic target in cancer.
,
Curr Pharm Design
,
2007
, vol.
13
(pg.
471
-
485
)
45
Jakob
C
Egerer
K
Liebisch
P
et al.
,
Circulating proteasome levels are an independent prognostic factor for survival in multiple myeloma.
,
Blood
,
2007
, vol.
109
(pg.
2100
-
2105
)
46
Palombella
VJ
Rando
OJ
Goldberg
AL
Maniatis
T
,
The ubiquitin-proteasome pathway is required for processing the NF-kappa B1 precursor protein and the activation of NF-kappa B.
,
Cell
,
1994
, vol.
78
(pg.
773
-
785
)
47
Zavrski
I
Krebbel
H
Wildemann
B
et al.
,
Proteasome inhibitors abrogate osteoclast differentiation and osteoclast function.
,
Biochem Biophys Res Commun
,
2005
, vol.
333
(pg.
200
-
205
)
48
Garrett
IR
Chen
D
Gutierrez
G
et al.
,
Selective inhibitors of the osteoblast proteasome stimulate bone formation in vivo and in vitro.
,
J Clin Invest
,
2003
, vol.
111
(pg.
1771
-
1782
)
49
Jagannath
S
Barlogie
B
Berenson
J
et al.
,
A phase 2 study of two doses of bortezomib in relapsed or refractory myeloma.
,
Br J Haematol
,
2004
, vol.
127
(pg.
165
-
172
)
50
Richardson
PG
Sonneveld
P
Schuster
MW
et al.
,
Bortezomib or high-dose dexamethasone for relapsed multiple myeloma.
,
N Engl J Med
,
2005
, vol.
352
(pg.
2487
-
2498
)
51
Terpos
E
Rahemtulla
A
Dimopoulos
MA
,
Current treatment options for myeloma.
,
Expert Opin Pharmacother
,
2005
, vol.
6
(pg.
1127
-
1142
)
52
Oyajobi
BO
Garrett
IR
Gupta
A
et al.
,
Role of Dickkopf 1 (DKK) in myeloma bone disease and modulation by the proteasome inhibitor Velcade.
,
J Bone Miner Res
,
2004
, vol.
19
abstract 1011
53
Giuliani
N
Morandi
F
Tagliaferri
S
et al.
,
The proteasome inhibitor bortezomib affects osteoblast differentiation in vitro and in vivo in multiple myeloma patients.
,
Blood
,
2007
, vol.
110
(pg.
334
-
338
)
54
Mukherjee
S
Raje
N
Patel
C
et al.
,
Bortezomib induces proliferation of mesenchymal progenitor cells and promotes differentiation towards osteoblastic lineage [abstract].
,
Blood
,
2006
, vol.
108
pg.
30a
Abstract 88
55
Pennisi
A
Ling
W
Perkins
P
et al.
,
PTH and bortezomib suppress growth of primary human myeloma through increased bone formation in vivo [abstract].
,
Blood
,
2006
, vol.
108
pg.
154a
Abstract 509
56
Kawanabe
N
Anderson
K
Lorenzo
JA
,
Bortezomib, a novel proteasome inhibitor, approved for use in multiple myeloma, inhibits osteoclast formation and function.
,
J Bone Miner Res
,
2004
, vol.
19
abstract SU337
57
Zavrski
I
Hecht
M
Krebbel
H
et al.
,
Bortezomib inhibits human osteoclastogenesis [abstract].
,
Blood
,
2006
, vol.
108
pg.
406a
Abstract 1395
58
Breitkreutz
I
Vallet
S
Raab
MS
et al.
,
Lenalidomide and bortezomib inhibit osteoclast differentiation and activation in multiple myeloma: clinical implications [abstract].
,
Blood
,
2006
, vol.
108
pg.
993a
Abstract 3485
59
Feng
R
Oton
AB
Patrene
K
et al.
,
Combination of the proteasome inhibitor bortezomib and a histone deacetylase inhibitor PXD101 results in synergistic inhibition of osteoclastogenesis and significantly stronger inhibition of multiple myeloma growth in vitro and in vivo [abstract].
,
Blood
,
2006
, vol.
108
pg.
153a
Abstract 507
60
Nakamura
T
Kukita
T
Shobuike
T
et al.
,
Inhibition of histone deacetylase suppresses osteoclastogenesis and bone destruction by inducing IFN-beta production.
,
J Immunol
,
2005
, vol.
175
(pg.
5809
-
5816
)
61
Boissy
P
Lund
T
Andersen
TL
Plesner
T
Delaisse
JM
,
Bortezomib transiently inhibits osteoclast resorptive activity in cell culture conditions mimicking in vivo intermittent treatment [abstract].
,
Blood
,
2006
, vol.
108
pg.
1000a
Abstract 3508
62
Zangari
M
Esseltine
D
Lee
CK
et al.
,
Response to bortezomib is associated to osteoblastic activation in patients with multiple myeloma.
,
Br J Haematol
,
2005
, vol.
131
(pg.
71
-
73
)
63
Shimazaki
C
Uchida
R
Nakano
S
et al.
,
High serum bone-specific alkaline phosphatase level after bortezomib-combined therapy in refractory multiple myeloma: possible role of bortezomib on osteoblast differentiation.
,
Leukemia
,
2005
, vol.
19
(pg.
1102
-
1103
)
64
Zangari
M
Barlogie
B
Lee
CK
et al.
,
Increment in bone phophatase (ALP) in myeloma patients during treatment with Velcade, thalidomide and dexamethasome (VTD) is a strong predictor for response [abstract].
,
Blood
,
2003
, vol.
102
pg.
687a
Abstract 2544
65
Zangari
M
Najarian
KB
Esseltine
DL
et al.
,
The anti-myeloma effect of bortezomib is associated with osteoblastic activity [abstract].
,
Blood
,
2005
, vol.
106
pg.
152a
Abstract 510
66
Zangari
M
Yaccoby
S
Cavallo
F
Esseltine
D
Tricot
G
,
Response to bortezomib and activation of osteoblasts in multiple myeloma.
,
Clin Lymphoma Myeloma
,
2006
, vol.
7
(pg.
109
-
114
)
67
Yaccoby
S
Wezeman
MJ
Zangari
M
et al.
,
Inhibitory effects of osteoblasts and increased bone formation on myeloma in novel culture systems and a myelomatous mouse model.
,
Haematologica
,
2006
, vol.
91
(pg.
192
-
199
)
68
Heider
U
Kaiser
M
Muller
C
et al.
,
Bortezomib increases osteoblast activity in myeloma patients irrespective of response to treatment.
,
Eur J Haematol
,
2006
, vol.
77
(pg.
233
-
238
)
69
Terpos
E
Heath
DJ
Rahemtulla
A
et al.
,
Bortezomib reduces serum dickkopf-1 and receptor activator of nuclear factor-kappaB ligand concentrations and normalises indices of bone remodelling in patients with relapsed multiple myeloma.
,
Br J Haematol
,
2006
, vol.
135
(pg.
688
-
692
)
70
Terpos
E
Anagnostopoulos
A
Heath
D
et al.
,
The combination of bortezomib, melphalan, dexamethasone and intermittent thalidomide (VMDT) is an effective regimen for relapsed/refractory myeloma and reduces serum levels of Dickkopf-1, RANKL, MIP-1α and angiogenic cytokines [abstract].
,
Blood
,
2006
, vol.
108
pg.
1010a
Abstract 3541
71
Weinstein
RS
Jilka
RL
Parfitt
AM
Manolagas
SC
,
Inhibition of osteoblastogenesis and promotion of apoptosis of osteoblasts and osteocytes by glucocorticoids: potential mechanisms of their deleterious effects on bone.
,
J Clin Invest
,
1998
, vol.
102
(pg.
274
-
282
)
72
Ohnaka
K
Tanabe
M
Kawate
H
Nawata
H
Takayanagi
R
,
Glucocorticoid suppresses the canonical Wnt signal in cultured human osteoblasts.
,
Biochem Biophys Res Commun
,
2005
, vol.
329
(pg.
177
-
181
)
73
Peles
S
Fisher
NM
Gao
F
Tomasson
MH
Dipersio
JF
Vij
R
,
A prospective study of the effects of once weekly bortezomib on markers of bone metabolism in patients with multiple myeloma (MM) [abstract].
,
J Clin Oncol
,
2006
, vol.
24
pg.
433s
Abstract 7548
74
Terpos
E
de la Fuente
J
Szydlo
R
et al.
,
Tartrate-resistant acid phosphatase isoform 5b: a novel serum marker for monitoring bone disease in multiple myeloma.
,
Int J Cancer
,
2003
, vol.
106
(pg.
455
-
457
)
75
Terpos
E
Politou
M
Szydlo
R
et al.
,
Autologous stem cell transplantation normalizes abnormal bone remodeling and sRANKL/osteoprotegerin ratio in patients with multiple myeloma.
,
Leukemia
,
2004
, vol.
18
(pg.
1420
-
1426
)
76
Terpos
E
Mihou
D
Szydlo
R
et al.
,
The combination of intermediate doses of thalidomide with dexamethasone is an effective treatment for patients with refractory/relapsed multiple myeloma and normalizes abnormal bone remodeling, through the reduction of sRANKL/osteoprotegerin ratio.
,
Leukemia
,
2005
, vol.
19
(pg.
1969
-
1976
)
77
Tosi
P
Zamagni
E
Cellini
C
et al.
,
First-line therapy with thalidomide, dexamethasone and zoledronic acid decreases bone resorption markers in patients with multiple myeloma.
,
Eur J Haematol
,
2006
, vol.
76
(pg.
399
-
404
)
78
von Metzler
I
Krebbel
H
Hecht
M
et al.
,
Bortezomib inhibits human osteoclastogenesis.
,
Leukemia
Prepublished on June 21, 2007, as DOI 10.1038/sj.leu.2404806.
Sign in via your Institution