3.1 Study description
From 11 electronic databases, 155 potentially relevant articles were retrieved. Among them, 148 articles were excluded. Seven studies [14-20] (Korean: 𝑛 = 5; English: 𝑛 = 2) were included in the qualitative synthesis and four studies [16,18-20] were included in the quantitative synthesis (meta-analysis) (Fig. 1). A total of 307 participants were included in these studies, 128 in the BVA group and 124 in the control group. Two [19, 20] of included studies assessed the effects of BVA on adhesive capsulitis and five [14-18] assessed the effects of BVA on post-stroke shoulder pain (Table 1). The duration of treatment varied from 2 to 12 weeks in the included studies. One study [20] was conducted one year follow up after 2 months of treatment.
3.2. Characteristics of the bee venom intervention
The participants were intramuscularly injected with bee venom using a syringe at various acupoints. Dried bee venom powder was diluted in saline at various ratios: 1:10000 in 3 studies [16, 19, 20], 1:20000 in one study [14], 1:2000 in one study [15], 1:4000 and 1:10000 in one study [17]. One study [18] did not report dilution rates. To summarize the acupoints were injected with bee venom, LI15 was used in all studies [14-20], TE14 and GB21 in 6 studies [14,16-20], SI10 in 4 studies [14, 15, 17, 18], SI11 in 3 studies [17, 19, 20], LI16 in 2 studies [19, 20], LI11 in 2 studies [15, 17], SI9 in one study [17], SI3 in one study [15], UE12 in one study [15], and ashi points in two studies [17, 18] (Table 1).
3.3. Characteristics of the control intervention
In seven studies, control interventions were classified into four types. First, normal saline was used as control intervention in four studies [16,18-20]. Two of them [19, 20] were given physiotherapy (PT), and the others [16, 18] were given CT such as classic acupuncture (AT), moxibustion, herbal medicine, PT. Secondly, AT was used in one study [15] as control intervention. Thirdly, Zingiberis Rhizoma herbal acupuncture therapy was used one study [14] as control intervention. In this study, all participants were treated with CT such as AT, herbal medicine, western medicine, PT. Fourthly, One study [17] did not provide any control intervention. In this study, all participants were treated with CT such as AT, herbal medicine, western medicine, moxibustion, PT (Table 1).
3.4. Characteristics of outcome measures
In a total of seven studies, VAS was used in six studies [14-19]. In three of these studies [16-18], there were significant differences in the BVA group compared to control group and only one study [14] suggested no significant difference between the two groups. In addition, two studies [15, 19] did not report appropriate statistical data. Park et al. [20] used VRS to evaluate shoulder pain, but there was no significant difference between the two groups (p > 0.05). PRS was used in the two studies [16, 18], in which there were significant differences between two groups (p < 0.05). SPADI was used in two studies [19, 20], both of which showed significant differences between the two groups (p < 0.05) (Table 2).
3.5. Risk of bias in the included studies
The risk of bias of included 7 studies was shown in Figure 2. All studies mentioned “randomization”, but only 3 studies [16, 18, 19] reported adequate methods of sequence generation – a table of random numbers [18], stratified sampling [16], and the bloc randomization method [19]. None of the trials mentioned whether they had adequate allocation concealment methods. Four studies [16,18-20] were assessed to be low risk for blinding of participants and personnel. The remaining three studies [14, 15, 17] compared BVA with AT, Zingiberis Rhizoma herbal acupuncture, and no control. Therefore, these studies were assessed to be at a high risk. Detection bias was low risk in four studies [16,18-20], it was unclear in one study [14] because it did not mention the blinding of outcome assessment. Two studies [15, 17] were assessed to be at a high risk because blinding could affect the outcome assessment. Attrition bias was low risk in six studies [14-19], but it was high risk in one study [20] that did not report a complete set of baseline data. None of the trials reported information regarding the pre-registered protocol, therefore we assessed all trials to be unclear of reporting bias. We evaluated all of the studies as unclear of other bias because they had insufficient information to determine additional bias.
3.6.1. Bee venom acupuncture versus saline injection
3.6.1.1. Bee venom acupuncture plus CT versus saline injection plus CT
Four of included trials [16,18-20] were classified into several subgroups according to the type of control intervention used. Two of the RCTs [16, 18] that compared the effectiveness of BVA plus CT and saline injection plus CT reported significant differences in the VAS of shoulder pain. The cause of shoulder pain in both studies was post-stroke shoulder pain. The meta-analysis suggested an effect in favor of BVA plus CT in VAS (SMD on 10-cm VAS, 1.25; 95% CI = 0.20 to 2.29, p = 0.02, n = 86; heterogenity, p = 0.03, I2 = 79%; Fig. 3 [1.1.1]). Also, we found that shoulder pain was significantly lower for BVA plus CT than for saline plus CT, as assessed by the PRS (SMD, 0.58; 95% CI = 0.15 to 1.01, p = 0.009, n = 86; heterogeneity, p = 0.97, I2 = 0%; Fig. 3 [1.1.2]). Overall, the result showed pain reduction was significantly greater for BVA than for saline injection (SMD, 0.89; 95% CI = 0.37 to 1.41, p = 0.0007, n = 172; heterogeneity, p = 0.05, I2 = 62%; Fig. 3).
3.6.1.2. Bee venom acupuncture plus PT versus saline injection plus PT
In two studies [19, 20] on adhesive capsulitis disease, VAS (at night, rest, and motion), VRS (at night, rest, and motion), and SPADI were measured for BVA plus PT and saline plus PT. One trial [19] reported that there was no significant difference in VAS pain reduction at night (SMD on 10-cm VAS, 0.34; 95% CI = -0.24 to 0.93, p = 0.25, n = 45; Fig. 4 [2.1.1]), at rest (SMD on 10-cm VAS, 0.45; 95% CI = -0.14 to 1.05, p = 0.13, n = 45; Fig. 4 [2.1.2]), and at motion (SMD on 10-cm VAS, 0.14; 95% CI = -0.45 to 0.72, p = 0.65, n = 45; Fig. 4 [2.1.3]). Overall, the result showed pain reduction in VAS had no significant difference between BVA and saline injection (SMD, 0.31; 95% CI = -0.03 to 0.65, p = 0.07, n = 135; heterogeneity, p = 0.75, I2 = 0%; Fig. 4).
The other trial [20] reported that there was no significant difference in VRS of pain reduction at night (SMD, 0.23; 95% CI = -0.41 to 0.87, p = 0.48, n = 38; Fig. 5 [2.2.1]), at rest (SMD, -0.04; 95% CI = -0.68 to 0.59, p = 0.90, n = 38; Fig. 5 [2.2.2]), and at motion (SMD, 0.12; 95% CI = -0.52 to 0.76, p = 0.71, n = 38; Fig. 5 [2.2.3]). Overall, the result showed pain reduction in VRS had no significant difference between BVA and saline injection (SMD, 0.10; 95% CI = -0.27 to 0.47, p = 0.58, n = 114; heterogeneity, p = 0.84, I2 = 0%; Fig. 5).
In 12-week short-term observations [19], BVA group showed significantly better outcomes in SPADI than the control group (SMD = 0.71; 95% CI = 0.10 to 1.31, p = 0.02; n = 45; Fig. 6 [2.3.1]). In a one-year long-term observation [20], SPADI had no significant difference between the two groups (SMD = -0.01; 95% CI = -0.65 to 0.63, p = 0.97, n = 38; Fig. 6 [2.3.2]). Overall, the result showed pain reduction in SPADI had no significant difference between BVA and saline injection (SMD, 0.36; 95% CI = -0.35 to 1.06, p = 0.32, n = 83; heterogeneity, p = 0.11, I2 = 61%; Fig. 6).
3.7. Adverse events
Two [16, 19] of the seven studies reported adverse events. Both studies used saline injection as the control intervention. One study [16] included pruritus (8 in the BVA group and 2 in the control group), burning sensation (3 in the BVA group and 1 in the control group), and pain (2 in the BVA group and 3 in the control group). All of these adverse events were Mueller Grade 0, and symptoms were relieved after using ice packs. In the other study [19], among the 45 patients in the BV1 and BV2 groups who received BVA, 30 patients experienced slight pruritus, local swelling, and or redness (under 20mm in diameter), which were Mueller Grade 0. One patient showed mild, generalized swelling and aching (in BV1 group), which were classified as Mueller Grade 1 reactions, and 3 patients showed slight redness and pruritus (in control group). The rest five studies [14, 15, 17, 18, 20] did not mention any information about adverse events (Table 2).