Background Pneumococcal pneumonia is the most frequent form of pneumonia. We herein assessed the effectiveness of the 23-valent pneumococcal polysaccharide vaccine (PPSV23) in the prevention of pneumonia overall in rheumatoid arthritis (RA) patients at risk for infections. We hypothesized that PPSV23 vaccination is superior in preventing pneumococcal pneumonia compared with placebo in RA patients. Methods A prospective, multicenter, double-blinded, randomized, placebo-controlled (1:1) trial was conducted across departments of rheumatology in Japanese National Hospital Organization hospitals. RA patients (n = 900) who had been treated with biological or immunosuppressive agents were randomly assigned PPSV23 or placebo (sodium chloride). The primary endpoints were the incidences of all-cause pneumonia and pneumococcal pneumonia. The secondary endpoint was death from pneumococcal pneumonia, all-cause pneumonia, or other causes. Cox regression models were used to estimate the risk of pneumonia overall for the placebo group compared with the vaccine group. Results Seventeen (3.7%) of 464 patients in the vaccine group and 15 (3.4%) of 436 patients in the placebo group developed pneumonia. There was no difference in the rates of pneumonia between the two study groups. The overall rate of pneumonia was 21.8 per 1000 person-years for patients with RA. The presence of interstitial pneumonia (hazard ratio: 3.601, 95% confidence interval: 1.547-8.380) was associated with an increased risk of pneumonia in RA patients. Conclusion PPSV23 does not prevent against pneumonia overall in RA patients at relative risk for infections. Our results also confirm that the presence of interstitial lung disease is associated with pneumonia in Japanese patients with RA.