Understanding the relationship between biodiversity and ecological stability is increasingly urgent as rapid species extinction continues. Though evidence of positive diversity–stability relationships is accumulating, empirical results are inconsistent, and effect sizes tend to be small, raising questions about relative contributions of intrinsic (i.e., species composition/interactions) and extrinsic (i.e., environmental) drivers of stability. Community stability may be more strongly influenced by environmental conditions than by community diversity in some contexts, yet little is known about the comparative importance of diversity and climate means, extremes, and variability in regulating stability. We used a half-century of continental-scale bird data to quantify avian community temporal variability (a metric often used to approximate ecological stability) at 1379 sites and compared relative effects of climatic variables and species richness. We found that extreme heat and extremely low precipitation at decadal scales are associated with high bird community variability and these climate variables outperformed species richness in terms of variance explained and magnitude of effect. This provides empirical support for the theoretical concept that, at a continental, decadal scale, environmental conditions can play a larger role than intrinsic factors in determining community stability. Our findings also increase understanding of how climate extremes cause diverse ecological responses.