Despite recent major strides in our understanding of the genetic and microbial influences that contribute to the development of the inflammatory bowel diseases (IBDs), their etiology continues to be enigmatic. Results from experiments in animal models of IBDs overwhelmingly support a causal role of the microbiota in these diseases, though whether such a cause-effect relationship exists in human IBDs is still uncertain. Therefore, virtually all currently approved and most often prescribed treatments for IBDs are directed toward the over-active immune response in these diseases rather than the intestinal bacteria. Nevertheless, there is an important need for non-immunosuppressive therapies that may present a more favorable risk-benefit profile such as those that selectively target the disruptions in gut microbiota that accompany IBDs. This need has led to clinical trials of various microbial-directed therapies including fecal microbial transplant, antibiotics, probiotics, and prebiotics. Unfortunately, these published studies, many of which are small, have generally failed to demonstrate a consistent benefit of these agents in IBDs, thus leading to slow acceptance of microbe-focused treatments for these conditions. In this article, we review and summarize the microbial basis for IBDs and the results of the most recent trials of fecal microbial transplant, antibiotics, probiotics, and prebiotics in IBDs. We also comment on possible safety concerns with these agents, speculate on why they have failed to show efficacy in certain clinical settings, and propose strategies to improve their usefulness.