Resource managers often rely on long-term monitoring surveys to detect trends in biological data. However, no survey gear is 100% efficient, and many sources of bias can be responsible for detecting or not detecting biological trends. The SmeltCam is an imaging apparatus developed as a potential sampling alternative to long-term trawling gear surveys within the San Francisco Estuary, California, to reduce handling stress on sensitive species like the Delta Smelt (Hypomesus transpacificus). Although believed to be a reliable alternative to closed cod-end trawling surveys, no formal test of sampling efficiency has been implemented using the SmeltCam. We used a paired deployment of the SmeltCam and a conventional closed cod-end trawl within the Napa River and San Pablo Bay, a Bayesian binomial N-mixture model, and data simulations to determine the sampling efficiency of both deployed gear types to capture a Delta Smelt surrogate (Northern Anchovy, Engraulis mordax) and to test potential bias in our modeling framework. We found that retention efficiency—a component of detection efficiency that estimates the probability a fish is retained by the gear, conditional on gear contact—was slightly higher using the SmeltCam (mean = 0.58) than the conventional trawl (mean = 0.47, Probability SmeltCam retention efficiency > trawl retention efficiency = 94%). We also found turbidity did not affect the SmeltCam’s retention efficiency, although total fish density during an individual tow improved the trawl’s retention efficiency. Simulations also showed the binomial model was accurate when model assumptions were met. Collectively, our results suggest the SmeltCam to be a reliable alternative to sampling with conventional trawling gear, but future tests are needed to confirm whether the SmeltCam is as reliable when applied to taxa other than Northern Anchovy over a greater range of conditions.