Estimates of species abundance are critical to understand population processes and to assess and select management actions. However, capturing and marking individuals for abundance estimation, while providing robust information, can be economically and logistically prohibitive, particularly for species with cryptic behavior. Camera traps can be used to collect data at temporal and spatial scales necessary for estimating abundance, but the use of camera traps comes with limitations when target species are not uniquely identifiable (i.e., “unmarked”). Abundance estimation is particularly useful in the management of invasive species, with herpetofauna being recognized as some of the most pervasive and detrimental invasive vertebrate species. However, the use of camera traps for these taxa presents additional challenges with relevancy across multiple taxa. It is often necessary to use lures to attract animals in order to obtain sufficient observations, yet lure attraction can influence species’ landscape use and potentially induce bias in abundance estimators. We investigated these challenges and assessed the feasibility of obtaining reliable abundance estimates using camera-trapping data on a population of invasive brown treesnakes (Boiga irregularis) in Guam. Data were collected using camera traps in an enclosed area where snakes were subject to high-intensity capture–recapture effort, resulting in presumed abundance of 116 snakes (density = 23/ha). We then applied spatial count, random encounter and staying time, space to event, and instantaneous sampling estimators to photo-capture data to estimate abundance and compared estimates to our presumed abundance. We found that all estimators for unmarked populations performed poorly, with inaccurate or imprecise abundance estimates that limit their usefulness for management in this system. We further investigated the sensitivity of these estimators to the use of lures (i.e., violating the assumption that animal behavior is unchanged by sampling) and camera density in a simulation study. Increasing the effective distances of a lure (i.e., lure attraction) and camera density both resulted in biased abundance estimates. Each estimator rarely recovered truth or suffered from convergence issues. Our results indicate that, when limited to unmarked estimators and the use of lures, camera traps alone are unlikely to produce abundance estimates with utility for brown treesnake management.