Diadromous fishes migrate between marine and fresh waters for reproduction. For anadromous species, which spawn in freshwater, improved access to freshwater spawning and nursery habitats and ability of juveniles to emigrate to the ocean may support population recovery. Despite the potentially enormous influence of early life stage survival on adult population size, managers and scientists have limited capacity to assess numbers of juvenile anadromous fishes leaving freshwater ecosystems. Such data are critical for evaluating reproductive success and habitat suitability and have been identified as a top priority in anadromous fish research and management. We developed a state-of-the-art underwater video and computational system to collect videos to estimate abundances and migration timing for juvenile river herring (Alosa pseudoharengus; Alosa aestivalis). We collected continuous video in the Monument River (Bourne, Massachusetts, USA) from June to November 2017. We trained three types of neural network models to detect and count fish in video frames and evaluated model performance by comparing human counts to model outputs. Our top model assessed presence and absence (F1 = 87%) and counted fish (counting error 9.4%) with an accuracy comparable to human counters (F1 = 88%). Our system's capability to collect accurate counts of emigrating juveniles will provide critical information that could be related to the numbers of spawning adults, system-specific productivity, and spawning and nursery habitat suitability. Both the video collection system and computational model may be transferrable to other sites and for other species where tracking juvenile emigration may inform management efforts.