Measuring oil concentration in the aquatic environment is essential for determining the potential exposure, risk, or injury for oil spill response and natural resource damage assessment. Conventional analytical chemistry methods require samples to be collected in the field, shipped, and processed in the laboratory, which is also rather time-consuming, laborious, and costly. For rapid field response immediately after a spill, there is a need to estimate oil concentration in near real time. To make the oil analysis more portable, fast, and cost effective, we developed a plug-and-play device and a deep learning model to assess oil levels in water using fluorescent images of water samples. We constructed a 3D-printed device to collect fluorescent images of solvent-extracted water samples using an iPhone. We prepared approximately 1,300 samples of oil at different concentrations to train and test the deep learning model. The model comprises a convolutional neural network and a novel module of histogram bottleneck block with an attention mechanism to exploit the spectral features found in low-contrast images. This model predicts the oil concentration in weight per volume based on fluorescence image. We devised a confidence interval estimator by combining gradient boosting and polymodal regressor to provide a confidence assessment of our results. Our model achieved sufficient accuracy to predict oil levels for most environmental applications. We plan to improve the device and iPhone application as a near-real-time tool for oil spill responders to measure oil in water.