Large geospatial datasets must often be generalized for analysis and display at reduced scales. Automated methods including artificial intelligence and deep learning are being applied to this problem, but the results are often analyzed on the basis of limited and subjective measures. To better support automation, a project is underway to develop a robust Python toolkit for computing objective metrics of the quality of generalized vector data. Six metrics are currently under development: Hausdorff and average distance between polylines, feature density difference, polyline legibility, change in topological adjacency, and change in sinuosity. This paper discusses the development progress on tools to compute the Hausdorff and average distance between polylines, generating quality metrics to quantify displacement.