If you can reduce the problem to figuring the geodesic distance to a collection of points, then a vantage point tree will give you an efficient solution. See my answer to a similar question here; this includes the solution in python.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
https://stackoverflow.com/questions/61955079/geodesic-distance-between-geometry-shapes-python
If you can reduce the problem to figuring the geodesic distance to a collection of points, then a vantage point tree will give you an efficient solution. See my answer to a similar question here; this includes the solution in python.