When printing handouts, the entire drawing area of the slide is reduced, not just the area of the drawing with objects on it.
Therefore, if the drawing size is much larger than is needed to hold the objects, the reduced handout printout will be very small.
The solution is to reduce the Drawing size to the smallest size possible to hold the objects before printing handouts.