Joe, it's mostly about technique and patience. I'm not sure exactly how you are going about it, so I"ll just 'splain' what I do.
The die-cut sheets, I sand starting with 220 grit. This removes the balsa quickly. Then finish with 400 grit. I sand the whole sheet, not the individual parts. Sanding each part alone can cause them to break, easily.
Sand in one direction. Back and forth usually cracks parts.
The individual stringers,1/16x1/16 inch, i sand with a block of 320 or 400 grit. Pulling the block down the stringer in one direction. The sanding block I use most, is 3/4"high and 1" wide by 3" long. I don't think the size is too critical, it's just what fits your hand the best. Again, patience, really helps. Lots of gentle strokes with the sander. Bearing down will usually cause problems. Does this help? Or does it sound like a silly answer?