Are there any rules of thumb here people apply in order to decide? Does it depend on the case, the exact place? I'm having a hard time deciding, as I'm not sure whether the interest rate is the only thing I should be looking at (in which case, private seems to make more sense). Thanks.

This isn't an MBA-specific question. Rather, it's a US-specific one. Maybe try Quora?