We discuss aspects of generalized matrix inverses from a "consistency-aware" perspective. We show that many standard tools in engineering and applied mathematics (e.g., the SVD) are commonly mis-applied in ways that undermine solution integrity. We then describe straightforward generalizations of these tools that remedy this situation.