
Because the machine is only on for a few brief moments at a time, and because you do nothing with it apart from visiting your bank, it becomes very hard for spyware or other malicious software to infect it.

The idea is to build a brand new machine from scratch every time you want to log onto your bank, and wiping it afterwards. Yes, this is a well established technique for secure access to online banking and such.
