If your TestCases or components under test rely on stuff in the Application scope (tsk tsk), then you'll need the plugin to talk to a custom RemoteFacade.cfc for your project because it needs to run under your Application.cfc.