It's up to you. I had tons of issues while attempting to JB such as not being able to boot tethered and the phone literally vibrating a bunch on its own and restarting on its own. Also the screen flickers black and white. So of course I immediately restored.
Also a bunch of Cydia apps, such as SBSettings, weren't even working properly.