If someone leaves the US for the purpose of taking up arms in a terrorist group such as ISIL, AlQueda etc. they should lose their passport or even their citizenship so they can no longer return to the US and threaten harm in the homeland.
Of course this should involve proving intent etc and possibly a way to return as an immigrant.