The U.S. Government has no way of vetting who is a 'refugee' and who is a potential terrorist. ISIS has claiming that they already have operatives among the Muslim refugees. Several countries in the Middle East have refused to accept refugees on this point alone.
Also, any refugees allowed to resettle in this country would more than likely require welfare and taxpayer-funded assistance. Given our $18 trillion + deficit, we can not afford this.