This doctrine is extremely dangerous in humanitarian terms. If the Pope decides to tell African people not to use condoms to protect themselves from AIDS, for example, the significant portion of African Catholics who subscribe to this doctrine will abide by the Pope's edict.
This doctrine was created solely by man anyway. Even people who believe that the Bible is "the word of God" can recognize that the Bible nowhere calls for the institution of the Pope, let alone papal infallibility. Both the institution and the doctrine were created by man.
Of course, the Vatican may not agree to our wishes, but the US cutting of diplomatic relations with the Vatican would then send a strong message to the world: We will not stand idly by while religion is permitted to run roughshod over human rights.