Here is a very good history of immigration which helps us to see the whole picture:

History of U.S. Immigration