Most people these days would not consider Italians as people of color, but there was a period in American history where they were not considered white. Greeks, Welsh, Irish, Scotts, and many other immigrants that we would now perceive as white were considered nuisances (at best) that crowded the civility of upper class American life. If you do some investigation, you’ll find a plethora of racist cartoons and artifacts, as well as hate crimes commited against these minorities. If you’re really into it you’ll find books like How the Irish Became White, by Noel Ignatiev, or Working Towards Whiteness, by David R. Roediger.