Immigration and the ways in which host societies receive newcomers pose challenges for modern civil societies. This article contributes to the ongoing discussion about how ethnic diversity influences tolerance towards immigrants. Compared to previous studies, we analyse tolerance as a sequential concept in order to uncover the effects of contextual diversity on attitudes towards immigrants and the granting of certain rights to this group. Moreover, we distinguish different shares of ethnic groups based on their ethnic and cultural origins both on the independent and dependent variable. The analysis relies on a subnational survey of sixty municipalities in Switzerland, revealing that only certain ethnic groups are seen as an economic and cultural threat.