Currently, Europe is dealing with a large number of asylum seekers. A recent report show that attitudes toward asylum seekers are not that negative in the Netherlands, and yet Dutch citizens living close to asylum seeker centers barely have contact with them. Because contact is vital for a multicultural society, we investigated the facilitators and barriers for Dutch citizens to establish and maintain contact with asylum seekers where they live close together. We conducted semistructured interviews with Dutch people and analyzed them using thematic analysis. We found four themes: Physical possibilities for Contact, Goals for Contact, Social Identities, and Positivity and Openness, and proposed a grounded theory model based on how the themes are related. The findings are discussed in relation to debates on multiculturalism and intergroup tolerance, and can be used to improve the integration policies by local governments, because they present clear conditions and practical information as to how contact can be established and maintained.