Background: Accurate data on the health status, health behaviour and access to health care of asylum seekers is essential, but such data is lacking in many European countries. We hence aimed to: (a) develop and pilot-test an instrument that can be used to compare and benchmark the country health information systems (HIS) with respect to the ability to assess the health status and health care situation of asylum seekers and (b) present the results of that pilot for The Netherlands (NL) and Germany (DE). Materials and Methods: Reviewing and adapting existing tools, we developed a Health Information Assessment Tool on Asylum Seekers (HIATUS) with 50 items to assess HIS performance across three dimensions: (1) availability and detail of data across potential data sources; (2) HIS resources and monitoring capacity; (3) general coverage and timeliness of publications on selected indicators. We piloted HIATUS by applying the tool to the HIS in DE and NL. Two raters per country independently assessed the performance of country HIS and the inter-rater reliability was analysed by Pearson’s rho and the intra-class correlation (ICC). We then applied a consensus-based group rating to obtain the final ratings which were transformed into a weighted summary score (range: 0–97). We assessed HIS performance by calculating total and domain-specific HIATUS scores by country as well as absolute and relative gaps in scores within and between countries. Results: In the independent rating, Pearson’s rho was 0.14 (NL) and 0.30 (DE), the ICC yielded an estimated reliability of 0.29 (NL) and 0.83 (DE) respectively. In the final consensus-based rating, the total HIATUS score was 47 in NL and 15 in DE, translating into a relative gap in HIS capacity of 52% (NL) and 85% (DE) respectively. Shortfalls in HIS capacity in both countries relate to the areas of HIS coordination, planning and policies, and to limited coverage of specific indicators such as self-reported health, mental health, socio-economic status and health behaviour. The relative ...