This study investigated noise exposure relationships among high-rise apartment populations. Field noise measurements were conducted at four sites, three of which were primarily exposed to railway noise. Noise maps were created to calculate noise exposure levels for each dwelling, and social surveys were conducted with 400 participants (100 from each site). Railway noise was more annoying than road traffic noise for residents of high-rise apartments, confirming the lack of a railway bonus. A comparison of the exposure–response relationships with previous studies revealed that road traffic noise was reported to be less annoying than in prior studies, whereas railway noise was more annoying. Even at low noise exposure levels, railway noise was highly annoying. Annoyance ratings were significantly scattered across noise exposure levels, suggesting that factors beyond noise exposure, such as attitudes towards sources and vibrations, influence noise annoyance.