Around for more than 15 years, Loong specializes in bargain secondhand CDs (read: $3 upwards) and vinyl ($5 upwards). Look hard enough and there are plenty of out-of-print titles, though as everything is stacked randomly in boxes, you really have to persevere.
