I've yet to see a manufacturer of a recent high drain battery spec below about 4A for charging.
Over discharge, over charge and temperature are the big battery killers, not charge current as long as it's in spec. Manufacturer cycle count is quoted assuming the use if the "typical charge current" figure outlined in the databsheet for that cell.
Cells are cheap, time is priceless. If you need your batteries asap then select the highest current you're able to do within spec. If you can wait, go with 500mA. That's what I do.