Looks like the AMQ store works correctly - thanks for the advice.
This might be related to issue AMQ-1389, where I also see duplicate messages when using the Kaha persistence adapter, although in a bit different scenario. For me, the AMQ store works correctly as well, but I still believe this is a bug in the Kaha adapter.