> The documentation of reftex-citation is a bit confusing. It promises
> completion on known citation keys but I believe "known" refers to keys
> that have been used previously in this session rather than all keys in
> the appropriate bibliography.
No, there should be all keys in the bibfile available for completion.
That feature is currently a bit broken, and we're investigating why.