Multiple address books - custom fields

Hello,
I have created three different address book types and assigned custom fileds to these by selecting the subtype.

However all fields seem to be showing for all addressbooks.  From what I understand and have read, this should not be the case.

Is this a bug? or am I doing something wrong.

Thanks

Nick