WHERE的な使い方だけどINとNOT INだけで=とか!=はなさそう
avg:system.cpu.user{env:shop.ist AND availability-zone IN (us-east-1a, us-east-1b, us-east4-b)} by {availability-zone}
avg:system.cpu.user{env:shop.ist AND availability-zone NOT IN (us-east-1a, us-east-1b, us-east4-b)} by {availability-zone}