Waning attention to international terrorism and other threats has former officials worried.