(CNN) -- "We're not going to unilaterally disarm," former Sen. Chuck Hagel told a Senate panel considering his nomination to become defense secretary when questioned Thursday about his links to a group that calls for eliminating nuclear weapons.