if some of the actors do not support us.”
His senior aide and son-in-law, Odrek Rwabwogo, had earlier warned that Ugandan farmers and small business owners would be hit hard by the expulsion.
The expulsion from Agoa is set to take effect from the start of next year.
In August, the World Bank announced it was suspending new loans to Uganda following the anti-homosexuality bill, while last month the US State Department warned about the risk of doing business there.
Mr Museveni has accused the World Bank of using money to try to “coerce” the government to drop the controversial legislation.
Additional reporting by BBC World Service Editor Will Ross