The TLK building in St Mary Cray High Street, run by the Home Office for asylum seekers, has been in use for two years.
Claims were reportedly made on social media with comparisons to Epping, where a hotel was blocked by the courts.
A spokesperson for Bromley Council said: “Our first-hand advice remains that the hostel is currently occupied by children, women and families only, in temporary accommodation while they await a decision from the Government concerning their immigration status.
“At that point, they will leave.
“We have also been advised that there are no current police investigations in relation to residents of the TLK apartments, contrary to other reports circulating.”
The Council added that it is mindful of the recent legal decision in Epping, which is now subject to appeal.
It confirmed that Bromley would consider its own legal options if the Government were to change the cohort of residents from families and children to single men.