"Definitely not!" Paul is responding here to the magistrates or city leaders, even though he is speaking to the jailor. (See: [[rc://en/ta/man/translate/figs-explicit]])
This refers to people from all over the Empire, who had legal citizenship. Among their rights were freedom from torture and the right to have a trial. The city leaders were afraid of what would happen if the Empire learned the city leaders had mistreated Paul and Silas. (See: [[rc://en/ta/man/translate/figs-explicit]])