Technically, the sentence above should be:

They took me into the back room.

That's because "take" is an action that starts outside of the room and finishes inside. Another example is "push":

They pushed me into the room.

However, people sometimes use "in" instead in spoken English.