Can I use the speaker or transmitter while it's connected to a power source or while it's charging?

Yes in both cases.

You can use the speaker and transmitter while they're connected to a power source and while they're charging.