You can make sure that your plugin is selected using some metadata.
For my own Media Plugin, I've added something like this:
public class ...
Then, when I create the PlaylistItem, I add this as required metadata:
Then it never fails to load *my* plugin instead of the default. Of course you have to properly set the SupportedDeliveryMethods attribute too.