Another option would be that the attacker cannot bring the AI fleet into battle when attacking players. Use the fleets for defense. Use them for PVE battles. But when attacking players, the fleets don't enter.
Either:
- Player with AI fleet cannot attack player
- Player with AI fleet can attack player, but fleets don't enter battle.
This way the fleets can be in game, but not used as gank tools.