Fault transfer and load balancing

[guleng]

Can the failover feature only be supported by OpenAI and Azure? Can't we support VLLM suppliers?
Is there a load balancing function between two identical LLMs? So, how should I configure it? I can't find the configuration method