How do you LLMs with multiple agents having different roles? Preferably offline (this would be one of the cases that legitimize my need for an Framework Desktoo) but online with subscription is OK too.
Each API call has absolutely no idea of the previous context, the program that manages the chat simply inserts the whole history of the chat (or a ai-resumed one) inside each message.
If you need 10 different roles then the program sends a single “system” prompt, with then 10 different “user” prompts with the different logic to execute (plus the context, if needed)
How do you LLMs with multiple agents having different roles? Preferably offline (this would be one of the cases that legitimize my need for an Framework Desktoo) but online with subscription is OK too.
Each API call has absolutely no idea of the previous context, the program that manages the chat simply inserts the whole history of the chat (or a ai-resumed one) inside each message.
If you need 10 different roles then the program sends a single “system” prompt, with then 10 different “user” prompts with the different logic to execute (plus the context, if needed)