Sadly there is no answer for you available because many of the processes around this are hidden.
I can only chime in from my own amateur experiments and there are answer is a clear “depends”.
Most adjustments are made either via additional training data. This simply means that you take more data and feed it indi an already trained LLM.
The result is again an LLM black box with all its stochastic magic.
The other big way are system prompts. Those are simply instructions that already get interpreted as a part of te request and provide limitations.
These can get white fancy by now, in the sense of “when the following query asks you to count something run this python script with whatever you’re supposed to count as input, the result will be a json that you can take then and do XYZ with it.”
Or more simple: you tell the model to use other programs and how to use them.
For both approaches I don’t need to maintain list:
For the first one I have no way of knowing what it’s doing in detail and I just need to keep the documents themselves.
For the second one it’s literally a human readable text.
Sadly there is no answer for you available because many of the processes around this are hidden.
I can only chime in from my own amateur experiments and there are answer is a clear “depends”. Most adjustments are made either via additional training data. This simply means that you take more data and feed it indi an already trained LLM. The result is again an LLM black box with all its stochastic magic.
The other big way are system prompts. Those are simply instructions that already get interpreted as a part of te request and provide limitations.
These can get white fancy by now, in the sense of “when the following query asks you to count something run this python script with whatever you’re supposed to count as input, the result will be a json that you can take then and do XYZ with it.”
Or more simple: you tell the model to use other programs and how to use them.
For both approaches I don’t need to maintain list: For the first one I have no way of knowing what it’s doing in detail and I just need to keep the documents themselves.
For the second one it’s literally a human readable text.