A unified prompt generator

[niansong1996]

Currently, how we load the prompt is by reading from a txt file. This is good for reproducibility, but not good when we have a large number of datasets, and when we want to use a non-fixed set of exemplars.

We would like to build a prompt generator that:

• Take some examples and use a promptify function to turn them into a list of strings as exemplars, moreover, it should have:
  • An instruction (optional)
  • A list of promptified exemplars
    • natural language input x
    • additional input (e.g., programming context) c
    • ouput code y
• Can still save the prompt in a txt file for reproducibility and debugging
• It should also be able to adapt to the chat format

In the future, we should also consider turn this prompt generator to a standardized package so that people can reuse.