is there an error in the way the prompt is builded ?

according to this https://gpus.llm-utils.org/llama-2-prompt-template/ [INST] should be before  system tag
but in your code is otherwise:
https://github.com/havenhq/haven/blob/5ac243a7805eb4588184a34546031adde651ae63/llamatune/llamatune/data/chat_data_module.py#L98
