A way to hide </think> ?

[VL4DST3R]

With all the buzz about DeepSeek r1 and distills for other models using it, would it be within scope to add a way to filter out the </think> sections since it can often be quite long/rambly and not necessarily useful for the end user?

[LostRuins]

Can you test your story in https://lite.koboldai.net

[VL4DST3R]

Even when using the latest release I am still getting missing starting tags. Is there a setting that conflicts/removes it that I'm not aware of?

[LostRuins]

did you pick the Deepseek instruct preset? Try toggle the "Separate End Tags" setting.

I tried the distill 7b and it does indeed not create start think tags. that's probably a model problem.

[VL4DST3R]

Yeah I missed setting the instruct preset, now it works properly! I was on Alpaca before, does the template for that cut away beginning tags?

[LostRuins]

No it does not. But the distills behave weirdly. Which model were you using and which prompt worked in the end? Would be good to share for others.

Anyway, glad it's working.

[VL4DST3R]

Ever since Deepseek support was added I've been maining DeepSeek-R1-Distill-Qwen-14B-Q6_K, so this was the only thing I was testing against when I made the thread. Once I switched to the proper template via the new preset it worked straight away, no need to prompt in any particular way.