[Bug]: deepseek-r1 think tags broken

[kevin-support-bot]

OpenHands#8218 Issue

---

@createthis, Would you apply this commit and check if the issue is resolved?

[github-actions]

This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.

[github-actions]

This issue was closed because it has been stalled for over 30 days with no activity.

[createthis]

@SmartManoj Sorry, I just saw this. I was on vacation last week.

I normally run open-hands under docker. I spent 4 hours this evening trying to get it running following this guide: https://github.com/All-Hands-AI/OpenHands/blob/main/Development.md

Unfortunately, it's stuck with Connection Refused from the runtime container:

06:19:51 - openhands:INFO: docker_runtime.py:163 - [runtime 9dd60b18cae84c4cb18f5c03dafcda94] Container started: openhands-runtime-9dd60b18cae84c4cb18f5c03dafcda94. VSCode URL: None
06:19:51 - openhands:INFO: docker_runtime.py:174 - [runtime 9dd60b18cae84c4cb18f5c03dafcda94] Waiting for client to become ready at http://localhost:31712...
06:21:40 - openhands:INFO: agent_session.py:200 - Agent session start
06:21:40 - openhands:ERROR: session.py:221 - Error creating agent_session: [Errno 111] Connection refused

I see the container running in docker desktop and the logs say it started successfully, so I don't know what the deal is with this error.

Is there any way you could build an image for me and then I can test it for you?

[SmartManoj]

Is the URL (http://localhost:31712) accessible?

[createthis]

@SmartManoj I finally had another moment to test this and I got the environment running with the help of GoodMorningIchigo from the discord server. I recorded the session here: https://github.com/createthis/open_hands_deepseek_r1_0528_think_tags

Unfortunately, it looks like R1-0528 under llama.cpp is completely ignoring the <think> tag instructions. I'm not sure there is much that can be done when it refuses to properly close tags.

[SmartManoj]

The above commit simple replaces think tags with thought tags programmatically. Isn't that what you expected?

You can use this script to test.

[createthis]

@SmartManoj No, that isn't what I expected. Please see OpenHands#8218 (comment) as I explain it there.

[github-actions]

This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.

[github-actions]

This issue was closed because it has been stalled for over 30 days with no activity.