Using Langgraph - instruct Anthropic to disable parallel tool use

Question

Using the Anthropic messsages API directly and providing multiple tools to the model, it's possible to instruct the model to only invoke one tool at a time by setting disable_parallel_tool_use=true in the tool_choice field.

I'm using LangGraph, and I'd like to be able to do the same thing - instruct the model to only choose one tool at a time.

Below is the heart of my code. I'm leaving out the tool method definitions and prompts, because they're not directly relevant.

model = ChatAnthropic(model="claude-3-5-sonnet-20241022")
tools = [search_word_forms, search_dictionaries, WordDetermination]
model_with_tools = model.bind_tools(tools, tool_choice="any")
response = model_with_tools.invoke(state["messages"])

Using this framework, how can I instruct the model to disable parallel tool use?

cw00h · Accepted Answer · 2025-01-08 12:13:25Z

2

Check out Langchain's document of ChatAnthropic: https://python.langchain.com/api_reference/anthropic/chat_models/langchain_anthropic.chat_models.ChatAnthropic.html#langchain_anthropic.chat_models.ChatAnthropic.bind_tools

You can use the dictionary containing options like type or disable_parallel_tool_use as tool_choice argument of bind_tools.

So the example code would be like:

model = ChatAnthropic(model="claude-3-5-sonnet-20241022")

tool_choice = {
    "type": "any" if tool_call_only else "auto",
    "disable_parallel_tool_use": not enable_parallel_tool_calls,
}
model_with_tools = model.bind_tools(tools, tool_choice=tool_choice)

edited Jan 8 at 12:13

answered Jan 8 at 12:11

cw00h

213 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Laizer Jan 8 at 20:26

Interesting! The documentation doesn't say that explicitly. The only values with dict type that it documents are: name of the tool as a string or as dict {"type": "tool", "name": "<<tool_name>>"}: calls corresponding tool;

cw00h Jan 9 at 6:35

I tested it out, and it seems like it works! I guess this is because LangChain directly gives the tool_choice directory to Claude request without modification? python.langchain.com/api_reference/_modules/langchain_anthropic/…

Chester Curme · Accepted Answer · 2025-01-19 02:07:45Z

2

As of the latest version of langchain-anthropic you can specify parallel_tools_calls when calling bind_tools:

model = ChatAnthropic(model="claude-3-5-sonnet-20241022")

model_with_tools = model.bind_tools(tools, parallel_tool_calls=False)

answered Jan 19 at 2:07

Chester Curme

211 bronze badge

Collectives™ on Stack Overflow

Using Langgraph - instruct Anthropic to disable parallel tool use

2 Answers 2

2 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related