anthropic[patch]: support claude 3.7 sonnet

[ccurme]

No description provided.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment

Name	Status	Preview	Comments	Updated (UTC)
langchain	⬜️ Ignored (Inspect)	Visit Preview		Feb 24, 2025 7:26pm

[baskaryan]

tangential but ooc what happens if you send thinking block without the signature?

[baskaryan]

isn't "thinking" the key in a type: thinking block?

[ccurme]

model_dumping the content generates a key {"text": None}, so I remove it here.

[ccurme]

tangential but ooc what happens if you send thinking block without the signature?

BadRequestError: Error code: 400 - {'type': 'error', 'error': {'type': 'invalid_request_error', 'message': 'messages.1.content.0.thinking.signature: Field required'}}

[baskaryan]

we should follow up with reasoning token counts if their api exposes those (guessing it does)

[ccurme]

we should follow up with reasoning token counts if their api exposes those (guessing it does)

I'm not seeing these carved out in the response:

import anthropic 
 
client = anthropic.Anthropic()
response = client.messages.create(
    model="claude-3-7-sonnet-latest",
    max_tokens=5000,
    thinking={
        "type": "enabled",
        "budget_tokens": 2000,
    },
    messages=[{
        "role": "user",
        "content": "Hello",
    }]
)

response.usage

Usage(cache_creation_input_tokens=0, cache_read_input_tokens=0, input_tokens=36, output_tokens=128)

[baskaryan]

we should follow up with reasoning token counts if their api exposes those (guessing it does)

I'm not seeing these carved out in the response:

import anthropic 
 
client = anthropic.Anthropic()
response = client.messages.create(
    model="claude-3-7-sonnet-latest",
    max_tokens=5000,
    thinking={
        "type": "enabled",
        "budget_tokens": 2000,
    },
    messages=[{
        "role": "user",
        "content": "Hello",
    }]
)

response.usage

Usage(cache_creation_input_tokens=0, cache_read_input_tokens=0, input_tokens=36, output_tokens=128)

yea doesn't seem updated yet https://github.com/anthropics/anthropic-sdk-python/blob/main/src/anthropic/types/usage.py