Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Claudette, a new friend that makes Claude 3.5 Sonnet even nicer (answer.ai)
22 points by jph00 on June 21, 2024 | hide | past | favorite | 8 comments


>chat("Concisely, what is the meaning of life?", prefill='According to Douglas Adams,')

>According to Douglas Adams, “42.” More seriously, it’s often considered to be finding personal fulfillment, happiness, and purpose.

"Chattiness" still seems to be an issue with LLMs. For many use cases, it is desirable to just get a "42" back, or just the Douglas Adams bit; but that's still quite a challenge to set up in a reliable way. Even using the "command" or "instruct" versions of the best LLMs, answers still diverge significantly. Hope this gets fixed (i.e. trained) soon.


It's even counterproductive. Because it adds ambiguity on whether the "more seriously..." part is from Douglas Adams or from the LLMs general knowledge, leading the user to put additional effort into clarifying this


Yeah it's a bit surprisingly actually - as I was building this lib I was running this prompt a lot, and Sonnet 3.5 is the first one that answers it with this extra unrequested stuff.


I feel you.

About a year ago, I was trying to get a very concise query from GPT-4.

"Do not write anything else but the specific answer the user requires."

"Be extremely brief and concise."

"Do not write <this> and <that> explicitly."

Nothing seemed to work. GPT always wants to put a little bit more out and that was really bad for my use case.

I asked about this on the OpenAI community but the reception was poor (it is a very toxic community, btw, I'd advise readers to not engage with it).

I'm surprised to see this is still an issue a year later with top of the line LLMs.

Disregarding that, Claudette looks pretty nice, thanks for putting it out for others to use :).



Everybody does NOT know about using a cute puppies for testing image functions. F minus. What about kittens? Hedgehogs? Quokkas? Get with the times, greybeards!


Very useful!


No TypeScript version? :(




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: