Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

How would I do this reliably? Eg give me 10 different values, all in one prompt for performance reasons?

Might not need JSON but whatever format it outputs, it needs to be reliable.



Don’t do it all in one prompt.


Right, but now I’m basically running a huge performance hit, need to parallelize my queries etc.

I was parsing a document recently, 10-ish questions for 1 document, would make things expensive.

Might be what’s needed but not ideal.


LLM performance is a function of the number of tokens, not queries




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: