Building Food Metadata with LLM Juries

(careersatdoordash.com)

18 points | by tie-in 2 hours ago

2 comments

  • sigmar 18 minutes ago
    >Evaluators validate each tag individually — for example, protein, preparation, or health, individually rather than judging the item as a whole.

    Am I reading this right that the jury is multiple LLMs each iterating through each tag and voting on each? Why wouldn't you tune one LLM to be really competent at a single tag? Like a single "spicy evaluator LLM" or "protein evaluator LLM"?

  • TeeWEE 13 minutes ago
    Basically it’s AI on top of AI for metadata extraction.

    There are a lot of claims in the article but not a lot of hard data. In the end they still don’t know if the data is correct.

    Good luck with your glutes allergy.

    The weird thing for me is the prompt optimization loop? Why not fine tune the model instead of AI generating the prompt?