← all repositories

amazon-science/auto-cot

Automatic chain-of-thought prompting system that reduces manual effort in designing reasoning demonstrations for large language models.

2k stars Jupyter Notebook LLMOps · EvalLanguage Models
auto-cot
Velocity · 7d
+1.5
★ / day
Trend
steady
star history

Auto-CoT automatically generates diverse chain-of-thought demonstrations to prompt large language models, removing the need for manual prompt design. It constructs reasoning chains step by step and selects demographically varied examples to cover different reasoning patterns. The approach achieves performance comparable to or exceeding manually designed prompts on GPT-3 across reasoning benchmarks like arithmetic and commonsense questions.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.