Glossary

Large language model (LLM)

Beginner

A program trained on huge amounts of text and code. It can answer questions and write text or code from a request typed in plain language.

Novice

A very large neural network trained on huge amounts of text and code to predict the next word piece (token), then tuned to follow instructions. Chatbots are built on them. In chip design they write hardware code, test code and tool scripts on request.

Expert

Output is sampled one token at a time, so the same prompt can give different answers, and settings such as temperature, the prompt and the examples in it change the quality. Nothing in the model checks that hardware code behaves correctly, so every output needs an outside check: simulation, a formal tool or human review.

Explained in AI in EDA (Extras).

See also: Hallucination, pass@k.

All 896 terms →