LLMs are sophisticated lossy compression algorithms. Understanding them through information theory explains hallucinations as compression artifacts and reveals how to optimize them through data engineering techniques like RAG and fine-tuning.
An introduction to Fully Homomorphic Encryption (FHE), a cryptographic technique that allows computations to be performed on encrypted data without needing to decrypt it first.
Arena-based allocation is a memory management strategy in which a large block of memory is pre-allocated, and then many small objects are quickly carved out from that block.
The C runtime (CRT) is a collection of startup routines, initialization code, standard library support, and sometimes system call wrappers that form the environment in which a C program executes.