5 posts
LLMs are sophisticated lossy compression algorithms. Understanding them through information theory explains hallucinations as compression artifacts and reveals how to optimize them through data engineering techniques like RAG and fine-tuning.
An introduction to Fully Homomorphic Encryption (FHE), a cryptographic technique that allows computations to be performed on encrypted data without needing to decrypt it first.
Arena-based allocation is a memory management strategy in which a large block of memory is pre-allocated, and then many small objects are quickly carved out from that block.
The C runtime (CRT) is a collection of startup routines, initialization code, standard library support, and sometimes system call wrappers that form the environment in which a C program executes.
The second part of the conspect of the "Intoduction to TLA+" course by Leslie Lamport.