Aaron's Digital Garden 🪴

❯

Infra LLMs + AI Agents

Folder: Infra-LLMs-+-AI-Agents

46 items under this folder.

Dec 04, 2025
Hints for Computer System Design
Nov 30, 2025
CacheBlend - Fast Large Language Model Serving for RAG with Cached Knowledge Fusion
Nov 25, 2025
Security of AI Agents
Nov 22, 2025
Amazon Bedrock AgentCore
Nov 19, 2025
CUA
Nov 18, 2025
OSWorld-Human - Benchmarking the Efficiency of Computer-Use Agents (CUA Workshop '25)
Nov 15, 2025
Survey on Evaluation of LLM-based Agents
Nov 13, 2025
SimpleDoc Multi-Modal Document Understanding with Dual-Cue Page Retrieval and Iterative Refinement
Nov 11, 2025
METIS Fast Quality-Aware RAG Systems with Configuration Adaptation
Nov 09, 2025
Cognify Supercharging Gen-AI Workflows With Hierarchical Autotuning (KDD '25)
Nov 06, 2025
MemGPT Towards LLMs as Operating Systems
Nov 03, 2025
Lec 16 LLM Tools and MCP
Nov 02, 2025
What are tools and MCP?
Oct 31, 2025
Lec 15 - Reasoning Models
Oct 30, 2025
Reasoning Models
Oct 29, 2025
Lec 14 - MegaScale Infer
Oct 28, 2025
MegaScale-Infer Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism (SIGCOMM '25)
Oct 27, 2025
Lec 13 InferCept
Oct 25, 2025
InferCept Efficient Intercept Support for Augmented Large Language Model Inference (ICML'24)
Oct 23, 2025
dLoRa Dynamically Orchestrating Requests and Adapters for LoRA LLM Serving
Oct 22, 2025
Lec 11 Long Context Serving
Oct 21, 2025
Attention
Oct 21, 2025
DeepSpeed Ulysses System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models (PODC '24)
Oct 20, 2025
Lec 10 - Prefill-Decode Disaggregation Past, Present, and Future
Oct 19, 2025
DistServe Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving (OSDI '24)
Oct 17, 2025
Lec 9 LLM Serving Pt.1 Prefix Caching
Oct 15, 2025
Lec 8 LLM GPUs MegaKernel
Oct 15, 2025
Preble Efficient Distributed Prompt Scheduling for LLM Serving
Oct 14, 2025
Compiling LLMs into a MegaKernel A Path to Low-Latency Inference
Oct 13, 2025
Lec 7 - LLMs - Gen AI
Oct 12, 2025
Fast Inference from Transformers via Speculative Decoding
Oct 10, 2025
Efficient Memory Management for Large Language Model Serving with PagedAttention
Oct 10, 2025
Lec 6 - vLLM and Paged Attention
Oct 08, 2025
RAG Crash Course
Oct 07, 2025
Orca A Distributed Serving System for Transformer-Based Generative Models
- s
Oct 06, 2025
Lec 3 - HLAT
Oct 05, 2025
HLAT High-quality Large Language Model Pre-trained on AWS Trainium
Oct 03, 2025
Lec 3 - Distributed Model Training
Oct 02, 2025
PipeDream Generalized Pipeline Parallelism for DNN Training
Oct 01, 2025
Lec 2 - Understanding LLM Performance
Sep 30, 2025
Mosaic Pretrained Transformer
Sep 30, 2025
Notes on LLM Inference Performance Engineering Best Practices by Megha Agarwal, Asfandyar Qureshi, Nikhil Sardana, Linden Li, Julian Quevedo and Daya Khudia
Sep 29, 2025
Lec 2 - AI Agents
Sep 29, 2025
ReAct Synergizing Reasoning and Acting in Language Models
Sep 29, 2025
What is an AI agent
Sep 26, 2025
Lec 1 - LLMs - Gen AI
- Gen-AI

Recent Writing

Computer Arch Crash Course
Sep 26, 2025
The Missing Readme - consolidated by new grad
Jun 16, 2025
Caching Crash Course
Jun 08, 2025
OS Crash Course
Jun 08, 2025

Recent Notes

C2 - Data Models and Query Languages
Dec 17, 2025
C1-Reliable, Scalable, and Maintainable Applications
Dec 16, 2025

Created with Quartz v4.5.2 © 2025

GitHub
LinkedIn