# Thoughts & Stories: AI/ML

> Sharing my experiences, learnings, and adventures in tech and beyond.

URL: https://www.matthewswong.com/en/blog/category/ai-ml/

- [Datadog Scout 1.0: What Cheaper AI SRE Investigations Mean](https://www.matthewswong.com/en/blog/datadog-scout-sre-model-bits-investigation-cost/)
- [LMCache Multi-Process Mode: Shared KV Cache for MoE Serving](https://www.matthewswong.com/en/blog/lmcache-multi-process-mode-moe-shared-kv-cache/)
- [vLLM Semantic Router v0.4: Mixture-of-Models Routing Guide](https://www.matthewswong.com/en/blog/vllm-semantic-router-v0-4-mixture-of-models-routing/)
- [KServe LLMInferenceService Guide: llm-d, WVA and vLLM](https://www.matthewswong.com/en/blog/kserve-llminferenceservice-llm-d-production-guide/)
- [OCI Model Artifacts: Faster Kubernetes Model Cold Start](https://www.matthewswong.com/en/blog/oci-model-artifacts-kserve-faster-model-cold-start/)
- [NVIDIA Dynamo on Kubernetes: Rust EPP and v1beta1 Upgrade](https://www.matthewswong.com/en/blog/nvidia-dynamo-1-5-rust-endpoint-picker-kubernetes/)
- [DeepSeek V4.1 Flash on vLLM vs SGLang: What the Numbers Mean](https://www.matthewswong.com/en/blog/deepseek-v4-1-flash-serving-vllm-vs-sglang/)
- [SGLang Unified Radix Cache: Prefix Caching for Hybrid Models](https://www.matthewswong.com/en/blog/sglang-unified-radix-cache-hybrid-model-prefix-caching/)
- [vllm-metal on Apple Silicon: a Local vLLM Server for Mac](https://www.matthewswong.com/en/blog/vllm-metal-apple-silicon-local-llm-server/)
- [vLLM 0.31 Release Notes: Preload, Model Runner V2 and the Flags That Break](https://www.matthewswong.com/en/blog/vllm-0-31-fast-restart-preload-weight-cache/)
- [vLLM Bi-Directional KV Transfer for Multi-Turn Agents](https://www.matthewswong.com/en/blog/vllm-bidirectional-kv-transfer-multi-turn-agents/)
- [vLLM Disaggregated Prefill Decode: A NixlConnector Guide](https://www.matthewswong.com/en/blog/vllm-disaggregated-prefill-decode-serving-guide/)
- [vLLM NixlPushConnector: Push vs Pull KV Transfer and TTFT](https://www.matthewswong.com/en/blog/vllm-nixl-push-connector-faster-ttft-disaggregated/)
- [Choosing an Embedding Model: A Practical Benchmark](https://www.matthewswong.com/en/blog/embedding-model-selection-benchmark/)
- [Hybrid Search and Reranking: Better RAG Retrieval](https://www.matthewswong.com/en/blog/hybrid-search-reranking-rag/)
- [RAG vs Fine-Tuning: An Honest Decision Framework](https://www.matthewswong.com/en/blog/rag-vs-fine-tuning-decision/)
- [Semantic Search with pgvector: Skip the Dedicated Vector Database](https://www.matthewswong.com/en/blog/pgvector-semantic-search-postgres/)
- [Building Production RAG LLM Applications: Architecture, Chunking, and Evaluation](https://www.matthewswong.com/en/blog/building-production-rag-llm-applications/)

---

- HTML version: https://www.matthewswong.com/en/blog/category/ai-ml/
- Bahasa Indonesia: https://www.matthewswong.com/id/blog/category/ai-ml/
- Site index for agents: https://www.matthewswong.com/llms.txt
- Sitemap: https://www.matthewswong.com/sitemap.xml
- API description (OpenAPI): https://www.matthewswong.com/openapi.json