Serving LangChain agents in production with LangServe
Eight months ago, our algorithmic trading desk transitioned its market sentiment and macro news analysis pipeline from standalone Python scripts to an aut…
Read entryAI Engineering
Why I chose Gemma 4 E4B over 26B for structured JSON output
In our automated algorithmic trading pipeline, prompt engineering is a liability. Every market tick requires us to parse un-structured news feeds, SEC fil…
Read entry
Serving embeddings at scale with ONNX Runtime
Last quarter, my team took over the real-time feature generation pipeline for our order-book anomaly detection models. The core of the pipeline relies on…
Read entry
Grammar-constrained decoding for reliable structured output
Two months ago, my production algorithmic trading system started dropping order executions during volatile market conditions. The issue wasn't network lat…
Read entry
pgvector vs Qdrant for a 10M-chunk index: how I chose
Six months ago, our hybrid search setup was burning money and dropping queries. We were serving RAG-augmented financial reports over a dataset of 10 milli…
Read entry
Deploying an LLM agent service on Kubernetes: probes, resources, and rollouts
When deploying a standard stateless microservice on Kubernetes, the playbook is simple: write a fast health check endpoint, set modest CPU requests, and u…
Read entry
Running PostgreSQL on Kubernetes with the CloudNativePG operator
I run an algorithmic trading system that processes high-frequency tick-level data and serves real-time feature vectors to ML models. Historically, our dat…
Read entry
GitHub Actions to ArgoCD: a GitOps pipeline for an AI microservice
Deploying a standard web API is straightforward. Deploying an AI microservice that loads a 1.2GB sentence-transformer model into memory, requires CUDA dri…
Read entry
Progressive delivery of a model service with ArgoCD: canary and instant rollback
A silent failure mode in production machine learning is rarely a clean crash. It is usually a subtle drift in the feature pipeline, an unhandled NaN in a…
Read entry
A free contact address with Cloudflare Email Routing — no mail server
Automated trading infrastructure demands extreme reliability, minimal operational surface area, and zero unnecessary overhead. When building out-of-band c…
Read entry