[KongchangAI]

#MLOps

37 related articles

SageMaker ML Workflow: From Notebook to Endpoint Deployment
·3 min

SageMaker ML Workflow: From Notebook to Endpoint Deployment

A software engineer's perspective on Amazon SageMaker ML workflow: data prep, notebook experiments, training, evaluation, versioning, endpoint deployment, and monitoring.

Read more →
Deep Review: The 5 Best Prompt Management Tools of 2026
·3 min

Deep Review: The 5 Best Prompt Management Tools of 2026

An in-depth review of the 5 best prompt management tools of 2026: Braintrust, PromptLayer, LangSmith, Langfuse, and Agenta. Compare versioning models, evaluation workflows, deployment, and rollback capabilities to help AI teams choose the right prompt engineering solution.

Read more →
How AI Research Teams Use AI Runtime to Accelerate Research Deployment
·2 min

How AI Research Teams Use AI Runtime to Accelerate Research Deployment

Databricks' AI research team shares how AI Runtime enables environment consistency, accelerates experimental iteration, and smooths the transition to production deployment.

Read more →
Stop Cloning Data: Connecting Vertex AI Directly to BigQuery in Practice
·3 min

Stop Cloning Data: Connecting Vertex AI Directly to BigQuery in Practice

Stop cloning data for Vertex AI: use BigQuery as a feature store, connect via TabularDataset and KFP components to save storage—and understand the real costs of performance contention, data snapshots, and SDK versions.

Read more →
MLOps for Beginners: How Amazon SageMaker Bridges Models to Production
·2 min

MLOps for Beginners: How Amazon SageMaker Bridges Models to Production

From training to deployment to monitoring, MLOps connects the entire pipeline for putting machine learning models into production. This article breaks down core MLOps concepts, SageMaker's role across the lifecycle, and realistic paths to adoption.

Read more →
The Full AI Development Lifecycle: An Engineering Guide from PoC to Production
·3 min

The Full AI Development Lifecycle: An Engineering Guide from PoC to Production

From PoC to production, the real challenge in AI isn't the model — it's the engineering process. This guide covers all seven lifecycle phases, from problem definition to monitoring, with Go/No-Go gates to manage risk.

Read more →
Deep Learning MLOps Tool Survey: The Real Pain Points of Maintaining Models in Production
·1 min

Deep Learning MLOps Tool Survey: The Real Pain Points of Maintaining Models in Production

A developer on Reddit surveys practitioners to validate real pain points in production ML model maintenance before open-sourcing a custom MLOps tool.

Read more →
Event-Driven ML Pipelines in Manufacturing: 3 Years on AWS and 72% Cost Savings
·2 min

Event-Driven ML Pipelines in Manufacturing: 3 Years on AWS and 72% Cost Savings

An AWS industrial practice report: automotive manufacturing uses event-driven ML training with ECS+GPU, SQS, and admission control Lambda — 72–78% cost savings over 3 years and 40K+ jobs.

Read more →
Canary Rollouts: A Practical Guide to Zero-Downtime AI Model Upgrades in Production
·2 min

Canary Rollouts: A Practical Guide to Zero-Downtime AI Model Upgrades in Production

Canary rollouts enable zero-downtime AI model upgrades in production. Learn how phased traffic ramping, metric gates, and automatic rollback reduce risk in dedicated inference deployments.

Read more →
The Rise of MLOps Communities: Real-World Conversations from GPUs to Production Deployment
·1 min

The Rise of MLOps Communities: Real-World Conversations from GPUs to Production Deployment

A developer launches an MLOps Discord community focused on infrastructure, GPUs, model serving, and production issues. Exploring why community exchange matters in AI engineering.

Read more →
Switching from LLM APIs to Self-Hosting: Does the Math Actually Work Out?
·2 min

Switching from LLM APIs to Self-Hosting: Does the Math Actually Work Out?

Is self-hosting LLMs worth it vs. paying for APIs? Based on real Reddit engineering discussions, this article breaks down the true TCO — idle GPU costs, engineering hours, cold starts, and ops overhead.

Read more →
Senior SWE Transitioning to MLOps: Which Skills Should You Prioritize?
·2 min

Senior SWE Transitioning to MLOps: Which Skills Should You Prioritize?

A senior SWE with 7 years of experience wants to break into MLOps. We analyze his strengths, five key skill gaps (AWS, model serving, ML observability, distributed systems, GPU inference), and practical advice for making the switch fast.

Read more →
The Hidden Challenge of LLM Inference Cost Tracking: Why Your Bill Never Tells the Full Story
·2 min

The Hidden Challenge of LLM Inference Cost Tracking: Why Your Bill Never Tells the Full Story

Why is LLM inference cost tracking so hard? Provider bills show totals but hide how retries, model fallbacks, and multi-step agent workflows inflate spending.

Read more →
The Service Is Healthy but the Model Is Failing — Who Owns This Incident?
·2 min

The Service Is Healthy but the Model Is Failing — Who Owns This Incident?

When infrastructure metrics are green but model predictions silently degrade, who owns the incident? This article examines ML ops blind spots, accountability gaps, and rollback decision-making.

Read more →
Nobody Owns 'Whether the Model Is Right': The Real Blind Spot in MLOps Monitoring
·2 min

Nobody Owns 'Whether the Model Is Right': The Real Blind Spot in MLOps Monitoring

The biggest blind spot in MLOps monitoring isn't tooling — it's that nobody owns 'whether the model is right.' This article breaks down why dashboards go green while models silently fail, and proposes a tripwire + scorecard dual-layer monitoring approach with clear single-owner accountability.

Read more →
Should AI Agents Have Version Control and Signing? A Practical Guide to OCI Packaging
·2 min

Should AI Agents Have Version Control and Signing? A Practical Guide to OCI Packaging

Should AI Agents have version control and signing like models? This article explores packaging Agents as OCI artifacts using KitOps — covering prompts, MCP configs, skills, and policies — for traceable, tamper-proof governance.

Read more →
Databricks Feature Platform: Define Once, Reuse Across Training and Production
·2 min

Databricks Feature Platform: Define Once, Reuse Across Training and Production

Databricks Feature Store unifies batch and streaming features via Feature Views, enables automatic point-in-time joins for training sets, and provides built-in governance and observability for ML production.

Read more →
Canary Rollouts Go Live: Zero-Downtime Model Inference Endpoint Upgrades
·2 min

Canary Rollouts Go Live: Zero-Downtime Model Inference Endpoint Upgrades

Dedicated Model Inference now supports Canary Rollouts for zero-downtime model upgrades. Traffic shifts 5%→25%→50%→100% with automatic p95 latency and error rate gates.

Read more →