Ai-Engineering
All articles
53 total
AI Supply Chain Security
Verifying model weights, scanning dependencies, and securing the …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
AI-Adapted Test Pyramid
The testing pyramid adapted for AI systems: unit tests for deterministic …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
API Versioning Strategies for AI Services
How to version AI APIs as models evolve: URL path versioning, header …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Capacity Planning for AI Inference
How to right-size GPU and TPU clusters, configure autoscaling for …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Chaos Testing for AI Systems
Chaos engineering for AI: injecting model API latency, simulating …
Guides
Added 28 Mar
·
Upd 30 May
·5 min
CI/CD Testing Strategy for AI Systems
Which tests to run at each CI/CD stage: PR-level unit tests, merge-level …
Guides
Added 28 Mar
·
Upd 30 May
·5 min
Compliance as Code for AI Systems
Encoding regulatory requirements as automated checks: policy-as-code …
Patterns
Added 28 Mar
·
Upd 30 May
·4 min
Contract Testing for AI Microservices
Contract testing between AI services: defining input/output contracts, …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Data Contract Pattern for AI Systems
Implementing schema contracts between data producers and AI consumers: …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Data Quality Validation for AI Systems
How to implement data quality validation for AI workloads using Great …
Guides
Added 28 Mar
·
Upd 30 May
·3 min
DeepEval vs Promptfoo for LLM Evaluation in CI
Comparing DeepEval and Promptfoo for automated LLM evaluation: metrics, …
Comparisons
Added 28 Mar
·
Upd 14 Jun
·7 min
Disaster Recovery for AI Systems
How to plan disaster recovery for AI systems: RTO/RPO targets, …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
End-to-End Testing
What end-to-end testing is, how browser automation validates full-stack …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
End-to-End Testing AI-Powered Products
How to E2E test AI applications: browser automation for chatbot UIs, …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Evaluator-Optimizer Pattern
Automated evaluation loops where one model generates output and another …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Fallback Chain Pattern
Cascading model fallback strategy where failures or low-confidence …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Fan-Out/Fan-In Pattern for AI Workloads
Parallel processing pattern for AI tasks: split work across multiple …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Feedback Loop Pattern for AI Systems
Systematic collection and incorporation of user feedback to continuously …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Flaky Test
What flaky tests are, why they are especially common in AI systems, and …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Golden Dataset
What a golden dataset is, how it serves as a curated evaluation …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Incident Management for AI Systems
How to handle incidents in AI systems: on-call rotations, escalation …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Integration Testing
What integration testing is, how it verifies component interactions, and …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Integration Testing AI Pipelines
How to integration test AI systems: testing RAG retrieval pipelines, …
Guides
Added 28 Mar
·
Upd 30 May
·5 min
Jest vs Pytest for AI Application Testing
Comparing Jest and Pytest for testing AI applications: language …
Comparisons
Added 28 Mar
·
Upd 14 Jun
·6 min
Managing Test Environments for AI Systems
Test environment strategies for AI: local dev with mocked models, …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Mocking
Test doubles for AI systems: mocks, stubs, fakes, and spies explained, …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Mocking AI Services for Testing
Strategies for mocking LLM APIs, embedding services, and vector …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Orchestrator-Worker Pattern
An orchestrator LLM decomposes complex tasks and delegates subtasks to …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Playwright
Playwright browser automation framework: what it is, key features, and …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Playwright Testing Guide for AI Applications
Comprehensive Playwright guide: setup, page objects, selectors, …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Playwright vs Cypress for Testing AI-Powered Web Apps
A detailed comparison of Playwright and Cypress for end-to-end testing …
Comparisons
Added 28 Mar
·
Upd 14 Jun
·5 min
Progressive Delivery for AI Deployments
Combining feature flags, canary releases, and automated rollback for AI …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Rate Limiting for LLM and AI Endpoints
How to implement rate limiting for AI API endpoints: token bucket and …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Real-Time Feature Computation Pattern
The architectural pattern for computing ML features from event streams: …
Patterns
Added 28 Mar
·
Upd 30 May
·5 min
Retrieval Routing Pattern
Smart routing between multiple knowledge sources based on query intent, …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Sandbox Testing Pattern for AI Agents
Sandboxed execution environments for testing AI agents with real tool …
Patterns
Added 28 Mar
·
Upd 30 May
·4 min
Security Scanning in AI/ML CI/CD Pipelines
How to integrate security scanning into AI/ML CI/CD pipelines: …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Semantic Assertion Pattern
Asserting AI output correctness via semantic similarity rather than …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Snapshot Testing
What snapshot testing is, how it captures and compares output snapshots …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Snapshot Testing for AI Systems
Snapshot and golden file testing for AI: capturing expected outputs, …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Software Quality Practices for ML Projects
How to apply software quality practices to ML projects: code coverage …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Statistical Assertion Pattern
A testing pattern for non-deterministic AI outputs: run N times, assert …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Test Data Management for AI Systems
Managing test data for AI: synthetic data generation, fixture design, …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Test Fixture
What test fixtures are, how they provide predefined data and state for …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Test-Driven Development
The TDD red-green-refactor cycle and how it applies to AI application …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Testing AI Agent Tool Calls
How to test AI agents that use tools: mocking tool responses, testing …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
Testing LLM Applications
LLM-specific testing strategies: prompt template testing, structured …
Guides
Added 28 Mar
·
Upd 30 May
·5 min
Testing Non-Deterministic Systems
Strategies for testing AI systems where the same input produces …
Guides
Added 28 Mar
·
Upd 30 May
·5 min
Testing RAG Systems
How to test Retrieval-Augmented Generation systems: unit testing …
Guides
Added 28 Mar
·
Upd 30 May
·5 min
Unit Testing
What unit testing is, how isolation and test doubles work, and assertion …
Glossary
Added 28 Mar
·
Upd 30 May
·3 min
Unit Testing AI Applications
How to unit test AI codebases effectively: testing prompt templates, …
Guides
Added 28 Mar
·
Upd 30 May
·4 min
VCR Pattern for AI API Testing
Record-and-replay pattern for AI API testing: capture real model …
Patterns
Added 28 Mar
·
Upd 30 May
·3 min
Zero Trust for AI Model Serving
Applying zero trust architecture to AI systems: securing inference …
Patterns
Added 28 Mar
·
Upd 30 May
·4 min
53 articles in this section. Search for a specific topic.
Open source projects