Insights by topic

All articles

All 49 articles, newest first.

· 5 min read

From LLM Prompt to Production (1/9) - Understanding the Problem

Having a working LLM prompt is never enough. There is a long journey from a working prompt to a working enterprise scale application.

architecturellmapi
· 5 min read

From LLM Prompt to Production (2/9) - Choosing the Technology

Choosing the right technology is the most important component of your success. The language, database and cloud service have a major impact on everything you do.

architecturellmapi
· 16 min read

From LLM Prompt to Production (3/9) - Architecture Patterns

The architecture patterns dictate how the application behaves. Perfect implementation and testing is never enough if the architecture itself is faulty.

architecturellmapi
· 13 min read

From LLM Prompt to Production (4/9) - Multi Prompt Design

If you are doing more than a "Hello World", you should be using a chain of prompts that collectively gather the required outcome.

architecturellmapi
· 14 min read

From LLM Prompt to Production (5/9) - Additional Complexity

Enterprise scale applications have many other decisions that complicate the architecture. Bedrock or standard hosting, RAG or Text prompts, and many such decisions define your journey

architecturellmapi
· 20 min read

From LLM Prompt to Production (6/9) - Redundancy and Scalability

Any enterprise scale application is incomplete unless you put in all the effort on ensuring redundancy and scalability.

architecturellmapi
· 23 min read

From LLM Prompt to Production (7/9) - Security and Compliance

In the era of hackers and nerds going crazy over data privacy, security and compliance have to be an important component of our solution

architecturellmapi
· 36 min read

From LLM Prompt to Production (8/9) - Performance Optimization

POC always looks great. But is the response fast enough - always?

architecturellmapi
· 8 min read

From LLM Prompt to Production (9/9) - Monitoring & Observing

One good response on the LLM does not mean that every response is good. Each customer should get the perfect answer. And we should be confident that this is a fact.

architecturellmapi