Patterns of LLM Use

Patterns of LLM Use

I am seeing many patterns regarding LLM use. I cannot tell if they are good patterns or bad patterns, yet, but I am putting it out there.

Deployment Agents

Using an LLM agent to deploy a product instead of a CI/CD pipeline.

Pros:

  • can handle unexpected situations

Cons:

  • repeatability is not guaranteed

Agent Interface

Hiding code behind an agent, all modifications go through that agent.

Pros: leads to BDD, Begging Driven Design

Cons: easier for noobs

Centralized API for Different Models, a la Bedrock

Pros:

  • better control over cost
  • easier to switch and govern

Cons:

  • harder access to model specific tools

Centralized CI Review Tool

Pros:

  • better setup per project

Cons:

  • less control per team if done incorrectly