Lesson 21.221.2 The map

In everyday life. Before a company moves its payroll from a spreadsheet to a payroll service, the finance lead lists every column of the old spreadsheet. For each one, she writes where the new service does it, or "still ours". In this concept, the columns are the lines of your loop, and her list is the mapping table.

What you will learn. How to list every line of your Chapter 20 loop, and record for each line where each SDK now does that work.

Why it matters. A line you never wrote down is work you may think an SDK does for you when it does not.

One request, start to finish. Before reading either SDK, list what your Chapter 20 loop did for Ana's question: its five steps, the tools it allowed, the three limits it checked before every call, the deadline on each call, the retries, where it kept the conversation, and the trace. Each of those is a row in the table below.

Here is the whole loop in six lines of plain words, with where each line goes once an SDK takes over. The table below is this, one row per line.

1  send the instructions, history and tools    -> both SDKs do it for you
2  keep the reply                              -> both SDKs do it for you
3  if the model wants no tool, stop            -> both SDKs do it for you
4  run each tool the model asked for           -> both SDKs do it for you
5  add each result, then go back to line 1     -> both SDKs do it for you
*  before each call: check turns, cost, time   -> turns: an option on both
                                                  cost: an option on the first SDK only
                                                  time: still yours on both

What is the mapping table?

The mapping table is the spine of this chapter. It has the Chapter 20 column filled and the two SDK columns empty. You fill them in during the lab, in docs/sdk-map.md. The finished table is on the companion page.

Backoff means waiting a little longer before each new try.

Three kinds of answer go in the SDK columns. It does it, with the option that controls it. It does it differently, with the difference written down. And still yours, when the SDK has no option and your code must keep doing it.

Figure 21.2. Every line of your loop, labeled with who does it now.

At work. Lab 21, Task 2: read the worker's spec and start your table. Each later task fills in a cell or two.

The operating rule: map every line of the loop you know to where the new library does it, before you trust the library. Write "still yours" wherever it has no answer.

Part A in one minute. There are four rungs: your loop, a tool runner, an agent SDK and a hosted runtime. Each does more for you and shows you less, and each chooses some things for you (21.1). The mapping table lists every line of your Chapter 20 loop, and you fill in where each SDK does it, how it differs, or that it is still yours (21.2). Now set up the lab and do Sitting 1.

Now go to the lab page. Do Lab 21: getting ready and Task 0 (about 20 minutes). Next comes Sitting 1, with Task 2 and the optional Task 1 (about 15 minutes, 45 with Task 1). Then come back for Part B.