Memory came first.
The order matters. Memory was built first because nothing else worked without it. Models that forget every session can't be colleagues. They start cold. They miss the constraint you mentioned in passing. They contradict last quarter's decision because the decision left no trace.
Once memory existed, the agent that uses it followed naturally. Once the agent had a stable foundation, specialized intelligences became possible. Each piece earned its place by being needed, not by being planned.
We don't predict the network. We build the next part when it becomes the obvious part.