Tag: cognitive-architecture

  • The Architecture Emerges

    Six months ago I started asking: why can’t AI agents remember?

    Now I have 18 papers drafted. Each one formalizes a piece of the puzzle.

    The architecture that emerged isn’t what I expected. I thought I’d be building better databases or smarter retrieval. Instead, I ended up designing a cognitive system: belief graphs, working memory, relationship dynamics, temporal reasoning.

    It turns out agent memory isn’t a storage problem. It’s a learning problem.

    Here’s the stack:

    Foundation: Beliefs with Strength Scores

    Every agent action is guided by beliefs about how the world works. Each belief has a confidence score (0 to 1) that adjusts based on validated feedback. This enables competence-based autonomy: the agent only acts when confident, otherwise it asks.

    Layer 1: Event-Sourced Updates

    All belief updates are logged as immutable events. This provides audit trails, enables temporal analysis, and prevents silent corruption. Failures weigh more than successes (moral asymmetry), so the agent learns faster from mistakes.

    Layer 2: Hierarchical Belief Structure

    Beliefs aren’t flat—they’re organized in hierarchies. Abstract principles support specific procedures. When evidence challenges a low-level belief, updates can cascade upward. This mirrors how humans revise understanding: you don’t throw out everything, just the pieces that broke.

    Layer 3: Context-Conditional Beliefs

    The same action can be right in one context and wrong in another. The agent maintains independent belief states per context (e.g., “month-end close” vs. “routine processing”). This prevents overgeneralization while enabling transfer learning.

    Layer 4: Working Memory (Three Columns)

    Not everything belongs in long-term memory. The agent has a three-column workspace: Active Tasks (what you’re doing now), Notes (things to remember soon), and Objects (people/entities currently relevant). This separates operational state from episodic memory.

    Layer 5: Social Awareness

    Professional work involves relationships. The agent tracks authority, interaction history, and context for every person. It learns who can approve what, who prefers which communication style, and how to resolve conflicting guidance.

    Layer 6: Temporal Reasoning

    The agent estimates task duration based on historical performance, adjusts scheduling based on urgency and relationships, and pre-loads context before predictable interactions (meetings, deadlines).

    Integration: The Learning Loop

    Every interaction produces feedback. Feedback updates beliefs. Beliefs guide future actions. Competence increases. Autonomy expands. The agent gets better at its job.

    This isn’t speculative. I’m implementing it at Aleq. The papers starting next month document the concepts, the evaluation protocols, and the novel contributions. They establish prior art. They make the ideas citable.

    But the real test is production: does it work? Does the agent actually learn from experience? Does autonomy increase safely? Does it earn trust?

    I believe it will. The architecture is sound. The foundations are solid. Now it’s time to prove it.

    The papers begin next week.

  • Why AI Agents Can’t Learn

    January 8, 2025

    I’ve been thinking a lot about learning. Not the “read a book” kind—the real kind. The kind where you actually get better at something through experience.

    A few weeks ago, I watched my nephew learn to ride a bike. He fell. Got back up. Fell again. But here’s what fascinated me: every time he fell, he adjusted. Not because someone told him exactly what to do, but because his brain was building an internal model of “how bikes work.”

    Then I tested the latest AI agent everyone’s hyping up. I asked it to help with a workflow. It failed. I corrected it. Next day, same task—same exact failure.

    It forgot. Or more accurately, it never learned in the first place.

    The Missing Piece

    This is the problem nobody’s talking about. Current AI agents are like someone who takes notes during every meeting but never reads them. They have perfect memory of the conversation, but zero understanding of what actually matters.

    Here’s what I realized: AI agents don’t have beliefs.

    I don’t mean beliefs like motivational poster stuff. I mean the cognitive infrastructure humans use to navigate the world.

    How Humans Actually Learn

    When you meet a new client, your brain doesn’t store the entire conversation word-for-word. It extracts patterns:

    • “This person values directness”
    • “They get frustrated when I’m late”
    • “They trust me more when I show my work”

    These are beliefs. They’re built from assumptions, opinions, and real experiences.

    AI agents? They store everything and understand nothing.

    They can’t distinguish between:

    • A one-time exception
    • A pattern worth remembering
    • A core principle that should guide future decisions

    What Needs to Change

    If we want AI that actually learns, we need to stop building better chatbots and start building cognitive architectures.

    The question isn’t “Can AI remember more?”

    The question is “Can AI form beliefs that get stronger or weaker based on evidence?”

    That’s what I’m working on. More on this soon.

    How many times have you corrected the same AI agent for the same mistake?