Source: Jack Roberts | https://www.youtube.com/watch?v=TXcr0x9SIXA Duration: 25 min | Published: 2026-04-09 Processed: 2026-04-10
multilingual-e5-instruct (a model that converts text into vectors; multilingual means it works across languages).email, youtube-knowledge, project-a, etc.).email namespace.diary, inbox, clients, decisions, youtube-library, references). Replaces or augments the Ogham/Supabase vector setup already in place.email namespace, so Jo can ask intent-based questions across his entire Gmail history.# Claude Code + Pinecone 2.0 = UNSTOPPABLE Memory
**Source:** Jack Roberts | https://www.youtube.com/watch?v=TXcr0x9SIXA
**Duration:** 25 min | **Published:** 2026-04-09
**Processed:** 2026-04-10
---
## Core Concepts
- The build is a long-term memory layer for Claude that uses Pinecone as the storage backend and retrieval-augmented generation (RAG) as the access pattern.
- Pinecone is a hosted vector database. A vector database stores text as numerical coordinates ("embeddings") so that similar meanings land near each other in space.
- RAG (retrieval-augmented generation) means: before the model answers, it first retrieves the most relevant stored chunks and injects them into its context so it can reason over them.
- Why this beats raw context windows and MCP connectors:
- Context windows are finite and expensive. Every token in context costs money and crowds out other instructions.
- MCP connectors (like the Gmail MCP) do keyword lookups against a live API, one query at a time, and can't do semantic search across everything at once.
- Pinecone stores a permanent copy of the data as vectors, so you can search by intent ("sponsorship offers with budget") not just by exact words ("partner").
- The difference between keyword search and semantic search:
- Keyword search matches literal tokens: "vehicle" only finds "vehicle."
- Semantic search matches meaning: "vehicle" also surfaces "automobile," "car," "truck" because their vectors sit nearby.
- The three-step RAG loop the system uses:
- Store — chunk documents, turn each chunk into a vector, write the vector plus the original text into Pinecone under a namespace (a label that groups related vectors).
- Retrieve — when a question comes in, vectorise the question, ask Pinecone for the nearest vectors, get the matching text back.
- Generate — pass the retrieved text into Claude as context, Claude writes the final answer grounded in those retrieved chunks.
- Setup sequence on Pinecone:
- Sign up at pinecone.io (free tier is generous).
- Create an API key under API Keys in the sidebar.
- No need to pre-create an index — the vectorising step creates it.
- Embedding model used in the demo: `multilingual-e5-instruct` (a model that converts text into vectors; multilingual means it works across languages).
- Two ways to write to Pinecone:
- Claude Code (inside an IDE like Antigravity or VS Code): best for bulk ingestion — books, PDFs, large folders, programmatic workflows. Uses the Pinecone CLI.
- Claude.ai web app ("Cowork"): best for quick conversational save/retrieve. A Pinecone memory Skill is installed into the app so you can say "save this conversation" or "search memory for X."
- Namespaces are the organisation trick:
- Instead of creating a new index per topic, use one index and tag vectors with namespaces (`email`, `youtube-knowledge`, `project-a`, etc.).
- Queries can be scoped to a namespace so results stay clean.
- The creator configures the Skill to pull from multiple sources per query, not just the single best match, and applies weighting so older content can be deprioritised or deleted.
- Notebook LM integration (from a previous video of the same creator):
- A Claude Skill connects Claude Code to Google Notebook LM.
- Claude can download every source inside a Notebook LM notebook (the demo pulled 235 of 271 sources) to a local folder, then vectorise the whole lot into Pinecone.
- Notebook LM is free to query and generate, which makes it a cheap research front-end that feeds the permanent Pinecone memory.
- Gmail use case:
- Instead of calling the Gmail MCP per query, dump the last N emails into Pinecone under an `email` namespace.
- Now you can ask intent-based questions: "who do I need to follow up with," "pending deals waiting for my response," "brief me before every call."
- This shifts Gmail from a filing cabinet (exact match lookup) into a queryable corpus.
- Cross-product memory:
- Because Pinecone is a shared backend, the same memory is accessible from Claude.ai, Claude Code, Antigravity, and Open Claude / Gravity Claude (browser-based Claude frontends).
- Any conversation in one surface becomes retrievable in every other surface.
- Persistence of personal preferences:
- The demo saves "my preferred city is Dubai" into Pinecone, then retrieves it from a fresh session with a similarity score of 0.86 (a cosine similarity number where 1.0 is identical meaning).
- Claude project instructions can be set to always consult Pinecone before answering, making the memory automatic rather than manual.
## Buildable Ideas
- Pinecone memory layer for Himiko: one index, multiple namespaces (`diary`, `inbox`, `clients`, `decisions`, `youtube-library`, `references`). Replaces or augments the Ogham/Supabase vector setup already in place.
- Comparison worth running: Pinecone free tier vs. current Supabase + Voyage AI stack. Which is cheaper, faster, more reliable at scale?
- Email-as-corpus pattern: daily job that vectorises every new inbox item into the `email` namespace, so Jo can ask intent-based questions across his entire Gmail history.
- Notebook LM harvester: scheduled skill that downloads all sources from every Notebook LM notebook into Pinecone. Turns the 25+ notebooks from a locked Google product into a queryable personal knowledge base.
- Cross-surface memory bridge: one memory backend that Claude Code, Claude.ai, and any custom frontends all read from and write to. Matches the Atlas / Agent OS vision of one persistent brain across interfaces.
- Weighted freshness: tag vectors with timestamps at ingest, then weight retrieval so recent content ranks higher. Solves the "12-month-old advice is wrong now" problem the creator flagged.
- Multi-source answers by default: configure the retrieval Skill to pull the top N matches per query and synthesise across them, not pick one winner. Reduces single-point-of-failure in retrieved context.
- Namespace-per-project pattern for multi-client work: each client gets a namespace, and Jin's project management queries automatically scope to the right client's memory.
## Key Takeaways
- Pinecone + a retrieval Skill gives Claude a permanent memory that beats both context windows and live MCP connectors for anything beyond one-off lookups.
- The architecture that matters is: one index, many namespaces, retrieval Skill installed in every Claude surface, writes from Claude Code and Claude.ai both land in the same place.
- Semantic search is the unlock — it's not keyword matching, it's matching by meaning, which is why you can ask "who offered me money" and find sponsorship emails that never use the word "money."
- For Himiko, this is a direct alternative (or complement) to the Ogham memory stack already running. Worth A/B testing Pinecone against it before committing either way.
- The Notebook LM harvester pattern turns every existing research notebook into a Pinecone-backed queryable corpus — that alone could be built this week against the existing 25+ notebooks.