My 2020 Comprehensive Obsidian Workflow For Zettelkasten and Evergreen Notes

Introduction to Obsidian and Zettelkasten

• Obsidian is a free application for personal knowledge management that features an active community of developers and supporters 0s.
• As of September 21, 2020, version 0.9.0 of Obsidian was released for insiders, which includes features that may not be available to the general public immediately 18s.
• The personal knowledge management system described combines the Zettelkasten method developed by Niklas Luhmann with the evergreen and atomic note-taking concepts popularized by Andy Matuschak 42s.

Origins and Principles of the Zettelkasten Method

• Niklas Luhmann was a German sociologist who utilized a system of note cards to produce a significant volume of academic work 1m15s.
• The Zettelkasten process involves reading literature or academic material and generating unique ideas rather than simply copying, pasting, or paraphrasing the source content 1m35s.
• Luhmann’s original system involved linking idea cards to bibliographical information and using an indexing pattern to connect cards, eventually resulting in a collection of approximately 90,000 interlinked index cards 1m50s.

Purpose and Utility of Zettelkasten

• Digital tools have replaced the manual indexing and physical card organization that were necessary during Luhmann’s time 2m6s.
• The primary purpose of a Zettelkasten is to serve as a "thinking partner" that aids the writing process by providing a jumping-off point, thereby preventing the need to start from a blank page 2m30s.
• By following pathways of linked information, users can identify connections between ideas to facilitate the creation of new content, such as writing or videos 2m55s.
• The book "How to Take Smart Notes" by Sönke Ahrens is recommended as a resource for understanding the utility of the Zettelkasten system for writers, researchers, and creative professionals 3m15s.

Zettelkasten for Research and Idea Generation

• The Zettelkasten system, as utilized by Niklas Luhmann, serves as a method to avoid confirmation bias by encouraging broad reading and the collection of diverse opinions before forming a specific research premise 0s.
• By prioritizing the generation of ideas and the creation of a network of notes first, a researcher can write based on their own train of thought while allowing the system to connect to relevant source literature 42s.
• This approach allows for the integration of conflicting perspectives into a single consolidated work, as the system links ideas to their original source literature notes regardless of the viewpoint 1m15s.

Evergreen Notes and Digital Advantages

• The workflow incorporates Andy Matuschak’s concept of "evergreen notes," which are atomic notes focused on a single concept or purpose 1m35s.
• Evergreen notes are designed to be revisited, improved, and updated over time, eventually forming a mature and stable "forest" of collected knowledge 1m50s.
• Digital tools like Obsidian allow for features that analog index cards cannot provide, such as advanced searching and mass editing capabilities 2m25s.

Digital Search and File Management

• Obsidian utilizes fuzzy searching, which enables users to find related or nearby concepts even if the search terms are not an exact match 2m35s.
• Because Obsidian stores data as plain text files, users can take a programmatic approach to file management, using scripts like Bash, Perl, or Python to perform mass edits across multiple files simultaneously 2m55s.
• The digital nature of the system allows for cloud hosting of the note collection 3m10s.
• Utilizing markdown files ensures portability, allowing notes to be stored in the cloud and accessed from any location, which provides an advantage over the physical index card system used by Niklas Luhmann 0s.
• Digital note-taking systems offer benefits such as ease of editing, searchability, mass editing capabilities, and cloud hosting 15s.

Visualizing and Navigating Linked Notes

• Obsidian allows for a note-taking layout inspired by Andy Matuschak, where users can hold the command key to open multiple linked notes side-by-side, effectively simulating the experience of spreading physical cards out on a desk for review 35s.
• The local graph view in Obsidian can be used to navigate and open connected notes, facilitating the same "desk" layout experience for reviewing interlinked ideas 1m25s.

Maintaining Integrity and Workflow Optimization

• A potential drawback of digital systems is the temptation to copy and paste content, whereas analog systems force users to manually write notes, which naturally filters information to only what is considered worth retaining 1m45s.
• To maintain the integrity of a Zettelkasten, it is important to avoid simple copying and pasting or plagiarism, and instead focus on distilling unique thoughts and notes 2m15s.
• Workflows are frequently adjusted to optimize productivity and accommodate personal needs, such as ADHD, ensuring the system remains functional rather than just a collection of unnecessary features 2m35s.
• The primary goal of a workflow is to reinforce the process of managing incoming content, distilling ideas, and producing output, such as writing or videos 2m55s.
• Obsidian supports Mermaid.js, which allows for the creation of flowcharts to visualize and manage content influx workflows 3m15s.

Processing Books and Developing Seedlings

• When processing physical books, such as How to Take Smart Notes by Sönke Ahrens, notes can be taken physically or digitally, though transcribing extensive handwritten notes can be labor-intensive 0s.
• For complex or technical books, it is effective to process content one chapter at a time by reading, taking notes, and distilling those notes into "seedlings" 25s.
• Seedlings represent new ideas that are initially placed in a "seed box" before moving to an "incubator" for further development and maturation 42s.
• Once matured, seedlings are planted into an "evergreen forest" by linking them to both their original source material and existing knowledge 1m2s.

Structuring and Linking Knowledge

• The system avoids rigid folders or hierarchies, instead utilizing a single top-level directory where notes are linked together to facilitate serendipitous discovery 1m25s.
• By heavily linking files, the system creates a network of information that serves as an external framework for thought, helping to maintain a flow state and generate unique content 1m55s.
• Literature notes should consist of one's own unique thoughts rather than copied, pasted, or paraphrased text 2m15s.
• Source notes include metadata such as author tags, the note title, relevant tags, the date of review, publication information, and a BibTeX entry 2m35s.

Literature Note Extraction and Refinement

• Literature notes are created by reviewing books and extracting bullet points, which are then processed during a second pass to identify key ideas 0s.
• Complex books may be processed chapter by chapter, while shorter or less complex material is reviewed in its entirety 0s.
• Extracted bullet points are transformed into links, allowing for the curation and maturation of ideas over time without requiring perfection during the initial capture 0s.
• Notes are fleshed out by connecting them to existing concepts, such as ADHD or executive function, to develop them into evergreen notes 0s.

Capturing and Processing Video Content

• A Chrome extension is used to take notes on YouTube videos, which automatically captures timestamps and exports the content to Google Docs in markdown format 35s.
• The note-taking process for videos involves typing observations while watching, which creates a document containing both the timestamps and the corresponding content 35s.
• While paid alternatives like Rocket Note exist, a free extension is currently utilized for its ability to generate timestamped notes 1m15s.
• Content from video transcripts can be converted into plain text within Obsidian, allowing for the use of multiple cursors or Vim macros to organize information alongside timestamps 0s.
• Maintaining timestamps within notes provides necessary context, enabling users to revisit specific segments of a video to flesh out ideas without needing to re-watch the entire recording 20s.
• Obsidian templates can be used to structure notes, and the iframe feature allows for the embedding and rendering of YouTube videos directly within the application when an internet connection is available 55s.
• Embedding a video via an iframe alongside timestamps allows for efficient review and development of ideas based on specific topics discussed in the video 1m35s.

Podcast Management and Audio Capture

• When listening to podcasts at a desk, users can embed the podcast player into Obsidian using an iframe and open two copies of the same note simultaneously to listen and take notes in edit mode 2m25s.
• The mobile application Air is used to capture podcast soundbites while on the go by double-tapping AirPods 3m15s.
• The Air app allows users to customize the duration of captured soundbites, provides a transcription of the audio, and enables the addition of custom captions 3m25s.
• Air quotes captured in the app can be exported to markdown format, which includes the timestamp, a link to the specific moment on the provider's site, personal thoughts, the user's caption, and the transcribed text 3m45s.
• Ideas are distilled from captured text, which can be transferred from a phone to a MacBook via AirDrop 0s.
• For single quotes from the Air app, a template page can be created that includes a link to the source, a media player, and the associated text 10s.
• When dealing with multiple quotes, the entire transcript file is exported and transferred to the computer to be processed as notes 25s.
• Iframes allow for the embedding of Air quotes directly into documents, providing a functional link to the source player and the transcription 42s.
• Podcast notes are managed by either embedding a player for the entire episode or creating specific pages for individual quotes, depending on the volume of content 1m5s.
• The Air app is utilized for its ease of use, specifically the ability to double-tap to capture quotes and export them as markdown files 1m20s.

Research Paper Workflow with Zotero

• Research papers are a primary source of literature, and a specific workflow is recommended for students and academics to manage notes and avoid plagiarism 1m35s.
• The current workflow for research papers involves using Zotero in conjunction with two plugins and Obsidian 2m6s.
• Zotero is used to automatically retrieve paper metadata and files by inputting a Digital Object Identifier (DOI) 2m25s.
• Within Zotero, users can open research papers to highlight text and add annotated notes directly to the PDF files 2m45s.
• The process for moving annotated PDF notes into Obsidian involves using two specific Zotero plugins: ZotFile and MDNotes. 10s
• ZotFile is used to extract annotations from PDFs into a text file located within the same sub-level as the original PDF in Zotero. 22s
• MDNotes is utilized to convert the extracted Zotero notes into markdown format, which can then be copied and pasted into Obsidian. 28s
• Extracting annotations via Zotero creates a rich text file that includes hyperlinks, allowing users to click and open the PDF directly to the specific location of the note. 42s
• When exported to markdown, the notes retain page references and relative links that function within Obsidian to navigate back to the source PDF. 1m25s
• Storing both the Zotero files and the Obsidian vault on iCloud allows for seamless referencing of materials across the system. 1m55s
• This workflow enables the creation of literature notes directly from PDFs without external distractions, facilitating the generation of ideas within Obsidian. 2m6s

Managing Internet Content with Raindrop.io

• Managing random internet content, such as articles from mailing lists or RSS feeds, involves using an RSS reader app to aggregate sources. 2m25s
• Raindrop.io is used as a free tool to manage and save articles from the internet, such as those found on Medium, by utilizing a web clipper to store them for later reading. 2m55s
• Articles and content that cannot be read immediately are saved using the Raindrop.io Chrome extension to a centralized inbox. 0s
• Raindrop.io is preferred over AI-based tagging applications because it allows for manual, clutter-free organization. 35s
• A numerical tagging system is used within Raindrop.io to manage reading status: a tag of "0" indicates unread content, while a tag of "1" indicates content that has been read. 55s
• Using numbers for tags ensures that status indicators remain at the top of the list, functioning as a boolean system for tracking progress. 1m15s
• The primary goal of the workflow is to avoid passive consumption and instead extract meaningful ideas for an Obsidian-based note-taking pipeline. 1m25s
• Content that is deemed unhelpful after review is deleted, while valuable content is processed by taking notes in Obsidian. 1m35s
• Once notes are transferred to Obsidian, the original item is filed into specific folders within Raindrop.io and assigned relevant descriptive tags, such as "spaced repetition" or "active recall," to facilitate future searching. 1m45s
• Raindrop.io serves as a curated reference library for read materials that are not needed for daily reference but remain accessible if required. 2m5s
• Raindrop.io acts as the primary catch-all collection point for information, with the exception of YouTube videos, which are managed via a separate "watch later" playlist. 2m20s

Reading Pipelines and Synthesis

• Zotero is used to manage a reading pipeline, with folders categorized by status such as "to read," "next," and "read," though these folders serve primarily as a visual organization tool rather than a functional one 0s.
• Content from various sources, including articles, research papers, podcasts, videos, and books, is processed into literature notes within Obsidian 25s.
• The workflow involves reviewing literature notes to identify and generate new "seedling" ideas, which are then incubated and fleshed out 35s.
• Seedling notes are "planted" in an evergreen forest by linking them to existing notes, ensuring the ideas are connected to related concepts 45s.
• The Zettelkasten system functions as an active practice of spaced repetition, as the process of finding appropriate places to file and link notes requires constant review and reading of previously created material 1m15s.
• By keeping material top of mind through continuous review and interlinking, the system facilitates the development of outputs such as papers or videos 1m40s.
• The primary goal of the system is synthesis rather than mere collection, emphasizing the importance of generating output from processed ideas 1m50s.

Technical Content and Documentation

• In addition to literature and idea notes, the system incorporates technical content, such as statistics and programming, using maps of content to connect related terms and definitions 2m10s.
• Technical notes serve as a reference tool, allowing for the linking of complex concepts or equations to their component parts to aid in understanding and documentation 2m35s.
• Technical notes can incorporate LaTeX equations for complex formulas and chunks of R code for script implementation, allowing for densely linked content that serves both technical and conceptual purposes 0s.

System Maintenance and Curation

• The primary objective of a personal knowledge management system is to identify and implement a workflow that functions effectively for the individual user 0s.
• The random note feature in Obsidian allows users to navigate to arbitrary notes, which facilitates stumbling upon past trains of thought and provides opportunities to perform formatting updates or edits 25s.
• While command-line utilities like regex replacements and grep can be used to manage notes, Obsidian’s built-in search and editing capabilities are generally sufficient for most maintenance tasks 1m5s.
• Note curation involves mass review processes, tag searching, and context searching, supported by saved searches for content and tags 1m25s.

Emergent Structure and Maps of Content

• A specific approach to organization involves using links for both files and tags, even when the linked note does not yet exist 1m55s.
• The system utilizes Nick Milo’s framework for Maps of Content (MOC), where structure is allowed to emerge organically over time as notes accumulate and central concepts become apparent 2m15s.
• Rather than pre-defining rigid categories, the system relies on observing connections on the graph to determine when a topic has grown enough to warrant the creation of a formal Map of Content 2m35s.
• Emojis are used as tags for aesthetic purposes and to simplify the process of selecting and typing tags within the system 2m55s.
• Specific symbols, such as a red exclamation point, are used to denote the importance of a note 3m10s.

Tagging Systems and Note Status

• The seed box serves as an inbox for literature notes that have been imported into Obsidian and are awaiting the generation of seedlings. 0s
• A saved search is utilized to filter out items that contain default template tags, ensuring the seed box view only displays relevant content. 20s
• Seedlings represent notes that have been generated from literature notes but require further development, such as the example regarding the social contract of the returned shopping cart. 35s
• Evergreen notes are fully fleshed-out notes that contain links and are identified by a tree tag, forming what is referred to as an evergreen note forest. 50s
• A specific tag is used to identify notes that may evolve into emerging maps of content, distinguishing them from seedlings or evergreen notes. 1m0s
• A gear icon tag is assigned to utility documents, such as workflow documentation, to manage system-related files. 1m10s
• A map icon is used to designate maps of content, while a checkmark icon identifies to-do items or notes that require additional work. 1m15s
• Tags are employed as status indicators and organizational tools to avoid reliance on folders, providing visual cues that facilitate easier navigation. 1m30s

File Naming and Daily Journaling

• Special symbols are placed at the beginning of file names to categorize different types of input, such as books, tweets, podcasts, videos, articles, research papers, and people. 1m45s
• Using special characters in file names allows for efficient searching by typing the symbol into the search bar, which isolates specific content types without cluttering the tag system. 2m15s
• The daily note functionality in Obsidian is an optional plugin that must be enabled by the user to create a journal-style entry for each day. 2m55s
• Daily journals serve as a space for capturing top-of-mind thoughts and logging daily consumption of media, such as books, videos, and podcasts. 0s
• Literature notes are linked directly within the daily journal, creating a chronological record that connects specific ideas to their source material and the date they were processed. 0s

Templates and Advanced Integrations

• Templates are utilized to standardize metadata and structure for various types of input, including meta-notes, daily prompts, and formatting elements like footnotes or HTML-based two-column layouts. 35s
• A third-party Python script allows for the creation of Anki flashcards directly within Obsidian using markdown, supporting features like cloze deletion, images, and audio. 1m0s
• The Anki integration assigns unique IDs to cards, enabling the script to update existing decks automatically when the corresponding markdown files are modified. 1m35s

Advanced Search and Automation

• Saved regex searches are employed to organize and retrieve information, such as identifying notes tagged with specific people, locating orphan notes without outgoing links, and finding seed box items requiring review. 2m5s
• A specific search utility is used to scan the entire vault for email addresses. 2m35s
• An external command utilizing egrep processes all files to generate a quantitative list of link references, which helps identify the most frequently cited tags or concepts within the vault. 2m45s
• Maps of content can be populated by gathering information using specific commands sourced from the Obsidian forums 0s.

Visual Tools and Writing Support

• Excalidraw allows for the integration of drawings into Obsidian by copying and pasting them as iframes or images 10s.
• Users can configure Excalidraw to provide transparent backgrounds for drawings, offering an alternative to writing Mermaid JS code for diagrams 10s.
• The Zettelkasten system and external thinking frameworks are utilized to assist with writing challenges, such as those associated with ADHD, by reducing the need to hold multiple ideas in memory simultaneously 42s.
• Grammarly is being tested as an additional tool to improve writing quality 42s.
• The long-term goal for the system is to facilitate the production of content, including Medium articles, research papers, and YouTube video scripts based on linked note concepts 42s.

Philosophy of the Graph and Community Engagement

• The Obsidian graph is intended to be a visualization of linked ideas rather than an end goal or a final output 1m25s.
• Users are advised against over-engineering connections or focusing on the aesthetic appearance of the graph, as the primary objective is the synthesis and production of ideas 1m25s.
• Workflow processes are subject to change, and updates or live demonstrations are shared via Twitch and YouTube 1m55s.
• Community engagement regarding personal knowledge management and Obsidian is facilitated through a Discord server 1m55s.
• Future content topics are currently being planned, and requests for specific subjects are welcomed. 0s
• Appreciation is expressed toward Patreon supporters, specifically Alberto, Devin, Klaus, and Brandon, for their contributions to the channel. 0s