Local-first · written in Rust · MIT
Grind a folder into one LLM-ready dump.
Pulp walks a tree, pulls text out of code, PDFs, Office files, and notebooks in parallel, and writes one file you can hand a model.
cargo install --git https://github.com/BeeGass/pulp --locked
The mill after pulping its built-in sample. Nothing is uploaded: open the browser mill and press Try a sample to run it in your tab.
Reference
What goes in, what comes out.
| Kind | Notes |
|---|---|
| Source | Rust, Lean, Python, TypeScript, TOML, Markdown, and other text |
| NumPy | .npy and .npz metadata and a small preview (not treated as binary) |
| HTML, XML, JSON | Readable text, or decoded source with --source |
| CSV, TSV | Tabular text |
| PDF, Word, PowerPoint, Excel, OpenDocument, EPUB, RTF | Extracted text |
| Jupyter | Cells; --notebook-outputs keeps outputs |
| Zip, tar | A root archive always expands; nested members need --archives |
Binary media (images, audio, wasm, …) is skipped unless --binaries. Noisy trees stay out even when they are tracked: node_modules/, target/, dist/, virtualenvs, lockfiles, .env, keys, and similar. Inside a git repository, .gitignore is honored unless --no-gitignore.
Formats
The same two files, three ways.
Real output of pulp -f txt|md|xml testdata from this repo. Without -f, the layout follows the -o extension and otherwise defaults to plain text.
Options
Flags you will reach for.
| Flag | Meaning |
|---|---|
-o, --output FILE | Write the dump here (default: stdout) |
-f, --format FMT | txt, md, or xml |
--tree MODE | selected (default), full, or none |
-j, --jobs N | Extraction threads; 0 uses every available core |
--include GLOB | Repeatable allow-list |
--exclude GLOB | Repeatable extra deny-list |
--hidden | Include hidden files (.git is still skipped) |
--no-gitignore | Ignore .gitignore and .ignore |
--archives | Expand nested zip and tar members |
--source | Keep HTML, XML, and JSON as source |
--notebook-outputs | Include Jupyter cell outputs |
--list | Print the paths that would be pulped |
Every flag is in the README.
Two mills
Same core, two places to run it.
| Capability | Browser mill · /mill | Local mill · pulp ui |
|---|---|---|
| Files leave the device | Never | Never |
| Choosing files | Folder or file picker, or drop | Your OS file manager, or any typed path |
.gitignore | Not available | Honored |
| Default excludes | Same core matcher | Same core matcher |
| PDF, Office, zip | A worker of its own, with a time limit | A child process with a time limit |
| Cancel | Stops the worker | Between files |
| Setup | None | One cargo line |
Install
One cargo line.
cargo install --git https://github.com/BeeGass/pulp --locked
$ pulp ui # local mill on 127.0.0.1:8747 $ pulp -o dump.xml . # this folder, one XML dump $ pulp -f md src # Markdown to stdout
Requires Rust 1.88 or newer. Browse opens Finder on macOS, zenity or kdialog on Linux, and Explorer on Windows; pulp ui --no-open suits headless boxes.