Earlier quoted context omitted.
So when using Cowork on a local folder and asking it to " create a new spreadsheet with a list of expenses from a pile of screenshots ", those screenshots may[*] become part of the " collected Inputs " kept by Anthropic. [*]"may" because depending on the execution, instead of directly uploading the screenshots, a (python) script may be created that does local processing and only upload derived output
Yes, in general. I think in your specific example it is more likely to ingest the screenshots (upload to Anthropic) and use its built-in vision model to extract the relevant information. But if you had like a million screenshots, it might choose to run some Python OCR software locally instead. In either case though, all the tool calls and output are part of the session and therefore Input. Even if it called a local O…
To be clear: I like what Anthropic is doing, they appear more trustworthy/serious than OpenAI, but Cowork will result in millions of unsuspecting users having complete folders full of data uploaded and persisted on servers, currently, owned by Anthropic.