SAP
Sentiment Analysis ProcessorFetch Sentiment for a Symbol
Calls the configured news sentiment provider for one symbol over the canonical T-1 17:00 → T0 17:00 ET window, fans articles out by mentioned ticker, and writes the resulting expressions to the per-symbol CSV under the T+1 entry-date directory. The consolidated report is NOT regenerated by this action — the bulk routine owns the report. Single-flight per job kind — a different per-symbol fetch on a different symbol does NOT block this kickoff.
Generate All Sentiments
Daily bulk routine. Waits on TDM's refresh_all_training_data to have a COMPLETED_OK since the last NYSE market close, fetches the symbol universe from TDM's derivative inventory via the ORK proxy, applies the UIP blacklist filter, fetches sentiment per symbol (parallel or sequential), and rebuilds the consolidated report at sentiment_storage_dir/<T+1>/full/sentiment.txt — the artefact WIN reads when applying its sentiment veto. Sequential-path processes one symbol at a time; parallel-path uses a thread pool sized by Max workers (0 = auto-detect from CPU). The shared rate limiter throttles broker calls regardless of thread count, so parallelism only buys CPU/IO overlap on the local write-CSV tail of each per-symbol pipeline. Per-symbol failures are best-effort — logged + counted, do not abort the whole run. Default concurrency-gate setting (off) holds the system exclusive while it runs.
