TDM
Tetsuo Data ManagerPull Primary Data for a Symbol
Fetches the full configured window of days of primary OHLCV data for a symbol from the market data broker.
Update Primary Data for a Symbol
Updates the stored primary OHLCV data for a symbol with a soft merge, deduplicated, from the most recent 7 day window. Allows faster data pull time compared to pulling all of the data at once.
Pull All Primary Data
Does a full pull of all primary data for all symbols in the current UIP inventory.
Update All Primary Data
Updates all primary data for all symbols in the current UIP inventory.
Generate Derivative Data for a Symbol
Takes the primary data for a symbol, builds a complete market-minute grid for every trading day, forward-fills OHLC and zero-fills volume for any minute the primary data skips, then resamples at a configured bucket interval so each bin starts on a market-open multiple, drops bins outside market hours and partial bins at the day edges, and pivots long format to a daily-wide format (one day per row).
Generate Derivative Data for All Symbols
Wipes all existing derivative data for all symbols, regenerates for all symbols in the primary inventory.
Refresh All Training Data
End-to-end refresh: Updates all primary data, regenerates all derivative data, and prunes symbol datasets that are not in the UIP universe to account for symbol blacklisting.
Wipe All Primary Data
Erases all stored primary data for all symbols. This erasure cannot be undone and requires a full pull of all primary data once completed before normal operation can work again.
Prune Non-Inventory Primary Data
Prunes all primary data for all symbols no longer in the UIP universe.
Wipe All Derivative Data
Deletes all derivative datasets for all symbols. This erasure cannot be undone and requires a regeneration of all derivative data once completed before normal operation can work again.
