Admin

Ingestion Jobs

Queue source-capture work for the outbound worker. Successful jobs should produce bronze evidence first; D0 normalization and review happen later.

Definitions

MarketScreener financials

marketscreenerpython module

Recurring MarketScreener financial statement, estimate, ratio, dividend, rating, and snapshot capture for one listed company.

Definition
marketscreener_financials
Source
MarketScreener
Command
scrappers.marketscreener.fetch_finances
Worker
required

Recent Jobs

JobDefinitionStatusArgsWorkerOutputCreated
958476a9
MarketScreener financials
marketscreener
succeeded
attempt 1/1
duration 2.9 s
ticker: MU, include_charts: false, company_url_name: MICRON-TECHNOLOGY-INC, marketscreener_id: 13639
codex-smoke-20260629
heartbeat Jun 29, 2026, 8:31 PM
logs 3
bronze://marketscreener/2026/06/29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/manifest.json
tables 5 | charts 0
D0 run bca261b5
Jun 29, 2026, 8:30 PM
56bde47f
MarketScreener financials
marketscreener
succeeded
attempt 1/1
duration 7.8 s
ticker: MU, include_charts: false, company_url_name: MICRON-TECHNOLOGY-INC, marketscreener_id: 13639
codex-local-d2-06-smoke
heartbeat Jun 28, 2026, 4:59 PM
logs 3
bronze://marketscreener/2026/06/28/56bde47f-8dc1-45e2-89ca-0e8c11759280/manifest.json
tables 5 | charts 0
D0 run d09405e2
Jun 28, 2026, 4:59 PM
f141a46a
MarketScreener financials
marketscreener
succeeded
attempt 1/1
duration 13.9 s
ticker: MU, include_charts: false, company_url_name: MICRON-TECHNOLOGY-INC, marketscreener_id: 13639
codex-local-d2-04
heartbeat Jun 28, 2026, 2:55 PM
logs 3
C:\dev\dig-list\data\ingestion-jobs\marketscreener\2026-06-28\f141a46a-4f8b-45f4-be56-c81ff0578656\MU-13639-finances.json
tables 5 | charts 0
Jun 28, 2026, 2:54 PM
5878d86b
MarketScreener financials
marketscreener
succeeded
attempt 1/1
duration 13.8 s
ticker: MU, include_charts: true, company_url_name: MICRON-TECHNOLOGY-INC, marketscreener_id: 13639
codex-local
heartbeat Jun 28, 2026, 2:37 PM
logs 2
C:\dev\dig-list\data\ingestion-jobs\marketscreener\2026-06-28\5878d86b-5cfa-4240-8358-1d8b1ba83acb\MU-13639-finances.json
Jun 28, 2026, 12:15 AM

Job 958476a9 Detail

Lifecycle

Status
succeeded
Definition
marketscreener_financials
Requested
Jun 29, 2026, 8:30 PM
Claimed
Jun 29, 2026, 8:31 PM
Started
Jun 29, 2026, 8:31 PM
Finished
Jun 29, 2026, 8:31 PM
Duration
2.9 s
Heartbeat
Jun 29, 2026, 8:31 PM
Worker
codex-smoke-20260629
Attempt
1/1

Evidence

Bronze manifest
bronze://marketscreener/2026/06/29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/manifest.json
Output path
-
D0 import run
bca261b5-8fa1-4204-aab7-4c156f14c2f1

Arguments

{
  "ticker": "MU",
  "include_charts": false,
  "company_url_name": "MICRON-TECHNOLOGY-INC",
  "marketscreener_id": 13639
}

Result

{
  "runner": "marketscreener_financials",
  "ticker": "MU",
  "command": {
    "args": {
      "ticker": "MU",
      "include_charts": false,
      "company_url_name": "MICRON-TECHNOLOGY-INC",
      "marketscreener_id": 13639
    },
    "module": "scrappers.marketscreener.fetch_finances",
    "executable": "/srv/dig-list/venvs/marketscreener/bin/python"
  },
  "process": {
    "code": 0,
    "duration_ms": 2642,
    "stderr_tail": "21:31:35 [INFO] fetch_finances: Fetching finances for 1 ID(s): [13639]\n21:31:35 [INFO] fetch_finances: Fetching: https://www.marketscreener.com/quote/stock/MICRON-TECHNOLOGY-INC-13639/finances/\n21:31:35 [INFO] fetch_finances: Got 605639 bytes\n21:31:36 [INFO] fetch_finances: Found 5 financial card(s) on page\n21:31:36 [INFO] fetch_finances:   income-statement-annual: 9 headers, 12 rows, units=USD in Million\n21:31:36 [INFO] fetch_finances:   income-statement-quarterly: 29 headers, 12 rows, units=USD in Million\n21:31:36 [INFO] fetch_finances:   bilan_card: 9 headers, 3 rows, units=USD in Million\n21:31:36 [INFO] fetch_finances:   fluxdetres_card: 9 headers, 5 rows, units=USD in Million\n21:31:36 [INFO] fetch_finances:   rf_card: 9 headers, 28 rows, units=USD in \n21:31:36 [INFO] fetch_finances: ✓ ID 13639: Financials Micron Technology, Inc.\n21:31:36 [INFO] fetch_finances: Saved to: /srv/dig-list/data/ingestion-jobs/_scratch/marketscreener/2026-06-29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/MU-13639-finances.json\n21:31:36 [INFO] fetch_finances: Done: 1/1 succeeded\n",
    "stdout_tail": ""
  },
  "fetched_at": "2026-06-29T20:31:36.068552+00:00",
  "chart_count": 0,
  "table_count": 5,
  "company_name": "Financials Micron Technology, Inc.",
  "output_bytes": 105738,
  "marketscreener_id": 13639,
  "bronze_records_uri": "bronze://marketscreener/2026/06/29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/records.jsonl.gz",
  "bronze_manifest_uri": "bronze://marketscreener/2026/06/29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/manifest.json",
  "bronze_record_count": 1,
  "bronze_records_path": "/srv/dig-list/data/bronze/marketscreener/2026/06/29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/records.jsonl.gz",
  "bronze_manifest_path": "/srv/dig-list/data/bronze/marketscreener/2026/06/29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/manifest.json",
  "bronze_records_bytes": 5533,
  "bronze_records_sha256": "7a3594ff5027b74da207c6df4234283975b92237fac5f11ff112cef65116a515"
}

Logs

  1. Jun 29, 2026, 8:31 PM | INFO | Job claimed by worker.
    {
      "at": "2026-06-29T20:31:33.305Z",
      "data": {
        "worker_id": "codex-smoke-20260629",
        "definition": "marketscreener_financials",
        "attempt_count": 1
      },
      "level": "info",
      "message": "Job claimed by worker."
    }
  2. Jun 29, 2026, 8:31 PM | INFO | Runner process completed.
    {
      "at": "2026-06-29T20:31:36.202Z",
      "data": {
        "chart_count": 0,
        "duration_ms": 2642,
        "table_count": 5,
        "output_bytes": 105738,
        "bronze_records_uri": "bronze://marketscreener/2026/06/29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/records.jsonl.gz",
        "bronze_manifest_uri": "bronze://marketscreener/2026/06/29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/manifest.json"
      },
      "level": "info",
      "message": "Runner process completed."
    }
  3. Jun 29, 2026, 8:31 PM | INFO | Job completed successfully.
    {
      "at": "2026-06-29T20:31:36.202Z",
      "data": {
        "bronze_manifest_uri": "bronze://marketscreener/2026/06/29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/manifest.json"
      },
      "level": "info",
      "message": "Job completed successfully."
    }