Admin

Ingestion Jobs

Queue source-capture work for the outbound worker. Successful jobs should produce bronze evidence first; D0 normalization and review happen later.

Definitions

MarketScreener financials

marketscreenerpython module

Recurring MarketScreener financial statement, estimate, ratio, dividend, rating, and snapshot capture for one listed company.

Definition
marketscreener_financials
Source
MarketScreener
Command
scrappers.marketscreener.fetch_finances
Worker
required

Recent Jobs

JobDefinitionStatusArgsWorkerOutputCreated
958476a9
MarketScreener financials
marketscreener
succeeded
attempt 1/1
duration 2.9 s
ticker: MU, include_charts: false, company_url_name: MICRON-TECHNOLOGY-INC, marketscreener_id: 13639
codex-smoke-20260629
heartbeat Jun 29, 2026, 8:31 PM
logs 3
bronze://marketscreener/2026/06/29/958476a9-df51-4eeb-88e8-4ce9e80c89f5/manifest.json
tables 5 | charts 0
D0 run bca261b5
Jun 29, 2026, 8:30 PM
56bde47f
MarketScreener financials
marketscreener
succeeded
attempt 1/1
duration 7.8 s
ticker: MU, include_charts: false, company_url_name: MICRON-TECHNOLOGY-INC, marketscreener_id: 13639
codex-local-d2-06-smoke
heartbeat Jun 28, 2026, 4:59 PM
logs 3
bronze://marketscreener/2026/06/28/56bde47f-8dc1-45e2-89ca-0e8c11759280/manifest.json
tables 5 | charts 0
D0 run d09405e2
Jun 28, 2026, 4:59 PM
f141a46a
MarketScreener financials
marketscreener
succeeded
attempt 1/1
duration 13.9 s
ticker: MU, include_charts: false, company_url_name: MICRON-TECHNOLOGY-INC, marketscreener_id: 13639
codex-local-d2-04
heartbeat Jun 28, 2026, 2:55 PM
logs 3
C:\dev\dig-list\data\ingestion-jobs\marketscreener\2026-06-28\f141a46a-4f8b-45f4-be56-c81ff0578656\MU-13639-finances.json
tables 5 | charts 0
Jun 28, 2026, 2:54 PM
5878d86b
MarketScreener financials
marketscreener
succeeded
attempt 1/1
duration 13.8 s
ticker: MU, include_charts: true, company_url_name: MICRON-TECHNOLOGY-INC, marketscreener_id: 13639
codex-local
heartbeat Jun 28, 2026, 2:37 PM
logs 2
C:\dev\dig-list\data\ingestion-jobs\marketscreener\2026-06-28\5878d86b-5cfa-4240-8358-1d8b1ba83acb\MU-13639-finances.json
Jun 28, 2026, 12:15 AM

Job 56bde47f Detail

Lifecycle

Status
succeeded
Definition
marketscreener_financials
Requested
Jun 28, 2026, 4:59 PM
Claimed
Jun 28, 2026, 4:59 PM
Started
Jun 28, 2026, 4:59 PM
Finished
Jun 28, 2026, 4:59 PM
Duration
7.8 s
Heartbeat
Jun 28, 2026, 4:59 PM
Worker
codex-local-d2-06-smoke
Attempt
1/1

Evidence

Bronze manifest
bronze://marketscreener/2026/06/28/56bde47f-8dc1-45e2-89ca-0e8c11759280/manifest.json
Output path
-
D0 import run
d09405e2-43af-41ef-8245-2f2cdb162e5f

Arguments

{
  "ticker": "MU",
  "include_charts": false,
  "company_url_name": "MICRON-TECHNOLOGY-INC",
  "marketscreener_id": 13639
}

Result

{
  "runner": "marketscreener_financials",
  "ticker": "MU",
  "command": {
    "args": {
      "ticker": "MU",
      "include_charts": false,
      "company_url_name": "MICRON-TECHNOLOGY-INC",
      "marketscreener_id": 13639
    },
    "module": "scrappers.marketscreener.fetch_finances",
    "executable": "python"
  },
  "process": {
    "code": 0,
    "duration_ms": 7590,
    "stderr_tail": "17:59:51 [INFO] fetch_finances: Fetching finances for 1 ID(s): [13639]\r\n17:59:51 [INFO] fetch_finances: Fetching: https://www.marketscreener.com/quote/stock/MICRON-TECHNOLOGY-INC-13639/finances/\r\n17:59:52 [INFO] fetch_finances: Got 610106 bytes\r\n17:59:53 [INFO] fetch_finances: Found 5 financial card(s) on page\r\n17:59:53 [INFO] fetch_finances:   income-statement-annual: 9 headers, 12 rows, units=USD in Million\r\n17:59:53 [INFO] fetch_finances:   income-statement-quarterly: 29 headers, 12 rows, units=USD in Million\r\n17:59:53 [INFO] fetch_finances:   bilan_card: 9 headers, 3 rows, units=USD in Million\r\n17:59:53 [INFO] fetch_finances:   fluxdetres_card: 9 headers, 5 rows, units=USD in Million\r\n17:59:53 [INFO] fetch_finances:   rf_card: 9 headers, 28 rows, units=USD in \r\n17:59:53 [INFO] fetch_finances: \\u2713 ID 13639: Financials Micron Technology, Inc.\r\n17:59:53 [INFO] fetch_finances: Saved to: C:\\dev\\dig-list\\data\\ingestion-jobs\\_scratch\\marketscreener\\2026-06-28\\56bde47f-8dc1-45e2-89ca-0e8c11759280\\MU-13639-finances.json\r\n17:59:53 [INFO] fetch_finances: Done: 1/1 succeeded\r\n",
    "stdout_tail": ""
  },
  "fetched_at": "2026-06-28T16:59:53.354329+00:00",
  "chart_count": 0,
  "table_count": 5,
  "company_name": "Financials Micron Technology, Inc.",
  "output_bytes": 110006,
  "marketscreener_id": 13639,
  "bronze_records_uri": "bronze://marketscreener/2026/06/28/56bde47f-8dc1-45e2-89ca-0e8c11759280/records.jsonl.gz",
  "bronze_manifest_uri": "bronze://marketscreener/2026/06/28/56bde47f-8dc1-45e2-89ca-0e8c11759280/manifest.json",
  "bronze_record_count": 1,
  "bronze_records_path": "C:\\dev\\dig-list\\packages\\ingest\\data\\bronze\\marketscreener\\2026\\06\\28\\56bde47f-8dc1-45e2-89ca-0e8c11759280\\records.jsonl.gz",
  "bronze_manifest_path": "C:\\dev\\dig-list\\packages\\ingest\\data\\bronze\\marketscreener\\2026\\06\\28\\56bde47f-8dc1-45e2-89ca-0e8c11759280\\manifest.json",
  "bronze_records_bytes": 5534,
  "bronze_records_sha256": "94e1660593ee203caa0cd553e348f070395f444cf1511e10a58846dffae3f90e"
}

Logs

  1. Jun 28, 2026, 4:59 PM | INFO | Job claimed by worker.
    {
      "at": "2026-06-28T16:59:46.360Z",
      "data": {
        "worker_id": "codex-local-d2-06-smoke",
        "definition": "marketscreener_financials",
        "attempt_count": 1
      },
      "level": "info",
      "message": "Job claimed by worker."
    }
  2. Jun 28, 2026, 4:59 PM | INFO | Runner process completed.
    {
      "at": "2026-06-28T16:59:54.120Z",
      "data": {
        "chart_count": 0,
        "duration_ms": 7590,
        "table_count": 5,
        "output_bytes": 110006,
        "bronze_records_uri": "bronze://marketscreener/2026/06/28/56bde47f-8dc1-45e2-89ca-0e8c11759280/records.jsonl.gz",
        "bronze_manifest_uri": "bronze://marketscreener/2026/06/28/56bde47f-8dc1-45e2-89ca-0e8c11759280/manifest.json"
      },
      "level": "info",
      "message": "Runner process completed."
    }
  3. Jun 28, 2026, 4:59 PM | INFO | Job completed successfully.
    {
      "at": "2026-06-28T16:59:54.120Z",
      "data": {
        "bronze_manifest_uri": "bronze://marketscreener/2026/06/28/56bde47f-8dc1-45e2-89ca-0e8c11759280/manifest.json"
      },
      "level": "info",
      "message": "Job completed successfully."
    }