1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
|
WVMQWENWS_6D91C42F
source=WEBVM
time=2026-11-06T10:15:04+00:00
stage=PI_WRAPPER_FINISHED
[2026-11-06T10:11:00+00:00] PI_WRAPPER_STARTED tag=WVMQWENWS_6D91C42F script=pi.py
[2026-11-06T10:11:08+00:00] booting.
[2026-11-06T10:11:09+00:00] booting..
[2026-11-06T10:11:09+00:00] booting....
[2026-11-06T10:11:09+00:00] booting.....
[2026-11-06T10:11:10+00:00]
[2026-11-06T10:11:10+00:00] $ /opt/kaggle-venv/bin/kaggle kernels push -p /home/user/my-notebook
[2026-11-06T10:12:15+00:00] Kernel version 10 successfully pushed. Please check progress at https://www.kaggle.com/code/simonday/automated-gpu-test
[2026-11-06T10:12:19+00:00]
[2026-11-06T10:12:19+00:00] Notebook URL: https://www.kaggle.com/code/simonday/automated-gpu-test
[2026-11-06T10:12:21+00:00] booting......
[2026-11-06T10:12:21+00:00]
[2026-11-06T10:12:21+00:00] booting.......
[2026-11-06T10:12:21+00:00]
[2026-11-06T10:12:21+00:00] $ /opt/kaggle-venv/bin/kaggle kernels status simonday/automated-gpu-test
[2026-11-06T10:12:42+00:00] simonday/automated-gpu-test has status "KernelWorkerStatus.RUNNING"
[2026-11-06T10:13:12+00:00]
[2026-11-06T10:13:12+00:00] booting........
[2026-11-06T10:13:12+00:00]
[2026-11-06T10:13:12+00:00] $ /opt/kaggle-venv/bin/kaggle kernels status simonday/automated-gpu-test
[2026-11-06T10:13:36+00:00] simonday/automated-gpu-test has status "KernelWorkerStatus.RUNNING"
[2026-11-06T10:14:06+00:00]
[2026-11-06T10:14:06+00:00] booting.........
[2026-11-06T10:14:06+00:00]
[2026-11-06T10:14:06+00:00] $ /opt/kaggle-venv/bin/kaggle kernels status simonday/automated-gpu-test
[2026-11-06T10:14:30+00:00] simonday/automated-gpu-test has status "KernelWorkerStatus.ERROR"
[2026-11-06T10:14:30+00:00] Kaggle reported an execution failure; collecting its output logs before exiting.
[2026-11-06T10:14:32+00:00] \n[DIAGNOSTICS] Fetching Kaggle kernel output and execution log.
[2026-11-06T10:14:32+00:00]
[2026-11-06T10:14:32+00:00] $ /opt/kaggle-venv/bin/kaggle kernels output simonday/automated-gpu-test -p /tmp/kaggle-kernel-diagnostics -o
[2026-11-06T10:15:00+00:00] Downloading weight_space_experiment.log to /tmp/kaggle-kernel-diagnostics
[2026-11-06T10:15:02+00:00]
[2026-11-06T10:15:02+00:00] 0%| | 0.00/4.63k [00:00<?, ?B/s]
[2026-11-06T10:15:02+00:00] 100%|██████████| 4.63k/4.63k [00:00<00:00, 82.9kB/s]
[2026-11-06T10:15:02+00:00]
[2026-11-06T10:15:02+00:00] Output file downloaded to /tmp/kaggle-kernel-diagnostics/weight_space_experiment.log
[2026-11-06T10:15:02+00:00] Kernel log downloaded to /tmp/kaggle-kernel-diagnostics/automated-gpu-test.log
[2026-11-06T10:15:02+00:00] [DIAGNOSTICS] kaggle kernels output exit code=0
[2026-11-06T10:15:02+00:00] \n===== KAGGLE_DIAGNOSTIC_FILE automated-gpu-test.log bytes=14101 =====
[2026-11-06T10:15:02+00:00] [{"stream_name":"stderr","time":9.713422995,"data":"/usr/local/lib/python3.13/dist-packages/nbformat/validator.py:434: MissingIDFieldWarning: Cell is missing an id field, this will become a hard error in future nbformat versions. You may want to use `normalize()` on your notebooks before validations (available since nbformat 5.1.4). Previous versions of nbformat are fixing this issue transparently, and will stop doing so in the future.\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":9.713507992,"data":" _validate(nbdict, ref, version, version_minor, relax_add_props)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":11.265659768,"data":"0.00s - Debugger warning: It seems that frozen modules are being used, which may\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":11.265714243,"data":"0.00s - make the debugger miss breakpoints. Please pass -Xfrozen_modules=off\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":11.26574389,"data":"0.00s - to python to disable frozen modules.\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":11.26574939,"data":"0.00s - Note: Debugging will proceed. Set PYDEVD_DISABLE_FILE_VALIDATION=1 to disable this validation.\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":12.181649147,"data":"0.00s - Debugger warning: It seems that frozen modules are being used, which may\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":12.181688553,"data":"0.00s - make the debugger miss breakpoints. Please pass -Xfrozen_modules=off\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":12.181700381,"data":"0.00s - to python to disable frozen modules.\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":12.181705442,"data":"0.00s - Note: Debugging will proceed. Set PYDEVD_DISABLE_FILE_VALIDATION=1 to disable this validation.\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":13.75585989,"data":"[2026-11-06T10:12:30+00:00] RUN_STARTED tag=WVMQWENWS_6D91C42F python=3.13.18 platform=Linux-6.18.55+-x86_64-with-glibc2.39\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.835725118,"data":"[2026-11-06T10:13:02+00:00] FEEDBACK_UPLOAD_FAILED stage=RUN_STARTED error=URLError: \u003curlopen error [Errno -3] Temporary failure in name resolution\u003e\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.837085224,"data":"[2026-11-06T10:13:02+00:00] GPU_PREFLIGHT_BEGIN\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.838444851,"data":"[2026-11-06T10:13:02+00:00] GPU_ENV KAGGLE_KERNEL_RUN_TYPE=Batch\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.839695382,"data":"[2026-11-06T10:13:02+00:00] GPU_ENV KAGGLE_KERNEL_INTEGRATION=\u003cunset\u003e\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.840808931,"data":"[2026-11-06T10:13:02+00:00] GPU_ENV CUDA_VISIBLE_DEVICES=\u003cunset\u003e\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.841867484,"data":"[2026-11-06T10:13:02+00:00] GPU_ENV NVIDIA_VISIBLE_DEVICES=\u003cunset\u003e\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.842858746,"data":"[2026-11-06T10:13:02+00:00] GPU_ENV CUDA_HOME=\u003cunset\u003e\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.843941817,"data":"[2026-11-06T10:13:02+00:00] GPU_ENV LD_LIBRARY_PATH=\u003cunset\u003e\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.844896915,"data":"[2026-11-06T10:13:02+00:00] GPU_DEVICE_NODES /dev/nvidia*=\u003cnone\u003e\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.845906075,"data":"[2026-11-06T10:13:02+00:00] GPU_PROC_DRIVER_EXISTS=False\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.858057586,"data":"[2026-11-06T10:13:02+00:00] DIAGNOSTIC_COMMAND_NOT_FOUND command=['nvidia-smi', '-q']\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.890327029,"data":"[2026-11-06T10:13:02+00:00] DIAGNOSTIC_COMMAND command=['sh', '-lc', 'ls -l /dev/nvidia* 2\u003e\u00261; cat /proc/driver/nvidia/version 2\u003e\u00261'] exit=1\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.891791508,"data":"[2026-11-06T10:13:02+00:00] DIAGNOSTIC_OUTPUT ls: cannot access '/dev/nvidia*': No such file or directory\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":45.892706106,"data":"[2026-11-06T10:13:02+00:00] DIAGNOSTIC_OUTPUT cat: /proc/driver/nvidia/version: No such file or directory\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.780800135,"data":"[2026-11-06T10:13:07+00:00] TORCH_DIAGNOSTIC version=2.11.0+cpu\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.782151696,"data":"[2026-11-06T10:13:07+00:00] TORCH_COMPILED_CUDA=None\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.783314001,"data":"[2026-11-06T10:13:07+00:00] TORCH_CUDA_AVAILABLE=False\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.784477129,"data":"[2026-11-06T10:13:07+00:00] TORCH_CUDA_DEVICE_COUNT=0\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.785433032,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG_BEGIN\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.793322597,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG PyTorch built with:\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.794388683,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - GCC 13.3\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.795400111,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - C++ Version: 201703\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.796366762,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - Intel(R) oneAPI Math Kernel Library Version 2024.2-Product Build 20240605 for Intel(R) 64 architecture applications\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.798618194,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - Intel(R) MKL-DNN v3.10.2 (Git Hash f1d471933dc852f956fd05389f9313c7148783d5)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.798969676,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - OpenMP 201511 (a.k.a. OpenMP 4.5)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.799966467,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - LAPACK is enabled (usually provided by MKL)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.801115292,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - NNPACK is enabled\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.801950025,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - CPU capability usage: AVX2\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.803229544,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, COMMIT_SHA=70d99e998b4955e0049d13a98d77ae1b14db1f45, CXX_COMPILER=/opt/rh/gcc-toolset-13/root/usr/bin/c++, CXX_FLAGS= -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -DC10_NODEPRECATED -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -faligned-new -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-dangling-reference -Wno-error=dangling-reference -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.11.0, USE_CUDA=0, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, USE_XCCL=OFF, USE_XPU=OFF, \n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.805055616,"data":"[2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG_END\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.806084021,"data":"[2026-11-06T10:13:07+00:00] GPU_PREFLIGHT_CLASSIFICATION No usable NVIDIA device/driver is visible inside the Kaggle kernel. Check whether Kaggle actually allocated the requested GPU; kernel metadata alone is not proof.\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.808069962,"data":"[2026-11-06T10:13:07+00:00] RUN_FAILED RuntimeError: CUDA preflight failed: No usable NVIDIA device/driver is visible inside the Kaggle kernel. Check whether Kaggle actually allocated the requested GPU; kernel metadata alone is not proof.\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.808110937,"data":"Traceback (most recent call last):\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.808117278,"data":" File \"/tmp/ipykernel_16/2438757360.py\", line 169, in main\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.808122654,"data":" torch = diagnose_gpu()\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.808128008,"data":" File \"/tmp/ipykernel_16/2438757360.py\", line 144, in diagnose_gpu\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.808133148,"data":" raise RuntimeError(\"CUDA preflight failed: \" + reason)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.808138663,"data":"RuntimeError: CUDA preflight failed: No usable NVIDIA device/driver is visible inside the Kaggle kernel. Check whether Kaggle actually allocated the requested GPU; kernel metadata alone is not proof.\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":50.808144427,"data":"\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stdout","time":82.831624527,"data":"[2026-11-06T10:13:39+00:00] FEEDBACK_UPLOAD_FAILED stage=RUN_FAILED error=URLError: \u003curlopen error [Errno -3] Temporary failure in name resolution\u003e\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.970801526,"data":"Traceback (most recent call last):\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971641343,"data":" File \"\u003cstring\u003e\", line 1, in \u003cmodule\u003e\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971669342,"data":" import sys;import papermill as pm;pm.execute_notebook(\"__notebook__.ipynb\",\"__notebook__.ipynb\",progress_bar=False,log_output=True,stdout_file=sys.stdout,stderr_file=sys.stderr,allow_errors=False,timeout=43200)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971679291,"data":" ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971809507,"data":" File \"/usr/local/lib/python3.13/dist-packages/papermill/execute.py\", line 131, in execute_notebook\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971818824,"data":" raise_for_execution_errors(nb, output_path)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971825493,"data":" ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971831258,"data":" File \"/usr/local/lib/python3.13/dist-packages/papermill/execute.py\", line 251, in raise_for_execution_errors\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971837371,"data":" raise error\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.97184274,"data":"papermill.exceptions.PapermillExecutionError: \n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971848498,"data":"---------------------------------------------------------------------------\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971854106,"data":"Exception encountered at \"In [1]\":\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971859743,"data":"---------------------------------------------------------------------------\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971865413,"data":"RuntimeError Traceback (most recent call last)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971873391,"data":"/tmp/ipykernel_16/2438757360.py in \u003ccell line: 0\u003e()\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971885221,"data":" 330 \n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.97190821,"data":" 331 if __name__ == \"__main__\":\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971914924,"data":"--\u003e 332 main()\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971921423,"data":"\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971927533,"data":"/tmp/ipykernel_16/2438757360.py in main()\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971934377,"data":" 167 publish(\"RUN_STARTED\", f\"model={MODEL_ID}; games={','.join(GAMES)}; python={platform.python_version()}\")\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971956803,"data":" 168 try:\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971961546,"data":"--\u003e 169 torch = diagnose_gpu()\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971966473,"data":" 170 publish(\"GPU_CHECK\", f\"torch={torch.__version__}; torch_cuda_build={getattr(torch.version, 'cuda', None)}; cuda={torch.cuda.is_available()}; gpu_count={torch.cuda.device_count()}\")\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971972047,"data":" 171 install_dependencies()\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971976504,"data":"\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971980679,"data":"/tmp/ipykernel_16/2438757360.py in diagnose_gpu()\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971985156,"data":" 142 )\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971991552,"data":" 143 log(\"GPU_PREFLIGHT_CLASSIFICATION \" + reason)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.971996398,"data":"--\u003e 144 raise RuntimeError(\"CUDA preflight failed: \" + reason)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.972003556,"data":" 145 log(\"GPU_PREFLIGHT_PASSED\")\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.972008732,"data":" 146 return torch\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.972013571,"data":"\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.97202627,"data":"RuntimeError: CUDA preflight failed: No usable NVIDIA device/driver is visible inside the Kaggle kernel. Check whether Kaggle actually allocated the requested GPU; kernel metadata alone is not proof.\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":83.972032933,"data":"\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":87.085952794,"data":"/usr/local/lib/python3.13/dist-packages/mistune.py:435: SyntaxWarning: invalid escape sequence '\\|'\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":87.085991299,"data":" cells[i][c] = re.sub('\\\\\\\\\\|', '|', cell)\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":87.342459511,"data":"/usr/local/lib/python3.13/dist-packages/nbconvert/filters/filter_links.py:36: SyntaxWarning: invalid escape sequence '\\_'\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":87.342494522,"data":" text = re.sub(r'_', '\\_', text) # Escape underscores in display text\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":88.35136048,"data":"[NbConvertApp] Converting notebook __notebook__.ipynb to notebook\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":88.454496469,"data":"[NbConvertApp] Writing 29073 bytes to __notebook__.ipynb\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":91.895341692,"data":"[NbConvertApp] Converting notebook __notebook__.ipynb to html\n"}
[2026-11-06T10:15:02+00:00] ,{"stream_name":"stderr","time":92.618137454,"data":"[NbConvertApp] Writing 348824 bytes to __results__.html\n"}
[2026-11-06T10:15:02+00:00] ]
[2026-11-06T10:15:02+00:00] ===== END_KAGGLE_DIAGNOSTIC_FILE automated-gpu-test.log =====
[2026-11-06T10:15:02+00:00] \n===== KAGGLE_DIAGNOSTIC_FILE weight_space_experiment.log bytes=4742 =====
[2026-11-06T10:15:02+00:00] [2026-11-06T10:12:30+00:00] RUN_STARTED tag=WVMQWENWS_6D91C42F python=3.13.18 platform=Linux-6.18.55+-x86_64-with-glibc2.39
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] FEEDBACK_UPLOAD_FAILED stage=RUN_STARTED error=URLError: <urlopen error [Errno -3] Temporary failure in name resolution>
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] GPU_PREFLIGHT_BEGIN
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] GPU_ENV KAGGLE_KERNEL_RUN_TYPE=Batch
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] GPU_ENV KAGGLE_KERNEL_INTEGRATION=<unset>
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] GPU_ENV CUDA_VISIBLE_DEVICES=<unset>
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] GPU_ENV NVIDIA_VISIBLE_DEVICES=<unset>
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] GPU_ENV CUDA_HOME=<unset>
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] GPU_ENV LD_LIBRARY_PATH=<unset>
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] GPU_DEVICE_NODES /dev/nvidia*=<none>
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] GPU_PROC_DRIVER_EXISTS=False
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] DIAGNOSTIC_COMMAND_NOT_FOUND command=['nvidia-smi', '-q']
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] DIAGNOSTIC_COMMAND command=['sh', '-lc', 'ls -l /dev/nvidia* 2>&1; cat /proc/driver/nvidia/version 2>&1'] exit=1
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] DIAGNOSTIC_OUTPUT ls: cannot access '/dev/nvidia*': No such file or directory
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:02+00:00] DIAGNOSTIC_OUTPUT cat: /proc/driver/nvidia/version: No such file or directory
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_DIAGNOSTIC version=2.11.0+cpu
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_COMPILED_CUDA=None
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_CUDA_AVAILABLE=False
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_CUDA_DEVICE_COUNT=0
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG_BEGIN
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG PyTorch built with:
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - GCC 13.3
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - C++ Version: 201703
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - Intel(R) oneAPI Math Kernel Library Version 2024.2-Product Build 20240605 for Intel(R) 64 architecture applications
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - Intel(R) MKL-DNN v3.10.2 (Git Hash f1d471933dc852f956fd05389f9313c7148783d5)
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - OpenMP 201511 (a.k.a. OpenMP 4.5)
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - LAPACK is enabled (usually provided by MKL)
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - NNPACK is enabled
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - CPU capability usage: AVX2
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, COMMIT_SHA=70d99e998b4955e0049d13a98d77ae1b14db1f45, CXX_COMPILER=/opt/rh/gcc-toolset-13/root/usr/bin/c++, CXX_FLAGS= -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -DC10_NODEPRECATED -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -faligned-new -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-dangling-reference -Wno-error=dangling-reference -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.11.0, USE_CUDA=0, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, USE_XCCL=OFF, USE_XPU=OFF,
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] TORCH_BUILD_CONFIG_END
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] GPU_PREFLIGHT_CLASSIFICATION No usable NVIDIA device/driver is visible inside the Kaggle kernel. Check whether Kaggle actually allocated the requested GPU; kernel metadata alone is not proof.
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:07+00:00] RUN_FAILED RuntimeError: CUDA preflight failed: No usable NVIDIA device/driver is visible inside the Kaggle kernel. Check whether Kaggle actually allocated the requested GPU; kernel metadata alone is not proof.
[2026-11-06T10:15:02+00:00] Traceback (most recent call last):
[2026-11-06T10:15:02+00:00] File "/tmp/ipykernel_16/2438757360.py", line 169, in main
[2026-11-06T10:15:02+00:00] torch = diagnose_gpu()
[2026-11-06T10:15:02+00:00] File "/tmp/ipykernel_16/2438757360.py", line 144, in diagnose_gpu
[2026-11-06T10:15:02+00:00] raise RuntimeError("CUDA preflight failed: " + reason)
[2026-11-06T10:15:02+00:00] RuntimeError: CUDA preflight failed: No usable NVIDIA device/driver is visible inside the Kaggle kernel. Check whether Kaggle actually allocated the requested GPU; kernel metadata alone is not proof.
[2026-11-06T10:15:02+00:00]
[2026-11-06T10:15:02+00:00] [2026-11-06T10:13:39+00:00] FEEDBACK_UPLOAD_FAILED stage=RUN_FAILED error=URLError: <urlopen error [Errno -3] Temporary failure in name resolution>
[2026-11-06T10:15:02+00:00]
[2026-11-06T10:15:02+00:00] ===== END_KAGGLE_DIAGNOSTIC_FILE weight_space_experiment.log =====
[2026-11-06T10:15:02+00:00] Inspect: https://www.kaggle.com/code/simonday/automated-gpu-test
[2026-11-06T10:15:02+00:00]
[2026-11-06T10:15:02+00:00] FATAL: RuntimeError: Kaggle kernel execution failed; see KAGGLE_DIAGNOSTIC_FILE output above.
[2026-11-06T10:15:04+00:00] PI_WRAPPER_FINISHED returncode=1
|
Cairnbin