Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to CUDA 12.8.0 #728

Merged
merged 2 commits into from
Feb 3, 2025
Merged

Conversation

bdice
Copy link
Contributor

@bdice bdice commented Feb 1, 2025

This updates to CUDA 12.8.0.

xref: rapidsai/build-planning#139

@bdice bdice requested a review from a team as a code owner February 1, 2025 16:05
@bdice bdice requested a review from gforsyth February 1, 2025 16:05
@bdice
Copy link
Contributor Author

bdice commented Feb 3, 2025

cuSpatial notebooks are failing:

Testing cuspatial/trajectory_clustering.ipynb
FileNotFoundError ['\x1b[0;31m---------------------------------------------------------------------------\x1b[0m', '\x1b[0;31mFileNotFoundError\x1b[0m                         Traceback (most recent call last)', "Cell \x1b[0;32mIn[3], line 1\x1b[0m\n\x1b[0;32m----> 1\x1b[0m \x1b[38;5;28;01mwith\x1b[39;00m \x1b[38;5;28;43mopen\x1b[39;49m\x1b[43m(\x1b[49m\x1b[38;5;124;43m'\x1b[39;49m\x1b[38;5;124;43mtrajectories_extracted.p\x1b[39;49m\x1b[38;5;124;43m'\x1b[39;49m\x1b[43m,\x1b[49m\x1b[43m \x1b[49m\x1b[38;5;124;43m'\x1b[39;49m\x1b[38;5;124;43mrb\x1b[39;49m\x1b[38;5;124;43m'\x1b[39;49m\x1b[43m)\x1b[49m \x1b[38;5;28;01mas\x1b[39;00m f:\n\x1b[1;32m      2\x1b[0m     trajectories \x1b[38;5;241m=\x1b[39m pickle\x1b[38;5;241m.\x1b[39mload(f)\n", 'File \x1b[0;32m/opt/conda/lib/python3.11/site-packages/IPython/core/interactiveshell.py:324\x1b[0m, in \x1b[0;36m_modified_open\x1b[0;34m(file, *args, **kwargs)\x1b[0m\n\x1b[1;32m    317\x1b[0m \x1b[38;5;28;01mif\x1b[39;00m file \x1b[38;5;129;01min\x1b[39;00m {\x1b[38;5;241m0\x1b[39m, \x1b[38;5;241m1\x1b[39m, \x1b[38;5;241m2\x1b[39m}:\n\x1b[1;32m    318\x1b[0m     \x1b[38;5;28;01mraise\x1b[39;00m \x1b[38;5;167;01mValueError\x1b[39;00m(\n\x1b[1;32m    319\x1b[0m         \x1b[38;5;124mf\x1b[39m\x1b[38;5;124m"\x1b[39m\x1b[38;5;124mIPython won\x1b[39m\x1b[38;5;124m\'\x1b[39m\x1b[38;5;124mt let you open fd=\x1b[39m\x1b[38;5;132;01m{\x1b[39;00mfile\x1b[38;5;132;01m}\x1b[39;00m\x1b[38;5;124m by default \x1b[39m\x1b[38;5;124m"\x1b[39m\n\x1b[1;32m    320\x1b[0m         \x1b[38;5;124m"\x1b[39m\x1b[38;5;124mas it is likely to crash IPython. If you know what you are doing, \x1b[39m\x1b[38;5;124m"\x1b[39m\n\x1b[1;32m    321\x1b[0m         \x1b[38;5;124m"\x1b[39m\x1b[38;5;124myou can use builtins\x1b[39m\x1b[38;5;124m\'\x1b[39m\x1b[38;5;124m open.\x1b[39m\x1b[38;5;124m"\x1b[39m\n\x1b[1;32m    322\x1b[0m     )\n\x1b[0;32m--> 324\x1b[0m \x1b[38;5;28;01mreturn\x1b[39;00m \x1b[43mio_open\x1b[49m\x1b[43m(\x1b[49m\x1b[43mfile\x1b[49m\x1b[43m,\x1b[49m\x1b[43m \x1b[49m\x1b[38;5;241;43m*\x1b[39;49m\x1b[43margs\x1b[49m\x1b[43m,\x1b[49m\x1b[43m \x1b[49m\x1b[38;5;241;43m*\x1b[39;49m\x1b[38;5;241;43m*\x1b[39;49m\x1b[43mkwargs\x1b[49m\x1b[43m)\x1b[49m\n', "\x1b[0;31mFileNotFoundError\x1b[0m: [Errno 2] No such file or directory: 'trajectories_extracted.p'"]
NameError ['\x1b[0;31m---------------------------------------------------------------------------\x1b[0m', '\x1b[0;31mNameError\x1b[0m                                 Traceback (most recent call last)', "Cell \x1b[0;32mIn[5], line 2\x1b[0m\n\x1b[1;32m      1\x1b[0m \x1b[38;5;28mprint\x1b[39m(\x1b[38;5;124m'\x1b[39m\x1b[38;5;124mFiltering based on number of points ...\x1b[39m\x1b[38;5;124m'\x1b[39m)\n\x1b[0;32m----> 2\x1b[0m trajectories \x1b[38;5;241m=\x1b[39m traj_filter_num_points(\x1b[43mtrajectories\x1b[49m, num_min\x1b[38;5;241m=\x1b[39m\x1b[38;5;241m30\x1b[39m)\n\x1b[1;32m      3\x1b[0m \x1b[38;5;28mprint\x1b[39m(\x1b[38;5;124mf\x1b[39m\x1b[38;5;124m'\x1b[39m\x1b[38;5;132;01m{\x1b[39;00m\x1b[38;5;28mlen\x1b[39m(trajectories)\x1b[38;5;132;01m}\x1b[39;00m\x1b[38;5;124m left after filtering based on number of points\x1b[39m\x1b[38;5;124m'\x1b[39m)\n\x1b[1;32m      5\x1b[0m trajectories \x1b[38;5;241m=\x1b[39m [traj_coord_to_image_coord(\n\x1b[1;32m      6\x1b[0m     trajectory) \x1b[38;5;28;01mfor\x1b[39;00m trajectory \x1b[38;5;129;01min\x1b[39;00m trajectories]\n", "\x1b[0;31mNameError\x1b[0m: name 'trajectories' is not defined"]
NameError ['\x1b[0;31m---------------------------------------------------------------------------\x1b[0m', '\x1b[0;31mNameError\x1b[0m                                 Traceback (most recent call last)', "Cell \x1b[0;32mIn[6], line 6\x1b[0m\n\x1b[1;32m      4\x1b[0m plt\x1b[38;5;241m.\x1b[39mfigure(figsize\x1b[38;5;241m=\x1b[39m(\x1b[38;5;241m15\x1b[39m, \x1b[38;5;241m15\x1b[39m))\n\x1b[1;32m      5\x1b[0m plt\x1b[38;5;241m.\x1b[39mimshow(bg_image)\n\x1b[0;32m----> 6\x1b[0m lc \x1b[38;5;241m=\x1b[39m LineCollection(\x1b[43mtrajectories\x1b[49m, color\x1b[38;5;241m=\x1b[39m\x1b[38;5;124m'\x1b[39m\x1b[38;5;124mb\x1b[39m\x1b[38;5;124m'\x1b[39m)\n\x1b[1;32m      7\x1b[0m plt\x1b[38;5;241m.\x1b[39mgca()\x1b[38;5;241m.\x1b[39madd_collection(lc)\n", "\x1b[0;31mNameError\x1b[0m: name 'trajectories' is not defined"]
NameError ['\x1b[0;31m---------------------------------------------------------------------------\x1b[0m', '\x1b[0;31mNameError\x1b[0m                                 Traceback (most recent call last)', 'Cell \x1b[0;32mIn[8], line 6\x1b[0m\n\x1b[1;32m      1\x1b[0m start \x1b[38;5;241m=\x1b[39m time\x1b[38;5;241m.\x1b[39mtime()\n\x1b[1;32m      3\x1b[0m \x1b[38;5;66;03m# Prepare data for GPU\x1b[39;00m\n\x1b[1;32m      4\x1b[0m \x1b[38;5;66;03m# Concatenating all trajectories\x1b[39;00m\n\x1b[1;32m      5\x1b[0m trajs \x1b[38;5;241m=\x1b[39m cp\x1b[38;5;241m.\x1b[39mconcatenate([cp\x1b[38;5;241m.\x1b[39masarray(traj)\n\x1b[0;32m----> 6\x1b[0m                        \x1b[38;5;28;01mfor\x1b[39;00m traj \x1b[38;5;129;01min\x1b[39;00m \x1b[43mtrajectories\x1b[49m], axis\x1b[38;5;241m=\x1b[39m\x1b[38;5;241m0\x1b[39m)\x1b[38;5;241m.\x1b[39mflatten()\n\x1b[1;32m      8\x1b[0m \x1b[38;5;66;03m# `offset` denote the starting index for each trajectory\x1b[39;00m\n\x1b[1;32m      9\x1b[0m offsets \x1b[38;5;241m=\x1b[39m cp\x1b[38;5;241m.\x1b[39masarray([\x1b[38;5;241m0\x1b[39m] \x1b[38;5;241m+\x1b[39m [\x1b[38;5;28mlen\x1b[39m(traj) \x1b[38;5;28;01mfor\x1b[39;00m traj \x1b[38;5;129;01min\x1b[39;00m trajectories])\x1b[38;5;241m.\x1b[39mcumsum()[:\x1b[38;5;241m-\x1b[39m\x1b[38;5;241m1\x1b[39m]\n', "\x1b[0;31mNameError\x1b[0m: name 'trajectories' is not defined"]
NameError ['\x1b[0;31m---------------------------------------------------------------------------\x1b[0m', '\x1b[0;31mNameError\x1b[0m                                 Traceback (most recent call last)', "Cell \x1b[0;32mIn[9], line 3\x1b[0m\n\x1b[1;32m      1\x1b[0m start \x1b[38;5;241m=\x1b[39m time\x1b[38;5;241m.\x1b[39mtime()\n\x1b[1;32m      2\x1b[0m agg \x1b[38;5;241m=\x1b[39m cuml\x1b[38;5;241m.\x1b[39mAgglomerativeClustering(n_clusters\x1b[38;5;241m=\x1b[39m\x1b[38;5;241m10\x1b[39m, linkage\x1b[38;5;241m=\x1b[39m\x1b[38;5;124m'\x1b[39m\x1b[38;5;124msingle\x1b[39m\x1b[38;5;124m'\x1b[39m)\n\x1b[0;32m----> 3\x1b[0m agg_result \x1b[38;5;241m=\x1b[39m agg\x1b[38;5;241m.\x1b[39mfit(\x1b[43mdmatrix\x1b[49m)\n\x1b[1;32m      4\x1b[0m end \x1b[38;5;241m=\x1b[39m time\x1b[38;5;241m.\x1b[39mtime()\n\x1b[1;32m      5\x1b[0m \x1b[38;5;28mprint\x1b[39m(\x1b[38;5;124m'\x1b[39m\x1b[38;5;124mA complete AC search takes:\x1b[39m\x1b[38;5;130;01m\\n\x1b[39;00m\x1b[38;5;124m  \x1b[39m\x1b[38;5;132;01m{0:.3f}\x1b[39;00m\x1b[38;5;124m seconds\x1b[39m\x1b[38;5;124m'\x1b[39m\x1b[38;5;241m.\x1b[39mformat(end \x1b[38;5;241m-\x1b[39m start))\n", "\x1b[0;31mNameError\x1b[0m: name 'dmatrix' is not defined"]
NameError ['\x1b[0;31m---------------------------------------------------------------------------\x1b[0m', '\x1b[0;31mNameError\x1b[0m                                 Traceback (most recent call last)', "Cell \x1b[0;32mIn[10], line 3\x1b[0m\n\x1b[1;32m      1\x1b[0m start \x1b[38;5;241m=\x1b[39m time\x1b[38;5;241m.\x1b[39mtime()\n\x1b[1;32m      2\x1b[0m dbscan \x1b[38;5;241m=\x1b[39m cuml\x1b[38;5;241m.\x1b[39mDBSCAN(eps\x1b[38;5;241m=\x1b[39m\x1b[38;5;241m20\x1b[39m, metric\x1b[38;5;241m=\x1b[39m\x1b[38;5;124m'\x1b[39m\x1b[38;5;124mprecomputed\x1b[39m\x1b[38;5;124m'\x1b[39m, min_samples\x1b[38;5;241m=\x1b[39m\x1b[38;5;241m2\x1b[39m)\n\x1b[0;32m----> 3\x1b[0m dbscan_result \x1b[38;5;241m=\x1b[39m dbscan\x1b[38;5;241m.\x1b[39mfit(\x1b[43mdmatrix\x1b[49m)\n\x1b[1;32m      4\x1b[0m end \x1b[38;5;241m=\x1b[39m time\x1b[38;5;241m.\x1b[39mtime()\n\x1b[1;32m      5\x1b[0m \x1b[38;5;28mprint\x1b[39m(\x1b[38;5;124m'\x1b[39m\x1b[38;5;124mA complete DBSCAN search takes:\x1b[39m\x1b[38;5;130;01m\\n\x1b[39;00m\x1b[38;5;124m  \x1b[39m\x1b[38;5;132;01m{0:.3f}\x1b[39;00m\x1b[38;5;124m seconds\x1b[39m\x1b[38;5;124m'\x1b[39m\x1b[38;5;241m.\x1b[39mformat(end \x1b[38;5;241m-\x1b[39m start))\n", "\x1b[0;31mNameError\x1b[0m: name 'dmatrix' is not defined"]
Completed cuspatial/trajectory_clustering.ipynb with 0 warnings and 6 errors

@bdice
Copy link
Contributor Author

bdice commented Feb 3, 2025

The cuspatial/trajectory_clustering.ipynb notebook failed on all test jobs twice in a row. I was able to run the cuspatial/trajectory_clustering.ipynb notebook locally with no issues. I am not sure what is going wrong. Perhaps there is a network issue with downloading the dataset? I am going to skip this notebook in b290f94, as the failures are not specific to CUDA 12.8.0.

@bdice
Copy link
Contributor Author

bdice commented Feb 3, 2025

This notebook failure is also discussed in #726 and #727. Let's merge this PR to fix the CI, which will unblock #727.

@bdice
Copy link
Contributor Author

bdice commented Feb 3, 2025

/merge

@rapids-bot rapids-bot bot merged commit 3f8cea7 into rapidsai:branch-25.02 Feb 3, 2025
61 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants