Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Python 3.11 compatibility #516

Merged
merged 2 commits into from
Aug 30, 2023
Merged

[CI] Python 3.11 compatibility #516

merged 2 commits into from
Aug 30, 2023

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Aug 30, 2023

No description provided.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 30, 2023
@vmoens vmoens marked this pull request as ready for review August 30, 2023 20:12
@vmoens vmoens added the CI label Aug 30, 2023
@vmoens vmoens merged commit 87299f7 into main Aug 30, 2023
14 of 15 checks passed
@vmoens vmoens deleted the nightly3.11 branch August 30, 2023 20:15
@github-actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 109. Improved: $\large\color{#35bf28}31$. Worsened: $\large\color{#d91a1a}14$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 0.8846ms 21.4783μs 46.5586 KOps/s 38.6896 KOps/s $\textbf{\color{#35bf28}+20.34\%}$
test_plain_set_stack_nested 2.3403ms 0.2294ms 4.3598 KOps/s 4.5391 KOps/s $\color{#d91a1a}-3.95\%$
test_plain_set_nested_inplace 0.2980ms 29.0283μs 34.4491 KOps/s 35.3177 KOps/s $\color{#d91a1a}-2.46\%$
test_plain_set_stack_nested_inplace 0.5703ms 0.2490ms 4.0164 KOps/s 3.8210 KOps/s $\textbf{\color{#35bf28}+5.12\%}$
test_items 2.7741ms 3.7337μs 267.8337 KOps/s 272.4691 KOps/s $\color{#d91a1a}-1.70\%$
test_items_nested 4.7924ms 0.4049ms 2.4698 KOps/s 2.4043 KOps/s $\color{#35bf28}+2.73\%$
test_items_nested_locked 0.6744ms 0.3990ms 2.5061 KOps/s 2.4403 KOps/s $\color{#35bf28}+2.69\%$
test_items_nested_leaf 4.4167ms 0.2433ms 4.1097 KOps/s 3.9207 KOps/s $\color{#35bf28}+4.82\%$
test_items_stack_nested 10.8761ms 2.4782ms 403.5224 Ops/s 393.3131 Ops/s $\color{#35bf28}+2.60\%$
test_items_stack_nested_leaf 4.7849ms 2.2558ms 443.3114 Ops/s 442.7517 Ops/s $\color{#35bf28}+0.13\%$
test_items_stack_nested_locked 2.7617ms 1.2575ms 795.2314 Ops/s 771.5250 Ops/s $\color{#35bf28}+3.07\%$
test_keys 0.1297ms 5.1747μs 193.2462 KOps/s 190.2907 KOps/s $\color{#35bf28}+1.55\%$
test_keys_nested 0.8039ms 0.1936ms 5.1655 KOps/s 5.0997 KOps/s $\color{#35bf28}+1.29\%$
test_keys_nested_locked 0.9437ms 0.1904ms 5.2509 KOps/s 5.1177 KOps/s $\color{#35bf28}+2.60\%$
test_keys_nested_leaf 1.2439ms 0.1877ms 5.3263 KOps/s 4.9665 KOps/s $\textbf{\color{#35bf28}+7.24\%}$
test_keys_stack_nested 3.0651ms 2.2936ms 435.9864 Ops/s 432.1480 Ops/s $\color{#35bf28}+0.89\%$
test_keys_stack_nested_leaf 4.4641ms 2.3811ms 419.9751 Ops/s 426.5353 Ops/s $\color{#d91a1a}-1.54\%$
test_keys_stack_nested_locked 4.3139ms 1.1399ms 877.2666 Ops/s 922.5712 Ops/s $\color{#d91a1a}-4.91\%$
test_values 0.1234ms 1.4794μs 675.9412 KOps/s 627.9491 KOps/s $\textbf{\color{#35bf28}+7.64\%}$
test_values_nested 1.2131ms 76.2382μs 13.1168 KOps/s 12.4812 KOps/s $\textbf{\color{#35bf28}+5.09\%}$
test_values_nested_locked 3.8461ms 76.1642μs 13.1295 KOps/s 13.6872 KOps/s $\color{#d91a1a}-4.07\%$
test_values_nested_leaf 6.2205ms 68.4839μs 14.6020 KOps/s 15.6169 KOps/s $\textbf{\color{#d91a1a}-6.50\%}$
test_values_stack_nested 3.8008ms 2.1099ms 473.9609 Ops/s 521.5549 Ops/s $\textbf{\color{#d91a1a}-9.13\%}$
test_values_stack_nested_leaf 3.2446ms 2.0573ms 486.0824 Ops/s 484.4490 Ops/s $\color{#35bf28}+0.34\%$
test_values_stack_nested_locked 1.5086ms 0.8953ms 1.1169 KOps/s 1.1682 KOps/s $\color{#d91a1a}-4.39\%$
test_membership 81.4000μs 1.8892μs 529.3174 KOps/s 521.6913 KOps/s $\color{#35bf28}+1.46\%$
test_membership_nested 0.3226ms 4.0570μs 246.4870 KOps/s 222.6922 KOps/s $\textbf{\color{#35bf28}+10.69\%}$
test_membership_nested_leaf 0.2218ms 4.0279μs 248.2654 KOps/s 224.6147 KOps/s $\textbf{\color{#35bf28}+10.53\%}$
test_membership_stacked_nested 2.6680ms 15.7700μs 63.4116 KOps/s 63.7731 KOps/s $\color{#d91a1a}-0.57\%$
test_membership_stacked_nested_leaf 3.3203ms 16.0301μs 62.3827 KOps/s 61.3044 KOps/s $\color{#35bf28}+1.76\%$
test_membership_nested_last 0.2951ms 8.2176μs 121.6901 KOps/s 118.1246 KOps/s $\color{#35bf28}+3.02\%$
test_membership_nested_leaf_last 1.7274ms 8.7813μs 113.8786 KOps/s 123.6777 KOps/s $\textbf{\color{#d91a1a}-7.92\%}$
test_membership_stacked_nested_last 2.7358ms 0.2756ms 3.6290 KOps/s 3.8480 KOps/s $\textbf{\color{#d91a1a}-5.69\%}$
test_membership_stacked_nested_leaf_last 1.1349ms 19.1951μs 52.0967 KOps/s 52.1908 KOps/s $\color{#d91a1a}-0.18\%$
test_nested_getleaf 2.5103ms 17.8649μs 55.9758 KOps/s 61.3694 KOps/s $\textbf{\color{#d91a1a}-8.79\%}$
test_nested_get 1.7583ms 17.2238μs 58.0591 KOps/s 62.3976 KOps/s $\textbf{\color{#d91a1a}-6.95\%}$
test_stacked_getleaf 2.0540ms 1.0814ms 924.6964 Ops/s 867.5855 Ops/s $\textbf{\color{#35bf28}+6.58\%}$
test_stacked_get 2.8007ms 1.0188ms 981.5415 Ops/s 931.7031 Ops/s $\textbf{\color{#35bf28}+5.35\%}$
test_nested_getitemleaf 0.7684ms 17.6398μs 56.6900 KOps/s 52.2436 KOps/s $\textbf{\color{#35bf28}+8.51\%}$
test_nested_getitem 1.3642ms 16.9014μs 59.1667 KOps/s 55.7692 KOps/s $\textbf{\color{#35bf28}+6.09\%}$
test_stacked_getitemleaf 2.2028ms 1.0452ms 956.7294 Ops/s 901.9215 Ops/s $\textbf{\color{#35bf28}+6.08\%}$
test_stacked_getitem 1.9252ms 0.9755ms 1.0251 KOps/s 899.8385 Ops/s $\textbf{\color{#35bf28}+13.92\%}$
test_lock_nested 78.4423ms 1.8856ms 530.3337 Ops/s 542.9332 Ops/s $\color{#d91a1a}-2.32\%$
test_lock_stack_nested 0.1228s 25.8799ms 38.6401 Ops/s 42.6053 Ops/s $\textbf{\color{#d91a1a}-9.31\%}$
test_unlock_nested 80.2985ms 2.0541ms 486.8271 Ops/s 502.3520 Ops/s $\color{#d91a1a}-3.09\%$
test_unlock_stack_nested 0.1187s 25.9327ms 38.5614 Ops/s 43.7574 Ops/s $\textbf{\color{#d91a1a}-11.87\%}$
test_flatten_speed 5.9870ms 1.1636ms 859.4149 Ops/s 797.6288 Ops/s $\textbf{\color{#35bf28}+7.75\%}$
test_unflatten_speed 3.2641ms 2.0338ms 491.7014 Ops/s 465.5891 Ops/s $\textbf{\color{#35bf28}+5.61\%}$
test_common_ops 7.8857ms 1.4680ms 681.1879 Ops/s 649.2992 Ops/s $\color{#35bf28}+4.91\%$
test_creation 1.8671ms 6.6653μs 150.0311 KOps/s 144.4580 KOps/s $\color{#35bf28}+3.86\%$
test_creation_empty 0.3568ms 16.0931μs 62.1385 KOps/s 60.2334 KOps/s $\color{#35bf28}+3.16\%$
test_creation_nested_1 0.3369ms 27.4234μs 36.4652 KOps/s 32.6859 KOps/s $\textbf{\color{#35bf28}+11.56\%}$
test_creation_nested_2 2.1529ms 32.8486μs 30.4427 KOps/s 27.6887 KOps/s $\textbf{\color{#35bf28}+9.95\%}$
test_clone 0.2983ms 29.6372μs 33.7413 KOps/s 30.0570 KOps/s $\textbf{\color{#35bf28}+12.26\%}$
test_getitem[int] 3.9727ms 34.9128μs 28.6428 KOps/s 29.7606 KOps/s $\color{#d91a1a}-3.76\%$
test_getitem[slice_int] 3.3489ms 75.9637μs 13.1642 KOps/s 13.7258 KOps/s $\color{#d91a1a}-4.09\%$
test_getitem[range] 0.5090ms 0.1220ms 8.1986 KOps/s 7.8846 KOps/s $\color{#35bf28}+3.98\%$
test_getitem[tuple] 1.4767ms 56.9346μs 17.5640 KOps/s 17.4221 KOps/s $\color{#35bf28}+0.81\%$
test_getitem[list] 0.4735ms 0.1152ms 8.6825 KOps/s 8.4491 KOps/s $\color{#35bf28}+2.76\%$
test_setitem_dim[int] 0.2154ms 50.2567μs 19.8978 KOps/s 20.0130 KOps/s $\color{#d91a1a}-0.58\%$
test_setitem_dim[slice_int] 0.4198ms 92.1358μs 10.8535 KOps/s 10.5869 KOps/s $\color{#35bf28}+2.52\%$
test_setitem_dim[range] 0.4713ms 0.1249ms 8.0062 KOps/s 7.8568 KOps/s $\color{#35bf28}+1.90\%$
test_setitem_dim[tuple] 0.4231ms 74.9439μs 13.3433 KOps/s 14.2850 KOps/s $\textbf{\color{#d91a1a}-6.59\%}$
test_setitem 0.7106ms 43.9071μs 22.7754 KOps/s 20.1531 KOps/s $\textbf{\color{#35bf28}+13.01\%}$
test_set 2.7090ms 42.3400μs 23.6183 KOps/s 22.0865 KOps/s $\textbf{\color{#35bf28}+6.94\%}$
test_set_shared 3.6019ms 0.2690ms 3.7169 KOps/s 3.5954 KOps/s $\color{#35bf28}+3.38\%$
test_update 1.1716ms 48.0041μs 20.8316 KOps/s 19.7153 KOps/s $\textbf{\color{#35bf28}+5.66\%}$
test_update_nested 0.3740ms 67.1397μs 14.8943 KOps/s 13.5284 KOps/s $\textbf{\color{#35bf28}+10.10\%}$
test_set_nested 0.8027ms 46.6996μs 21.4135 KOps/s 19.7963 KOps/s $\textbf{\color{#35bf28}+8.17\%}$
test_set_nested_new 0.7058ms 65.1876μs 15.3403 KOps/s 14.1401 KOps/s $\textbf{\color{#35bf28}+8.49\%}$
test_select 1.3156ms 0.1236ms 8.0928 KOps/s 7.6799 KOps/s $\textbf{\color{#35bf28}+5.38\%}$
test_unbind_speed 2.2530ms 0.6997ms 1.4292 KOps/s 1.3637 KOps/s $\color{#35bf28}+4.80\%$
test_unbind_speed_stack0 85.2422ms 9.1655ms 109.1046 Ops/s 99.9323 Ops/s $\textbf{\color{#35bf28}+9.18\%}$
test_unbind_speed_stack1 0.6856ms 1.0018μs 998.1647 KOps/s 1.0163 MOps/s $\color{#d91a1a}-1.79\%$
test_creation[device0] 0.9456ms 0.5788ms 1.7277 KOps/s 1.8322 KOps/s $\textbf{\color{#d91a1a}-5.70\%}$
test_creation_from_tensor 6.8314ms 0.6346ms 1.5759 KOps/s 1.6760 KOps/s $\textbf{\color{#d91a1a}-5.98\%}$
test_add_one[memmap_tensor0] 1.7691ms 59.8752μs 16.7014 KOps/s 16.3023 KOps/s $\color{#35bf28}+2.45\%$
test_contiguous[memmap_tensor0] 0.9651ms 11.3919μs 87.7814 KOps/s 89.5827 KOps/s $\color{#d91a1a}-2.01\%$
test_stack[memmap_tensor0] 0.9841ms 40.1424μs 24.9113 KOps/s 24.8393 KOps/s $\color{#35bf28}+0.29\%$
test_memmaptd_index 2.0852ms 0.3676ms 2.7202 KOps/s 2.5889 KOps/s $\textbf{\color{#35bf28}+5.07\%}$
test_memmaptd_index_astensor 6.3955ms 2.1332ms 468.7812 Ops/s 501.3311 Ops/s $\textbf{\color{#d91a1a}-6.49\%}$
test_memmaptd_index_op 9.0700ms 4.9454ms 202.2087 Ops/s 195.3625 Ops/s $\color{#35bf28}+3.50\%$
test_reshape_pytree 1.4627ms 42.9008μs 23.3096 KOps/s 22.2249 KOps/s $\color{#35bf28}+4.88\%$
test_reshape_td 2.7361ms 57.4828μs 17.3965 KOps/s 17.4867 KOps/s $\color{#d91a1a}-0.52\%$
test_view_pytree 1.4678ms 42.1685μs 23.7144 KOps/s 23.6975 KOps/s $\color{#35bf28}+0.07\%$
test_view_td 0.5174ms 10.5635μs 94.6658 KOps/s 88.1957 KOps/s $\textbf{\color{#35bf28}+7.34\%}$
test_unbind_pytree 0.8678ms 45.9192μs 21.7774 KOps/s 23.0349 KOps/s $\textbf{\color{#d91a1a}-5.46\%}$
test_unbind_td 1.3290ms 0.1194ms 8.3763 KOps/s 8.6061 KOps/s $\color{#d91a1a}-2.67\%$
test_split_pytree 4.1089ms 53.0611μs 18.8462 KOps/s 19.0902 KOps/s $\color{#d91a1a}-1.28\%$
test_split_td 1.9321ms 0.1532ms 6.5279 KOps/s 6.3417 KOps/s $\color{#35bf28}+2.93\%$
test_add_pytree 3.2336ms 76.5766μs 13.0588 KOps/s 13.7074 KOps/s $\color{#d91a1a}-4.73\%$
test_add_td 1.0252ms 0.1336ms 7.4850 KOps/s 7.5200 KOps/s $\color{#d91a1a}-0.47\%$
test_distributed 0.3835ms 11.1104μs 90.0057 KOps/s 109.9936 KOps/s $\textbf{\color{#d91a1a}-18.17\%}$
test_tdmodule 0.2697ms 41.4176μs 24.1443 KOps/s 23.4918 KOps/s $\color{#35bf28}+2.78\%$
test_tdmodule_dispatch 0.3653ms 78.1656μs 12.7934 KOps/s 12.8776 KOps/s $\color{#d91a1a}-0.65\%$
test_tdseq 0.4503ms 45.0010μs 22.2217 KOps/s 19.6998 KOps/s $\textbf{\color{#35bf28}+12.80\%}$
test_tdseq_dispatch 0.6127ms 87.9470μs 11.3705 KOps/s 9.8786 KOps/s $\textbf{\color{#35bf28}+15.10\%}$
test_instantiation_functorch 3.9723ms 2.0992ms 476.3635 Ops/s 477.2631 Ops/s $\color{#d91a1a}-0.19\%$
test_instantiation_td 6.2073ms 1.6745ms 597.1980 Ops/s 590.1757 Ops/s $\color{#35bf28}+1.19\%$
test_exec_functorch 1.5894ms 0.2733ms 3.6589 KOps/s 3.6121 KOps/s $\color{#35bf28}+1.30\%$
test_exec_td 0.7976ms 0.2743ms 3.6462 KOps/s 3.4418 KOps/s $\textbf{\color{#35bf28}+5.94\%}$
test_vmap_mlp_speed[True-True] 9.2401ms 2.0979ms 476.6688 Ops/s 495.5707 Ops/s $\color{#d91a1a}-3.81\%$
test_vmap_mlp_speed[True-False] 6.5677ms 1.0510ms 951.5003 Ops/s 961.3432 Ops/s $\color{#d91a1a}-1.02\%$
test_vmap_mlp_speed[False-True] 8.5867ms 1.7569ms 569.1965 Ops/s 576.9194 Ops/s $\color{#d91a1a}-1.34\%$
test_vmap_mlp_speed[False-False] 9.2925ms 0.7882ms 1.2688 KOps/s 1.2674 KOps/s $\color{#35bf28}+0.11\%$
test_vmap_transformer_speed[True-True] 28.0791ms 20.5966ms 48.5516 Ops/s 48.4766 Ops/s $\color{#35bf28}+0.15\%$
test_vmap_transformer_speed[True-False] 23.3612ms 13.4473ms 74.3645 Ops/s 71.8560 Ops/s $\color{#35bf28}+3.49\%$
test_vmap_transformer_speed[False-True] 30.9802ms 20.9535ms 47.7247 Ops/s 48.5210 Ops/s $\color{#d91a1a}-1.64\%$
test_vmap_transformer_speed[False-False] 22.7603ms 13.4419ms 74.3942 Ops/s 76.1577 Ops/s $\color{#d91a1a}-2.32\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants