Skip to content

[scheduler] Enhancement: Add background coroutine group #1485

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jan 23, 2025
Merged

[scheduler] Enhancement: Add background coroutine group #1485

merged 1 commit into from
Jan 23, 2025

Conversation

iyzhang
Copy link
Contributor

@iyzhang iyzhang commented Jan 14, 2025

This PR splits our coroutines into foreground and background. We always prioritize foreground coroutines, running them until none are runnable before scheduling the background coroutines. The runtime controls this by polling different task groups in the scheduler rather than changing the scheduler.

@iyzhang iyzhang requested a review from anandbonde January 14, 2025 00:57
@iyzhang iyzhang self-assigned this Jan 14, 2025
anandbonde
anandbonde reviewed Jan 14, 2025
View reviewed changes
@iyzhang iyzhang force-pushed the enhancement-scheduler-use-task-groups branch from df6036b to 8835d42 Compare January 15, 2025 20:52
anandbonde
anandbonde approved these changes Jan 15, 2025
View reviewed changes
Copy link
Contributor

@anandbonde anandbonde left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

@iyzhang iyzhang force-pushed the enhancement-scheduler-use-task-groups branch from d9ff841 to 7995298 Compare January 18, 2025 00:03
@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 7995298

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::catnap::transport::epoll 12469487 3883 1608 6639779302 100 6639779302 100
ioc::network::libos::push 17600 512 212 7826900 0 7826900 0
ioc::network::libos::pop 15498 469 196 5837749 0 5837749 0
ioc::network::libos::connect 50 51358 21406 2060657 0 2060657 0
demikernel::sgaalloc 11317 123 52 1250415 0 1250415 0
demikernel::sgafree 11548 77 32 918929 0 918929 0
ioc::network::libos::pushto 2141 364 152 775270 0 775270 0
demikernel::socket 10 152463 62739 502358 0 502358 0
ioc::network::libos::accept 27 11845 5011 391321 0 391321 0
ioc::network::libos::close 18 23518 9763 363901 0 363901 0
demikernel::new 1 252513 105018 252513 0 252513 0
demikernel::bind 1 28269 11736 28269 0 28269 0
demikernel::listen 1 14827 6157 14827 0 14827 0

@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = 7995298

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::inetstack::poll;inetstack::layer4::poll_once 18568693 703 286 11346191370 46 11337956591 85
bgc::inetstack::poll 9284347 1615 657 13211835830 53 1865644460 14
demikernel::new 1 93184565 37784145 93184565 0 93184565 1
ioc::network::libos::push 16145 3111 1287 48350307 0 48350307 0
ioc::network::libos::pushto 2468 4238 1808 10356778 0 10356778 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch 5768 2766 1087 8374352 0 8364763 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11501 407 165 5710872 0 5710872 0
ioc::network::libos::pop 9234 584 239 3497979 0 3497979 0
bgc::inetstack::tcp::established::background 11512 1681 674 13115455 0 3337388 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11512 493 201 3139322 0 3139322 0
ioc::network::libos::connect 42 47150 19360 1898427 0 1898427 0
demikernel::sgaalloc 6652 168 70 1170725 0 1170725 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11459 892 344 927873 0 927873 0
demikernel::sgafree 8850 124 51 713977 0 713977 0
bgc::inetstack::tcp::passiveopen::background 42 32971 13285 514375 0 514375 0
ioc::network::libos::close 47 8145 3347 302449 0 302449 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;udp::receive 817 246 105 188583 0 188583 0
ioc::network::libos::accept 39 2203 894 52806 0 52806 0
demikernel::bind 1 26095 10298 26095 0 26095 0
bgc::inetstack::arp::background 7 2828 1145 17851 0 17851 0
demikernel::socket 10 1968 798 7114 0 7114 0
demikernel::listen 1 3280 1316 3280 0 3280 0
bgc::inetstack::icmp::background 1 1889 765 2032 0 2032 0

@iyzhang iyzhang force-pushed the enhancement-scheduler-use-task-groups branch from 7995298 to d202a70 Compare January 21, 2025 22:49
This was referenced Jan 21, 2025
Closed
Closed
@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = d202a70

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::inetstack::poll;inetstack::layer4::poll_once 18578731 727 288 11397459929 46 11389643491 85
bgc::inetstack::poll 9289366 1665 658 13283539116 53 1886079187 14
demikernel::new 1 98752340 38885642 98752340 0 98752340 1
ioc::network::libos::push 16145 3050 1217 46917546 0 46917546 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch 5775 2568 998 7948920 0 7946184 0
ioc::network::libos::pushto 1343 4281 1731 5669874 0 5669874 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11550 396 156 5428963 0 5428963 0
bgc::inetstack::tcp::established::background 11560 1603 629 12914271 0 3315838 0
ioc::network::libos::pop 9216 594 234 3278918 0 3278918 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11560 452 179 3248641 0 3248641 0
ioc::network::libos::connect 42 38102 15250 1521338 0 1521338 0
demikernel::sgaalloc 6585 163 65 962672 0 962672 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11508 878 339 920828 0 920828 0
demikernel::sgafree 8786 122 49 625300 0 625300 0
bgc::inetstack::tcp::passiveopen::background 42 31570 12347 517427 0 517427 0
ioc::network::libos::close 47 6312 2494 291712 0 291712 0
ioc::network::libos::accept 39 2268 889 57132 0 57132 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;udp::receive 221 224 92 53821 0 53821 0
demikernel::bind 1 26492 10266 26492 0 26492 0
bgc::inetstack::arp::background 7 3306 1298 14281 0 14281 0
demikernel::socket 10 1981 776 6304 0 6304 0
demikernel::listen 1 3653 1424 3653 0 3653 0
bgc::inetstack::icmp::background 1 1964 773 2068 0 2068 0

@github-actions GitHub Actions
Copy link

libos = catnip
commit id = d202a70

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::inetstack::poll;inetstack::layer4::poll_once;catnip::runtime::receive 27611397 202 81 5566140157 19 5566140157 40
bgc::inetstack::poll;inetstack::layer4::poll_once 27611397 359 143 9525939779 33 3955573709 28
bgc::inetstack::poll 13805699 912 364 12237793258 42 2711853480 19
demikernel::new 1 1759894500 700615747 1759894500 6 1759894500 13
ioc::network::libos::push 16144 1182 472 16298061 0 14232973 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11057 338 134 4627404 0 4626674 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch 2450 2725 1065 4297539 0 4277717 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11069 305 122 2862549 0 2860217 0
bgc::inetstack::tcp::established::background 11069 1067 423 10919137 0 2738253 0
ioc::network::libos::pop 9041 416 167 2729053 0 2729053 0
ioc::network::libos::push;catnip::runtime::transmit 8763 330 132 2242095 0 2242095 0
ioc::network::libos::pushto 1946 1489 634 2663907 0 2100005 0
ioc::network::libos::connect 42 35658 14498 1500547 0 1442804 0
demikernel::sgafree 8820 102 41 698049 0 698049 0
demikernel::sgaalloc 6625 146 58 683512 0 683512 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11014 295 114 690930 0 680957 0
ioc::network::libos::pushto;catnip::runtime::transmit 1946 315 134 563902 0 563902 0
bgc::inetstack::tcp::passiveopen::background 42 34473 13761 412285 0 359717 0
ioc::network::libos::close 50 5853 2347 271529 0 271529 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;udp::receive 504 292 125 178272 0 178272 0
ioc::network::libos::connect;catnip::runtime::transmit 42 6235 2516 57744 0 57744 0
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 21 17031 6824 52569 0 52569 0
ioc::network::libos::accept 38 2243 893 47648 0 47648 0
bgc::inetstack::arp::background 7 3162 1258 23474 0 23474 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger;catnip::runtime::transmit 20 1096 458 14511 0 14511 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;catnip::runtime::transmit 24 619 246 11334 0 11334 0
demikernel::bind 1 11136 4398 11136 0 11136 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender;catnip::runtime::transmit 21 550 218 9973 0 9973 0
demikernel::socket 10 2532 1014 8275 0 8275 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 10 500 208 4089 0 4089 0
demikernel::listen 1 3491 1383 3491 0 3491 0
bgc::inetstack::icmp::background 1 1746 695 1907 0 1907 0

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = d202a70

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::catnap::transport::epoll 12514078 3479 1461 6630283121 100 6630283121 100
ioc::network::libos::push 17600 486 214 7633155 0 7633155 0
ioc::network::libos::pop 15477 479 230 5920561 0 5920561 0
ioc::network::libos::connect 50 49656 20175 1956617 0 1956617 0
demikernel::sgaalloc 11280 121 49 1269554 0 1269554 0
demikernel::sgafree 11534 79 38 946623 0 946623 0
demikernel::socket 10 150955 64911 503644 0 503644 0
ioc::network::libos::accept 27 11640 5996 382391 0 382391 0
ioc::network::libos::close 18 22970 10886 347562 0 347562 0
ioc::network::libos::pushto 1029 341 135 342691 0 342691 0
demikernel::new 1 246196 114477 246196 0 246196 0
demikernel::bind 1 26909 13190 26909 0 26909 0
demikernel::listen 1 13701 6907 13701 0 13701 0

@anandbonde anandbonde self-requested a review January 22, 2025 00:12
@github-actions GitHub Actions
Copy link

libos = catnip
commit id = d202a70

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::inetstack::poll;inetstack::layer4::poll_once;catnip::runtime::receive 27889887 203 80 5593722277 19 5593722277 39
bgc::inetstack::poll;inetstack::layer4::poll_once 27889887 363 144 9624122428 33 4026154572 28
bgc::inetstack::poll 13944944 919 365 12392598743 42 2768476314 20
demikernel::new 1 1762489048 698101112 1762489048 6 1762489048 12
ioc::network::libos::push 16145 1172 466 16554736 0 14461985 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11056 345 137 4675448 0 4675022 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch 2408 2372 929 4317538 0 4299883 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11068 285 113 2891856 0 2889810 0
bgc::inetstack::tcp::established::background 11068 1063 420 11083305 0 2825182 0
ioc::network::libos::pop 9043 393 156 2606723 0 2606723 0
ioc::network::libos::push;catnip::runtime::transmit 8763 333 132 2272129 0 2272129 0
ioc::network::libos::connect 42 35016 14053 1464220 0 1409101 0
ioc::network::libos::pushto 1263 1257 532 1591468 0 1260783 0
demikernel::sgafree 8782 102 40 701081 0 701081 0
demikernel::sgaalloc 6538 147 58 682013 0 682013 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11014 297 115 690819 0 680760 0
bgc::inetstack::tcp::passiveopen::background 42 35358 14018 399580 0 344022 0
ioc::network::libos::pushto;catnip::runtime::transmit 1263 262 111 330685 0 330685 0
ioc::network::libos::close 50 5596 2225 256644 0 256644 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;udp::receive 541 247 99 139914 0 139914 0
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 21 18903 7499 55558 0 55558 0
ioc::network::libos::connect;catnip::runtime::transmit 42 6397 2530 55120 0 55120 0
ioc::network::libos::accept 39 2050 811 45895 0 45895 0
bgc::inetstack::arp::background 7 3120 1235 22858 0 22858 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger;catnip::runtime::transmit 21 1021 420 16373 0 16373 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;catnip::runtime::transmit 24 624 247 11105 0 11105 0
demikernel::bind 1 10394 4093 10394 0 10394 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender;catnip::runtime::transmit 21 585 232 10059 0 10059 0
demikernel::socket 10 2140 861 7807 0 7807 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 10 411 172 2979 0 2979 0
demikernel::listen 1 2869 1122 2869 0 2869 0
bgc::inetstack::icmp::background 1 1832 726 2006 0 2006 0

anandbonde
anandbonde reviewed Jan 22, 2025
View reviewed changes
@iyzhang iyzhang force-pushed the enhancement-scheduler-use-task-groups branch from d202a70 to c060684 Compare January 23, 2025 00:59
@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = c060684

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::inetstack::poll;inetstack::layer4::poll_once 19288000 718 286 11746947364 46 11737610965 85
bgc::inetstack::poll 9644000 1645 655 13701419011 54 1954471646 14
ioc::network::libos::push 16145 2966 1199 47432495 0 47432495 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch 6049 2563 1001 9494644 0 9492931 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11814 400 160 5509404 0 5509404 0
ioc::network::libos::pop 9321 499 201 3387727 0 3387727 0
bgc::inetstack::tcp::established::background 11825 1707 681 12989228 0 3354605 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11825 551 226 3180787 0 3180787 0
ioc::network::libos::pushto 500 5481 2212 2409738 0 2409738 0
ioc::network::libos::connect 42 39583 16264 1596831 0 1596831 0
demikernel::sgaalloc 6489 151 61 1105461 0 1105461 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11772 899 346 944433 0 944433 0
demikernel::sgafree 8738 131 53 740019 0 740019 0
bgc::inetstack::tcp::passiveopen::background 42 32366 12818 491867 0 491867 0
ioc::network::libos::close 47 6554 2622 286357 0 286357 0
ioc::network::libos::accept 40 2236 888 54177 0 54177 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;udp::receive 146 239 97 33683 0 33683 0
bgc::inetstack::arp::background 7 2013 799 10732 0 10732 0
bgc::inetstack::icmp::background 1 2263 898 2371 0 2371 0

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = c060684

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::catnap::transport::epoll 13301807 3880 1646 7019101830 100 7019101830 100
ioc::network::libos::push 17600 490 202 7808859 0 7808859 0
ioc::network::libos::pop 15406 482 197 5592112 0 5592112 0
ioc::network::libos::connect 50 50060 20527 2061689 0 2061689 0
demikernel::sgaalloc 11284 118 49 1280621 0 1280621 0
demikernel::sgafree 11536 79 33 1018866 0 1018866 0
ioc::network::libos::accept 27 12537 5207 418882 0 418882 0
ioc::network::libos::pushto 1234 348 145 414269 0 414269 0
ioc::network::libos::close 18 23087 9470 348592 0 348592 0

@github-actions GitHub Actions
Copy link

libos = catnip
commit id = c060684

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::inetstack::poll;inetstack::layer4::poll_once;catnip::runtime::receive 28174520 209 84 5836997205 21 5836997205 46
bgc::inetstack::poll;inetstack::layer4::poll_once 28174520 382 154 9793957188 35 3952101982 31
bgc::inetstack::poll 14087260 960 387 12597706655 45 2803749468 22
ioc::network::libos::push 16145 1244 504 17818297 0 15629560 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch 2272 3004 1182 4940340 0 4923478 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11049 355 142 4728356 0 4728201 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11061 294 118 2835847 0 2834782 0
bgc::inetstack::tcp::established::background 11061 1089 434 11084354 0 2821272 0
ioc::network::libos::pop 9046 388 157 2673559 0 2673559 0
ioc::network::libos::push;catnip::runtime::transmit 8763 390 157 2376344 0 2376344 0
ioc::network::libos::connect 42 40686 16317 1601617 0 1542563 0
ioc::network::libos::pushto 1318 1373 576 1810190 0 1471597 0
demikernel::sgafree 8785 107 43 713617 0 713617 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11007 312 121 698880 0 688555 0
demikernel::sgaalloc 6542 144 57 673953 0 673953 0
bgc::inetstack::tcp::passiveopen::background 42 35336 14996 413016 0 353920 0
ioc::network::libos::pushto;catnip::runtime::transmit 1317 257 108 338593 0 338593 0
ioc::network::libos::close 50 5851 2354 272098 0 272098 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;udp::receive 550 289 125 143833 0 143833 0
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 21 18113 7742 59096 0 59096 0
ioc::network::libos::connect;catnip::runtime::transmit 42 6517 2621 59054 0 59054 0
ioc::network::libos::accept 39 2187 912 45937 0 45937 0
bgc::inetstack::arp::background 6 2183 886 21031 0 21031 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger;catnip::runtime::transmit 23 1259 525 19873 0 19873 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender;catnip::runtime::transmit 21 551 222 10324 0 10324 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;catnip::runtime::transmit 22 624 257 10060 0 10060 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 4 990 408 2891 0 2891 0
bgc::inetstack::icmp::background 1 2264 911 2438 0 2438 0

@iyzhang iyzhang force-pushed the enhancement-scheduler-use-task-groups branch from c060684 to 1ed0e7b Compare January 23, 2025 01:45
@github-actions GitHub Actions
Copy link

libos = catnip
commit id = 1ed0e7b

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::inetstack::poll;inetstack::layer4::poll_once;catnip::runtime::receive 6606815 208 83 1364430521 20 1364430521 45
bgc::inetstack::poll;inetstack::layer4::poll_once 6606815 366 146 2314460113 34 945087277 31
bgc::inetstack::poll 3303407 933 372 2970823965 44 656363853 22
ioc::network::libos::push 16145 1190 477 17622144 0 15447247 1
ioc::network::libos::pushto 5902 1324 564 7720801 0 6277930 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch 2404 2855 1120 5027527 0 5015482 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11059 349 139 4735254 0 4734345 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11070 310 123 2981408 0 2978562 0
bgc::inetstack::tcp::established::background 11070 1102 437 11187886 0 2771159 0
ioc::network::libos::pop 9198 401 160 2736619 0 2736619 0
ioc::network::libos::push;catnip::runtime::transmit 8763 327 131 2361317 0 2361317 0
ioc::network::libos::connect 42 37277 15220 1587086 0 1529143 0
ioc::network::libos::pushto;catnip::runtime::transmit 5901 249 106 1442871 0 1442871 0
demikernel::sgafree 9105 105 42 742160 0 742160 0
demikernel::sgaalloc 6929 131 53 697086 0 697086 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11016 320 124 700064 0 689356 0
bgc::inetstack::tcp::passiveopen::background 42 36649 14321 405894 0 346656 0
ioc::network::libos::close 50 5912 2363 279037 0 279037 0
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 21 19010 7410 59238 0 59238 0
ioc::network::libos::connect;catnip::runtime::transmit 42 6277 2472 57943 0 57943 0
ioc::network::libos::accept 38 2306 908 48865 0 48865 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;udp::receive 82 346 147 28154 0 28154 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger;catnip::runtime::transmit 16 1428 596 17710 0 17710 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;catnip::runtime::transmit 23 642 254 11470 0 11470 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender;catnip::runtime::transmit 21 578 230 10708 0 10708 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 13 838 355 6364 0 6364 0
bgc::inetstack::arp::background 2 2198 876 6122 0 6122 0
bgc::inetstack::icmp::background 1 2124 849 2211 0 2211 0

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 1ed0e7b

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::catnap::transport::epoll 13277567 3765 1560 7008604920 100 7008604920 100
ioc::network::libos::push 17600 504 210 7909578 0 7909578 0
ioc::network::libos::pop 15476 499 206 5794344 0 5794344 0
ioc::network::libos::connect 50 49889 20570 2009097 0 2009097 0
demikernel::sgaalloc 11284 128 53 1247311 0 1247311 0
demikernel::sgafree 11537 82 34 992724 0 992724 0
ioc::network::libos::pushto 1253 336 130 421819 0 421819 0
ioc::network::libos::accept 27 11805 4962 399763 0 399763 0
ioc::network::libos::close 18 23666 9774 352041 0 352041 0

@iyzhang iyzhang force-pushed the enhancement-scheduler-use-task-groups branch from 1ed0e7b to be0bd4b Compare January 23, 2025 05:58
@github-actions GitHub Actions
Copy link

libos = catnip
commit id = be0bd4b

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::inetstack::poll;inetstack::layer4::poll_once;catnip::runtime::receive 28406808 208 82 5842528348 20 5842528348 45
bgc::inetstack::poll;inetstack::layer4::poll_once 28406808 362 143 10068907374 35 4221772368 33
bgc::inetstack::poll 14203404 925 366 12912938735 45 2844031362 22
ioc::network::libos::push 16145 1235 495 17362950 0 15180236 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch 2583 2765 1086 4684736 0 4666550 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 11058 347 138 4664697 0 4663503 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 11069 318 130 2939645 0 2937281 0
bgc::inetstack::tcp::established::background 11069 1108 443 11072882 0 2772454 0
ioc::network::libos::pop 9043 403 161 2677158 0 2677158 0
ioc::network::libos::push;catnip::runtime::transmit 8763 357 144 2369804 0 2369804 0
ioc::network::libos::connect 42 34933 14103 1481636 0 1426521 0
ioc::network::libos::pushto 1223 1376 582 1687529 0 1354823 0
demikernel::sgafree 8779 114 46 706041 0 706041 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11016 319 123 696087 0 685757 0
demikernel::sgaalloc 6535 139 56 664328 0 664328 0
bgc::inetstack::tcp::passiveopen::background 42 35097 13817 439163 0 381150 0
ioc::network::libos::pushto;catnip::runtime::transmit 1223 270 114 332706 0 332706 0
ioc::network::libos::close 50 5955 2377 278830 0 278830 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;udp::receive 522 302 127 150590 0 150590 0
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 21 17594 6951 58012 0 58012 0
ioc::network::libos::connect;catnip::runtime::transmit 42 5612 2228 55115 0 55115 0
ioc::network::libos::accept 38 2171 856 46289 0 46289 0
bgc::inetstack::arp::background 7 2217 875 20584 0 20584 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger;catnip::runtime::transmit 12 1681 714 14705 0 14705 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;catnip::runtime::transmit 23 570 225 11094 0 11094 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender;catnip::runtime::transmit 21 555 219 10330 0 10330 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 13 567 234 7425 0 7425 0
bgc::inetstack::icmp::background 1 2086 826 2235 0 2235 0

@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = be0bd4b

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::inetstack::poll;inetstack::layer4::poll_once 19606664 691 276 11948719371 46 11938617824 86
bgc::inetstack::poll 9803332 1591 635 13865560545 54 1916841174 14
ioc::network::libos::push 16145 2975 1211 47536480 0 47536480 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch 6271 2395 934 10272759 0 10270269 0
ioc::network::libos::pushto 942 5651 2414 5560960 0 5560960 0
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 12042 416 165 5471944 0 5471944 0
ioc::network::libos::pop 9391 473 188 3463377 0 3463377 0
bgc::inetstack::tcp::established::background 12052 1757 687 13110628 0 3454212 0
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 12052 552 214 3220813 0 3220813 0
ioc::network::libos::connect 42 42422 17070 1652146 0 1652146 0
demikernel::sgaalloc 6532 189 77 1104768 0 1104768 0
bgc::inetstack::tcp::established::background;tcp::established::background::sender 11999 979 376 963660 0 963660 0
demikernel::sgafree 8763 129 51 790021 0 790021 0
bgc::inetstack::tcp::passiveopen::background 42 32822 13338 517736 0 517736 0
ioc::network::libos::close 47 6578 2621 298653 0 298653 0
ioc::network::libos::accept 40 2295 929 54917 0 54917 0
bgc::inetstack::poll;inetstack::layer4::poll_once;inetstack::layer4::receive_batch;udp::receive 240 230 95 48967 0 48967 0
bgc::inetstack::arp::background 7 2004 798 9961 0 9961 0
bgc::inetstack::icmp::background 1 2276 908 2387 0 2387 0

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = be0bd4b

collapsed_stack num_calls cycles_per_call nanoseconds_per_call total_duration percent_total_duration total_duration_exclusive percent_total_duration_exclusive
bgc::catnap::transport::epoll 13197641 2908 1217 6978874827 100 6978874827 100
ioc::network::libos::push 17600 492 203 7754382 0 7754382 0
ioc::network::libos::pop 15484 461 192 5684177 0 5684177 0
ioc::network::libos::connect 50 51326 21532 2051434 0 2051434 0
demikernel::sgaalloc 11283 116 48 1266153 0 1266153 0
demikernel::sgafree 11535 81 34 994270 0 994270 0
ioc::network::libos::accept 27 12699 5325 426923 0 426923 0
ioc::network::libos::pushto 1156 350 141 395622 0 395622 0
ioc::network::libos::close 18 22589 9410 345916 0 345916 0

@iyzhang iyzhang merged commit 9d7a4ae into dev Jan 23, 2025
14 checks passed
@iyzhang iyzhang deleted the enhancement-scheduler-use-task-groups branch January 23, 2025 16:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@anandbonde anandbonde anandbonde approved these changes

Assignees

@iyzhang iyzhang

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@iyzhang @anandbonde