Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DemiBuffer] Implement prepend #1367

Merged
merged 1 commit into from
Aug 8, 2024
Merged

[DemiBuffer] Implement prepend #1367

merged 1 commit into from
Aug 8, 2024

Conversation

iyzhang
Copy link
Contributor

@iyzhang iyzhang commented Aug 7, 2024

This PR implements a prepend function for both DPDK and heap allocated buffers. It allocates some headroom when allocating DemiBuffers so that we can use it later for packet headers.

@iyzhang iyzhang requested a review from ppenna August 7, 2024 22:12
@iyzhang iyzhang self-assigned this Aug 7, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 7, 2024

libos = catpowder
commit id = b40482a

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 3744637.35 910.97 402.75 77.55
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 3744637.35 62.61 28.00 4.54
bgc::inetstack::poll_recv 3739686.95 1241.64 549.87 64.01
bgc::inetstack::tcp::established::background 19478.82 4145.27 1822.40 6.47
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 19478.82 1494.88 639.92 31.53
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 19460.59 1171.67 525.82 26.30
bgc::inetstack::tcp::established::background;tcp::established::background::sender 19460.59 805.46 357.69 19.28
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 19460.59 330.68 148.60 7.66
ioc::network::libos::pop 11731.08 982.62 441.68 1.11
ioc::network::libos::push;inetstack::push 8791.37 5911.20 2698.51 88.56
ioc::network::libos::push 8100.05 6168.10 2814.39 3.56
demikernel::push 8100.05 597.81 269.54 0.30
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive 6745.66 755.15 332.16 15.82
demikernel::sgaalloc 6541.71 124.18 56.10 0.10
demikernel::sgafree 6264.24 79.17 35.40 0.04
demikernel::pop 6056.20 456.92 201.77 0.15
ioc::network::libos::pushto 662.00 5903.83 2532.81 3.16
ioc::network::libos::pushto;inetstack::push 662.00 5209.49 2235.74 88.41
demikernel::pushto 662.00 611.94 261.77 0.35
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive;udp::receive 220.67 466.22 207.87 60.91
bgc::passive_listening::poll 62.54 4746.32 2111.19 0.00
ioc::network::libos::close 46.32 10444.91 4618.65 0.18
ioc::network::libos::connect 41.86 22834.85 10290.58 0.28
bgc::inetstack::tcp::passiveopen::background 41.86 12523.87 5602.96 0.01
ioc::network::libos::accept 38.57 2505.30 1119.66 0.00
demikernel::async_close 32.50 663.53 278.18 0.01
demikernel::accept 21.86 1199.70 532.13 0.00
demikernel::connect 20.93 2988.47 1363.96 0.01
demikernel::socket 10.30 1877.85 841.51 0.00
bgc::inetstack::arp::background 2.50 2412.18 1062.48 0.00
bgc::inetstack::icmp::background 1.02 3058.28 1342.96 0.00
demikernel::new 1.00 94575087.48 41540563.38 25.87
bgc::inetstack::poll_recv;inetstack::poll 1.00 9845.30 4360.78 0.04
demikernel::bind 1.00 9510.00 4168.18 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 1.00 7416.17 3290.10 74.67
demikernel::listen 1.00 5236.57 2325.98 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 1.00 344.20 152.14 3.64
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 7, 2024

libos = catnip
commit id = b40482a

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 6022747.07 301.95 125.84 55.81
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive;catnip::runtime::receive 6022747.07 198.49 82.75 65.69
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 6022747.07 52.45 22.19 8.86
bgc::inetstack::poll_recv 6017740.90 564.70 235.95 36.67
bgc::inetstack::tcp::established::background 18447.21 3314.02 1376.08 2.68
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 18447.21 863.34 353.55 28.29
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 18426.30 1104.77 462.13 26.36
bgc::inetstack::tcp::established::background;tcp::established::background::sender 18426.30 757.81 315.15 19.93
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 18426.30 320.64 134.14 8.20
ioc::network::libos::pop 12233.80 914.00 383.43 0.53
ioc::network::libos::push;inetstack::push 8791.71 1568.37 666.54 70.03
ioc::network::libos::push;inetstack::push;catnip::runtime::transmit 8791.71 800.29 340.09 50.15
ioc::network::libos::push 8100.39 2078.78 882.80 0.49
demikernel::push 8100.39 681.40 289.02 0.14
ioc::network::libos::pushto 7773.33 1298.95 578.91 0.27
ioc::network::libos::pushto;inetstack::push 7773.33 608.26 271.28 46.73
demikernel::pushto 7773.33 418.16 186.39 0.09
ioc::network::libos::pushto;inetstack::push;catnip::runtime::transmit 7773.33 346.64 154.53 57.27
demikernel::sgaalloc 6987.79 142.77 60.88 0.05
demikernel::sgafree 6691.18 67.27 28.20 0.01
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive 6402.68 874.67 362.54 12.31
demikernel::pop 6265.20 467.76 194.48 0.06
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive;udp::receive 3799.67 428.69 185.06 56.60
bgc::inetstack::tcp::established::background;tcp::established::background::receiver;catnip::runtime::transmit 1769.58 1111.74 464.19 7.97
bgc::passive_listening::poll 58.89 5856.11 2482.17 0.00
ioc::network::libos::close 49.43 7607.91 3188.03 0.01
bgc::inetstack::tcp::passiveopen::background 41.86 15713.42 6686.39 0.00
ioc::network::libos::connect 41.86 14871.27 6272.63 0.01
ioc::network::libos::connect;catnip::runtime::transmit 41.86 6642.29 2811.57 31.40
ioc::network::libos::accept 38.57 2512.86 1058.15 0.00
demikernel::async_close 32.50 596.44 237.59 0.00
ioc::network::libos::close;catnip::runtime::transmit 31.41 823.26 344.38 8.78
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 26.20 753.99 311.72 0.01
demikernel::accept 21.86 1200.21 504.24 0.00
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 20.93 21325.18 9128.21 46.67
demikernel::connect 20.93 3974.47 1681.75 0.00
demikernel::socket 10.30 1196.04 500.27 0.00
bgc::inetstack::arp::background 2.63 2501.22 1038.78 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 2.00 18958.18 7902.74 86.49
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive;catnip::runtime::receive 2.00 18506.67 7714.36 97.59
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 2.00 1624.37 673.86 7.44
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for;inetstack::receive 1.35 1735.55 721.53 64.99
bgc::inetstack::icmp::background 1.02 3166.57 1319.18 0.00
demikernel::new 1.00 1810554948.70 754021117.70 59.85
bgc::inetstack::poll_recv;inetstack::poll 1.00 43803.20 18252.29 0.21
demikernel::bind 1.00 22611.50 9115.55 0.00
demikernel::listen 1.00 4060.21 1686.42 0.00
bgc::passive_listening::poll;catnip::runtime::transmit 1.00 564.00 215.02 0.18
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 7, 2024

libos = catnap
commit id = b40482a

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::catnap::transport::epoll 5634808.31 2311.54 1045.55 33.50
demikernel::sgaalloc 11305.68 258.80 116.35 0.24
ioc::network::libos::push;catnap::linux::transport::push 9076.34 825.98 376.24 4.98
ioc::network::libos::push 8810.42 17759.22 8111.44 6.90
demikernel::push 8810.42 570.77 258.62 0.19
ioc::network::libos::pop;catnap::linux::transport::pop 8024.57 570.07 256.39 2.17
demikernel::sgafree 7919.85 83.01 37.30 0.04
ioc::network::libos::pop 7816.08 4296695.92 1831227.22 26.84
demikernel::pop 7816.08 550.64 244.86 0.11
ioc::network::libos::pushto 522.00 8600.52 3673.98 22.92
ioc::network::libos::pushto;catnap::linux::transport::push 522.00 680.01 288.38 7.89
demikernel::pushto 522.00 475.90 203.10 1.28
demikernel::async_close 32.50 832.69 346.18 0.02
ioc::network::libos::connect 24.95 3223682.31 1426435.23 22.01
ioc::network::libos::connect;catnap::linux::transport::connect 24.95 54899.45 24851.00 2.56
demikernel::connect 24.95 2322.31 1049.57 0.01
ioc::network::libos::close 18.35 23742.21 10636.01 0.08
ioc::network::libos::close;catnap::linux::transport::close 18.35 22728.27 10182.05 96.01
demikernel::accept 15.42 1468.49 661.23 0.00
ioc::network::libos::accept 15.39 888915696.99 399086310.12 43.01
ioc::network::libos::accept;catnap::linux::transport::accept 15.39 3148.22 1428.51 0.00
demikernel::socket 9.50 59535.54 26776.69 0.10
demikernel::socket;catnap::linux::transport::socket 9.50 58497.88 26310.21 98.14
demikernel::new 1.00 1625309.85 728316.39 0.61
demikernel::bind 1.00 31495.08 14150.91 0.01
demikernel::bind;catnap::linux::transport::bind 1.00 25828.50 11623.15 82.28
demikernel::listen 1.00 14265.97 6424.13 0.00
demikernel::listen;catnap::linux::transport::listen 1.00 13174.50 5934.16 92.29
demikernel::close 0.00 nan nan 0.00

@ppenna ppenna force-pushed the enhancement-demibuffer-implement-prepend branch from b40482a to 637868c Compare August 8, 2024 15:48
@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 8, 2024

libos = catpowder
commit id = 637868c

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 3608923.88 903.24 400.50 77.77
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 3608923.88 63.47 28.50 4.52
bgc::inetstack::poll_recv 3603686.60 1237.15 549.58 64.51
bgc::inetstack::tcp::established::background 20531.88 4161.54 1836.37 6.67
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 20531.88 1504.08 642.52 31.64
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 20513.57 1182.56 534.39 26.20
bgc::inetstack::tcp::established::background;tcp::established::background::sender 20513.57 808.89 361.93 19.58
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 20513.57 330.85 149.56 7.55
ioc::network::libos::pop 11863.10 994.51 449.71 1.17
ioc::network::libos::push;inetstack::push 8791.71 5816.65 2702.20 87.68
ioc::network::libos::push 8100.39 6131.14 2846.83 3.52
demikernel::push 8100.39 656.52 301.27 0.29
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive 7242.17 724.75 319.47 14.77
demikernel::sgaalloc 6548.12 134.60 61.11 0.12
demikernel::sgafree 6267.88 73.16 32.49 0.04
demikernel::pop 6056.39 480.62 211.57 0.15
ioc::network::libos::pushto 718.33 4773.23 1922.63 2.62
ioc::network::libos::pushto;inetstack::push 718.33 4255.71 1714.17 89.16
demikernel::pushto 718.33 463.27 186.58 0.25
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive;udp::receive 263.00 460.99 194.10 59.42
bgc::passive_listening::poll 62.39 5131.82 2333.89 0.00
ioc::network::libos::close 46.60 10642.38 4692.82 0.18
ioc::network::libos::connect 41.86 22610.58 10285.71 0.23
bgc::inetstack::tcp::passiveopen::background 41.86 12354.77 5608.87 0.01
ioc::network::libos::accept 38.32 2610.90 1183.46 0.00
demikernel::async_close 32.50 648.09 261.62 0.01
demikernel::accept 21.86 1144.00 515.12 0.00
demikernel::connect 20.93 4825.31 2220.75 0.01
demikernel::socket 10.30 1325.11 583.07 0.00
bgc::inetstack::arp::background 2.37 2329.98 1023.17 0.00
bgc::inetstack::icmp::background 1.02 3135.48 1375.97 0.00
demikernel::new 1.00 91867475.25 40500566.95 25.20
bgc::inetstack::poll_recv;inetstack::poll 1.00 10206.20 4541.67 0.03
demikernel::bind 1.00 9268.50 4100.28 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 1.00 7654.77 3414.18 74.33
demikernel::listen 1.00 4386.36 1957.75 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 1.00 400.80 177.02 4.01
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 8, 2024

libos = catnap
commit id = 637868c

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::catnap::transport::epoll 5671379.65 2292.48 1039.26 34.04
demikernel::sgaalloc 11307.28 269.09 121.75 0.25
ioc::network::libos::push;catnap::linux::transport::push 9076.32 824.13 377.86 4.95
ioc::network::libos::push 8810.41 17583.59 8047.27 7.15
demikernel::push 8810.41 537.01 244.21 0.18
ioc::network::libos::pop;catnap::linux::transport::pop 8024.23 554.41 249.51 3.75
demikernel::sgafree 7919.80 76.91 34.54 0.04
ioc::network::libos::pop 7815.75 3989565.58 1712570.64 25.30
demikernel::pop 7815.75 574.13 255.37 0.12
ioc::network::libos::pushto 559.00 8529.80 3606.60 22.86
ioc::network::libos::pushto;catnap::linux::transport::push 559.00 870.80 365.36 9.92
demikernel::pushto 559.00 435.29 184.11 1.18
demikernel::async_close 32.50 952.73 390.39 0.01
ioc::network::libos::connect 24.95 4100331.51 1847060.97 24.03
ioc::network::libos::connect;catnap::linux::transport::connect 24.95 56465.06 25722.43 2.24
demikernel::connect 24.95 2335.34 1064.14 0.01
ioc::network::libos::close 18.35 23043.70 10394.02 0.06
ioc::network::libos::close;catnap::linux::transport::close 18.35 22012.04 9924.36 95.82
demikernel::accept 15.42 1349.81 617.32 0.00
ioc::network::libos::accept 15.41 885075547.41 413538087.65 43.14
ioc::network::libos::accept;catnap::linux::transport::accept 15.39 2861.62 1306.11 0.00
demikernel::socket 9.50 57349.99 25964.82 0.09
demikernel::socket;catnap::linux::transport::socket 9.50 56183.37 25436.82 97.89
demikernel::new 1.00 1632843.29 734467.89 0.54
demikernel::bind 1.00 29590.90 13387.10 0.01
demikernel::bind;catnap::linux::transport::bind 1.00 24172.95 10936.33 81.69
demikernel::listen 1.00 13962.39 6305.05 0.00
demikernel::listen;catnap::linux::transport::listen 1.00 12913.13 5831.61 92.34
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 8, 2024

libos = catnip
commit id = 637868c

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 5974035.23 301.66 127.33 55.53
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive;catnip::runtime::receive 5974035.23 197.74 83.47 65.50
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 5974035.23 53.74 22.79 9.01
bgc::inetstack::poll_recv 5969090.92 568.14 240.07 36.22
bgc::inetstack::tcp::established::background 18158.96 3357.25 1438.81 2.68
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 18158.96 892.31 373.31 28.37
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 18138.04 1113.73 485.50 26.43
bgc::inetstack::tcp::established::background;tcp::established::background::sender 18138.04 761.03 326.62 19.92
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 18138.04 328.19 142.29 8.29
ioc::network::libos::pop 12048.51 897.15 389.48 0.52
ioc::network::libos::push;inetstack::push 8791.71 1547.28 673.52 71.32
ioc::network::libos::push;inetstack::push;catnip::runtime::transmit 8791.71 799.46 346.30 50.74
ioc::network::libos::push 8100.39 2014.16 876.52 0.48
demikernel::push 8100.39 673.89 287.92 0.14
demikernel::sgaalloc 6630.79 133.14 56.10 0.05
demikernel::sgafree 6329.44 68.58 29.12 0.01
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive 6103.71 879.41 371.34 13.23
demikernel::pop 6077.90 447.03 189.22 0.06
ioc::network::libos::pushto 1744.33 1278.55 545.35 0.08
ioc::network::libos::pushto;inetstack::push 1744.33 581.10 248.08 45.52
demikernel::pushto 1744.33 411.09 175.91 0.03
ioc::network::libos::pushto;inetstack::push;catnip::runtime::transmit 1744.33 367.45 156.80 63.19
bgc::inetstack::tcp::established::background;tcp::established::background::receiver;catnip::runtime::transmit 1507.68 1145.44 492.83 7.42
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive;udp::receive 632.00 367.02 152.81 56.80
bgc::passive_listening::poll 59.21 5972.41 2565.27 0.00
ioc::network::libos::close 49.53 7634.89 3194.77 0.02
bgc::inetstack::tcp::passiveopen::background 41.86 15247.41 6533.32 0.00
ioc::network::libos::connect 41.86 14763.50 6159.01 0.01
ioc::network::libos::connect;catnip::runtime::transmit 41.86 5882.03 2455.44 29.60
ioc::network::libos::accept 38.32 2554.50 1100.05 0.00
demikernel::async_close 32.50 616.90 243.55 0.00
ioc::network::libos::close;catnip::runtime::transmit 31.41 854.76 361.19 8.74
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 24.00 793.08 365.65 0.01
demikernel::accept 21.86 1435.28 616.08 0.00
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 20.93 20236.96 8598.17 45.41
demikernel::connect 20.93 3832.68 1585.20 0.00
demikernel::socket 10.30 1321.98 556.35 0.00
bgc::inetstack::arp::background 2.62 2601.06 1107.37 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 2.00 18773.32 7949.01 86.83
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive;catnip::runtime::receive 2.00 18270.77 7736.42 97.31
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 2.00 1525.60 644.01 7.07
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for;inetstack::receive 1.35 1607.94 678.36 64.46
bgc::inetstack::icmp::background 1.02 3117.17 1313.89 0.00
demikernel::new 1.00 1815107030.43 766014698.30 60.33
bgc::inetstack::poll_recv;inetstack::poll 1.00 43216.53 18288.64 0.25
demikernel::bind 1.00 22429.69 9210.90 0.00
demikernel::listen 1.00 7008.79 3036.06 0.00
bgc::passive_listening::poll;catnip::runtime::transmit 1.00 580.00 294.46 0.18
demikernel::close 0.00 nan nan 0.00

@iyzhang iyzhang force-pushed the enhancement-demibuffer-implement-prepend branch from 637868c to 7dc72a5 Compare August 8, 2024 17:27
@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 8, 2024

libos = catnip
commit id = 7dc72a5

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 5861072.73 298.56 125.60 55.36
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive;catnip::runtime::receive 5861072.73 197.94 83.29 66.25
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 5861072.73 53.32 22.60 9.03
bgc::inetstack::poll_recv 5856452.95 563.13 237.24 36.26
bgc::inetstack::tcp::established::background 17305.66 3260.10 1373.83 2.59
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 17305.66 839.81 346.55 28.35
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 17284.75 1088.36 463.89 26.24
bgc::inetstack::tcp::established::background;tcp::established::background::sender 17284.75 753.09 318.03 20.01
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 17284.75 320.63 136.42 8.26
ioc::network::libos::pop 12152.94 883.12 377.08 0.53
ioc::network::libos::push;inetstack::push 8791.77 1546.11 668.12 70.47
ioc::network::libos::push;inetstack::push;catnip::runtime::transmit 8791.77 780.52 338.58 49.65
ioc::network::libos::push 8100.42 2041.46 881.33 0.50
demikernel::push 8100.42 690.66 296.26 0.15
demikernel::sgaalloc 6790.67 135.36 57.74 0.05
demikernel::sgafree 6498.70 66.65 28.24 0.01
demikernel::pop 6169.43 454.84 191.25 0.06
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive 5781.92 859.89 359.90 12.81
ioc::network::libos::pushto 4565.00 1283.64 575.50 0.17
ioc::network::libos::pushto;inetstack::push 4565.00 591.22 265.04 46.06
demikernel::pushto 4565.00 450.03 201.73 0.06
ioc::network::libos::pushto;inetstack::push;catnip::runtime::transmit 4565.00 360.93 161.78 60.84
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive;udp::receive 2136.00 421.62 187.73 58.21
bgc::inetstack::tcp::established::background;tcp::established::background::receiver;catnip::runtime::transmit 775.23 1127.68 476.51 8.14
bgc::passive_listening::poll 58.82 6059.15 2579.85 0.00
ioc::network::libos::close 49.40 7373.97 3102.18 0.01
bgc::inetstack::tcp::passiveopen::background 41.86 15601.93 6707.31 0.00
ioc::network::libos::connect 41.86 14683.39 6210.63 0.01
ioc::network::libos::connect;catnip::runtime::transmit 41.86 6570.16 2779.90 31.76
ioc::network::libos::accept 38.64 2505.06 1067.37 0.00
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 33.67 764.71 331.94 0.01
demikernel::async_close 32.50 599.45 239.39 0.00
ioc::network::libos::close;catnip::runtime::transmit 31.41 816.37 343.76 8.78
demikernel::accept 21.86 1262.32 538.30 0.00
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 20.93 21087.17 9090.15 45.59
demikernel::connect 20.93 3934.50 1647.37 0.00
demikernel::socket 10.30 1508.75 644.94 0.00
bgc::inetstack::arp::background 2.63 2426.88 1021.36 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 2.00 19019.98 8020.74 86.65
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive;catnip::runtime::receive 2.00 18516.80 7809.10 97.33
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 2.00 1556.32 655.42 7.11
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for;inetstack::receive 1.37 1667.27 701.43 66.67
bgc::inetstack::icmp::background 1.02 3183.60 1337.26 0.00
demikernel::new 1.00 1811702025.57 761995385.47 60.35
bgc::inetstack::poll_recv;inetstack::poll 1.00 43862.10 18491.98 0.22
demikernel::bind 1.00 24147.31 9987.22 0.00
demikernel::listen 1.00 5363.86 2256.79 0.00
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 8, 2024

libos = catpowder
commit id = 7dc72a5

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 5991084.42 904.43 401.51 77.59
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 5991084.42 62.71 28.19 4.43
bgc::inetstack::poll_recv 5985957.32 1243.61 553.26 65.69
bgc::inetstack::tcp::established::background 20665.21 4371.64 1915.46 6.55
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 20665.21 1649.24 701.88 31.56
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 20647.07 1180.19 528.69 26.24
bgc::inetstack::tcp::established::background;tcp::established::background::sender 20647.07 821.23 365.82 19.52
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 20647.07 332.83 148.87 7.48
ioc::network::libos::pop 11240.31 967.00 430.42 1.00
ioc::network::libos::push;inetstack::push 8791.77 5824.12 2685.03 88.47
ioc::network::libos::push 8100.42 6087.10 2804.15 3.44
demikernel::push 8100.42 560.36 255.17 0.28
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive 7294.76 739.50 326.09 14.34
demikernel::sgaalloc 6579.46 132.41 60.50 0.10
demikernel::sgafree 6278.06 73.04 32.59 0.04
demikernel::pop 6052.82 482.27 211.33 0.16
ioc::network::libos::pushto 1062.33 4862.73 2015.57 5.28
ioc::network::libos::pushto;inetstack::push 1062.33 4352.84 1804.29 89.51
demikernel::pushto 1062.33 459.13 190.19 0.49
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive;udp::receive 314.67 348.89 144.07 57.37
bgc::passive_listening::poll 62.46 5204.28 2319.29 0.00
ioc::network::libos::close 47.97 12390.56 5532.88 0.17
ioc::network::libos::connect 41.86 23504.74 10839.88 0.26
bgc::inetstack::tcp::passiveopen::background 41.86 12723.31 5680.48 0.01
ioc::network::libos::accept 38.00 2770.99 1232.90 0.00
demikernel::async_close 32.50 743.87 314.40 0.01
demikernel::accept 21.86 1279.91 568.45 0.00
demikernel::connect 20.93 3555.66 1650.12 0.01
demikernel::socket 10.30 1733.29 777.76 0.00
bgc::inetstack::arp::background 3.43 2435.11 1070.75 0.00
bgc::inetstack::icmp::background 1.05 3172.43 1399.28 0.00
demikernel::new 1.00 94624715.95 41907902.78 24.18
demikernel::bind 1.00 11564.31 4976.01 0.00
bgc::inetstack::poll_recv;inetstack::poll 1.00 10949.10 4860.68 0.04
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 1.00 8392.70 3728.66 75.78
demikernel::listen 1.00 5818.43 2558.31 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 1.00 388.93 173.30 3.66
demikernel::close 0.00 nan nan 0.00

@iyzhang iyzhang force-pushed the enhancement-demibuffer-implement-prepend branch from 7dc72a5 to 1714d9a Compare August 8, 2024 19:38
@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 8, 2024

libos = catpowder
commit id = 1714d9a

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 3660701.65 924.62 415.20 77.46
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 3660701.65 67.27 30.48 4.55
bgc::inetstack::poll_recv 3655428.35 1285.28 577.76 65.12
bgc::inetstack::tcp::established::background 20974.70 4209.29 1877.92 6.68
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 20974.70 1495.57 645.00 31.72
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 20955.64 1163.14 532.23 25.31
bgc::inetstack::tcp::established::background;tcp::established::background::sender 20955.64 883.68 397.80 20.22
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 20955.64 341.39 155.93 7.66
ioc::network::libos::pop 10947.37 1114.12 503.04 0.93
ioc::network::libos::push;inetstack::push 8791.77 5924.91 2778.43 88.35
ioc::network::libos::push 8100.42 6196.29 2904.58 3.59
demikernel::push 8100.42 610.74 280.91 0.29
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive 7434.37 753.75 336.31 15.57
demikernel::sgaalloc 6543.12 135.59 61.14 0.10
demikernel::sgafree 6265.50 79.29 35.79 0.04
demikernel::pop 6056.84 504.52 225.22 0.16
ioc::network::libos::pushto 678.33 4872.59 2132.13 2.36
ioc::network::libos::pushto;inetstack::push 678.33 4363.41 1909.20 89.55
demikernel::pushto 678.33 458.62 200.56 0.22
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive;udp::receive 222.67 338.45 150.25 57.16
bgc::passive_listening::poll 62.46 5043.23 2333.65 0.00
ioc::network::libos::close 47.43 10294.61 4583.67 0.16
ioc::network::libos::connect 41.86 24372.08 11014.72 0.23
bgc::inetstack::tcp::passiveopen::background 41.86 11926.69 5575.64 0.01
ioc::network::libos::accept 38.11 2531.17 1174.21 0.00
demikernel::async_close 32.50 645.43 265.04 0.01
demikernel::accept 21.86 1262.04 581.20 0.00
demikernel::connect 20.93 3264.63 1499.53 0.01
demikernel::socket 10.30 1490.52 659.79 0.00
bgc::inetstack::arp::background 2.47 2395.90 1076.84 0.00
bgc::inetstack::icmp::background 1.02 3117.90 1393.34 0.00
demikernel::new 1.00 94037933.30 42106757.26 24.77
bgc::inetstack::poll_recv;inetstack::poll 1.00 10212.40 4599.97 0.04
demikernel::bind 1.00 9222.25 4179.71 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 1.00 7671.73 3459.09 74.43
demikernel::listen 1.00 4821.86 2225.41 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 1.00 321.60 143.75 3.25
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 8, 2024

libos = catnap
commit id = 1714d9a

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::catnap::transport::epoll 5652576.97 2202.45 990.42 33.53
demikernel::sgaalloc 11307.12 255.69 115.98 0.21
ioc::network::libos::push;catnap::linux::transport::push 9076.36 783.35 355.31 4.80
ioc::network::libos::push 8810.43 17501.24 7918.27 6.56
demikernel::push 8810.43 528.69 237.18 0.16
ioc::network::libos::pop;catnap::linux::transport::pop 8025.23 532.32 236.68 2.55
demikernel::sgafree 7920.67 75.69 33.70 0.04
ioc::network::libos::pop 7816.72 3612590.64 1580143.13 26.52
demikernel::pop 7816.72 532.79 236.05 0.11
ioc::network::libos::pushto 568.67 8063.40 3514.42 22.78
ioc::network::libos::pushto;catnap::linux::transport::push 568.67 538.70 234.90 6.69
demikernel::pushto 568.67 425.38 185.29 1.20
demikernel::async_close 32.50 920.92 383.37 0.02
ioc::network::libos::connect 24.95 4190008.81 1890825.96 23.26
ioc::network::libos::connect;catnap::linux::transport::connect 24.95 57042.99 25943.85 2.28
demikernel::connect 24.95 2094.98 954.12 0.01
ioc::network::libos::close 18.35 23766.85 10574.04 0.07
ioc::network::libos::close;catnap::linux::transport::close 18.35 22731.00 10110.20 95.91
demikernel::accept 15.42 1563.88 694.87 0.00
ioc::network::libos::accept 15.39 904079354.74 404929847.29 43.31
ioc::network::libos::accept;catnap::linux::transport::accept 15.39 3132.73 1398.09 0.00
demikernel::socket 9.50 59604.29 26583.05 0.10
demikernel::socket;catnap::linux::transport::socket 9.50 58510.09 26096.01 98.06
demikernel::new 1.00 1623919.45 722120.04 0.60
demikernel::bind 1.00 30794.62 13690.28 0.01
demikernel::bind;catnap::linux::transport::bind 1.00 25101.02 11158.87 81.62
demikernel::listen 1.00 15308.92 6792.78 0.00
demikernel::listen;catnap::linux::transport::listen 1.00 13915.26 6189.52 91.55
demikernel::close 0.00 nan nan 0.00

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 8, 2024

libos = catnip
commit id = 1714d9a

collapsed_stack num_calls cycles_per_call nanoseconds_per_call percent_time
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 5926070.23 300.11 127.04 55.24
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive;catnip::runtime::receive 5926070.23 198.67 84.14 66.15
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 5926070.23 54.00 23.07 8.99
bgc::inetstack::poll_recv 5921238.65 568.26 241.09 36.07
bgc::inetstack::tcp::established::background 18459.05 3252.77 1385.54 2.65
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 18459.05 847.84 352.95 28.32
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 18438.14 1079.82 465.97 26.30
bgc::inetstack::tcp::established::background;tcp::established::background::sender 18438.14 747.77 318.93 20.00
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 18438.14 318.43 137.01 8.26
ioc::network::libos::pop 12052.45 882.26 381.31 0.51
ioc::network::libos::push;inetstack::push 8791.77 1563.75 683.53 70.72
ioc::network::libos::push;inetstack::push;catnip::runtime::transmit 8791.77 803.73 350.91 50.46
ioc::network::libos::push 8100.42 2055.50 897.85 0.50
demikernel::push 8100.42 659.39 284.39 0.14
demikernel::sgaalloc 6783.96 135.58 58.25 0.05
demikernel::sgafree 6456.48 67.68 28.85 0.01
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive 6289.31 865.34 365.21 12.91
demikernel::pop 6130.67 463.38 196.15 0.06
ioc::network::libos::pushto 3861.33 1258.45 565.61 0.16
ioc::network::libos::pushto;inetstack::push 3861.33 563.48 253.18 44.86
demikernel::pushto 3861.33 414.43 186.21 0.06
ioc::network::libos::pushto;inetstack::push;catnip::runtime::transmit 3861.33 350.80 157.60 62.14
bgc::inetstack::tcp::established::background;tcp::established::background::receiver;catnip::runtime::transmit 1777.42 1063.03 455.29 8.28
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;inetstack::receive;udp::receive 1483.67 372.56 165.26 55.98
bgc::passive_listening::poll 59.64 5661.82 2426.57 0.00
ioc::network::libos::close 49.42 7430.13 3143.25 0.01
ioc::network::libos::connect 41.86 16738.91 7173.06 0.01
bgc::inetstack::tcp::passiveopen::background 41.86 15461.99 6648.70 0.00
ioc::network::libos::connect;catnip::runtime::transmit 41.86 6678.48 2865.71 31.26
ioc::network::libos::accept 38.89 2587.69 1110.16 0.00
demikernel::async_close 32.50 656.74 264.25 0.00
ioc::network::libos::close;catnip::runtime::transmit 31.41 885.86 375.75 9.21
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter;catnip::runtime::transmit 31.20 718.93 339.47 0.01
demikernel::accept 21.86 1263.06 541.51 0.00
bgc::inetstack::tcp::passiveopen::background;catnip::runtime::transmit 20.93 21004.91 9003.29 46.52
demikernel::connect 20.93 5157.66 2206.97 0.00
demikernel::socket 10.30 1496.98 642.44 0.00
bgc::inetstack::arp::background 2.63 2519.79 1068.91 0.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 2.00 19765.03 8379.22 86.99
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive;catnip::runtime::receive 2.00 19242.68 8157.65 97.25
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 2.00 1478.42 628.79 6.67
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for;inetstack::receive 1.32 1677.30 707.78 67.72
bgc::inetstack::icmp::background 1.02 3136.08 1324.88 0.00
demikernel::new 1.00 1816769629.18 769058694.60 60.50
bgc::inetstack::poll_recv;inetstack::poll 1.00 45261.83 19186.84 0.19
demikernel::bind 1.00 27497.06 11339.32 0.00
demikernel::listen 1.00 3918.86 1659.31 0.00
bgc::passive_listening::poll;catnip::runtime::transmit 1.00 700.00 319.75 0.21
demikernel::close 0.00 nan nan 0.00

ppenna
ppenna approved these changes Aug 8, 2024
View reviewed changes
Copy link
Collaborator

@ppenna ppenna left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ppenna ppenna merged commit fcf17f6 into dev Aug 8, 2024
20 checks passed
@ppenna ppenna deleted the enhancement-demibuffer-implement-prepend branch August 8, 2024 20:03
@ppenna ppenna added the enhancement Enhancement Request on an Existing Feature label Aug 9, 2024
This was referenced Aug 10, 2024
Merged
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ppenna ppenna ppenna approved these changes

Assignees

@iyzhang iyzhang

Labels
enhancement Enhancement Request on an Existing Feature
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@iyzhang @ppenna