options

Executable Output


* [MAQAO] Info: Detected 1 Lprof instances in ip-172-31-47-249.ec2.internal. 
If this is incorrect, rerun with number-processes-per-node=X
OMP: pid 23568 tid 23667 thread 1 bound to OS proc set {1}
OMP: pid 23568 tid 23668 thread 2 bound to OS proc set {2}
OMP: pid 23568 tid 23669 thread 3 bound to OS proc set {3}
OMP: pid 23568 tid 23568 thread 0 bound to OS proc set {0}
OMP: pid 23568 tid 23671 thread 5 bound to OS proc set {5}
OMP: pid 23568 tid 23670 thread 4 bound to OS proc set {4}
OMP: pid 23568 tid 23675 thread 9 bound to OS proc set {9}
OMP: pid 23568 tid 23672 thread 6 bound to OS proc set {6}
OMP: pid 23568 tid 23674 thread 8 bound to OS proc set {8}
OMP: pid 23568 tid 23676 thread 10 bound to OS proc set {10}
OMP: pid 23568 tid 23678 thread 12 bound to OS proc set {12}
OMP: pid 23568 tid 23679 thread 13 bound to OS proc set {13}
OMP: pid 23568 tid 23673 thread 7 bound to OS proc set {7}
OMP: pid 23568 tid 23677 thread 11 bound to OS proc set {11}
OMP: pid 23568 tid 23699 thread 33 bound to OS proc set {33}
OMP: pid 23568 tid 23683 thread 17 bound to OS proc set {17}
OMP: pid 23568 tid 23681 thread 15 bound to OS proc set {15}
OMP: pid 23568 tid 23685 thread 19 bound to OS proc set {19}
OMP: pid 23568 tid 23684 thread 18 bound to OS proc set {18}
OMP: pid 23568 tid 23700 thread 34 bound to OS proc set {34}
OMP: pid 23568 tid 23701 thread 35 bound to OS proc set {35}
OMP: pid 23568 tid 23682 thread 16 bound to OS proc set {16}
OMP: pid 23568 tid 23680 thread 14 bound to OS proc set {14}
OMP: pid 23568 tid 23698 thread 32 bound to OS proc set {32}
OMP: pid 23568 tid 23686 thread 20 bound to OS proc set {20}
OMP: pid 23568 tid 23687 thread 21 bound to OS proc set {21}
OMP: pid 23568 tid 23691 thread 25 bound to OS proc set {25}
OMP: pid 23568 tid 23690 thread 24 bound to OS proc set {24}
OMP: pid 23568 tid 23695 thread 29 bound to OS proc set {29}
OMP: pid 23568 tid 23692 thread 26 bound to OS proc set {26}
OMP: pid 23568 tid 23688 thread 22 bound to OS proc set {22}
OMP: pid 23568 tid 23689 thread 23 bound to OS proc set {23}
OMP: pid 23568 tid 23694 thread 28 bound to OS proc set {28}
OMP: pid 23568 tid 23707 thread 41 bound to OS proc set {41}
OMP: pid 23568 tid 23693 thread 27 bound to OS proc set {27}
OMP: pid 23568 tid 23696 thread 30 bound to OS proc set {30}
OMP: pid 23568 tid 23702 thread 36 bound to OS proc set {36}
OMP: pid 23568 tid 23706 thread 40 bound to OS proc set {40}
OMP: pid 23568 tid 23708 thread 42 bound to OS proc set {42}
OMP: pid 23568 tid 23717 thread 51 bound to OS proc set {51}
OMP: pid 23568 tid 23705 thread 39 bound to OS proc set {39}
OMP: pid 23568 tid 23733 thread 67 bound to OS proc set {67}
OMP: pid 23568 tid 23715 thread 49 bound to OS proc set {49}
OMP: pid 23568 tid 23732 thread 66 bound to OS proc set {66}
OMP: pid 23568 tid 23714 thread 48 bound to OS proc set {48}
OMP: pid 23568 tid 23716 thread 50 bound to OS proc set {50}
OMP: pid 23568 tid 23704 thread 38 bound to OS proc set {38}
OMP: pid 23568 tid 23712 thread 46 bound to OS proc set {46}
OMP: pid 23568 tid 23718 thread 52 bound to OS proc set {52}
OMP: pid 23568 tid 23719 thread 53 bound to OS proc set {53}
OMP: pid 23568 tid 23721 thread 55 bound to OS proc set {55}
OMP: pid 23568 tid 23720 thread 54 bound to OS proc set {54}
OMP: pid 23568 tid 23697 thread 31 bound to OS proc set {31}
OMP: pid 23568 tid 23731 thread 65 bound to OS proc set {65}
OMP: pid 23568 tid 23724 thread 58 bound to OS proc set {58}
OMP: pid 23568 tid 23703 thread 37 bound to OS proc set {37}
OMP: pid 23568 tid 23711 thread 45 bound to OS proc set {45}
OMP: pid 23568 tid 23710 thread 44 bound to OS proc set {44}
OMP: pid 23568 tid 23723 thread 57 bound to OS proc set {57}
OMP: pid 23568 tid 23735 thread 69 bound to OS proc set {69}
OMP: pid 23568 tid 23709 thread 43 bound to OS proc set {43}
OMP: pid 23568 tid 23727 thread 61 bound to OS proc set {61}
OMP: pid 23568 tid 23736 thread 70 bound to OS proc set {70}
OMP: pid 23568 tid 23722 thread 56 bound to OS proc set {56}
OMP: pid 23568 tid 23734 thread 68 bound to OS proc set {68}
OMP: pid 23568 tid 23740 thread 74 bound to OS proc set {74}
OMP: pid 23568 tid 23738 thread 72 bound to OS proc set {72}
OMP: pid 23568 tid 23728 thread 62 bound to OS proc set {62}
OMP: pid 23568 tid 23730 thread 64 bound to OS proc set {64}
OMP: pid 23568 tid 23739 thread 73 bound to OS proc set {73}
OMP: pid 23568 tid 23726 thread 60 bound to OS proc set {60}
OMP: pid 23568 tid 23737 thread 71 bound to OS proc set {71}
OMP: pid 23568 tid 23741 thread 75 bound to OS proc set {75}
OMP: pid 23568 tid 23742 thread 76 bound to OS proc set {76}
OMP: pid 23568 tid 23743 thread 77 bound to OS proc set {77}
OMP: pid 23568 tid 23713 thread 47 bound to OS proc set {47}
OMP: pid 23568 tid 23729 thread 63 bound to OS proc set {63}
OMP: pid 23568 tid 23725 thread 59 bound to OS proc set {59}
OMP: pid 23568 tid 23747 thread 81 bound to OS proc set {81}
OMP: pid 23568 tid 23745 thread 79 bound to OS proc set {79}
OMP: pid 23568 tid 23748 thread 82 bound to OS proc set {82}
OMP: pid 23568 tid 23750 thread 84 bound to OS proc set {84}
OMP: pid 23568 tid 23756 thread 90 bound to OS proc set {90}
OMP: pid 23568 tid 23749 thread 83 bound to OS proc set {83}
OMP: pid 23568 tid 23751 thread 85 bound to OS proc set {85}
OMP: pid 23568 tid 23754 thread 88 bound to OS proc set {88}
OMP: pid 23568 tid 23744 thread 78 bound to OS proc set {78}
OMP: pid 23568 tid 23760 thread 94 bound to OS proc set {94}
OMP: pid 23568 tid 23758 thread 92 bound to OS proc set {92}
OMP: pid 23568 tid 23757 thread 91 bound to OS proc set {91}
OMP: pid 23568 tid 23755 thread 89 bound to OS proc set {89}
OMP: pid 23568 tid 23759 thread 93 bound to OS proc set {93}
OMP: pid 23568 tid 23746 thread 80 bound to OS proc set {80}
OMP: pid 23568 tid 23753 thread 87 bound to OS proc set {87}
OMP: pid 23568 tid 23752 thread 86 bound to OS proc set {86}
OMP: pid 23568 tid 23761 thread 95 bound to OS proc set {95}
{"n_kv_max": 16384, "n_batch": 2048, "n_ubatch": 512, "flash_attn": -1, "is_pp_shared": 0, "n_gpu_layers": -1, "n_threads": 96, "n_threads_batch": 96, "pp": 128, "tg": 0, "pl": 16, "n_kv": 2048, "t_pp": 2.019469, "speed_pp": 1014.127930, "t_tg": 0.000000, "speed_tg": nan, "t": 2.019469, "speed": 1014.127930}





Your experiment path is /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-47-249.ec2.internal/176-131-3962/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761314070/tools/lprof_npsu_run_0

To display your profiling results:
####################################################################################################################################################################################################################################
#    LEVEL    |     REPORT     |                                                                                              COMMAND                                                                                              #
####################################################################################################################################################################################################################################
#  Functions  |  Cluster-wide  |  maqao lprof -df xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-47-249.ec2.internal/176-131-3962/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761314070/tools/lprof_npsu_run_0      #
#  Functions  |  Per-node      |  maqao lprof -df -dn xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-47-249.ec2.internal/176-131-3962/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761314070/tools/lprof_npsu_run_0  #
#  Functions  |  Per-process   |  maqao lprof -df -dp xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-47-249.ec2.internal/176-131-3962/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761314070/tools/lprof_npsu_run_0  #
#  Functions  |  Per-thread    |  maqao lprof -df -dt xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-47-249.ec2.internal/176-131-3962/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761314070/tools/lprof_npsu_run_0  #
#  Loops      |  Cluster-wide  |  maqao lprof -dl xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-47-249.ec2.internal/176-131-3962/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761314070/tools/lprof_npsu_run_0      #
#  Loops      |  Per-node      |  maqao lprof -dl -dn xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-47-249.ec2.internal/176-131-3962/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761314070/tools/lprof_npsu_run_0  #
#  Loops      |  Per-process   |  maqao lprof -dl -dp xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-47-249.ec2.internal/176-131-3962/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761314070/tools/lprof_npsu_run_0  #
#  Loops      |  Per-thread    |  maqao lprof -dl -dt xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-47-249.ec2.internal/176-131-3962/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761314070/tools/lprof_npsu_run_0  #
####################################################################################################################################################################################################################################

×