* [MAQAO] Info: Detected 1 Lprof instances in ip-172-31-18-66.
If this is incorrect, rerun with number-processes-per-node=X
[0mOMP: pid 5262 tid 5329 thread 1 bound to OS proc set {1}
OMP: pid 5262 tid 5330 thread 2 bound to OS proc set {2}
OMP: pid 5262 tid 5262 thread 0 bound to OS proc set {0}
OMP: pid 5262 tid 5333 thread 5 bound to OS proc set {5}
OMP: pid 5262 tid 5334 thread 6 bound to OS proc set {6}
OMP: pid 5262 tid 5336 thread 8 bound to OS proc set {8}
OMP: pid 5262 tid 5341 thread 13 bound to OS proc set {13}
OMP: pid 5262 tid 5335 thread 7 bound to OS proc set {7}
OMP: pid 5262 tid 5340 thread 12 bound to OS proc set {12}
OMP: pid 5262 tid 5338 thread 10 bound to OS proc set {10}
OMP: pid 5262 tid 5339 thread 11 bound to OS proc set {11}
OMP: pid 5262 tid 5343 thread 15 bound to OS proc set {15}
OMP: pid 5262 tid 5331 thread 3 bound to OS proc set {3}
OMP: pid 5262 tid 5342 thread 14 bound to OS proc set {14}
OMP: pid 5262 tid 5346 thread 18 bound to OS proc set {18}
OMP: pid 5262 tid 5345 thread 17 bound to OS proc set {17}
OMP: pid 5262 tid 5332 thread 4 bound to OS proc set {4}
OMP: pid 5262 tid 5361 thread 33 bound to OS proc set {33}
OMP: pid 5262 tid 5362 thread 34 bound to OS proc set {34}
OMP: pid 5262 tid 5337 thread 9 bound to OS proc set {9}
OMP: pid 5262 tid 5347 thread 19 bound to OS proc set {19}
OMP: pid 5262 tid 5363 thread 35 bound to OS proc set {35}
OMP: pid 5262 tid 5344 thread 16 bound to OS proc set {16}
OMP: pid 5262 tid 5360 thread 32 bound to OS proc set {32}
OMP: pid 5262 tid 5348 thread 20 bound to OS proc set {20}
OMP: pid 5262 tid 5365 thread 37 bound to OS proc set {37}
OMP: pid 5262 tid 5378 thread 50 bound to OS proc set {50}
OMP: pid 5262 tid 5350 thread 22 bound to OS proc set {22}
OMP: pid 5262 tid 5352 thread 24 bound to OS proc set {24}
OMP: pid 5262 tid 5349 thread 21 bound to OS proc set {21}
OMP: pid 5262 tid 5364 thread 36 bound to OS proc set {36}
OMP: pid 5262 tid 5366 thread 38 bound to OS proc set {38}
OMP: pid 5262 tid 5356 thread 28 bound to OS proc set {28}
OMP: pid 5262 tid 5353 thread 25 bound to OS proc set {25}
OMP: pid 5262 tid 5368 thread 40 bound to OS proc set {40}
OMP: pid 5262 tid 5377 thread 49 bound to OS proc set {49}
OMP: pid 5262 tid 5354 thread 26 bound to OS proc set {26}
OMP: pid 5262 tid 5357 thread 29 bound to OS proc set {29}
OMP: pid 5262 tid 5379 thread 51 bound to OS proc set {51}
OMP: pid 5262 tid 5351 thread 23 bound to OS proc set {23}
OMP: pid 5262 tid 5355 thread 27 bound to OS proc set {27}
OMP: pid 5262 tid 5367 thread 39 bound to OS proc set {39}
OMP: pid 5262 tid 5358 thread 30 bound to OS proc set {30}
OMP: pid 5262 tid 5376 thread 48 bound to OS proc set {48}
OMP: pid 5262 tid 5359 thread 31 bound to OS proc set {31}
OMP: pid 5262 tid 5381 thread 53 bound to OS proc set {53}
OMP: pid 5262 tid 5374 thread 46 bound to OS proc set {46}
OMP: pid 5262 tid 5386 thread 58 bound to OS proc set {58}
OMP: pid 5262 tid 5385 thread 57 bound to OS proc set {57}
OMP: pid 5262 tid 5382 thread 54 bound to OS proc set {54}
OMP: pid 5262 tid 5373 thread 45 bound to OS proc set {45}
OMP: pid 5262 tid 5370 thread 42 bound to OS proc set {42}
OMP: pid 5262 tid 5380 thread 52 bound to OS proc set {52}
OMP: pid 5262 tid 5387 thread 59 bound to OS proc set {59}
OMP: pid 5262 tid 5384 thread 56 bound to OS proc set {56}
OMP: pid 5262 tid 5375 thread 47 bound to OS proc set {47}
OMP: pid 5262 tid 5369 thread 41 bound to OS proc set {41}
OMP: pid 5262 tid 5383 thread 55 bound to OS proc set {55}
OMP: pid 5262 tid 5388 thread 60 bound to OS proc set {60}
OMP: pid 5262 tid 5389 thread 61 bound to OS proc set {61}
OMP: pid 5262 tid 5372 thread 44 bound to OS proc set {44}
OMP: pid 5262 tid 5391 thread 63 bound to OS proc set {63}
OMP: pid 5262 tid 5390 thread 62 bound to OS proc set {62}
OMP: pid 5262 tid 5371 thread 43 bound to OS proc set {43}
{"n_kv_max": 16384, "n_batch": 2048, "n_ubatch": 512, "flash_attn": -1, "is_pp_shared": 0, "n_gpu_layers": -1, "n_threads": 64, "n_threads_batch": 64, "pp": 128, "tg": 0, "pl": 16, "n_kv": 2048, "t_pp": 3.247757, "speed_pp": 630.589050, "t_tg": 0.000000, "speed_tg": nan, "t": 3.247757, "speed": 630.589050}
Your experiment path is /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-131-5415/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761315517/tools/lprof_npsu_run_0
To display your profiling results:
######################################################################################################################################################################################################################
# LEVEL | REPORT | COMMAND #
######################################################################################################################################################################################################################
# Functions | Cluster-wide | maqao lprof -df xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-131-5415/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761315517/tools/lprof_npsu_run_0 #
# Functions | Per-node | maqao lprof -df -dn xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-131-5415/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761315517/tools/lprof_npsu_run_0 #
# Functions | Per-process | maqao lprof -df -dp xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-131-5415/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761315517/tools/lprof_npsu_run_0 #
# Functions | Per-thread | maqao lprof -df -dt xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-131-5415/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761315517/tools/lprof_npsu_run_0 #
# Loops | Cluster-wide | maqao lprof -dl xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-131-5415/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761315517/tools/lprof_npsu_run_0 #
# Loops | Per-node | maqao lprof -dl -dn xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-131-5415/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761315517/tools/lprof_npsu_run_0 #
# Loops | Per-process | maqao lprof -dl -dp xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-131-5415/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761315517/tools/lprof_npsu_run_0 #
# Loops | Per-thread | maqao lprof -dl -dt xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-131-5415/llama.cpp/run/oneview_runs/defaults/orig/oneview_results_1761315517/tools/lprof_npsu_run_0 #
######################################################################################################################################################################################################################