Remove sequence_length-based heuristic for allocating ggml context #487
Job | Run time |
---|---|
28s | |
1m 15s | |
21s | |
39s | |
29s | |
49s | |
1m 24s | |
57s | |
58s | |
19s | |
1m 17s | |
0s | |
8m 56s |
Job | Run time |
---|---|
28s | |
1m 15s | |
21s | |
39s | |
29s | |
49s | |
1m 24s | |
57s | |
58s | |
19s | |
1m 17s | |
0s | |
8m 56s |