Allow sequence lengths of up to 64 out of the box by forking ggml #439
Job | Run time |
---|---|
1m 3s | |
31s | |
1m 40s | |
24s | |
1m 52s | |
49s | |
1m 53s | |
34s | |
45s | |
25s | |
59s | |
0s | |
10m 55s |
Job | Run time |
---|---|
1m 3s | |
31s | |
1m 40s | |
24s | |
1m 52s | |
49s | |
1m 53s | |
34s | |
45s | |
25s | |
59s | |
0s | |
10m 55s |