ggml: 42221 segmentation fault (core dumped) ./mpt

 ./mpt -m ~/.models/ggml/mpt-7b-storywriter-ggml_v2-q5_1.bin -n 1000 --repeat-penalty 2 --prompt "..."

...
With this work I do not address myself to strangers, but to those adherents of the
movement who belong to it with their hearts and whose reason now seeks a more
intimate enlightenment. I know that one is able to win people far more by the
spoken than by the written word, and that every great movement on this globe owes
its rise to the great speakers and not to the great writers. 

upSeveral times since I had turned my attention in earnest Upwards�ward������[henyl�g������� ���rs>��������������Solomon��������Ŀ�����v������������������������������������� ������ͷ���������'F���������������or���Ŀ���� �����olidated����ı�����*�(F/����veķ2-��� ǵ������������E õ��������~�Ĺ����K�84��������Ŀ���������}}{(��íĵĵ��������Ŀentieth���/���±��[1]    42221 segmentation fault (core dumped)  ./mpt -m ~/.models/ggml/mpt-7b-storywriter-ggml_v2-q5_1.bin --prompt  -n 1000

About this issue

Original URL
State: closed
Created a year ago
Comments: 18 (11 by maintainers)

Commits related to this issue

Update issue template so people will use it (#404) — committed to CCLDArjun/ggml by gjmulder a year ago

Most upvoted comments

while (n_past < params.n_ctx && n_sampled < params.n_predict)

Maybe better to restrict n_predict instead. Something like:

if ( n_predict + n_prompt_tokens > n_ctx) {
    n_predict = n_ctx - n_prompt_tokens;
}

klosax on Jul 22, 2023