Markdown files cannot be edited

[a96219]

• Gitea version (or commit ref): docker 1.15.0+dev-327-gc636ef8f1

• Git version:

• Operating system: centos 7

• Database (use [x]):

  • PostgreSQL

• Can you reproduce the bug at https://try.gitea.io:

  • try.gitea.io/FreeSaltedFish/test

[a96219]

[a96219]

Click Edit to stay stuck in this interface

[silverwind]

Check the browser console for any errors.

[a96219]

检查浏览器控制台是否有任何错误。

Check the browser console for any errors.

I didn't see any errors
This project can reproduce the problem: https://try.gitea.io/FreeSaltedFish/test

[silverwind]

Works fine for me when I edit one of the files I can access. Might be a browser cache problem of you had visited before, try clearing it or CTRL-F5 a few times.

[a96219]

Works fine for me when I edit one of the files I can access. Might be a browser cache problem of you had visited before, try clearing it or CTRL-F5 a few times.

This is not true for all files, but only for some.
Can you edit the md document in my link above?

[a96219]

Works fine for me when I edit one of the files I can access. Might be a browser cache problem of you had visited before, try clearing it or CTRL-F5 a few times.

When I delete parts of the file, I can open the edit page again

[silverwind]

I forked your repo and indeed that seems to be some issue with the GET https://try.gitea.io/silverwind/testedit/_edit/master/test.md request hanging, seems like a backend bug.

[a96219]

I forked your repo and indeed that seems to be some issue with the GET https://try.gitea.io/silverwind/testedit/_edit/master/test.md request hanging, seems like a backend bug.

I updated my repo:https://try.gitea.io/FreeSaltedFish/test

Test1.md is only one line more than test2.md.
but Test1.md cannot be edited,Test2.md can be edited.

Test3.md is only one more '\n' than test2.md
but Test3.md cannot be edited,Test2.md can be edited.

Is it caused by some special sequence of bytes?

[noerw]

This is a really weird one.
It seems it's not about the length of the file, but some other condition. I could also produce this with giteas CHANGELOG.md..
I suspect this is because we have Transfer-Encoding: chunked for HTTP, and somehow somewhere the chunk length is miscalculated, sending non-zero when the response is actually finished..?

edit: I bisected, 270aab4 is the bad commit (from PR #15667)
@zeripath any ideas?

[a96219]

Will this bug be fixed in the next version?

[noerw]

@FreeSaltedFish The bug didn't exist in the last release, this only happens in the current development version. So yes, we try to not introduce new bugs in releases, but can't give any guarantee. Feel free to look into it yourself if you want to get it fixed asap.

---

@zeripath I studied your changes in your cat-file --batch PR for a while, but didn't find any obvious bug. Two potential error conditions come to mind;

1. somewhere we read the wrong amount of bytes, or return the wrong size
2. there is a racecondition for reading multiple files
   • on _edit page, there are two calls to blob.DataAsync(): one for the file itself, and one for .editorconfig. Could there be a racecondition?
   • (I don't understand where CatFileBatch() ensures results are returned in order)

Could you take a look on this?

For reference, here we call to read the file

gitea/routers/repo/editor.go

Lines 104 to 125 in fb6c689

	dataRc, err := blob.DataAsync()
	if err != nil {
	ctx.NotFound("blob.Data", err)
	return
	}
	defer dataRc.Close()
	ctx.Data["FileSize"] = blob.Size()
	ctx.Data["FileName"] = blob.Name()
	buf := make([]byte, 1024)
	n, _ := dataRc.Read(buf)
	buf = buf[:n]
	// Only some file types are editable online as text.
	if !base.IsRepresentableAsText(buf) {
	ctx.NotFound("base.IsRepresentableAsText", nil)
	return
	}
	d, _ := ioutil.ReadAll(dataRc)
	buf = append(buf, d...)

which is similar to the (working) codepath for viewing a file:

gitea/routers/repo/view.go

Line 497 in fb6c689

rd := charset.ToUTF8WithFallbackReader(io.MultiReader(bytes.NewReader(buf), dataRc))