Error when adding file containing # to entry with character

[judober]

JabRef version 5.2--2020-10-13--fdaf25a on Windows 10

• Mandatory: I have tested the latest development version from http://builds.jabref.org/master/ and the problem persists

Steps to reproduce the behavior:

1. Add bibtexentry for https://link.springer.com/book/10.1007%2F978-3-662-53281-2
2. Add file
3. Apply format pattern: "Filename format pattern": [bibtexkey] - [title:latex_to_unicode:remove_braces_formatter:regex("/|:|,","#")]
4. Restart Jabref
5. When opening from jabref, the file is not found.
6. bilatex source file line looks weird: "file = {:Hue17 - Leiter} # Halbleiter #{ Supraleiter.pdf:PDF},"

My setup: biblatex, keypattern: "[auth3][shortyear]"

[Siedlerchr]

@k3KAW8Pnf7mkmdSMPHz27 I just merged your other PR, does this maybe fix this is as well?

[k3KAW8Pnf7mkmdSMPHz27]

@Siedlerchr I don't think so. I'll take a look at it. I don't know how the source file line should look...

[k3KAW8Pnf7mkmdSMPHz27]

I can't reproduce. I'd guess that a workaround is to use :regex("[{}]","") rather than remove_braces_formatter (the brackets in regex were only an issue for citation keys, not filenames).

@judober could you paste the bibtexentry or link to it? I am not familiar with springer's webpage and the one I got from google scholar does not match yours.
Also, I'd appreciate if you check if the workaround works for you, it might make it easier for someone to debug this particular issue.

I'd guess this is one/two bugs, I don't believe curly brackets are removed for filenames, in which case it might create an issue when they are stored in the bib-file?
There might also be an issue when the title special field markers attempts to remove the latex commands.

[k3KAW8Pnf7mkmdSMPHz27]

@Siedlerchr I don't know what is going on in this issue, but I don't think my PR should impact this.

[k3KAW8Pnf7mkmdSMPHz27]

@judober on another note, if you want to use latex_to_unicode for titles, you might consider using [TITLE:...] (i.e., all-caps). This will not perform the same changes on the title that [title:...] does. Beware that I'd consider this an undocumented feature and it might be subject to change 😬

[Siedlerchr]

Okay. I think the regex or so does not make sense because the # is interpreted as bibtex string.
@judober It would be really nice if you could show how it should look like, e.g what the expected outcome shoud look like

[judober]

I tested again and I think I have to close Jabref and open it again in order to reproduce (will update original post).

Just added the entry through doi, loaded the pdf (probably any pdf will do) and draged in on the entry. When I click the pdf symbol, after restart, my documentsfolder is opened but neither the pdf folder nor the pdf. Also I have the weird file-entry in the biblatex source that causes problem when using the library (undefined label Halbleiter).

The entry:

@Book{Hue17,
  author    = {Rudolf Huebener},
  date      = {2017},
  title     = {Leiter, Halbleiter, Supraleiter},
  doi       = {10.1007/978-3-662-53281-2},
  publisher = {Springer Berlin Heidelberg},
  file      = {:Hue17 - Leiter} #  Halbleiter #{ Supraleiter.pdf:PDF},
  timestamp = {2020.10.13},
}

I would expect the file-line to be
file = {:Hue17 - Leiter # Halbleiter # Supraleiter.pdf:PDF},
And of course jabref to open the pdf.

My manual workaround:
remove all # from the filename and add it manually. Than I get
file = {:Hue17 - Leiter Halbleiter Supraleiter.pdf:PDF},
and everything works.

I tried [bibtexkey] - [title:latex_to_unicode:regex("[{}]",""):regex("/|:|,","#")] but this didn't change anything.
The same for [bibtexkey] - [TITLE:latex_to_unicode:remove_braces_formatter:regex("/|:|,","#")]

@Siedlerchr @k3KAW8Pnf7mkmdSMPHz27 does this help?

Also, I think this used to work with older jabref versions (5.0). At least I use this pattern for a while and did not notice this issue before.

[koppor]

# is a special character in BibTeX and in JabRef.

See https://docs.jabref.org/advanced/strings for general information

I can't reproduce step 1 here. What is the BibTeX? Does it contain #

I assume that step 3 introduced #. Would it be possible to use another character. For instance, _?

[judober]

Regarding step 1: I just added the entry using the doi: 10.1007/978-3-662-53281-2
It does not have inherent #

I tried [bibtexkey] - [title:latex_to_unicode:remove_braces_formatter:regex("/|:|,","_")] and it works. Seems like a good solution for me, I was not aware of the specialty of #.
However, I wonder why I haven't had this problem before since I was using # for quite some time.

Also, when # in the filename is problematic, shouldn't jabref check this somehow and warn the user?

[k3KAW8Pnf7mkmdSMPHz27]

I can reproduce it from the "new entry" button in the GUI.

On a side note, I also get
11:54:05.303 [JavaFX Application Thread] WARN org.jabref.logic.citationkeypattern.BracketedPattern - Key generator warning: unknown modifier 'remove_braces_formatter'.

[k3KAW8Pnf7mkmdSMPHz27]

It doesn't seem like there should be an issue if there is only one # (based on BibDatabase#resolveContent). The split ({:Ham81 - Organische Leiter, Halbleiter }{und Photoleiter.pdf:PDF},) happens as soon as you have two (e.g., you can add it to the title Organische leiter, halbleiter ##und photoleiter). Perhaps that's why it hasn't been an issue before?

I'd guess adding it to FileNameCleaner#ILLEGAL_CHARS, same as curly brackets, would be the easy solution?

[Siedlerchr]

@k3KAW8Pnf7mkmdSMPHz27 Good idea to add it to the illegal chars to avoid problems