loadup-apps-from-full failure on Linux Mint

[pamoroso]

I tried building the latest Medley sources on Linux Mint 22 Cinnamon with scripts/loadup-all -apps but the build failed with the error:

>>>>> START loadup-apps-from-full
"/home/paolo/medley/medley/../maiko/linux.x86_64/lde" "/tmp/loadups-37706/full.sysout" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-37706/logindir"
GREET FILE: "/tmp/loadups-37706/loadup-apps-from-full.cm"
VMEM FILE: "/tmp/loadups-37706/logindir/vmem/lisp_loadup_1.virtualmem"
----- FAILURE -----
..... files created .....
<<<<< END loadup-apps-from-full

----- loadup-all.sh: FAILURE -----

The dribble files: dribble.zip

The branches and heads:

paolo@lispmachine:~/medley/maiko$ git status
On branch master
Your branch is up to date with 'origin/master'.

nothing to commit, working tree clean
paolo@lispmachine:~/medley/maiko$ git log|head
commit 3c4d9f5393e56857d1e75352f8d8d0a0c9d91e01
Author: Nick Briggs <nicholas.h.briggs@gmail.com>
Date:   Mon Jan 20 12:24:44 2025 -0800

    Modifies LISPFINISH subr to use 2nd argument, if present, for exit status (#525)
    
    Redesign of exit status handling, instead of overloading the FAST flag
    of (LOGOUT fast), add an optional 2nd argument, EXITSTATUS.
    
    Retains compatability, with behavior unchanged, between new emulator
paolo@lispmachine:~/medley/maiko$ cd ../medley
paolo@lispmachine:~/medley/medley$ git status
On branch master
Your branch is up to date with 'origin/master'.

nothing to commit, working tree clean
paolo@lispmachine:~/medley/medley$ git log|head
commit ef6a645bf5362e0ef11304c959bc70f5dba20c08
Merge: d737f7ec 90c723a8
Author: Matt Heffron <heffron@alumni.caltech.edu>
Date:   Tue Jan 21 10:40:30 2025 -0800

    Fix move of PSEUDOHOSTS from lispusers to library (#1980)
    
    The files were **copied** from `lispusers` to `library`, and then
    modified there.
    They should have been **moved** so the git history was preserved.
paolo@lispmachine:~/medley/medley$ cd ../notecards
paolo@lispmachine:~/medley/notecards$ git status
On branch main
Your branch is up to date with 'origin/main'.

nothing to commit, working tree clean
paolo@lispmachine:~/medley/notecards$ git log|head
commit 86daa57ad611f8aeb430f3d7418d0cdad564464e
Merge: 56e340b 9bef2e2
Author: Frank Halasz <frank@halasz.org>
Date:   Tue Jan 14 21:37:40 2025 -0800

    Merge pull request #17 from Interlisp/fgh_last-TEDIT
    
    Remove last \TEDIT.* call from Notecards

commit 9bef2e207f0a3044f8914683682b22d393a7f54a

[pamoroso]

I built Medley successfully the day before, i.e. on January 21, 2025.

[nbriggs]

Full doesn't load correctly for me on Linux Mint 22.1 - which may be why loading apps from full isn't working for you.

I can build on my Mac at:
Medley: ef6a645
Maiko: 3c4d9f5
Notecards: 86daa57
(which is master branches for all three), but at the same revision on Linux Mint 22.1 it fails loading TEDIT into the Lisp.sysout as part of making Full.sysout.

[nbriggs]

I just tried building on macOS on a case-sensitive volume, and it worked perfectly. I presume that regular Ubuntu loadups are working, so I don't know what's going on with Linux Mint particularly.

[pamoroso]

Still on master I git pulled the repos to the latest sources with heads:

• Maiko: 3c4d9f5
• Medley: ef6a645
• NoteCards: 86daa57

and the build failed:

>>>>> START loadup-full-from-lisp
"/home/paolo/medley/medley/../maiko/linux.x86_64/lde" "/tmp/loadups-18393/lisp.sysout" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-18393/logindir"
GREET FILE: "/tmp/loadups-18393/loadup-full-from-lisp.cm"
VMEM FILE: "/tmp/loadups-18393/logindir/vmem/lisp_loadup_1.virtualmem"
+++++ SUCCESS +++++
..... files created .....
-rw-rw-r-- 1 paolo paolo 9955 Jan 23 16:28 /tmp/loadups-18393/full.dribble
-rw-rw-r-- 1 paolo paolo 10614784 Jan 23 16:28 /tmp/loadups-18393/full.sysout
<<<<< END loadup-full-from-lisp

>>>>> START loadup-apps-from-full
"/home/paolo/medley/medley/../maiko/linux.x86_64/lde" "/tmp/loadups-18393/full.sysout" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-18393/logindir"
GREET FILE: "/tmp/loadups-18393/loadup-apps-from-full.cm"
VMEM FILE: "/tmp/loadups-18393/logindir/vmem/lisp_loadup_1.virtualmem"
----- FAILURE -----
..... files created .....
<<<<< END loadup-apps-from-full

----- loadup-all.sh: FAILURE -----

[fghalasz]

I see this now too on WSL. I'm working on tracking ot down. Not straightforward so far.

[nbriggs]

It fails for me right after it has opened INTERPRESS.LCOM, after it has reported it is about to load TEdit, but before it actually opens TEDIT.LCOM -- I put tracing code into Maiko's COM_openfile to verify that it wasn't managing to open and read something from TEdit that it choked on.

[nbriggs]

Clarifying: it has probably processed and closed INTERPRESS.LCOM since it reported it was about to load TEdit.

[rmkaplan]

So, INTERPRESS loaded successfully and has been closed, TEDIT hasn’t yet been opened, and there are no files in between?

…

On Jan 24, 2025, at 12:51 PM, Nick Briggs ***@***.***> wrote: Clarifying: it has probably processed and closed INTERPRESS.LCOM since it reported it was about to load TEdit. — Reply to this email directly, view it on GitHub <#1986 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AQSTUJKQFJRNNPY3LRRUHPT2MKRVZAVCNFSM6AAAAABVU53PHWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMMJTGM2TQNJZGA>. You are receiving this because you are subscribed to this thread.

[masinter]

If you RENAMEFILE or mv
or git mv a file which has versions > 1 you might have the situation that post-checkout was made to detect

[nbriggs]

@rmkaplan Correct - no files in between, and in that space it takes a stack overflow and then proceeds to the ENDLOADUP and writes a sysout without a few things that should be there.

[fghalasz]

On WSL/Ubuntu22.04:

1. One out of 10 times I do a clean git clone --depth 1 https://github.com/interlisp/medley, the loadups-all.sh -apps script succeeds. The other 9 times, it fails as described by Paolo. A tree-diff between the two clones shows no difference between the file trees of 'successful' and 'unsuccessful' clones. Huh?? Some randomness somewhere.

2. If you take a clone for which the script fails and then manually copy the files RDSYS and RDSYS.LCOM from the /tmp/loadups-9999 directory from the failed run into MEDLEYDIR/library and then rerun the loadups-all.sh -apps script, then the script will always complete successfully.

@pamoroso Could you try copying the RDSYS and RDSYS.LCOM files as described and see if that allows the loadup apps script to succeed on your system.

[pamoroso]

I copied RDSYS and RDSYS.LCOM, rerun loadups-all.sh -apps, and the build still failed:

>>>>> START loadup-full-from-lisp
"/home/paolo/medley/medley/../maiko/linux.x86_64/lde" "/tmp/loadups-20239/lisp.sysout" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-20239/logindir"
GREET FILE: "/tmp/loadups-20239/loadup-full-from-lisp.cm"
VMEM FILE: "/tmp/loadups-20239/logindir/vmem/lisp_loadup_1.virtualmem"
+++++ SUCCESS +++++
..... files created .....
-rw-rw-r-- 1 paolo paolo 9955 Jan 25 11:48 /tmp/loadups-20239/full.dribble
-rw-rw-r-- 1 paolo paolo 10617344 Jan 25 11:48 /tmp/loadups-20239/full.sysout
<<<<< END loadup-full-from-lisp

>>>>> START loadup-apps-from-full
"/home/paolo/medley/medley/../maiko/linux.x86_64/lde" "/tmp/loadups-20239/full.sysout" -id "loadup_1" -title "Medley Interlisp :: loadup_1" -g 1024x768 -sc 1024x768 -noscroll
MEDLEYDIR: "/home/paolo/medley/medley"
LOGINDIR: "/tmp/loadups-20239/logindir"
GREET FILE: "/tmp/loadups-20239/loadup-apps-from-full.cm"
VMEM FILE: "/tmp/loadups-20239/logindir/vmem/lisp_loadup_1.virtualmem"
----- FAILURE -----
..... files created .....
<<<<< END loadup-apps-from-full

----- loadup-all.sh: FAILURE -----

[pamoroso]

I freshly cloned the medley and notecards repos and loadup-all.sh -apps on master successfully finished the build. It runs fine too.

[fghalasz]

@pamoroso Could you try the clone/loadup process a few more times (always keeping the old clone around).

My experience is that the loadup process will succeed sometimes and fail sometimes - with fails far outnumbering the succeeds across the clones. Once the loadup for a particular clone works, it seems to keep working.