ppc_aes_gcm_encrypt/ppc_aes_gcm_decrypt failing to restore f14-f22, and f29 registers as required by ABI

[grooverdan]

OpenSSL-3.6.0

The PPC64 ELFv2 ABI required that the callee save and restore the f29 register. An example in MariaDB showed this didn't occur.

ref: https://issues.redhat.com/browse/RHEL-122599
ref: https://jira.mariadb.org/browse/MDEV-33603
ref: 64-bit ELF ABI Specification for OpenPOWER Architecture - v2.1.5 - Table 2.22. Floating-Point Register Roles for Binary Floating-Point Types - f14-f31 are non-volatile who's meaning is at the beginning of 2.2.2 Registers

[buildbot@f40a55dc5abb test]$ LD_LIBRARY_PATH=../ gdb --args ./tls13ccstest ../apps/server.pem  ../apps/server.pem  tls13ccstest
GNU gdb (Red Hat Enterprise Linux) 14.2-4.1.el9_6
Copyright (C) 2023 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "ppc64le-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<https://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
   <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from ./tls13ccstest...
(No debugging symbols found in ./tls13ccstest)
(gdb) display $f14
1: $f14 = <error: No registers.>
(gdb) display $f15
2: $f15 = <error: No registers.>
(gdb) display $f16
3: $f16 = <error: No registers.>
(gdb) display $f17
4: $f17 = <error: No registers.>
(gdb) display $f18
5: $f18 = <error: No registers.>
(gdb) display $f19
6: $f19 = <error: No registers.>
(gdb) display $f20
7: $f20 = <error: No registers.>
(gdb) display $f21
8: $f21 = <error: No registers.>
(gdb) display $f22
9: $f22 = <error: No registers.>
(gdb) display $f23
10: $f23 = <error: No registers.>
(gdb) display $f24
11: $f24 = <error: No registers.>
(gdb) display $f25
12: $f25 = <error: No registers.>
(gdb) display $f26
13: $f26 = <error: No registers.>
(gdb) display $f27
14: $f27 = <error: No registers.>
(gdb) display $f28
15: $f28 = <error: No registers.>
(gdb) display $f20
16: $f20 = <error: No registers.>
(gdb) display $f29
17: $f29 = <error: No registers.>
(gdb) display $f30
18: $f30 = <error: No registers.>
(gdb) display $f31
19: $f31 = <error: No registers.>
(gdb)  b SSL_do_handshake
Function "SSL_do_handshake" not defined.
Make breakpoint pending on future shared library load? (y or [n]) y
Breakpoint 1 (SSL_do_handshake) pending.
(gdb) r
Starting program: /build/openssl-3.6.0/test/tls13ccstest ../apps/server.pem ../apps/server.pem tls13ccstest
warning: Error disabling address space randomization: Operation not permitted
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
1..1
   # Subtest: test_tls13ccs
   1..12

Breakpoint 1, 0x00003fffb87c8a34 in SSL_do_handshake () from ../libssl.so.3
1: $f14 = 0
2: $f15 = 0
3: $f16 = 0
4: $f17 = 0
5: $f18 = 0
6: $f19 = 0
7: $f20 = 0
8: $f21 = 0
9: $f22 = 0
10: $f23 = 0
11: $f24 = 0
12: $f25 = 0
13: $f26 = 0
14: $f27 = 0
15: $f28 = 0
16: $f20 = 0
17: $f29 = 0
18: $f30 = 0
19: $f31 = 0
Missing separate debuginfos, use: dnf debuginfo-install glibc-2.34-168.el9_6.23.ppc64le
(gdb) set $f14=0.14
(gdb) set $f15=0.15
(gdb) set $f16=0.16
(gdb) set $f17=0.17
(gdb) set $f18=0.18
(gdb) set $f19=0.19
(gdb) set $f20=0.20
(gdb) set $f21=0.21
(gdb) set $f22=0.22
(gdb) set $f23=0.23
(gdb) set $f24=0.24
(gdb) set $f25=0.25
(gdb) set $f26=0.26
(gdb) set $f27=0.27
(gdb) set $f28=0.28
(gdb) set $f29=0.29
(gdb) set $f30=0.30
(gdb) set $f31=0.31
(gdb) s
Single stepping until exit from function SSL_do_handshake,
which has no line number information.
0x00003fffb87c9174 in SSL_connect () from ../libssl.so.3
1: $f14 = 0.14000000000000001
2: $f15 = 0.14999999999999999
3: $f16 = 0.16
4: $f17 = 0.17000000000000001
5: $f18 = 0.17999999999999999
6: $f19 = 0.19
7: $f20 = 0.20000000000000001
8: $f21 = 0.20999999999999999
9: $f22 = 0.22
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f20 = 0.20000000000000001
17: $f29 = 0.28999999999999998
18: $f30 = 0.29999999999999999
19: $f31 = 0.31
(gdb) s
Single stepping until exit from function SSL_connect,
which has no line number information.
0x00000000100090fc in create_bare_ssl_connection_ex ()
1: $f14 = 0.14000000000000001
2: $f15 = 0.14999999999999999
3: $f16 = 0.16
4: $f17 = 0.17000000000000001
5: $f18 = 0.17999999999999999
6: $f19 = 0.19
7: $f20 = 0.20000000000000001
8: $f21 = 0.20999999999999999
9: $f22 = 0.22
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f20 = 0.20000000000000001
17: $f29 = 0.28999999999999998
18: $f30 = 0.29999999999999999
19: $f31 = 0.31
(gdb) s
Single stepping until exit from function create_bare_ssl_connection_ex,
which has no line number information.

Breakpoint 1, 0x00003fffb87c8a34 in SSL_do_handshake () from ../libssl.so.3
1: $f14 = 0.14000000000000001
2: $f15 = 0.14999999999999999
3: $f16 = 0.16
4: $f17 = 0.17000000000000001
5: $f18 = 0.17999999999999999
6: $f19 = 0.19
7: $f20 = 0.20000000000000001
8: $f21 = 0.20999999999999999
9: $f22 = 0.22
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f20 = 0.20000000000000001
17: $f29 = 0.28999999999999998
18: $f30 = 0.29999999999999999
19: $f31 = 0.31
(gdb) s
Single stepping until exit from function SSL_do_handshake,
which has no line number information.
0x00003fffb87c8d64 in SSL_accept () from ../libssl.so.3
1: $f14 = -1.1401504744320569e-17
2: $f15 = -2.17647265888608e-21
3: $f16 = -6.8419872059387868e-90
4: $f17 = -3.189049837857242e+230
5: $f18 = 5.2151008090809153e-109
6: $f19 = 3.3310983171458963e+49
7: $f20 = 2.1337373836080768e+245
8: $f21 = 1.1753164624440392e+128
9: $f22 = -2.9402425673378118e-278
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f20 = 2.1337373836080768e+245
17: $f29 = 0
18: $f30 = 0.29999999999999999
19: $f31 = 0.31

(gdb) info sharedlibrary
From                To                  Syms Read   Shared Object Library
0x00003fffb88efe80  0x00003fffb892f3c0  Yes         /lib64/ld64.so.2
0x00003fffb879c500  0x00003fffb8885a58  Yes (*)     ../libssl.so.3
0x00003fffb80e3000  0x00003fffb84d8f7c  Yes (*)     ../libcrypto.so.3
0x00003fffb7ddcf80  0x00003fffb7f76f0c  Yes (*)     /lib64/libc.so.6
(*): Shared library is missing debugging information.

So registers clobbered who's non-volatility wasn't respectedf14-22, f29

[grooverdan]

(gdb) 
70	        s = encrypt ? ppc_aes_gcm_encrypt(in, out, len, key, ivec, Xi)
1: $f29 = 0.33329999999999999
(gdb) 
74	        add32TOU(ivec + 12, (u32) next_ctr);
1: $f29 = 0

0x00003fff7f763834 in Do_next_ghash () from ../libcrypto.so.3
1: $f29 = 0.33329999999999999
(gdb) 
0x00003fff7f763838 in Do_next_ghash () from ../libcrypto.so.3
1: $f29 = 0
(gdb) 


   0x00003fff7f763818 <+76>:	vcipherlast v22,v22,v23
   0x00003fff7f76381c <+80>:	xxlxor  vs53,vs53,vs21
   0x00003fff7f763820 <+84>:	stxvb16x vs53,r20,r9
   0x00003fff7f763824 <+88>:	xxlxor  vs54,vs54,vs22
   0x00003fff7f763828 <+92>:	stxvb16x vs54,r21,r9
   0x00003fff7f76382c <+96>:	addi    r9,r9,128
   0x00003fff7f763830 <+100>:	vxor    v15,v15,v0
   0x00003fff7f763834 <+104>:	xxlxor  vs29,vs29,vs29
   0x00003fff7f763838 <+108>:	vpmsumd v23,v12,v15
   0x00003fff7f76383c <+112>:	vpmsumd v24,v9,v16
   0x00003fff7f763840 <+116>:	vpmsumd v25,v6,v17
   0x00003fff7f763844 <+120>:	vpmsumd v26,v3,v18
   0x00003fff7f763848 <+124>:	vxor    v23,v23,v24
   0x00003fff7f76384c <+128>:	vxor    v23,v23,v25
   0x00003fff7f763850 <+132>:	vxor    v23,v23,v26

xxlxor vs29,vs29,vs29 is from ppc_aes_gcm_ghash2_4x and the vector registers are shared with the fp registers.

The v29 aka f29 register isn't saved in the ppc_aes_gcm_encrypt or ppc_aes_gcm_decrypt stack.

Ref: #16854

ping @dannytsen @ssrivat

[grooverdan]

So all f14-22,29 aren't saved in the function. Also the LR looks like its stored beyond the stack.

[buildbot@f40a55dc5abb test]$  LD_LIBRARY_PATH=../ gdb --args ./tls13ccstest ../apps/server.pem  ../apps/server.pem  tls13ccstest
GNU gdb (Red Hat Enterprise Linux) 14.2-4.1.el9_6
Copyright (C) 2023 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "ppc64le-redhat-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<https://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from ./tls13ccstest...
(gdb) b SSL_connect
Breakpoint 1 at 0x1001c3a8
(gdb) r
Starting program: /build/openssl-3.6.0/test/tls13ccstest ../apps/server.pem ../apps/server.pem tls13ccstest
warning: Error disabling address space randomization: Operation not permitted
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
1..1
    # Subtest: test_tls13ccs
    1..12

Breakpoint 1, SSL_connect (s=0x26c1d5c0) at ssl/ssl_lib.c:2235
2235	    SSL_CONNECTION *sc = SSL_CONNECTION_FROM_SSL(s);
Missing separate debuginfos, use: dnf debuginfo-install glibc-2.34-168.el9_6.23.ppc64le
(gdb) source /tmp/set.gdb
Delete all auto-display expressions? (y or n) [answered Y; input not from terminal]
(gdb) b ppc_aes_gcm_encrypt
Breakpoint 2 at 0x3fffa3b633c0: file crypto/modes/aes-gcm-ppc.s, line 381.
(gdb) c
Continuing.

Breakpoint 2, ppc_aes_gcm_encrypt () at crypto/modes/aes-gcm-ppc.s:381
381		stdu	1,-512(1)
1: $f14 = 0.14000000000000001
2: $f15 = 0.14999999999999999
3: $f16 = 0.16
4: $f17 = 0.17000000000000001
5: $f18 = 0.17999999999999999
6: $f19 = 0.19
7: $f20 = 0.20000000000000001
8: $f21 = 0.20999999999999999
9: $f22 = 0.22
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f29 = 0.28999999999999998
17: $f30 = 0.29999999999999999
18: $f31 = 0.31
(gdb) info all-registers
r0             0x3fffa3ca8c80      70367197170816
r1             0x3fffded07d00      70368187415808
r2             0x3fffa3f57f00      70367199985408
r3             0x26c4a208          650420744
r4             0x26c4a208          650420744
r5             0x330               816
r6             0x26c1a8f0          650225904
r7             0x26c1a728          650225448
r8             0x26c1a768          650225512
r9             0x1                 1
r10            0x33                51
r11            0x3fffa3d99c7c      70367198157948
r12            0xffffffffffffffff  18446744073709551615
r13            0x3fffa41e4860      70367202658400
r14            0x0                 0
r15            0x0                 0
r16            0x0                 0
r17            0x0                 0
r18            0x0                 0
r19            0x0                 0
r20            0x0                 0
r21            0x0                 0
r22            0x0                 0
r23            0x1001337c          268514172
r24            0x3fffa41ec000      70367202689024
r25            0x3fffa41eb740      70367202686784
r26            0x3fffded0b4d0      70368187430096
r27            0x1003fbf0          268696560
r28            0x3fffded0b580      70368187430272
r29            0x3fffded0b4a8      70368187430056
r30            0x3fffa4168360      70367202149216
r31            0x3fffded07d00      70368187415808
f0             9.8813129168249309e-324 (raw 0x0000000000000002)
f1             0                   (raw 0x0000000000000000)
f2             0                   (raw 0x0000000000000000)
f3             0                   (raw 0x0000000000000000)
f4             0                   (raw 0x0000000000000000)
f5             0                   (raw 0x0000000000000000)
f6             0                   (raw 0x0000000000000000)
--Type <RET> for more, q to quit, c to continue without paging--
f7             0                   (raw 0x0000000000000000)
f8             0                   (raw 0x0000000000000000)
f9             0                   (raw 0x0000000000000000)
f10            0                   (raw 0x0000000000000000)
f11            3.4766013745995381e-310 (raw 0x00003fffa3ac9570)
f12            2.4703282292062327e-323 (raw 0x0000000000000005)
f13            0                   (raw 0x0000000000000000)
f14            0.14000000000000001 (raw 0x3fc1eb851eb851ec)
f15            0.14999999999999999 (raw 0x3fc3333333333333)
f16            0.16                (raw 0x3fc47ae147ae147b)
f17            0.17000000000000001 (raw 0x3fc5c28f5c28f5c3)
f18            0.17999999999999999 (raw 0x3fc70a3d70a3d70a)
f19            0.19                (raw 0x3fc851eb851eb852)
f20            0.20000000000000001 (raw 0x3fc999999999999a)
f21            0.20999999999999999 (raw 0x3fcae147ae147ae1)
f22            0.22                (raw 0x3fcc28f5c28f5c29)
f23            0.23000000000000001 (raw 0x3fcd70a3d70a3d71)
f24            0.23999999999999999 (raw 0x3fceb851eb851eb8)
f25            0.25                (raw 0x3fd0000000000000)
f26            0.26000000000000001 (raw 0x3fd0a3d70a3d70a4)
f27            0.27000000000000002 (raw 0x3fd147ae147ae148)
f28            0.28000000000000003 (raw 0x3fd1eb851eb851ec)
f29            0.28999999999999998 (raw 0x3fd28f5c28f5c28f)
f30            0.29999999999999999 (raw 0x3fd3333333333333)
f31            0.31                (raw 0x3fd3d70a3d70a3d7)
pc             0x3fffa3b633c0      0x3fffa3b633c0 <ppc_aes_gcm_encrypt>
msr            0x800000000002d033  9223372036854960179
cr             0x48002849          1207969865
lr             0x3fffa3ca8a74      0x3fffa3ca8a74 <ppc_aes_gcm_crypt+300>
ctr            0x3fffa3b6cd60      70367195876704
xer            0x20040000          537133056
fpscr          0x0                 0
vr0            {uint128 = 0xec919ce056f19923c12573f56d144566, v4_float = {0x6d144566, 0xc12573f5, 0x56f19923, 0xec919ce0}, v4_int32 = {0x6d144566, 0xc12573f5, 0x56f19923, 0xec919ce0}, v8_int16 = {0x4566, 0x6d14, 0x73f5, 0xc125, 0x9923, 0x56f1, 0x9ce0, 0xec91}, v16_int8 = {0x66, 0x45, 0x14, 0x6d, 0xf5, 0x73, 0x25, 0xc1, 0x23, 0x99, 0xf1, 0x56, 0xe0, 0x9c, 0x91, 0xec}}
vr1            {uint128 = 0x127fb16117325c134147c1e09000000, v4_float = {0x9000000, 0x34147c1e, 0x117325c1, 0x127fb16}, v4_int32 = {0x9000000, 0x34147c1e, 0x117325c1, 0x127fb16}, v8_int16 = {0x0, 0x900, 0x7c1e, 0x3414, 0x25c1, 0x1173, 0xfb16, 0x127}, v16_int8 = {0x0, 0x0, 0x0, 0x9, 0x1e, 0x7c, 0x14, 0x34, 0xc1, 0x25, 0x73, 0x11, 0x16, 0xfb, 0x27, 0x1}}
vr2            {uint128 = 0xea84b8534e91ec6645146df57325c1, v4_float = {0xf57325c1, 0x6645146d, 0x534e91ec, 0xea84b8}, v4_int32 = {0xf57325c1, 0x664514--Type <RET> for more, q to quit, c to continue without paging--q
Quit
(gdb) b aes_gcm_out
Breakpoint 3 at 0x3fffa3b63bf8: file crypto/modes/aes-gcm-ppc.s, line 857.
(gdb) b ppc_aes_gcm_ghash2_4x
Function "ppc_aes_gcm_ghash2_4x" not defined.
Make breakpoint pending on future shared library load? (y or [n]) n
(gdb) b Do_next_ghash
Breakpoint 4 at 0x3fffa3b637cc: file crypto/modes/aes-gcm-ppc.s, line 610.
(gdb) c
Continuing.

Breakpoint 4, 0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610
610		b	aes_gcm_out
1: $f14 = -4.8105303416598689e+250
2: $f15 = 1.0664299564417642e-255
3: $f16 = -5.3914931421222871e-299
4: $f17 = -2.1619324455994734e-278
5: $f18 = 1.0650080747898409e-279
6: $f19 = 1.220394314205649e-197
7: $f20 = 1.7880003465408455e-235
8: $f21 = 5.4390071536829512e-77
9: $f22 = 2.1103425546779344e+262
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f29 = 0.28999999999999998
17: $f30 = 0.29999999999999999
18: $f31 = 0.31
(gdb) c
Continuing.

Breakpoint 4, 0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610
610		b	aes_gcm_out
1: $f14 = -4.8105303416598689e+250
2: $f15 = 6.3032201260876615e-246
3: $f16 = 1.412688620508054e-303
4: $f17 = -2.3784229626225908e+154
5: $f18 = -1.1262785522328377e-191
6: $f19 = -1.8571290935059875e+105
7: $f20 = -1.1391688791978199e+144
8: $f21 = 8.3031277774152594e-216
9: $f22 = -5.8650511747062352e-101
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f29 = 0
17: $f30 = 0.29999999999999999
18: $f31 = 0.31
(gdb) finish
Run till exit from #0  0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610

Breakpoint 4, 0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610
610		b	aes_gcm_out
1: $f14 = -4.8105303416598689e+250
2: $f15 = -2.0243565300165343e+229
3: $f16 = -2.128289004078897e+166
4: $f17 = -7.4694570223571815e-55
5: $f18 = 7.2091740402628856e-33
6: $f19 = -6.5399802789486322e+270
7: $f20 = 1.4420737251925064e-244
8: $f21 = -1.1205834462744062e+229
9: $f22 = -7.4626787169737416e+132
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f29 = 0
17: $f30 = 0.29999999999999999
18: $f31 = 0.31
(gdb) finish
Run till exit from #0  0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610

Breakpoint 4, 0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610
610		b	aes_gcm_out
1: $f14 = -4.8105303416598689e+250
2: $f15 = 4.0873159466019959e-32
3: $f16 = 2.8979113321809382e+226
4: $f17 = 9.0941971365147753e-301
5: $f18 = -48165.997112824021
6: $f19 = -7.7406523495874181e+109
7: $f20 = 3.1361938864060117e-210
8: $f21 = -4.2913320830223284e+63
9: $f22 = 4.1072512973142443e-77
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f29 = 0
17: $f30 = 0.29999999999999999
18: $f31 = 0.31
(gdb) finish
Run till exit from #0  0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610

Breakpoint 4, 0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610
610		b	aes_gcm_out
1: $f14 = -4.8105303416598689e+250
2: $f15 = 1.7675815820661719e-284
3: $f16 = -9.0939496723680964e-299
4: $f17 = 3.1331563273158939e-77
5: $f18 = -5.0781228683260548e-299
6: $f19 = -1.165028741944218e-146
7: $f20 = -2.8623760662684803e+181
8: $f21 = -8.5526232093927438e+266
9: $f22 = -2.0583599248519564e+55
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f29 = 0
17: $f30 = 0.29999999999999999
18: $f31 = 0.31
(gdb) finish
Run till exit from #0  0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610

Breakpoint 4, 0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610
610		b	aes_gcm_out
1: $f14 = -4.8105303416598689e+250
2: $f15 = 2.2183477751903207e+307
3: $f16 = -7.041043507919788e-262
4: $f17 = 2.4929303322770514e+153
5: $f18 = -2.6121657855047778e+213
6: $f19 = 4.984494493080703e+254
7: $f20 = -2.2665515695674281e-307
8: $f21 = 3.6372084466641696e+130
9: $f22 = 6.7953821531660072e-257
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f29 = 0
17: $f30 = 0.29999999999999999
18: $f31 = 0.31
(gdb) clear
Deleted breakpoint 4 
(gdb) finish
Run till exit from #0  0x00003fffa3b637cc in Do_next_ghash () at crypto/modes/aes-gcm-ppc.s:610

Breakpoint 3, aes_gcm_out () at crypto/modes/aes-gcm-ppc.s:857
857		stxvb16x	32, 0, 8
1: $f14 = -4.8105303416598689e+250
2: $f15 = -1.0648910234842522e-219
3: $f16 = -7.041043507919788e-262
4: $f17 = 2.4929303322770514e+153
5: $f18 = -2.6121657855047778e+213
6: $f19 = 4.984494493080703e+254
7: $f20 = -2.2665515695674281e-307
8: $f21 = 3.6372084466641696e+130
9: $f22 = 6.7953821531660072e-257
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f29 = 0
17: $f30 = 0.29999999999999999
18: $f31 = 0.31
(gdb) finish
Run till exit from #0  aes_gcm_out () at crypto/modes/aes-gcm-ppc.s:857
0x00003fffa3ca8a74 in ppc_aes_gcm_crypt (
    in=0x26c4a208 "\313\3510H\360\221\005\336\360\030\245\\\a\360!ZJJ\220\234\326\352(v-ڀ\350W\357\327h\211qͤ\034\355\3710\037\323A\314\001\016n\274wϥ\265\372)ܒ}\025\016\376\357b\001\216w\222z\216\377\214\201%RybҘ\001\2650gf\202\303xb\377R\202\254]\t\256\343\035j\376\206\030\254\363\026\267L9\206_\346\272h\234Jd\335F\251\364\034\033\3019T\035\261\332b\377\023c\205\334%#>\\ơ@M'j>\243`\231\301\265pY\251\326\351\f\345J\255\214", 
    out=0x26c4a208 "\313\3510H\360\221\005\336\360\030\245\\\a\360!ZJJ\220\234\326\352(v-ڀ\350W\357\327h\211qͤ\034\355\3710\037\323A\314\001\016n\274wϥ\265\372)ܒ}\025\016\376\357b\001\216w\222z\216\377\214\201%RybҘ\001\2650gf\202\303xb\377R\202\254]\t\256\343\035j\376\206\030\254\363\026\267L9\206_\346\272h\234Jd\335F\251\364\034\033\3019T\035\261\332b\377\023c\205\334%#>\\ơ@M'j>\243`\231\301\265pY\251\326\351\f\345J\255\214", len=816, 
    key=0x26c1a8f0, ivec=0x26c1a728 "\201\372\361\022[\0227K\337<\276Z", Xi=0x26c1a768, encrypt=1)
    at providers/implementations/ciphers/cipher_aes_gcm_hw_ppc.inc:70
70	        s = encrypt ? ppc_aes_gcm_encrypt(in, out, len, key, ivec, Xi)
1: $f14 = -4.8105303416598689e+250
2: $f15 = -1.0648910234842522e-219
3: $f16 = -7.041043507919788e-262
4: $f17 = 2.4929303322770514e+153
5: $f18 = -2.6121657855047778e+213
6: $f19 = 4.984494493080703e+254
7: $f20 = -2.2665515695674281e-307
8: $f21 = 3.6372084466641696e+130
9: $f22 = 6.7953821531660072e-257
10: $f23 = 0.23000000000000001
11: $f24 = 0.23999999999999999
12: $f25 = 0.25
13: $f26 = 0.26000000000000001
14: $f27 = 0.27000000000000002
15: $f28 = 0.28000000000000003
16: $f29 = 0
17: $f30 = 0.29999999999999999
18: $f31 = 0.31
(gdb) info all-registers
r0             0x3fffa3ca8a74      70367197170292
r1             0x3fffded07d00      70368187415808
r2             0x3fffa3f57f00      70367199985408
r3             0x330               816
r4             0x26c4a208          650420744
r5             0x330               816
r6             0x26c1a8f0          650225904
r7             0x26c1a728          650225448
r8             0x26c1a768          650225512
r9             0x1b0               432
r10            0xe                 14
r11            0x330               816
r12            0x0                 0
r13            0x3fffa41e4860      70367202658400
r14            0x0                 0
r15            0x0                 0
r16            0x0                 0
r17            0x0                 0
r18            0x0                 0
r19            0x0                 0
r20            0x0                 0
r21            0x0                 0
r22            0x0                 0
r23            0x1001337c          268514172
r24            0x3fffa41ec000      70367202689024
r25            0x3fffa41eb740      70367202686784
r26            0x3fffded0b4d0      70368187430096
r27            0x1003fbf0          268696560
r28            0x3fffded0b580      70368187430272
r29            0x3fffded0b4a8      70368187430056
r30            0x3fffa4168360      70367202149216
r31            0x3fffded07d00      70368187415808
f0             -7.311459402164853e-19 (raw 0xbc2af97a68fa3b8b)
f1             6.9275117403366757e+177 (raw 0x64db5a48ef1581cb)
f2             -3.1765289599433587e+279 (raw 0xf9f66640910c5dcb)
f3             -2.5749041358013308e+120 (raw 0xd8efe8b237fa6979)
f4             3.3340058232617643e+62 (raw 0x4ce9ef38dde5b2f3)
f5             3.7948353102932992e-241 (raw 0x0e043e4339fe573a)
f6             -2.5583350533344471e+255 (raw 0xf4f5cf2c29107ddf)
--Type <RET> for more, q to quit, c to continue without paging--
f7             -4.8952642489398414e+149 (raw 0xdf03245ce6fd7366)
f8             5.8956176060000609e-12 (raw 0x3d99ede01489903f)
f9             -6.6404001986067728e-271 (raw 0x87d673a6612b00c0)
f10            -697.9755021063595  (raw 0xc085cfcdd40c5ff2)
f11            1.0202399446710478e-227 (raw 0x10ceefb471e5ef74)
f12            -2.1515887299581966e+192 (raw 0xe7de2e7c33d2718e)
f13            2.5796944902733897e-95 (raw 0x2c4b8d0c5dae6278)
f14            -4.8105303416598689e+250 (raw 0xf3fae020c02891ae)
f15            -1.0648910234842522e-219 (raw 0x92780ee20fa3febb)
f16            -7.041043507919788e-262 (raw 0x89b62be14ddf4a7e)
f17            2.4929303322770514e+153 (raw 0x5fc7cc98460ec483)
f18            -2.6121657855047778e+213 (raw 0xec3f098bd09302bf)
f19            4.984494493080703e+254 (raw 0x74d0ff2825deb79f)
f20            -2.2665515695674281e-307 (raw 0x80445f713225710f)
f21            3.6372084466641696e+130 (raw 0x5b0a3c741cb962f1)
f22            6.7953821531660072e-257 (raw 0x0ac053446a3a8884)
f23            0.23000000000000001 (raw 0x3fcd70a3d70a3d71)
f24            0.23999999999999999 (raw 0x3fceb851eb851eb8)
f25            0.25                (raw 0x3fd0000000000000)
f26            0.26000000000000001 (raw 0x3fd0a3d70a3d70a4)
f27            0.27000000000000002 (raw 0x3fd147ae147ae148)
f28            0.28000000000000003 (raw 0x3fd1eb851eb851ec)
f29            0                   (raw 0x0000000000000000)
f30            0.29999999999999999 (raw 0x3fd3333333333333)
f31            0.31                (raw 0x3fd3d70a3d70a3d7)
pc             0x3fffa3ca8a74      0x3fffa3ca8a74 <ppc_aes_gcm_crypt+300>
msr            0x800000000002d033  9223372036854960179
cr             0x28002849          671098953
lr             0x3fffa3ca8a74      0x3fffa3ca8a74 <ppc_aes_gcm_crypt+300>
ctr            0x0                 0
xer            0x20040000          537133056
fpscr          0x0                 0

[dannytsen]

@grooverdan That's my mistake on this version which was fixed in the Linux kernel version and did not update to the OpenSSL. I'll correct this and update with a new version.