|
1 | 1 | %auto-ignore
|
2 | 2 | \begin{abstract}
|
3 |
| - In this work we present a theoretical model for differentiable programming. We present an algebraic language that enables both implementations and analysis of differentiable programs by way of \emph{operational calculus}. |
| 3 | + In this work we present a theoretical model for differentiable programming. We |
| 4 | + present an algebraic language that presents formal semantics of |
| 5 | + differentiable programs by way of \emph{operational calculus}, which enables |
| 6 | + reasoning about their analytic properties. |
4 | 7 |
|
5 |
| -To this purpose, we develop an \emph{abstract computational model of automatically differentiable programs} of arbitrary order. In the model, programs are elements of \emph{programming spaces} and are viewed as maps from the \emph{virtual memory space} to itself. |
6 |
| - Virtual memory space is an algebra of programs, \emph{an algebraic data structure} one can calculate with. |
| 8 | + To this purpose, we develop an \emph{abstract computational model of |
| 9 | + differentiable programs} of arbitrary order. In the model, |
| 10 | + programs are elements of \emph{programming spaces} and are viewed as maps from |
| 11 | + the \emph{virtual memory space} to itself. Virtual memory space is an algebra |
| 12 | + of programs, \emph{an algebraic data structure} one can calculate with. |
7 | 13 |
|
8 |
| -We define the \emph{operator of differentiation} ($\D$) on programming spaces and, using its powers, implement the \emph{general shift operator} and the \emph{operator of program composition}. |
9 |
| - We provide the formula for the expansion of a differentiable program into an infinite tensor series in terms of the powers of $\D$. We express the operator of program composition in terms of the generalized shift operator and $\D$, which implements a differentiable composition in the language. We prove that our language enables differentiable derivatives of programs by the use of the \emph{order reduction map}. We demonstrate our models algebraic power over analytic properties of differentiable programs by analysing iterators, considering \emph{fractional iterations} and their \emph{iterating velocities}. We than solve the special case of \emph{ReduceSum}. |
| 14 | + We define the \emph{operator of differentiation} ($\D$) on programming spaces |
| 15 | + and, using its powers, implement the \emph{general shift operator} and the |
| 16 | + \emph{operator of program composition}. We provide the formula for the |
| 17 | + expansion of a differentiable program into an infinite tensor series in terms |
| 18 | + of the powers of $\D$. We express the operator of program composition in terms |
| 19 | + of the generalized shift operator and $\D$, which implements a differentiable |
| 20 | + composition in the language. We prove that our language enables differentiable |
| 21 | + derivatives of programs by the use of the \emph{order reduction map}. We |
| 22 | + demonstrate our models algebraic power over analytic properties of |
| 23 | + differentiable programs by analysing iterators, considering \emph{fractional |
| 24 | + iterations} and their \emph{iterating velocities}, and explicitly solve the special |
| 25 | + case of \emph{ReduceSum}. |
10 | 26 | \end{abstract}
|
11 | 27 |
|
0 commit comments