Skip to content

Commit

Permalink
Fix a few formatting things in optimiser docs
Browse files Browse the repository at this point in the history
  • Loading branch information
kshyatt committed Oct 23, 2019
1 parent fa5737f commit 1f9193d
Showing 1 changed file with 3 additions and 4 deletions.
7 changes: 3 additions & 4 deletions src/optimise/optimisers.jl
Original file line number Diff line number Diff line change
Expand Up @@ -442,14 +442,13 @@ function apply!(o::Optimiser, x, Δ)
end

"""
InvDecay(γ)
InvDecay(γ)
Applies inverse time decay to an optimiser
## Parameters
- gamma (γ): Defaults to `0.001`
## Example
```julia
Optimiser(InvDecay(..), Opt(..))
```
Expand All @@ -470,7 +469,7 @@ function apply!(o::InvDecay, x, Δ)
end

"""
ExpDecay(eta, decay, decay_step, clip)
ExpDecay(eta, decay, decay_step, clip)
Discount the learning rate `eta` by `decay` every `decay_step` till a minimum of `clip`.
Expand Down Expand Up @@ -509,7 +508,7 @@ function apply!(o::ExpDecay, x, Δ)
end

"""
WeightDecay(wd)
WeightDecay(wd)
Decays the weight by `wd`
Expand Down

0 comments on commit 1f9193d

Please sign in to comment.