MATLAB implementation of all the Operations Research algorithms and problems solved by me.

⛓️ Python package which provides you a simple way to generate phrases using Markov chains.

🦜 DISCOTRESS 🦜 is a software package to simulate and analyse the dynamics on arbitrary Markov chains

🔁 Stationary distributions for arbitrary finite state Markov processes, including specializations for the Moran, Wright-Fisher, and other processes, exact (when possible) and approximate computations

A package for temporal point process modeling, simulation and inference (unmaintained)

ChainoPy: A Python Library for Discrete Time Markov Chain based stochastic analysis

Learn to get started using DISCOTRESS with these tutorials! Then apply to your own Markov chains in ecology 🦜🌴 economics 💸📈 biophysics 🧬🦠 and more!

Random word generation using Random Markov Processes

Gevo (Graph EVOlution) - Python implentation of Markov process simulations on model graphs.

String generator based on Markov process

Kalman Filter algorithm simulation with Markov process for state estimation.

Fast R implementation of Gillespie's Stochastic Simulation Algorithm

An R package for fitting Coxian Phase-Type distributions using the Expectation-Maximization (EM) algorithm. Supports parameter estimation, model selection, survival function computation, and visualization for applications in survival analysis, queueing models, and reliability engineering.

An Open Source Tool for Analyzing Discrete Markov Chains.

Python code for posterior sampling of a semi-Markov Jump Process

A book about Markov processes

a spark version of probability suffix tree based on markov process

Implementation of a Denoising Diffusion Probabilistic Model with some mathematical background.

⛓️ Teaching material on Markov processes

Maximum Entropy (MaxEnt) parameter inference in biological networks.