Markov chains

Links

• Ask HN: Best place to start learning about Markov Chains? (2019)
• Markov-chain Monte Carlo Interactive Gallery
• Really fast Markov chains in ~20 lines of sh, grep, cut and awk (2019)
• Notes on the Theory of Markov Chains in a Continuous State Space
• Markov Chain Truncation for Doubly-Intractable Inference (2017)
• Markov-chain Monte Carlo Interactive Gallery (Code)
• Applications of Markov Chains (2003) (HN)
• Open Markov Processes (2020)
• gomarkov - Go implementation of markov chains for textual data.
• Hidden Markov models in PyMC3
• Wayeb - Complex Event Processing and Forecasting (CEP/F) engine written in Scala.
• Mici - Manifold Markov chain Monte Carlo methods in Python.
• Efficient Search with Markov Chains (2020)
• MDP-numba - Simple JIT-compiled implementation of Markov Decision Processes.
• A Tutorial on Hidden Markov Models (1989)
• A Brief History of Markov Chains (HN)
• Naive text generator built in JavaScript using Markov chains
• Генерация текста с помощью цепей Маркова
• markov-strings - Simplistic Markov chain text generator.
• markov-strings-db - Rewrite of scambier/markov-strings made to utilize a relational SQL database rather than an in-memory object.
• Localization Schemes: A Framework for Proving Mixing Bounds for Markov Chains (2022)
• Introduction to Automatic Backward Filtering Forward Guiding (2022)
• Book: Markov Chains for Programmers (Code) (HN)
• Generic markov chain implementation in Rust
• IOHMM - Python package of Input-Output Hidden Markov Model.
• marc - Markov chain generator for Python and/or Swift.
• hmmlearn - Hidden Markov Models in Python, with scikit-learn like API.