JuliaPOMDP

All

69 repositories

POMDPs.jl
Public
MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on discrete and continuou…
python reinforcement-learning julia
python reinforcement-learning julia artificial-intelligence pomdps reinforcement-learning-algorithms control-systems markov-decision-processes mdps
Julia
•
Other
•109•748•23•2•Updated Mar 8, 2026Mar 8, 2026
CompressedBeliefMDPs.jl
Public
A Julia package for solving POMDPs with belief compression. Part of the POMDPs.jl community.
compression reinforcement-learning julia
compression reinforcement-learning julia artificial-intelligence pomdps dimensionality-reduction markov-decision-processes mdps
Julia
•
MIT License
•0•6•1•2•Updated Mar 2, 2026Mar 2, 2026
ContinuumWorld.jl
Public
A continuous gridworld-like MDP for education.
Jupyter Notebook
•
Other
•5•7•1•15•Updated Feb 12, 2026Feb 12, 2026
QMDP.jl
Public
QMDP Solvers for POMDPs
Julia
•
Other
•4•16•0•0•Updated Nov 17, 2025Nov 17, 2025
IncrementalPruning.jl
Public
Incremental pruning solver for partially observable Markov decision processes
Julia
•
MIT License
•3•5•1•0•Updated Nov 17, 2025Nov 17, 2025
RockSample.jl
Public
Implement the rock sample problem using POMDPs.jl
Julia
•
Other
•8•7•0•1•Updated Nov 17, 2025Nov 17, 2025
DeepQLearning.jl
Public
Implementation of the Deep Q-learning algorithm to solve MDPs
machine-learning reinforcement-learning deep-reinforcement-learning
machine-learning reinforcement-learning deep-reinforcement-learning pomdps
Julia
•
Other
•14•78•8•0•Updated Nov 16, 2025Nov 16, 2025
TabularTDLearning.jl
Public
Julia implementations of temporal difference Reinforcement Learning algorithms like Q-Learning and SARSA
reinforcement-learning q-learning sarsa
reinforcement-learning q-learning sarsa
Julia
•
Other
•6•13•1•0•Updated Nov 16, 2025Nov 16, 2025
PointBasedValueIteration.jl
Public
Point-based value iteration solver for POMDPs
Julia
•
MIT License
•5•6•1•0•Updated Nov 16, 2025Nov 16, 2025
MCVI.jl
Public
Julia
•
Other
•3•5•3•0•Updated Nov 16, 2025Nov 16, 2025
FIB.jl
Public
Fast informed bound solver for POMDPs.
Julia
•
Other
•3•2•3•0•Updated Nov 16, 2025Nov 16, 2025
MCTS.jl
Public
Monte Carlo Tree Search for Markov decision processes using the POMDPs.jl framework
Julia
•
Other
•36•81•9•4•Updated Nov 16, 2025Nov 16, 2025
BeliefGridValueIteration.jl
Public
Offline POMDP solver computing an upper bound of the value function in a discretized belief space.
Julia
•
Other
•2•3•0•0•Updated Nov 16, 2025Nov 16, 2025
TagPOMDPProblem.jl
Public
Tag POMDP problem using POMDPS.jl
Julia
•
MIT License
•1•2•2•0•Updated Nov 16, 2025Nov 16, 2025
AEMS.jl
Public
Anytime error minimization search for POMDPs, implemented in Julia.
Julia
•
Other
•3•6•1•0•Updated Nov 16, 2025Nov 16, 2025
POMDPSolve.jl
Public
A Julia wrapper for pomdp-solve that interfaces with the POMDPs.jl framework
Julia
•
Other
•4•11•3•0•Updated Nov 16, 2025Nov 16, 2025
POMCPOW.jl
Public
Online solver based on Monte Carlo tree search for POMDPs with continuous state, action, and observation spaces.
pomdps
pomdps
Julia
•
Other
•20•59•5•0•Updated Nov 16, 2025Nov 16, 2025
BasicPOMCP.jl
Public
The PO-UCT algorithm (aka POMCP) implemented in Julia
planning pomdps pomcp-algorithm
planning pomdps pomcp-algorithm po-uct
Julia
•
Other
•18•37•6•1•Updated Nov 16, 2025Nov 16, 2025
ARDESPOT.jl
Public
Implementation of the AR-DESPOT POMDP algorithm
Julia
•
Other
•8•12•8•1•Updated Nov 16, 2025Nov 16, 2025
AdaOPS.jl
Public
An implementation of the AdaOPS (Adaptive Online Packing-based Search), which is an online POMDP Solver used to solve problems defined with the POMDPs.jl genera…
Julia
•
Other
•3•16•1•0•Updated Nov 16, 2025Nov 16, 2025
GlobalApproximationValueIteration.jl
Public
Julia
•
MIT License
•6•7•1•0•Updated Nov 16, 2025Nov 16, 2025
LocalApproximationValueIteration.jl
Public
Julia
•
Other
•6•10•2•0•Updated Nov 16, 2025Nov 16, 2025
DiscreteValueIteration.jl
Public
Value iteration solver for MDPs
Julia
•
Other
•12•21•6•1•Updated Nov 16, 2025Nov 16, 2025
DroneSurveillance.jl
Public
Implementation of a drone surveillance problem with POMDPs.jl
Julia
•
Other
•8•8•0•0•Updated Nov 16, 2025Nov 16, 2025
LaserTag.jl
Public
Jupyter Notebook
•
Other
•8•4•3•1•Updated Nov 16, 2025Nov 16, 2025
POMDPModels.jl
Public
Problem models for testing POMDPs.jl
Jupyter Notebook
•
Other
•28•34•13•0•Updated Nov 16, 2025Nov 16, 2025
GapHeuristicSearch.jl
Public
A Julia implementation of the Gap Heuristic Search online planning algorithm, for use with the POMDPs.jl ecosystem.
Julia
•1•0•1•0•Updated Nov 16, 2025Nov 16, 2025
VDPTag2.jl
Public
Julia
•
Other
•8•7•2•0•Updated Nov 16, 2025Nov 16, 2025
POMDPLinter.jl
Public
Tools to help develop POMDP Models
Julia
•
MIT License
•3•3•4•0•Updated Oct 14, 2025Oct 14, 2025
MOMDPs.jl
Public
An extension of POMDPs.jl for Mixed Observability MDPs
Julia
•
Other
•3•7•1•0•Updated Jun 27, 2025Jun 27, 2025