All

69 repositories

POMDPs.jl
Public
MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on discrete and continuou…
python reinforcement-learning julia
python reinforcement-learning julia artificial-intelligence pomdps reinforcement-learning-algorithms control-systems markov-decision-processes mdps
Julia
•
Other
•107•758•23•2•Updated Apr 12, 2026Apr 12, 2026
POMDPModels.jl
Public
Problem models for testing POMDPs.jl
Jupyter Notebook
•
Other
•28•34•13•0•Updated Mar 20, 2026Mar 20, 2026
CompressedBeliefMDPs.jl
Public
A Julia package for solving POMDPs with belief compression. Part of the POMDPs.jl community.
compression reinforcement-learning julia
compression reinforcement-learning julia artificial-intelligence pomdps dimensionality-reduction markov-decision-processes mdps
Julia
•
MIT License
•0•6•1•2•Updated Mar 2, 2026Mar 2, 2026
ContinuumWorld.jl
Public
A continuous gridworld-like MDP for education.
Jupyter Notebook
•
Other
•5•7•1•15•Updated Feb 12, 2026Feb 12, 2026
QMDP.jl
Public
QMDP Solvers for POMDPs
Julia
•
Other
•4•16•0•0•Updated Nov 17, 2025Nov 17, 2025
IncrementalPruning.jl
Public
Incremental pruning solver for partially observable Markov decision processes
Julia
•
MIT License
•3•5•1•0•Updated Nov 17, 2025Nov 17, 2025
RockSample.jl
Public
Implement the rock sample problem using POMDPs.jl
Julia
•
Other
•9•7•0•1•Updated Nov 17, 2025Nov 17, 2025
DeepQLearning.jl
Public
Implementation of the Deep Q-learning algorithm to solve MDPs
machine-learning reinforcement-learning deep-reinforcement-learning
machine-learning reinforcement-learning deep-reinforcement-learning pomdps
Julia
•
Other
•14•78•8•0•Updated Nov 16, 2025Nov 16, 2025
TabularTDLearning.jl
Public
Julia implementations of temporal difference Reinforcement Learning algorithms like Q-Learning and SARSA
reinforcement-learning q-learning sarsa
reinforcement-learning q-learning sarsa
Julia
•
Other
•6•13•1•0•Updated Nov 16, 2025Nov 16, 2025
PointBasedValueIteration.jl
Public
Point-based value iteration solver for POMDPs
Julia
•
MIT License
•5•6•1•0•Updated Nov 16, 2025Nov 16, 2025
MCVI.jl
Public
Julia
•
Other
•3•5•3•0•Updated Nov 16, 2025Nov 16, 2025
FIB.jl
Public
Fast informed bound solver for POMDPs.
Julia
•
Other
•3•2•3•0•Updated Nov 16, 2025Nov 16, 2025
MCTS.jl
Public
Monte Carlo Tree Search for Markov decision processes using the POMDPs.jl framework
Julia
•
Other
•35•81•9•4•Updated Nov 16, 2025Nov 16, 2025
BeliefGridValueIteration.jl
Public
Offline POMDP solver computing an upper bound of the value function in a discretized belief space.
Julia
•
Other
•2•3•0•0•Updated Nov 16, 2025Nov 16, 2025
TagPOMDPProblem.jl
Public
Tag POMDP problem using POMDPS.jl
Julia
•
MIT License
•1•2•2•0•Updated Nov 16, 2025Nov 16, 2025
AEMS.jl
Public
Anytime error minimization search for POMDPs, implemented in Julia.
Julia
•
Other
•3•6•1•0•Updated Nov 16, 2025Nov 16, 2025
POMDPSolve.jl
Public
A Julia wrapper for pomdp-solve that interfaces with the POMDPs.jl framework
Julia
•
Other
•4•11•3•0•Updated Nov 16, 2025Nov 16, 2025
POMCPOW.jl
Public
Online solver based on Monte Carlo tree search for POMDPs with continuous state, action, and observation spaces.
pomdps
pomdps
Julia
•
Other
•20•60•5•0•Updated Nov 16, 2025Nov 16, 2025
BasicPOMCP.jl
Public
The PO-UCT algorithm (aka POMCP) implemented in Julia
planning pomdps pomcp-algorithm
planning pomdps pomcp-algorithm po-uct
Julia
•
Other
•18•38•6•1•Updated Nov 16, 2025Nov 16, 2025
ARDESPOT.jl
Public
Implementation of the AR-DESPOT POMDP algorithm
Julia
•
Other
•8•12•8•1•Updated Nov 16, 2025Nov 16, 2025
AdaOPS.jl
Public
An implementation of the AdaOPS (Adaptive Online Packing-based Search), which is an online POMDP Solver used to solve problems defined with the POMDPs.jl genera…
Julia
•
Other
•3•16•1•0•Updated Nov 16, 2025Nov 16, 2025
GlobalApproximationValueIteration.jl
Public
Julia
•
MIT License
•6•7•1•0•Updated Nov 16, 2025Nov 16, 2025
LocalApproximationValueIteration.jl
Public
Julia
•
Other
•6•10•2•0•Updated Nov 16, 2025Nov 16, 2025
DiscreteValueIteration.jl
Public
Value iteration solver for MDPs
Julia
•
Other
•12•21•6•1•Updated Nov 16, 2025Nov 16, 2025
DroneSurveillance.jl
Public
Implementation of a drone surveillance problem with POMDPs.jl
Julia
•
Other
•8•8•0•0•Updated Nov 16, 2025Nov 16, 2025
LaserTag.jl
Public
Jupyter Notebook
•
Other
•8•4•3•1•Updated Nov 16, 2025Nov 16, 2025
GapHeuristicSearch.jl
Public
A Julia implementation of the Gap Heuristic Search online planning algorithm, for use with the POMDPs.jl ecosystem.
Julia
•1•0•1•0•Updated Nov 16, 2025Nov 16, 2025
VDPTag2.jl
Public
Julia
•
Other
•8•7•2•0•Updated Nov 16, 2025Nov 16, 2025
POMDPLinter.jl
Public
Tools to help develop POMDP Models
Julia
•
MIT License
•3•3•4•0•Updated Oct 14, 2025Oct 14, 2025
MOMDPs.jl
Public
An extension of POMDPs.jl for Mixed Observability MDPs
Julia
•
Other
•3•7•1•0•Updated Jun 27, 2025Jun 27, 2025

ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

JuliaPOMDP

All

All

69 repositories

POMDPs.jl

POMDPModels.jl

CompressedBeliefMDPs.jl

ContinuumWorld.jl

QMDP.jl

IncrementalPruning.jl

RockSample.jl

DeepQLearning.jl

TabularTDLearning.jl

PointBasedValueIteration.jl

MCVI.jl

FIB.jl

MCTS.jl

BeliefGridValueIteration.jl

TagPOMDPProblem.jl

AEMS.jl

POMDPSolve.jl

POMCPOW.jl

BasicPOMCP.jl

ARDESPOT.jl

AdaOPS.jl

GlobalApproximationValueIteration.jl

LocalApproximationValueIteration.jl

DiscreteValueIteration.jl

DroneSurveillance.jl

LaserTag.jl

GapHeuristicSearch.jl

VDPTag2.jl

POMDPLinter.jl

MOMDPs.jl

All

All

Repositories list

69 repositories