Running RL algorithms on the fish/shark aquarium environment to find unexpected biological insights.

Classifying, auto-encoding and reverse-engineering QUBO matrices

C++ implementation of the continuous LunarLander environment.

Minimal example for the Zoho Mail API using Flask. Supports OAuth refresh tokens and shows how to automatically send a HTML mail from a Flask server.

It GRABs you, it consumes you. What is GRAB doing you ask? It is learning. With 0 domain knowledge.

Single header library for parsing Chromium's SNSS files

Block advertisements that are inserted in Twitch streams directly.

Speculative research

AlphaZero written in C++, for research. Includes some tangential goodies such as imitation learning, Python implementations and a plethora of experiments.

Super simple, research only

Real-time Dynamic Programming (RTDP)

Small minimum size gym environments for testing (and maybe finding edge cases)

Subgoal MCTS (and some more such as GRAB) implemented in Python

BRTDP implemented including DS-MPI for upper bound

Solving routing with uncertainty using Markov decision processes

Screenshot Tracker for Mac - Rewatch what you've worked on.

SQL conveniency functions: Query and exec in 2-3 lines

LRZ Sync+Share library for uploads and other file management

Temp

Rich MinigamesAPI supporting different types of Minigames

Counts your keypresses per session and shows charts

3d multiplayer chess program

Event based UCI wrapper

Youtube playlist player (kinda webradio)

Easy to use proxy fetcher and changer for Windows 7+

Create a player's skin out of blocks

A Soundcloud Downloader in a small Console app

Download videos as mp3 into your music library