Code Repositories

asym-rlpo - Asymmetric Reinforcement Learning under Partial Observability

Code for

Baisero and Amato, “Unbiased Asymmetric Reinforcement Learning under Partial Observability,” in Proceedings of the Conference on Autonomous Agents and Multiagent Systems, 2022.
Baisero, Daley, and Amato, “Asymmetric DQN for Partially Observable Reinforcement Learning,” in Proceedings of the Conference on Uncertainty in Artificial Intelligence (to appear), 2022.
Available at abaisero/asym-rlpo.

rl-psr - Reward-Predictive State Representations

Code for

Baisero and Amato, “Reconciling Rewards with Predictive State Representations,” in Proceedings of the International Joint Conference on Artificial Intelligence, 2021.
Available at abaisero/rl-rpsr.

Learning Internal State Models in Partially Observable Environments

Code for

Baisero and Amato, “Learning Internal State Models in Partially Observable Environments,” in Reinforcement Learning under Partial Observability, NeurIPS Workshop, 2018.
Available at abaisero/2018-nips-rlpo-code.

gym-pomdps - Gym Environments for Flat POMDPs

Gym environments for POMDPs and DecPOMDPs respectively encoded by .POMDP and .DPOMDP files.

Available at abaisero/gym-pomdps.

rl-parsers - Reinforcement Learning Parsers

Parsers for file formats related to reinforcement learning, including the standard .MDP, .POMDP and .DPOMDP file formats, and the custom .FSC (Finite State Controller) and .FSS (Finite State Structure) file formats.

Available at abaisero/rl-parsers.

one-to-one - Tools for Semantic Indexing

Tools for flat indexing of complicated semantic structures.

; Useful to access tables of values indexed by objects with rich interfaces and attributes.

Family of classes which represent bijections between sets of \(N\) structured and/or semantic values/objects and a corresponding set of indices \(\{0, \ldots, N-1\}\); Useful to represent and access tables of values indexed directly by objects with rich interfaces and attributes.

The provided classes automate (via a user-friendly interface) the conversions between values and indices.

Available at abaisero/one-to-one.

pytk - Python Toolkit

A personal repository of general purpose utilities including: context managers, decorators, iterators, collections, and 3D geometry classes. This code is in continuous fluctuation, and not significantly stable.

Available at abaisero/pytk.

Website

This website is built with Jekyll, a minimalistic static website generator that uses HTML, Markdown, and Liquid to define page templates and fill in content. The website style is powered by Bootstrap (an HTML/CSS/JS framework) and Font Awesome (an icon toolkit). Despite not being a web developer, these tools allowed me to create this website with ease.

Available at abaisero/website.