Research. I’m currently interested in efficient Transformer attention for graph-structured data. I’ve designed novel Monte Carlo estimators to approximate the softmax kernel, random walk-based algorithms for building ‘graph random features’, and new position encodings using Lie groups. I’m also a dilettante in robotics, statistical physics, approximate Bayesian inference, and influence functions.