At Montvieux, I act as a technical lead and internal consultant on Reinforcement Learning research projects. During my time at Montvieux, I have overseen research projects to push the edge of reinforcement learning in the domain of Cyber Security, especially in terms of generalisation and data efficiency. I have also led research on Multi-Agent Reinforcement Learning and the use of Genetic Algorithms in control problems. During this work, I have developed novel algorithms and deployed them at scale using Ray's RLLib framework, as well as enhancing my understanding of Reinforcement Learning theory. My work has also allowed me to teach RL to the rest of the company through talks and organised hackathon events. During my time at Montvieux, I have also been exposed to other fields of AI and improved my python coding ability.
My first job out of university was as a developer at Blue Prism, a robotic process automation company. I worked in an agile environment with most of my current work being written in C# with an SQL backend. I helped my developmentteam is enhance the scalability of the Blue Prism product by modernising the communication protocols of the software robots. I have been responsible for multiple RnD projects resulting in presentations and further improvements to the product.
Doing a masters in AI felt like a natural next step after graduating from my bachelors. During my studies at Edinburgh, I kept my skill set well-rounded by studying various fields in AI. I particularly excelled in computer vision, traditional machine learning, and the more modern deep learning. However, I eventually found my forte in reinforcement learning and metaheuristics, the topics of my master thesis - a comprehensive review of reinforcement learning and ant colony optimisation. Work from this thesis has been published
I spent the first two years of my undergraduate degree learning software development skills including OO programming, web design, and mobile development. I began my first machine learning courses at the start of my third year and then shifted my focus wholly to AI. I graduated with a first-class degree in 2018.
As an intellectually curious person, I have worked many side projects that have helped me to develop my skills. Occasionally I will produce a write up for these projects that I publish on my webpage and medium. These projects are dated now, and aren't my finest work, but are still interesting.
Below are some examples of the areas I have worked in (Click the text to see more):
The majority of the code that I produce is available on my GitHub.