Hi, Welcome to my blog. I am Avinash Sooriyarachchi and I write about my work in data and machine learning here. Most of my work has been deep learning focused and as of late I’ve been doing more stuff with language models and machine learning based systems.
You can check out some of my projects here:
Popular repos:
- makeMoE- Sparse Mixture of Experts Language Model from Scratch (Hacker News)
- seemore: From scratch implementation of a vision language model in pure PyTorch
- Tuning the Fintetuning: An exploration of achieving success with QLoRA
My Talks:
Empowering Generative AI with Databricks and AMD-Data and AI Summit 2024
Streaming machine learning with Databricks and Github Actions - Universe 2022
ODSC Europe 2023 - Getting Up to Speed on Real Time Machine Learning
Monetizing Data Assets: Sharing Data, Models and Features - Data and AI Summit 2023
Selected Blogs:
Efficient Fine-Tuning with LoRA: A Guide to Optimal Parameter Selection for Large Language Models
Building a Similarity-based Image Recommendation System for e-Commerce
Common Sense Product Recommendations using Large Language Models
Build your own AI Coding Assistant with Databricks using Visual Studio Code and GitHub Copilot
Getting Up to Speed on Real-Time Machine Learning with Spark and SBERT
Posts
SeeMoE: Implementing a MoE Vision Language Model from Scratch
seemore: Implement a Vision Language Model from Scratch
Use of convolutions for time series prediction and natural language processing
Building a Natural Language Processing API with SAS Viya, FastAPI, and Docker
Effective Hyperparameter Optimization of LightGBM Classifiers with Optuna
Bayesian Optimization for Neural Architecture Search
Interactive Explainable Machine Learning with SAS Viya, Streamlit, and Docker
subscribe via RSS