-
How to run Ollama in a docker container using the GPU and make it accessible to external connections
Recently, I needed to configure a new machine using an NVIDIA GPU to serve an Ollama instance that could be queried from other devices on the same local network. This article walks you through the process I have been using to get it working. Install NVIDIA drivers and utility packages Before proceeding, we need to…
-
Done using Django 4.2.21 I recently had to migrate a Django application to Kubernetes and in the migration process one of my Pods threw the following error message at startup: Looking up some potential solutions, it appeared that this error message is thrown as a generic error and non specific to the underlying exception.I found…
-
I already have done a post on how to create a complete Devcontainer using Devpod and Neovim. See reference here. Recently I was challenged on creating the same setup but for other code editors like VSCode or Intellij. And since I spent some more time on it, I thought it would be also a good…
-
I spent some time pocking around with LLMs and a setup which is called RAG (Retrieval-Augmented Generation) and I stumbled on some pretty interesting benchmarks on MacOS. I’ve been a huge fan of MacBooks for the last 10+ years and especially since they launched their Apple Silicon chips. When I played around with LLMs, I…
-
Sometimes, you need to push your code automatically to more than one repository. This is totally possible in git and here is how you do it. Note: keep in mind that the most frequent use case assumes that all secondary repositories are only used for push; otherwise, you may have conflicts. Check your current git…
-
You probably heard of an amazing piece of technology called Devcontainers. Largely pushed by Microsoft through their editor Visual Studio Code and their online development platform Codepsaces, it makes this piece of software the ideal companion to completely containerize your development environments.Since I am a huge fan of containerization, I had a closer look.In this…
-
As a long term Ubuntu and Debian user (not admin), I recently came across an advice to give Arch Linux a try. First, I was kind of skeptical, having tried out more complex distributions in the past like Gentoo which were difficult to install and to maintain. It took me a couple of days (not…
-
Ever needed to get hold of what is going on in Docker or why some logs seem to be outside of the usual log files. Heck even Docker logs does not give you the information you are looking for and yet your containers seem to restart without you having any trace of that. Docker logs…
-
For some time now I do system installations on Linux machines and I find myself searching the exact commands to quickly install Docker on Ubuntu and be able to run docker commands without sudo. So, here is a quick guide to do that. System configuration The steps hereafter have been tested on: Install Docker Cleanup…
-
Today I ran into a rather annoying issue: whenever I resumed my laptop after a suspend, my external monitor won’t work; even when unplugging plugging the USB-C cable back in. My configuration So far, I am using: The problem At the time of writing, there seems to be a problem with some open drivers for…