Year: 2022

  • Tensorflow not detecting GPU

    Tensorflow not detecting GPU

    If TensorFlow doesn’t detect your GPU, it will default to the CPU, which means when doing heavy training jobs, these will take a really long time to complete. This is most likely because the CUDA and CuDNN drivers are not being correctly detected in your system. I am assuming that you have already installed Tensorflow […]

  • Does CUDA 11.6 work with Tensorflow?

    Does CUDA 11.6 work with Tensorflow?

    The short answer is No. The latest Tensorflow, which is currently Tensorflow 2.9, is not yet ready to work with CUDA 11.6. If you check the Tensorflow compatibility matrix below you will find that as of today the recommended CUDA version you should install is 11.2: Version Python version Compiler Build tools cuDNN CUDA tensorflow-2.9.0 […]

  • Installing Tensorflow 2.9 with GPU Support

    Installing Tensorflow 2.9 with GPU Support

    You have come here because you want to install Tensorflow 2.9, and you want to get it right for the first time. Typically installing Tensorflow is hard work due to the number of dependencies. The good news is that since Tensorflow 2.5, the basic dependencies haven’t changed much, CUDA 11.2 and CuDNN 8.1 is still […]

  • How to setup Tensorflow on Ubuntu Linux with multiple GPUs using Docker

    How to setup Tensorflow on Ubuntu Linux with multiple GPUs using Docker

    For this tutorial, I will be setting up the latest version of Tensorflow, currently 2.9 with GPU support on a workstation kindly provided by SabrePC with 4 x RTX 3080. For those curious, here is a clip of what this workstation looks like: Setting up Tensorflow typically requires a lot of hard work as you […]

  • What does it mean to create a service identity in GCP?

    What does it mean to create a service identity in GCP?

    This is a very short article to briefly discuss a poorly documented beta feature in GCP. The ability to create a service identity for an API. Creating a service identity, is the process of creating a service account, with a predefined email address for a specific API or service. This service account is used by […]

  • How to start a docker container and delete the container on exit

    How to start a docker container and delete the container on exit

    In this very quick article, I am sharing a command snippet that you probably need to run often. You want to start a docker container locally but you don’t want to leave anything leftover running or even the container itself after you exit. Here is how you do it: -it -i and -t are used […]

  • Python Exercise for Beginners – Implementing One Hot Encoding

    Python Exercise for Beginners – Implementing One Hot Encoding

    In today’s Python exercise we will create a one-hot encoding algorithm to convert categorical data to a numerical format. The reason why we need to do this is that machine learning algorithms only can deal with numbers, not strings. What is One Hot Encoding? One-hot encoding is a way of representing categorical information in binary […]

  • What is a Kubernetes Sidecar Container?

    What is a Kubernetes Sidecar Container?

    One of the most useful patterns in Kubernetes is the Sidecar pattern. But what is a sidecar pattern? Typically a Pod in Kubernetes contains one container only(single container pod). But it is possible for a Pod to contain more than one container. In that case, it is called a multi-container pod.  When another container is […]

  • Reducing 90% in costs with Spot VMs for Machine Learning on Google Kubernetes Engine in GCP

    Reducing 90% in costs with Spot VMs for Machine Learning on Google Kubernetes Engine in GCP

    When running big machine learning training jobs using neural networks, you need a GPU. And let’s be honest, GPUs are expensive and hard to get nowadays with the chip shortage! So it is unlikely that you will have plenty of spare GPUs lying around. This is why it makes sense to rent GPUs on the […]

  • How I migrated all my websites to Google Kubernetes Engine on the cheap using Spot VMs

    How I migrated all my websites to Google Kubernetes Engine on the cheap using Spot VMs

    Today I wanted to share with you a project that has kept me busy throughout the Christmas holidays. I have been migrating all my websites, which were previously scattered across several servers in GCP and AWS to one single cluster using Google Kubernetes Engine.My criteria for this project was to reduce costs as much as […]