Category: Data Science

  • Lip Synching Head Talking Videos At 4K using Wav2lip and Vqgan

    Lip Synching Head Talking Videos At 4K using Wav2lip and Vqgan

    Hello everyone, in this article I wanted to talk about a paper that is a follow-up of Wav2Lip:: Towards Generating Ultra-High Resolution Talking-Face Videos with Lipsynchronization. This paper makes an improvement of the Wav2Lip model so that it is able to generate lip-synching videos at 4K resolutions. And how does it manage to achieve that? […]

  • Google Dataflow Secure Quickstart with Python

    Google Dataflow Secure Quickstart with Python

    In this step-by-step guide I will share the additional steps that I followed to enable Google Dataflow with the least permissions needed, with Google KMS Encryption enabled, and all the necessary service accounts, that one would be expected to employ in a secure production deployment. I will base this guide on the already existing GCP […]

  • PHORHUM: From a 2D photo to 3D animated model by Google

    PHORHUM: From a 2D photo to 3D animated model by Google

    Google has released a paper on a new state-of-the-art machine learning model, called PHORHUM, that is able to create a 3D model from a single 2D photo, with texture disentangled from the lighting source in the photo. There is only one bad news. Google hasn’t yet released source code or a demo for anyone to […]

  • How to resize an image with Tensorflow tf.image.resize()

    How to resize an image with Tensorflow tf.image.resize()

    When dealing with training data, you often need to resize images to a fixed size, according to the architecture of the machine learning model that you want to use. In Tensorflow we can use tf.image.resize() to resize images to different resolutions. The method controls the different algorithms that we can use for resizing. You can […]

  • Does CUDA 11.6 work with Tensorflow?

    Does CUDA 11.6 work with Tensorflow?

    The short answer is No. The latest Tensorflow, which is currently Tensorflow 2.9, is not yet ready to work with CUDA 11.6. If you check the Tensorflow compatibility matrix below you will find that as of today the recommended CUDA version you should install is 11.2: Version Python version Compiler Build tools cuDNN CUDA tensorflow-2.9.0 […]

  • Installing Tensorflow 2.9 with GPU Support

    Installing Tensorflow 2.9 with GPU Support

    You have come here because you want to install Tensorflow 2.9, and you want to get it right for the first time. Typically installing Tensorflow is hard work due to the number of dependencies. The good news is that since Tensorflow 2.5, the basic dependencies haven’t changed much, CUDA 11.2 and CuDNN 8.1 is still […]

  • A tutorial on how to convert a Tensorflow model to Tensorflow.js

    A tutorial on how to convert a Tensorflow model to Tensorflow.js

    In this article, I will take you through the steps that are needed to convert any model in Tensorflow Hub to Tensorflow.JS format, and how you can quickly make a simple interactive page that you can host on any web server on the internet. I am only scratching the surface of what is possible. More […]

  • From a 2D Photo to a 3D Model with Nvidia Ganverse3D with Nvidia Omniverse Create

    From a 2D Photo to a 3D Model with Nvidia Ganverse3D with Nvidia Omniverse Create

    Remember that a few months ago I talked about a new ground-breaking application, yet to be released, from Nvidia Research Labs, called GanVerse3D, capable of rendering 3D models with texture from 2D photos?  Not only that, GanVerse3D was also supposed to be capable of animating the 3D model at a click of a button. Yes, […]

  • Blender 3D — How to create and render a scene in Blender using Python API

    Blender 3D — How to create and render a scene in Blender using Python API

    In this article, I will show you how you can create a scene in Blender, using the Python 2.93 Blender API. We will create a simple scene with a plane, a cube, texture, a light source, and a camera. Then I will show you how you can rotate a virtual camera around a cube and […]

  • How to turn 2D photos into a 3D model using Nvidia Kaolin and PyTorch – A 3D Deep Learning Tutorial

    How to turn 2D photos into a 3D model using Nvidia Kaolin and PyTorch – A 3D Deep Learning Tutorial

    If you have read my last article on GANverse3D, then you will probably have heard about the DIB-R paper, which I mentioned a few times. This was a key paper for 3D Deep Learning from 2019.  The DIB-R paper introduced an improved differential renderer as a tool to solve one of the most fashionable problems […]