Published in Analytics Vidhya

·Pinned

How to Pick the Optimal Image Size for Training Convolution Neural Network?

When training a Convolution Neural Network on a custom dataset, picking the right image is crucial. This will impact the training time & performance of the model. Also, we will learn how to identify if there are any issues with the dataset.

Why?

Before we jump to how part, Let us discuss the negative consequence of choosing the wrong size. After we pick a fixed width and height, the standard procedure is to resize all the images to this fixed size. So, now every image falls into one of the two buckets.

Downscaling…

Read more · 3 min read

Published in Analytics Vidhya

·Pinned

Do You Visualize DataLoaders for Deep Neural Networks?

A lot of factors can affect the performance of a Deep Neural Network. Let’s see how we can set up a PyTorch pipeline for Image augmentation (with help of Albumentations Python library), and use visualization to find any potential issue before it costs you time and money.

Photo by Startup Stock Photos from Pexels

In software development when something is wrong, usually we get an error, but with data science this is not the case. If the model is not performing well, then the general approach is to alter the model architecture or tune hyperparameters and train more. …

Stamp Detection using Computer Vision and Python

We will use OpenCV to identify the number of stamps in a picture.

Background

A friend of mine reach out and asked me whether I could write a program to detect the number of Rubber stamps in an image. Apparently, these invoice receipts will be categorized based on the number of stamps on them. …

Customize or Extend Python Third-Party Modules Using Partial Function

Let me explain with an example.

Introduction

Partial functions allow us to fix values for some arguments of a function and generate a new function. The common example for partial function would be:

This example is a solid starter example for partial functions, but feels more like a syntactic sugar rather than functionality gain. …

Validate User Input in Python Function

Writing type hints for function arguments is a good start, but as the name suggests, it only hints at the data type of argument. When the functionality of the code depends on the data type of argument, then we must put validations in place.

Introduction

Type hints are great, they help you to write better code and reduce documentation required for external users or downstream software developers. However, type hints do not validate the input from the user. In my opinion, without any validation, you are playing the odds, but if you are up for…

Read more · 3 min read

Published in Analytics Vidhya

·Jun 10

7 Advanced Markdown Tips!

Step up your Markdown game with useful and practical tips.

1. Align Images Horizontally

Want to display images side by side for comparison?

Place the images inside a table.
Have the image caption as the title.

Image Source

2. Using Reference for Links

Don’t repeat yourself by typing the URL multiple times in the same Markdown file. …

Automate Gist Creation From Markdown File Using Python

Markdown’s code block is great for writing code snippets. However, when you try to publish or share it via blogging platform there are some shortcomings. Gist can help to bridge the gap. Gist makes your blog look better & easier to maintain. In this post, Let us see how automated gist creation can improve your technical blogging experience.

Gist Intro

Gist is a GitHub repository where you can store & share code/data with others. A single gist can store multiple files. Syntax highlighting is supported based on the file extension type, so be careful when you name the file. Gists can be public or secret. …

Read more · 3 min read

Published in Analytics Vidhya

·Apr 30

Digit Emoji Predictor: Build UI for Deep Learning model in Notebook

Build a digit emoji predictor in Jupyter notebook by passing data between JavaScript & Python. Typically, JavaScripts are used for data visualization in notebooks, but it can also be used for prototyping front-end/UI for deep learning models.

Why the hell build UI in Notebook?

Short Answer:

Share the Deep Learning model notebook with colleagues from different teams like Business, Data Science, Front End developer, DevOps for their opinion before the real software development takes place.

Jupyter notebook is meant for quick prototyping and everyone knows this but what many misses is we can also…

Do You Really Understand Try & Finally in Python?

In python, `try` and `except` blocks are often used by programmers for handling any exception or unhappy scenarios. F`inally` clause is very under appreciated & can be better utilised. Let us check out how final-block works.

Deep dive

No matter what happened previously, the final-block is executed once the code block is complete and any raised exceptions handled. Even if there’s an error in an exception handler or the else-block and a new exception is raised, the code in the final-block is still run.

This quote from the…

Read more · 3 min read

Published in Analytics Vidhya

·Apr 10

Write Better Python Functions (Using Type Dispatch)

Writing a function in python is easy but writing a good function is not that easy. Most python programmers are often not aware of how to write clear and concise functions, let alone using Type Dispatch. Let us see how we can write better functions in python using Type Dispatch.

Getting Started

Before we get into what is Type Dispatch? or How Type dispatch can make you a better Python programmer, let us get some basics out of the way like What is a good python function? To be honest, I would rather let Jeff Knupp explain it.

I truly believe that…

When training a Convolution Neural Network on a custom dataset, picking the right image is crucial. This will impact the training time & performance of the model. Also, we will learn how to identify if there are any issues with the dataset.

Why?

A lot of factors can affect the performance of a Deep Neural Network. Let’s see how we can set up a PyTorch pipeline for Image augmentation (with help of Albumentations Python library), and use visualization to find any potential issue before it costs you time and money.

We will use OpenCV to identify the number of stamps in a picture.

Background

Let me explain with an example.

Introduction

Writing type hints for function arguments is a good start, but as the name suggests, it only hints at the data type of argument. When the functionality of the code depends on the data type of argument, then we must put validations in place.

Introduction

Step up your Markdown game with useful and practical tips.

1. Align Images Horizontally

2. Using Reference for Links

Gist Intro

Build a digit emoji predictor in Jupyter notebook by passing data between JavaScript & Python. Typically, JavaScripts are used for data visualization in notebooks, but it can also be used for prototyping front-end/UI for deep learning models.

Why the hell build UI in Notebook?

In python, try and except blocks are often used by programmers for handling any exception or unhappy scenarios. Finally clause is very under appreciated & can be better utilised. Let us check out how final-block works.

Deep dive

Writing a function in python is easy but writing a good function is not that easy. Most python programmers are often not aware of how to write clear and concise functions, let alone using Type Dispatch. Let us see how we can write better functions in python using Type Dispatch.

Getting Started

Aravind Ramalingam

In python, `try` and `except` blocks are often used by programmers for handling any exception or unhappy scenarios. F`inally` clause is very under appreciated & can be better utilised. Let us check out how final-block works.