A lot of factors can affect the performance of a Deep Neural Network. Let’s see how we can set up a PyTorch pipeline for Image augmentation (with help of Albumentations Python library), and use visualization to find any potential issue before it costs you time and money.
In software development when something is wrong, usually we get an error, but with data science this is not the case. If the model is not performing well, then the general approach is to alter the model architecture or tune hyperparameters and train more. Yes, these are good options, but making sure that the data is correct should be the priority.
From the television series The Newsroom¹:
The first step in solving a problem is to recognize that it does exist.
Difference in train vs test data is the single biggest reason for low performing models. Image augmentations help to…
We will use OpenCV to identify the number of stamps in a picture.
Background
A friend of mine reach out and asked me whether I could write a program to detect the number of Rubber stamps in an image. Apparently, these invoice receipts will be categorized based on the number of stamps on them. Initially, I thought of building a Deep Learning Segmentation model, but soon I realized that it is not worth the effort.
The images are generated in a controlled environment so few computer vision algorithms should do the trick. To illustrate the computer vision algorithms used in detecting the stamps, I will be using a sample image downloaded from Google as…
Markdown’s code block is great for writing code snippets. However, when you try to publish or share it via blogging platform there are some shortcomings. Gist can help to bridge the gap. Gist makes your blog look better & easier to maintain. In this post, Let us see how automated gist creation can improve your technical blogging experience.
Gist Intro
Gist is a GitHub repository where you can store & share code/data with others. A single gist can store multiple files. Syntax highlighting is supported based on the file extension type, so be careful when you name the file. Gists can be public or secret. Do note that secret gists aren’t private, meaning anyone with the URL would be able to view the code/data.
Why to use gist?
- Supports GitHub repository functionalities like version control, fork & clone.
- Ability to subscribe, star and comment makes gist easy to collaborate with others.
- Gist can be shared in multiple ways without any dependency or installation.
Build a digit emoji predictor in Jupyter notebook by passing data between JavaScript & Python. Typically, JavaScripts are used for data visualization in notebooks, but it can also be used for prototyping front-end/UI for deep learning models.
Why the hell build UI in Notebook?
Short Answer:
Share the Deep Learning model notebook with colleagues from different teams like Business, Data Science, Front End developer, DevOps for their opinion before the real software development takes place.
Jupyter notebook is meant for quick prototyping and everyone knows this but what many misses is we can also do a quick prototype of UI as well. Many data scientists are quick to start building the big deep learning model with whatever little data they have without even thinking about what they are developing and for whom 🤷♂️. Trust me, the first model you are satisfied with (based on…
Most Python programmers are guilty (me included) of always using List without even considering Tuple at all. Surely for some use cases, Tuple should be better, right? Keep reading for one such case.
Tuple is like List but immutable, so it has lesser in built methods. Tuples are faster than Lists, but it is noticeable only when the size of the tuple is considerably large. If you want a refresher, check out this blog by Michael Galarnyk
Caveat
A general rule of thumb is to use Tuple only when the data will or should not change.
# Create Tuple with two elements
tup = (1, [2])# Re-assign first element
tup[0] = 3
Step up your Markdown game with useful and practical tips.
1. Align Images Horizontally
Want to display images side by side for comparison?
- Place the images inside a table.
- Have the image caption as the title.
2. Using Reference for Links
Don’t repeat yourself by typing the URL multiple times in the same Markdown file. With the help of reference, we can define the link once and reuse it as many times as required.
3. Comment
You can add comments by wrapping the comment inside [] and following it with # or go with <!--Comment Here-->.
4. Embed Video with Thumbnail
Let the reader know that this is a video by having the screenshot (with video control buttons) as the thumbnail. …
In python, try and except blocks are often used by programmers for handling any exception or unhappy scenarios. Finally clause is very under appreciated & can be better utilised. Let us check out how final-block works.
Deep dive
No matter what happened previously, the final-block is executed once the code block is complete and any raised exceptions handled. Even if there’s an error in an exception handler or the else-block and a new exception is raised, the code in the final-block is still run.
This quote from the python documentation is absolutely correct but the execution behavior is little tricky when try and finally blocks are encapsulated within a function which has a return statement. Let me explain with examples. See if you could guess the output of the following functions.
Example 1:
# Both the try & final blocks…Writing a function in python is easy but writing a good function is not that easy. Most python programmers are often not aware of how to write clear and concise functions, let alone using Type Dispatch. Let us see how we can write better functions in python using Type Dispatch.
Getting Started
Before we get into what is Type Dispatch? or How Type dispatch can make you a better Python programmer, let us get some basics out of the way like What is a good python function? To be honest, I would rather let Jeff Knupp explain it.
I truly believe that the only way to really understand howsomething works is by breaking it into granular pieces and putting it back together or building it from scratch. Let us take a very well-defined use case and write a function for it from scratch. …
