In software development when something is wrong, usually we get an error, but with data science this is not the case. If the model is not performing well, then the general approach is to alter the model architecture or tune hyperparameters and train more. Yes, these are good options, but making sure that the data is correct should be the priority.
From the television series The Newsroom¹:
The first step in solving a problem is to recognize that it does exist.
Difference in train vs test data is the single biggest reason for low performing models. Image augmentations help to…
A friend of mine reach out and asked me whether I could write a program to detect the number of Rubber stamps in an image. Apparently, these invoice receipts will be categorized based on the number of stamps on them. Initially, I thought of building a Deep Learning Segmentation model, but soon I realized that it is not worth the effort.
The images are generated in a controlled environment so few computer vision algorithms should do the trick. To illustrate the computer vision algorithms used in detecting the stamps, I will be using a sample image downloaded from Google as…
Gist is a GitHub repository where you can store & share code/data with others. A single gist can store multiple files. Syntax highlighting is supported based on the file extension type, so be careful when you name the file. Gists can be public or secret. Do note that secret gists aren’t private, meaning anyone with the URL would be able to view the code/data.
Share the Deep Learning model notebook with colleagues from different teams like Business, Data Science, Front End developer, DevOps for their opinion before the real software development takes place.
Jupyter notebook is meant for quick prototyping and everyone knows this but what many misses is we can also do a quick prototype of UI as well. Many data scientists are quick to start building the big deep learning model with whatever little data they have without even thinking about what they are developing and for whom 🤷♂️. Trust me, the first model you are satisfied with (based on…
Tuple is like List but immutable, so it has lesser in built methods. Tuples are faster than Lists, but it is noticeable only when the size of the tuple is considerably large. If you want a refresher, check out this blog by Michael Galarnyk
A general rule of thumb is to use Tuple only when the data will or should not change.
# Create Tuple with two elements
tup = (1, )# Re-assign first element
tup = 3
Want to display images side by side for comparison?
Don’t repeat yourself by typing the URL multiple times in the same Markdown file. With the help of reference, we can define the link once and reuse it as many times as required.
You can add comments by wrapping the comment inside
 and following it with
# or go with
Let the reader know that this is a video by having the screenshot (with video control buttons) as the thumbnail. …
exceptblocks are often used by programmers for handling any exception or unhappy scenarios. F
inallyclause is very under appreciated & can be better utilised. Let us check out how final-block works.
No matter what happened previously, the final-block is executed once the code block is complete and any raised exceptions handled. Even if there’s an error in an exception handler or the else-block and a new exception is raised, the code in the final-block is still run.
This quote from the python documentation is absolutely correct but the execution behavior is little tricky when
finally blocks are encapsulated within a function which has a
return statement. Let me explain with examples. See if you could guess the output of the following functions.
# Both the try & final blocks…
Before we get into what is Type Dispatch? or How Type dispatch can make you a better Python programmer, let us get some basics out of the way like What is a good python function? To be honest, I would rather let Jeff Knupp explain it.
I truly believe that the only way to really understand howsomething works is by breaking it into granular pieces and putting it back together or building it from scratch. Let us take a very well-defined use case and write a function for it from scratch. …