Brief introduction about BERT. How it is different from other Language Models (LMs)? What all are its advancements over others? Its features, performance evaluation, tasks by BERT, different pre-trained models, what does a BERT model name imply, model architecture, some required formatting while using BERT, few methods that can be adopted while implementing the BERT model, etc.

Photo by Soner Eker on Unsplash

Natural Language Processing (NLP) has broadened its horizons field with many distinct tasks, most task-specific datasets contain only a few thousand or a few hundred thousand human-labeled training examples. Shortage of training data is one of the biggest challenges in NLP. However, modern deep learning-based NLP models see aids from much larger amounts of data, enhancing when trained on millions, or billions, of annotated training examples.

To help close this breach in data, researchers have developed a variety of approaches for training general-purpose language representation models using the enormous amount of unannotated text on the web (known as pre-training). Then…


BLOB, Blob Storage, Azure BLOB storage, BLOB actions, Azure Blob Storage Features

A Binary Large OBject (BLOB) is a collection of binary data stored as a single entity in a DataBase Management System (DBMS).

Photo by Pat Whelen on Unsplash

Since blobs can store binary data, they can be used to store images or other multimedia files. Hence, blobs are typically images, audio, or other multimedia objects, though sometimes binary executable code is stored as a blob.

It is used for storing information in databases and database support for blobs is not universal. They often require significantly more space than other data types is a reason that blobs are used to store objects such as images, audio files…


Create a local Functions project directory which equivalent to a function app in Azure

Photo by Daniel Mingook Kim on Unsplash

A Functions project directory contains the files host.json and local.settings.json, along with subfolders that contain the code for individual functions. This directory is the equivalent of a function app in Azure.

Version 3.x/2.x requires you to select a default language for your project when it is initialized. In version 3.x/2.x, all functions added use default language templates. In version 1.x, you specify the language each time you create a function.

Prerequisites

  • A Microsoft Azure account.

Use this link to create free one.

Or else use this link to create one.


Steps to install the Azure Functions Core Tools in Windows 10

Photo by Shahadat Rahman on Unsplash

Azure Functions Core Tools includes a version of the same runtime that powers Azure Functions runtime that you can run on your local development computer. It also provides commands to create functions, connect to Azure, and deploy function projects.

Prerequisites

  • A Microsoft Azure account.

Use this link to create free one.

Or else use this link to create one.

Follow this article for the same.

Version 3.x and 2.x

Version 3.x/2.x of the tools uses the Azure Functions runtime…


Install or update the Azure Command Line Interface tools for Windows

Photo by Oxa Roxa on Unsplash

Prerequisites:

  • A Microsoft Azure account.

Use this link to create a free one.

Or else use this link to create one.

Install or update

The MSI distributable is used for installing or updating the Azure CLI on Windows. You don’t need to uninstall current versions before using the MSI installer because the MSI will update any existing version.

When the installer asks if it can make changes to your computer, click Yes

Azure CLI current version

Download and install the current release of the Azure CLI.

Current release of the Azure CLI

Azure CLI beta version

The beta version of the Azure CLI supports…


Install and configure the pseudo-distributed mode of Hadoop 3.1 in Windows 10 by setting up a single node cluster.

Image by author

Installing a virtual machine requires allocation of a large amount of RAM for it to function smoothly else it would hang constantly.

This article will explain how to install and configure single-node pseudo-distributed Hadoop 3.1 cluster on Windows 10 without a virtual machine.

Prerequisite:

Java should be installed in the system before installing Hadoop.

Install java version 1.8 in your system. If it is already installed, skip this part and move further.

If java is not installed in your system, then go this link.


OpenCV’s imwrite to save an image in a specific location with python code

Image

OpenCV’s imwrite function is used to save images in a specific location.

True

OpenCV’s imwrite saves images to the file path specified. Here we are saving the file name image.jpg to a location C:/Users/admin/Downloads with a new name saved_image.jpg.

Spark notes:

  • The output of the above code will be False in the absence of that specific location.
  • imwrite will overwrite existing files without outputting an error or asking for confirmation.
  • Image of any format can be saved using this method. The format of the image is defined by the filename’s extension (.jpg, .png, etc.).
  • One can save any image from any location to another using this method.

Reference:

[1]Chris Albon, Machine Learning with Python Cookbook: Practical Solutions from Preprocessing to Deep Learning(2018), O’Reilly Media


OpenCV python code for blurring an image using kernel or filter with the basic concepts of convolution, low pass filter, frequency of image, etc. by converting it into a gray scale image.

Blurred images

An image can be represented as a matrix. Features like edge, contrast, etc. have to be extracted from the image for image processing.

Convolution is a fundamental operation on images in which a mathematical operation is applied to each pixel to get the desired result. Here, another matrix called kernel/filter is used which is smaller in the size of the image. On each pixel of the image, this filter is applied and the new value obtained which is the value of that pixel. The obtained image is called filtered image.
Each cell of the kernel contains some value, that kernel is…


Transportation problem (TP) with example (N-W Corner Rule, Least cost method, VAM, Balanced TP, Unbalanced TP)

A railway track scissors-crossover in which a pair of switches connects two parallel rail tracks.
Photo by Zane Lee on Unsplash

In this fast-moving world, the need for the commodity is increasing day by day. Accordingly, the importance of transportation has a great role to play in society. The profit and fortunes of the companies which are moving merchandise from one corner of the country to another are determined by transportation. This is especially true when transportation costs and transportation time are overwhelming than production costs and production time. What if the transportation in all areas of handled professionally and if the costs involved are made optimal, the productivity of the country goes up even if no other factor is touched!

Akhitha Babu

Data Science student at Central University of Rajasthan, India

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store