Apache Hadoop Project

Apache Hadoop is the open source project that acts as the agenda for storage and processing large amount of data. The Apache Hadoop project mainly aims at the development of the open source software that will be used for consistent, accessible and scattered or better known as distributed computing. It is highly designed to scale and balance up from single servers to thousands of machines, each providing local advance computation and high storage capacity.

The license under which it is developed is Apache License 2.0 and it is developed for cross platform so it can be termed as interoperable. Hadoop is built under the Apache top level project which is the community of large number of people. It is developed by the people of this community and since it is the open source community people from all over the world have given the ideas and many of them have contributed to it in many ways.

The project contains some modules which can be explained as follows:

• Hadoop Common: It is the common functions and utilities that supports and maintain the other Hadoop modules.

• Hadoop Distributed File System: It is also called as HDFS. Basically it is a distributed file system which provides and gives high-throughput access to many application data. It is one of the main modules of the project.

• Hadoop YARN: It is theagenda for not only job scheduling but also cluster resource maintenance and management.

• Hadoop MapReduce: MapReduce isa YARN-based module for implementation of parallel processing of large data sets.

History of Hadoop

The history of Hadoop is quite interesting. Earlier around 2004 there was simply Google file system paper then in the mid came Google MapReduce paper. In 2005 nutch uses MapReduce. Then in the starting of 2006 Hadoop got separated from Nutch and then finally around the mid of 2008 Hadoop became Apache project. The large community of this project was formed and then the development of Hadoop project started.

Hadoop Distributed File System includes the following features: 

•  Very Large integrated Distributed File System

– contains around 10K nodes with 100 million files supporting system with capacity of 10 PB.

•  Undertakes Commodity Hardware

– All the files are fully or partially replicated to handle hardware and software failure.

–Itdetects all kinds of failures and recovers data from them with maximum accuracy.

•  Enhanced for Batch Processing

– Basically data locations are exposed such that computations and other calculations can move to wherever data exists in.

– It also provides very advanced and high comprehensive bandwidth.

So these are some advanced features of HDFS or Hadoop distributed file system that have really made the project successful.

Following are the advantages of Hadoop project:

• Flexible

• Fast

• Secure

• Scalable

• Reliable

• Cost effective


• Cross platform

• High storage capacity

• Failure resistant

• Data Replication to prevent failure.

So these are some amazing features that have really helped Hadoop to become a successful project and no doubt it has been adopted by many famous companies like Facebook, Amazon, Google, Yahoo, IBM, etc. So it’s really very successful project with highly advance features.

Some other projects related to Hadoop are Ambari, Avro, Cassandra, Pig, Hive, Chukwa, Spark etc. All of them are related to big data and cluster computing. In later posts we will also discuss about some other projects related to big data to stay connected.

Lockitron – Smart Keyless Entry System

Lockitron is a device that is capable of locking and unlocking deadbolts locks through remote control namely a smartphone. The gadget has been designed by Apigy,based in Mountain View, California, which is an easy to install app connected smart home solution that can turn any common deadbolt into a smart keyless entry system.

The device can fit over the lock control mechanism from the inside of the door while the door can be unlocked through an app on the phone or through web page control. Moreover, phones with Bluetooth Low Energy- BLE, can also unlock the door automatically when an authenticated is within range and the supplied NFC tag could be read to start a command to toggle the state of the lock.

Apigy designed Lockitron as a standalone product, based on earlier success of deadbolt replacement solutions, which can now be operational over the internet through Wi-Fi or directly from iPhone via Bluetooth 4.0. Apigy, like several hardware start-ups did encountered many problems at the time of manufacture, missed deadline due to unforeseen complications as well as quality control issues.

After successful funding campaign of two years, Lockitron has now been shipped to backer in quantity though there some minor problems with the current software with some features which were promised that seemed to be absent.

Adopted Sensor Suite with Motorized Turning Ring

Though the basic dimensions of deadbolts of US are standardized, its internal mechanics like the degree of rotation needed to activate the lock differs from each manufacturer for instance a Schlage needs a 90 degree turn to lock and unlock the bolt while products which are by Kwikset need a more substantial 120 degree turn.

To adjust the varying locking ratios, some locks have a deadbolt lever which is centrally placed in the decorative mounting plate while others place the pivot point off centre in the fascia’s lower third and to work with these roadblocks, Lockitron had adopted a sensor suite with motorized turning ring which automatically programs the locking start and stop positions, determining correct force that can also be activated by knocking.

A rubber insert grasps the deadbolt lever which can be cut or printed in 3D for an accurate fit.

Mounting Lockitron is easy, straightforward process

Mounting of the Lockitron is easy and a straightforward process which needs a Philips-head screwdriver which is included for installing purpose together with a C-shaped mounting plate which needs to be fitted between the door and decorative deadbolt plate to make a solid anchor from which Lockitron can be latched.

 The C-plate has grooves matching with common deadbolts assemblies and tabs which interlock with Lockitrons’ chassis.Installing is done by loosening the deadbolt screws from the interior door, sliding the C-plate behind the deadbolt decorative mounting plate and fitting the mounting plate into a accurate groove on the C-plate to the centre of the Lockitron.

 Thereafter, tightening the deadbolt screw ensuring that the lever turns with the least amount of resistance since deadbolts tend to be fiddly and doors are drilled with some inaccuracy. If all this is not aligned accurately there could be chances that the lever may turn out to be hard to turn. Once done the Lockitron need to be held at an angle to the door, to slip it over the tables on the C-plate, rotated till it is vertically straight up and down with the door edge and then mounted.
Lockitron Relies More on Wi-Fi than Bluetooth

Thereafter the app can be downloaded which guides the user through the process of setting up Locitrons’ software and on entering Wi-Fi network range, the app ask to connect the Lockitron with Apigy’s cloud service by taking a picture of a barcode attached to the device chassis. In Lockitron, the focus is on phone’s display at the upper right corner of Lockiron while the app flashes pattern of pulses which are captured by on board photo sensor.

The concept of Lockitron relies more on Wi-Fi rather than Bluetooth connection since Wi-Fi has a higher energy cost on the AA batteries which are included and the firmware puts Lockitron to sleep in order to conserve power. Scheduling sleep/wake is arbitrary and manual activation is limited to knocking or locking the door. At the time of leaving the home, the door is unlocked from inside and as we exit we tend to pull the door close but it still remain unlocked. We can then open the app and swipe to lock the door.

 Lockitron is a good idea and the hardware has good capabilities but its execution is not quite up to the mark. Apigy on their part are constantly making progress in updating for better Wi-Fi connection, to modify wake/sleep pattern, higher app monitoring accuracy with better mechanical operation. Moreover, the company also has plans to activate `Sense’, which is a proximity aware method of keyless entry based on Bluetooth 4.0 that was on the hyped features list.

A Single Picture: Now a Thousand Images!!!

Visual Media is considered as the most effective form of media. An average human being has the tendency to learn more via this medium than any other. As a result, nowadays every communication involves visual interactions. From buying products to learning new subjects; pictures, diagrams & videos are the modern day tools of the trade. Photography is one of the most vital examples of visual media. Since its invention, an estimated 3.5 trillion photographs have been taken till date, with 10 % of that amount being captured the past year alone. Photographs are considered useful for the following reasons: -

•   Ability to store memories of special occasions in life.

•   Capturing sceneries of beautiful holiday spots.

•    Keeping records.

Its sheer ability to express multitudes of information as well as emotions makes photography an irreplaceable tool in our daily life. Now for a second, let us imagine a photograph storing thousands more photographs in it. Though to a common person it may sound absurd, but thanks to today’s exponential rate of development of science of technology, this seemingly impossible objective is soon about to be turned into reality.

Background: -
 
Research is being conducted in the above stated matter &amazingly even a software dubbed “AverageExplorer” has been created by researchers at University of California, Berkley. Alexei Efros, an associate professor of electrical engineering & computer science is considered as the lead researcher of this project. He along with Jun-Yan Zhu, a UC Berkley CS graduate & Yong Jae Lee, a former post doctoral researcher at the University & also the lead author of the project’s findings, developed the initial programme.

Operation & Implications: -
 

•  The process of combining multiple pictures into a single image generally involves the process of combining the visual data present in each of the component systems to produce a meaningful result. Features can also be tweaked to take an average account of all the components or put weight on specific areas &characteristics, which can vary from user to user.

•  This software has an immense scope in today’s visual media ridden universe. Users can sift through tons of pictures, visual data in general in seconds simply by specifying a few constraints. The “dark matter” would no longer appear to be a subject of mystery.

•  Online Shopping will become fast, smooth &efficient, as customers would be able to make quick choices by judging “product rich” images.

•  Recognition Software would be revolutionized as computers would be able to identify facial as well as structural features in milliseconds once optimized for such operations via AverageExplorer.

•  Data storage spaces can be significantly reduced once “pictures can contain pictures” & computing, data traversing run times would hugely improve.

Once again, the beauty of technology has left humans befuddled by its magic & innovation. This software has the capability of revolutionizing the entire world of photography & to a huge extent human life, as people keep a vast amount of pictures to store special memories as well as conduct day-to-day business.

5 Apps That Will Make Spellbound

Nowadays, smartphones & tablets have become indispensible tools to an average person. Being “smart”, these gadgets are famous for providing users with innovative apps, which are capable of helping day-to-day life. Apple’s iOs & Google’s Android are the most notable smartphone/tablet operating systems & each of them boasts a plethora of apps capable of performing a wide range of tasks. These apps can be obtained from iStore (in case of Apple devices) or the Google Play Store (applicable for Android compatible devices). Most of these softwares are free & easily available but an internet connection is necessary for installation purposes. Discussed below are 5apps which are special in terms of their innovative approach & usefulness in day to day life: -

• Translator: - Language translator is an effective tool as an average person can come across multiple languages, which are unknown to him/her during his course of life, especially f he/she is a travelling professional or tourist. Google Translator helps users identify over 80 languages. It is available for freeon both iStore as well as Play Store. It is capable of identifying speech, texts even photos (only on android devices). It is a free to download app, though a running internet connection is needed for usage. 
• Encryptor: - Calls can now be made secure via ZRTP & AES 128 encryption. The man advantage being, improved privacy. Apple has Signal while Android users can use Redphone to encrypt their call. It is necessary that both callers involved have the necessary software installed on their devices. Service charges are nonexistent.
• Mosquito Repellent: -Smartphone apps can now be used to drive off mosquitoes as well. A high frequency sound is generated by the device once the concerned software is installed. People can rest easy as human ears are impervious to such high frequency sounds. Iphone users can use Anti-Mosquito Sonic Repeller while android users can go for Mosquito Go Away. Thanks to these apps, hanging outdoors can become a lot more pleasant than usual.
• Sleep Analyst: - Sleep is one of the most vital body functions necessary for maintaining a healthy life. The app known as Sleep Cycle Alarm is a useful little tool designed to help users attain a proper sleep. Once activated, it records sleep patterns before displaying detailed analysis to users. Once all such information is compiled, it creates alarm schedules in such a way that the user is ensured a proper sleep. It is very effective in maintaining life quality though time durations in attaining desirable results can vary from person to person.
• Live Scanner: - Real life emergencies require fast & effective retrieval of relevant information to ease such situations. Scanner Radio as well as Emergency Radio are apps, which make live information such as weather updates, air traffic, NOAA notifications, police activity etc easily available to users. Scanner Radio is available for free on both iStore & Play Store.

The above discussed apps are a must have for a modern smartphone user & they can count on these apps to enrich their lives.

Ultimate Sea Adventure on Phone- Oceanhorn

Oceanhorn even though seems to be inspired from Zelda; it is fantasy story full of adventure, battle and exploration. It is completely an interlaced story.

What you need to know about the game:

This game is about the story of a boy, who in search of his missing father is exploring everything about a monster named Oceanhorn. The game has exceptional narratives and has the capacity to draw the complete attention of the player and provide them with enough motivation for the actions that needs to be taken by the characters in the game. The game has been laced with high quality graphics and music to keep the player engrossed. Currently the game has been made to be compatible with every iOS and has been priced at $8.99 US.

What’s the story of Oceanhorn:

This is game all about a boy, who has been send to a completely different world with only his father’s book of his travel and a necklace of his late mother. The boy is in search of his father, who has gone missing after he went searching for Oceanhorn. The game starts with the boy meeting a hermit who guides him about collecting 3 sacred and holy emblems. In order to collect these emblems the character will be travelling across different islands and enters the exciting part of sailing and surfing.

The character can sail across different islands my developing a course of sail in the map and following the route. The water journey has been kept exciting with constant entry of attackers and enemies and other hazardous conditions. Just like most of the other games, it’s about shooting all the enemies in order to save your lives and health.

So what’s exciting?

Being a game based on adventure, exploration becomes the main exciting part. It’s up to the player to select their course of action. The choice can be difficult task as the game has not been designed to give any hints of which course or path to consider. In order to collect the emblem, player might have to repeatedly come back to same areas again and again. Interaction is the only means to collect ideas and information. These hints will enable the player to search a new area of probably complete a new task.

Puzzles have been incorporated to test the mind of the player as solving them can help to either collect treasure or get into a new location. Getting a puzzle solved is an exciting task but if it takes lot of time, might even frustrate certain players. Players need not get confused with puzzles to be main problem solver as they might to be even there just to confuse.

The enemies in the game has been developed tactfully like boss battle is about skills, player need to use their skill to kill these boss as they have to attack them for a long time and in the end can even get helpless.

What could be different?

The controls have been given well but the swipe control might occasionally trouble you and frame rate issues need to rectify.

In the end, this game will give you all the excitement you need to restore the empire of Arcadia when compared to other games at much higher costs.