I guess if your a Tech guy that was not a confusing read ,

New Post Public Reply Private Reply Replies (1) Message Board
2can chessmite #12732
I guess if your a Tech guy that was not a confusing read , I had to look stuff up just to keep up. great reading chessmite.

I didn't know what the heck a node was....say what !!
I had to look it up Kool chess.

This is what I got to help me with the understanding.
Understanding Hadoop Clusters and the Network

http://bradhedlund.com/2011/09/10/understandi...e-network/

This article is Part 1 in series that will take a closer look at the architecture and methods of a Hadoop cluster, and how it relates to the network and server infrastructure. The content presented here is largely based on academic work and conversations I’ve had with customers running real production clusters. If you run production Hadoop clusters in your data center, I’m hoping you’ll provide your valuable insight in the comments below. Subsequent articles to this will cover the server and network architecture options in closer detail. Before we do that though, lets start by learning some of the basics about how a Hadoop cluster works. (In a hurry? Download this article here.) OK, let’s get started!


Server Roles in Hadoop

The three major categories of machine roles in a Hadoop deployment are Client machines, Masters nodes, and Slave nodes. The Master nodes oversee the two key functional pieces that make up Hadoop: storing lots of data (HDFS), and running parallel computations on all that data (Map Reduce). The Name Node oversees and coordinates the data storage function (HDFS), while the Job Tracker oversees and coordinates the parallel processing of data using Map Reduce. Slave Nodes make up the vast majority of machines and do all the dirty work of storing the data and running the computations. Each slave runs both a Data Node and Task Tracker daemon that communicate with and receive instructions from their master nodes. The Task Tracker daemon is a slave to the Job Tracker, the Data Node daemon a slave to the Name Node.

Client machines have Hadoop installed with all the cluster settings, but are neither a Master or a Slave. Instead, the role of the Client machine is to load data into the cluster, submit Map Reduce jobs describing how that data should be processed, and then retrieve or view the results of the job when its finished. In smaller clusters (~40 nodes) you may have a single physical server playing multiple roles, such as both Job Tracker and Name Node. With medium to large clusters you will often have each role operating on a single server machine.

In real production clusters there is no server virtualization, no hypervisor layer. That would only amount to unnecessary overhead impeding performance. Hadoop runs best on Linux machines, working directly with the underlying hardware. That said, Hadoop does work in a virtual machine. That’s a great way to learn and get Hadoop up and running fast and cheap. I have a 6-node cluster up and running in VMware Workstation on my Windows 7 laptop.


Hadoop Cluster
Hadoop Cluster

This is the typical architecture of a Hadoop cluster. You will have rack servers (not blades) populated in racks connected to a top of rack switch usually with 1 or 2 GE boned links. 10GE nodes are uncommon but gaining interest as machines continue to get more dense with CPU cores and disk drives. The rack switch has uplinks connected to another tier of switches connecting all the other racks with uniform bandwidth, forming the cluster. The majority of the servers will be Slave nodes with lots of local disk storage and moderate amounts of CPU and DRAM. Some of the machines will be Master nodes that might have a slightly different configuration favoring more DRAM and CPU, less local storage.

In this post, we are not going to discuss various detailed network design options. Let’s save that for another discussion (stay tuned). First, lets understand how this application works…


Digital Uts Ventures (DUTV) Stock Research Links

DUTV Board Company Profile Buy Rating Time & Sales News Filings Financials
Scroll down for more posts ▼

Top 10 Most Recent News Articles

Vail’s Board Fight Puts Strategy Under a Sharp Lens

Updated Category News Views 62

Fresh snow does not make a boardroom dispute disappear. Vail Resorts has put out an investor presentation ahead of its December 14, 2026 annual meeting, asking shareholders to support all nine of management’s director nominees on its white proxy card. That is the formal message. The real message is plainer: NYSE:MTN knows this election has become a test of whether...

Continue Reading
Color Me Mine Tests Florida's Creative Leisure Demand

Updated Category News Views 72

Pottery studios are not exactly the sort of thing that makes markets pound the table, but Florida’s latest Color Me Mine push deserves a closer look. The company signed three franchise agreements in 2026 for Panama City Beach, Doral and Boca Raton, adding planned growth to a state where it already operates 11 studios. For a private franchisor, this is not a quarterly...

Continue Reading
Peptide Labels Cannot Substitute for Clinical Care

Updated Category News Views 151

A Label Is Not a Care Plan Those three little words, research use only, carry far more weight than a flashy product page would have people believe. The HelloNation article featuring wellness expert Andres Giraldo makes a plain but necessary distinction: a research-use-only, or RUO, label does not turn a peptide into prescribed treatment, and it sure does not establish...

Continue Reading
Somerville’s New Immersive Bet Has Room to Grow Locally

Updated Category News Views 74

A passcard, a hidden door, and 12,000 square feet of mischief have landed at Somernova. Edge of Elsewhere, the new flagship attraction from Boston-area creative studio Midnight Mansion, is open in Somerville’s Union Square as of November 18, 2026. It is part interactive art installation, part puzzle game, part physical story world. That sounds delightfully odd, which is...

Continue Reading
Watson Motion Tests Military Pretrial Confinement Rules

Updated Category News Views 170

Military confinement fights are rarely neat, and this one comes with a short clock but plenty of unanswered questions. Defense lawyers for U.S. Air Force Maj. Jason Watson argued on Nov. 17 that he should be released from pretrial confinement while his case proceeds. A military judge is ordinarily expected to issue a ruling within 14 days of the hearing, under the court's...

Continue Reading
AI Gives CPA Firms a New Advisory Staffing Math Today

Updated Category News Views 75

Month-end just got a lot less comfortable for firms living on the clock. Netsurit and Southwestern Talent are pitching the Virtual CFO Platform as a way for CPA firms to turn machine-led analysis into advisory work without first building a costly bench of specialists. That is not a cute workflow tweak. It goes straight at the labor model that has kept plenty of accounting...

Continue Reading
Hanmi Compressor Tests Vietnam Before Wider Expansion

Updated Category News Views 175

Compressed air is the sort of factory necessity nobody brags about until it fails, and that is precisely why Hanmi Compressor’s Vietnam plan deserves a sober look. The Daegu-based specialist is not arriving with a grand export victory lap. It is still building the front door: a website, a promotional video, and a process for finding Vietnamese manufacturers and...

Continue Reading
Hitachi's Quiet Fusion Bet Is Really About Data Control

Updated Category News Views 69

Weeks of engineering work can vanish because one storage system hiccups, which is a rotten way to learn that data infrastructure belongs in the mission-critical column. Esteyco’s new environment, built with Hitachi Vantara and implemented by Quadrics Sistemas, is not a fusion breakthrough. It is the less glamorous machinery that keeps serious fusion research from...

Continue Reading
Emaar's Huspy Deal Brings Financing Into Home Sales

Updated Category News Views 87

Mortgage paperwork is nobody’s idea of luxury, yet it can wreck a property sale faster than a bad floor plan. Emaar Properties has partnered with Dubai-based Huspy to give its customers access to mortgage advice and financing comparisons from more than 20 UAE banks. It is not a flashy tower launch or a headline-grabbing land purchase. Frankly, that is why investors...

Continue Reading
RayNeo's Black Friday Push Tests Smart Glasses Demand

Updated Category News Views 160

A million shipped pairs is a real milestone, but holiday markdowns are where the rubber meets the road for RayNeo. The company is taking its XR gaming glasses and iO AI smart glasses into Europe’s Black Friday scrum with discounts running through late November, betting that portability, giant virtual screens and a little AI convenience can pry open consumers’ wallets....

Continue Reading

Top 5 Most Recently Viewed Articles

How the Bank of England's Interest Rate Decision Impacts Your Investments

Updated Category Economy Views 316

Introduction The Bank of England's decision on interest rates plays a critical role in shaping the economic landscape, with far-reaching effects on your investment portfolio. Changes in these rates can influence stock market performance, affect bond yields, and alter the attractiveness of various asset classes. Understanding how these adjustments can impact your...

Continue Reading
Eric Beightel Joins Environmental Science Associates Team

Updated Category News Views 131

Eric Beightel Appointed as Federal Strategy Director Environmental Science Associates (ESA) is thrilled to welcome Eric Beightel to its team as the new Federal Strategy Director. With a comprehensive background in environmental policy, Beightel brings a wealth of knowledge to ESA, poised to enhance its capabilities in navigating the complexities of federal regulations....

Continue Reading
iBio Inc. Showcases Innovative Antibody Developments Soon

Updated Category News Views 257

Exciting Presentations from iBio Inc. iBio, Inc. (NASDAQ: IBIO), a pioneering biotechnology company, is gearing up to present breakthrough research on its Activin E antibody. This development showcases its commitment to addressing critical health challenges like obesity. Recently, Cory Schwartz, Ph.D., the Director of Research and Early Development at iBio, announced his...

Continue Reading
Turkey's Markets Experience A Dip as Investors React

Updated Category News Views 319

A Dip in Turkey's Stock Market Performance Turkey's stock market witnessed a decline recently, with shares closing lower on the exchange. The BIST 100 index, a benchmark for investors, finished down by 0.60%, indicating a challenging trading day for stakeholders. Sectors Impacting Market Trends Leading the Declines A noticeable drop in market values was driven by several...

Continue Reading
Medline Celebrated for Innovation in Respiratory Care Solutions

Updated Category News Views 180

Medline secured the prestigious Zenith Award from the American Association for Respiratory Care (AARC) in 2024, marking a significant moment for traders and healthcare pros alike. This award wasn’t just handed out; it was earned by only eight companies out of over 300 nominees. The kind of spotlight that draws attention can shake up market sentiments. Why Medline Stood...

Continue Reading