Hadoop and Spark Installation on Raspberry Pi-3 Cluster – Part-1

In this part we will go through the hardware configurations of the Raspberyy PI-3 4 Node Cluster setup.

Hardware Configuration

---

 

1. Raspberry Pi 3 Model B 2016 Single Board Computer – 4 = 120 (bought from Microcentre)

 

 

2. Samsung EVO 32GB Class 10 Micro SDHC Card with Adapter (MB-MP32DA/AM) – 4 (12) = $48

 

 

3. Cable Matters 8-Pack, Cat5E Snagless Ethernet Patch Cable in Blue 3 Feet – 4 = $10

 

 

 

 

 

4. TRENDnet 8-Port Unmanaged 10/100 Mbps GREENnet Ethernet Desktop Plastic Housing Switch,TE100-S8 – 1 = $15

 

 

5. Anker [4-Pack] PowerLine Micro USB (1ft) – 1 = $10

 

 

6. StarTech.com USB2TYPEM 3 Feet USB to Type M Barrel 5V DC Power Cable – 1 = $4

 

 

7. 100 Pcs M2.5 x 10mm + 6mm PC Board Hexagonal Hex Threaded Spacer – 1 = $14

 

8. ORICO DUB-10P-WH 96W 10 Ports Family-Sized Smart Super USB Charger with 10 × 5V 2.4A Port – White – 1 = $20

 

 

 

9. Machine Screws (bought from Home Depot) – 2 = under $2

 

 

 

10. Thin card board from Home Depot – $4

Total Budget under $250

Except Machine Screws, Card Board and RaspberryPis all above things are bought in Amazon and NewEgg.

Additionally you can buy heat sinks and fans based on the load and extent you are going to use this cluster.

My personal cluster setup Steps:

• Drill 4 holes on to the card board as per the holes available on the Raspberry Pi
• Stack two nylon standoffs together form 20 such sets
• Insert screws from below the cardboard and 4 stacked nylon standoffs from above the cardboard
• Keep stacking Raspberry Pis (RPIs) one by one and tighten the standoffs.
• Connect 4 micro USB cables from RPIs to the USB switch
• Connect 4 ethernet cables from RPIs to the Ethernet switch
• Connect Ethernet switch to the USB switch via USB2TYPEM cable.
• Insert 32G samsung sd card into each of the RPIs
• Switch on the USB switch and the entire cluster will be powered.