Dell InfiniScale III manuali

Dell InfiniScale III Manuale Utente (27 pagine)

Marchio: Dell | Categoria: Switch di rete | Dimensione: 0.63 MB |

Inglese

Francese

Indice

M-Series User Manual

1

Contents

3

About this Manual

4

Revision History

5

1 Overview

6

1.1 InfiniBand Connectors

7

1.2 Switch Status Lights

7

2.2 Mechanical Installation

11

3.2 Updating Firmware

14

4 Troubleshooting

17

Appendix A: Specifications

18

C.1: FCC Statements (USA)

20

C.1.3 VCCI Statements (Japan)

21

8. Elimination du matériel

25

Dell InfiniScale III Manuale Utente (276 pagine)

Marchio: Dell | Categoria: Switch di rete | Dimensione: 7.70 MB |

Inglese

Indice

CONFIDENTIAL

1

 What is InfiniBand?

3

Infiniband Feature Highlights

4

 Host Channel Adapter (HCA)

5

 Switch

5

 Router (coming soon…)

5

IB Architecture Layers

6

 Link width

9

 Link Speed

9

 Link rate

9

 Media types

10

 8 to 10 bit encoding

10

Link Layer - Responsibilities

11

Link Layer: Packets

12

 Maximum Transfer Unit (MTU)

13

 16 Service Levels (SLs)

14

 Virtual Lanes (VLs)

14

Link Layer: Flow Control

15

Link Layer: Example

16

 Local ID (LID)

19

Layer 2 Forwarding

20

 Responsibility

21

 Globally Unique ID (GUID)

21

Transport Layer: Queue Pairs

23

 Data transfer

24

 Control operations

24

 RDMA Read

25

 RDMA Write

25

Transport Services

26

 Some verbs for example

30

Management Model

31

Management Model – Packets

33

Subnet Management

34

 Connection Manager (CM)

35

 Performance Management (PM)

35

 Baseboard Management (BSM)

35

Topologies

36

Full Fat Tree / Full CBB

37

Half Fat Tree / Half CBB

37

InfiniBand Link Speed Roadmap

38

6. What are VLs used for?

40

Mellanox InfiniBand Products

41

HCA Silicon Features

43

InfiniHost

45

InfiniHost III Lx

46

InfiniHost III Ex

47

ConnectX

48

ConnectX - 2

49

HCA Cards

50

 Variations:

51

ConnectX-2 Cards

52

Card Installation

54

 LEDs behavior:

55

Switch Silicon Features

56

InfiniBand Switch Silicon

57

InfiniScale III

58

InfiniScale IV

59

Superior Scaling

60

InfiniBand Adaptive Routing

61

Hardware Congestion Control

62

Port Mirroring

63

Enables utility computing

64

Up to 6 independent subnets

64

Switch Systems

65

 24 Port 4X 1U

66

 SDR or DDR Variants

66

 Power consumption:

66

Mellanox IS4 Systems Family

67

 1U 36 Ports systems

68

 IS5025

68

 IS5030

68

 IS5035

68

 MIS000079 Installation kit

69

 Rack deeper than 500mm:

69

 Use ESD mat and strap

70

1U brackets

71

 Initial Configuration

73

IS50XX LEDs and Status

74

 MTS3600

75

 MTS3610

75

 Power Side Panel:

76

MTS3600 LEDs and Status

77

 Package contents:

78

 Remember to use ESD strap

79

 Screw Rail into Rack

80

 Connect Shelf to Rack

80

 Tighten all bolts

80

 Connect eye bolts to

81

 Attach chassis to vertical

81

 Connect a valid ground to

82

 Install cable holder

82

 Verify PSU LEDs are Green

83

 ATTN LEDs should be off

84

 ATTN LED should be off

85

Setup Guide

86

Gateway Silicon and Systems

87

BX Silicon

88

Integrated PHYs

89

BridgeX System

90

Ethernet/IP

90

BridgeX – NPIV model

91

Replaceable fan drawer

92

Embedded management

92

CX4 to QSFP Hybrid Cables

92

 Fibre Channel Switches

93

Access and configuration

94

• XAUI to XFI/SFI

95

• XAUI to 10GBASE-KR

95

• 10GBASE-KR to XFI/SFI

95

Mellanox Cable Product Line

98

 Copper

99

Questions

100

 Adapters and Silicon

101

 Switch Systems

101

 BridgeX (BX)

101

InfiniBand Linux

102

SW Stack

102

MLNX_OFED

102

• Supports:

103

The SW stack

104

Mellanox OFED

105

 Pre-built RPM install

106

Configuration

107

OpenSM Subnet Manager

108

OpenSM - Features

109

Running OpenSm

110

Routing Algorithms

112

OFED Tools

113

Single Node

114

SRC/DST Pair

114

Node Based Tools

115

 /etc/init.d/openibd status

116

 modinfo ‘module name’

117

 ibstat

118

 ibv_devinfo

118

 /sys/class/infiniband

118

 Burn new HCA firmware

119

 Burn new IS4 firmware

120

 perfquery

121

 ibportstate

121

 ibroute

121

 smpquery

121

 Run performance tests

122

Collecting debug information

123

Cluster Based Tools

124

 Open source Linux tools

125

 ibswitches

126

 ibhosts

126

 ibtracert

126

 Integrated diagnostic tools

127

 Easy to use

127

Ibdiagnet usage

129

• Port LIDs

130

• Port GUIDs

130

• Host names

130

• Link Speed

130

Error counter review

132

IPoIB in a Nut Shell

136

Application

137

IPoIB Building Blocks

138

MAC address is “MACy”

139

 IPoIB MAC is not routable

141

 So…..:

141

IPoIB – A Day in a Life

142

 Address resolution

143

 Data flow

144

 Teardown

145

Bandwidth (MB/s)

146

 IPoIB runs in two modes

147

• ifconfig ib0 10.10.0.1 up

148

• MPI_I/SEND, MPI_I/RECV

150

• MPI_Wait, MPI_Walltime

150

• MVAPICH 1.1.0

150

• Open MPI 1.2.8

150

MPI Example

151

 mpicc is equivalent to gcc

152

 Basic format:

153

 Other flags:

153

MVAPICH Internals

155

Fast RDMA Path

156

 Simple send/receive buffers

157

 Used for vbuf transfers

157

Rendezvous mode (zero copy)

158

Cheat Sheet

159

SDP – Sockets Direct Protocol

160

SDP Buffering Model

163

Connection Setup

164

BCopy Data Transfer

165

Read ZCopy Data Transfer

166

Write ZCopy Data Transfer

167

Bandwidth (Gb/s)

170

SDP libdsp.so Library

171

SDP libsdp.so Library

172

SDP in OFED Overview

173

 Loading kernel module

174

 Simplest usage

175

 Configure /etc/libdsp.conf

176

 Running ssh, scp over SDP

177

Debug and monitoring

178

SRP – SCSI RDMA Protocol

179

SRP in a Nut Shell

180

SCSI I/O Operation

182

SRP connection setup

183

Disk read

184

Disk write

185

 Discovering targets

186

[port#]/add_target

187

 Used to:

188

SRP Tools - SRP Daemon

189

 srp_daemon extensions

190

Run srp_daemon automatically

191

• mkfs –t ext3 /dev/sdb1

192

• mount /dev/sdb1 /test_srp

192

 To manually run DM

194

Exercises

195

Questions:

196

Lab Exercise

198

Exercise #2 – Update firmware

200

Exercise #3 – Driver checks

201

2. Turn off Master SM

202

Exercise #7 – Switch Queries

205

Exercise #8 – MPI Tests

206

FabricIT

207

• One or two per network

209

 Hardware monitoring

210

 SNMP support

210

 Easy to use communication

210

 Fabric Subnet Manager

211

 Advanced features

211

 Fabric Inspector

211

 Additional Mellanox Tools

211

Manager User Interfaces

212

Chassis Initialization

213

Initial Switch Configuration

214

GUI/CLI Interface Overview

217

Web GUI - Basics

218

GUI – Network Interface Setup

219

GUI – Default gateway setup

220

GUI – Date/Time setup

221

CLI - Basics

222

CLI - User Modes

223

CLI - User Modes (cont.)

224

CLI – Special Command Forms

225

CLI – Network Interface Setup

226

Chassis Management

227

What is Chassis Management

228

GUI - System Monitoring

229

GUI – Port Monitoring

231

GUI – System FRU

234

CLI - System Monitoring

235

Updating the Software Image

237

GUI - Updating Software Image

238

CLI - Updating Software Image

239

 Steps to updating firmware:

241

Event Notification

243

Fabric Management

244

Fabric Management - Features

245

Licensing

246

GUI - Fabric Management

247

SM’ buttons

248

CLI - Fabric Management

249

Fabric Inspector

251

 Inspector main page:

252

9 Systems in

253

Fabric Inspector – Nodes Page

254

Fabric Inspector – Ports Page

255

Show only switch

256

System-name

257

Load from cluster

257

Save changes

257

CLI - Fabric Inspector

258

 Command that shows ports

260

Cluster Bring-up Steps

262

Scan fabric

263

Clear counters

263

System Names Utility

266

 Use filters:

267

Only Ports with Link Up

268

Check for ports with

268

FabricIT Questions

270

FabricIT Questions (cont.)

272

FabricIT Hands-on Exercises

273

FabricIT Hands-On Exercises

274

Thank You

276

Più prodotti e manuali per Switch di rete Dell

Modelli	Tipo di Documento
Brocade M6505	Manuale Utente Brocade 6505 Switch data sheet, 7 pagine
Intel PRO Family of Adapters	Manuale Utente Wake-on-LAN (WOL) Support on Dell™ Servers, 15 pagine
PowerConnect M6220	Manuale Utente Dell PowerEdge M1000e: PowerConnect M6220 Switch Stacking, 13 pagine
PowerConnect W-650	Manuale Utente W-Series Quick reference guide, 2 pagine
2724 - PowerConnect Switch	Manuale Utente Enabling Web-Managed Mode for Dell PowerConnect 2708, 2716, 12 pagine
S5000	Specifiche Dell S5000 Specifications, 36 pagine
PowerConnect J-SRX240	Manuale Utente Simplifying IT using PowerConnect J-SRX Service Gateways, 5 pagine
PowerConnect M6220	Manuale Utente DELL™ POWERCONNECT™ M6220 SWITCH, 3 pagine
S4810-ON	Specifiche Dell S4810-ON Specifications, 16 pagine
PowerConnect 6024F	Specifiche Dell PowerConnect 6024F Specifications, 24 pagine
S4820T	Specifiche Dell S4820T Specifications, 39 pagine
PowerConnect 5424	Manuale Utente PowerConnect 5424 Version 2.0.0.33 Release notes, 6 pagine
LTO-2-024	Manuale Utente HP StoreEver LTO Ultrium Tape Drives, 32 pagine
Brocade 6520	Manuale Utente BROCADE FABRIC VISION UPDATE, 45 pagine
PowerConnect 5316M	Manuale Utente VLAN configurations for Dell PowerEdge 1855 blade servers, 6 pagine
PowerConnect 3248	Manuale Utente Addendum to the 3248 and 5224 User`s Guides, 42 pagine
2161DS-2	Manuale Utente Improving Real-Time Access to Data Center Servers, 3 pagine
3348 - PowerConnect Switch - Stackable	Manuale Utente PowerConnect 3348/3324 Version 1.1.0.42 Release, 11 pagine
PowerConnect B - MLXe 8	Manuale Utente DELL Solution tooteportfelli uudised, 67 pagine
POWERCONNECT 6200 SERIES	Manuale Utente DELL PowERConnECT 6200 SERIES SwITCHES, 2 pagine

Dell dispositivi