Updates to TIA & ISO Data Center p Standards to Reflect Industry ...

38 downloads 139575 Views 1MB Size Report
ANSI/TIA-942-A Telecommunications Infrastructure Standard for Data Centers ( US, approved April 2012, published Aug 2012). • ISO/IEC 24764 Information ...
Updates p to TIA & ISO Data Center Standards to Reflect Industry Changes Jonathan h Jew J&M Consultants, Inc. Co-editor TIA-942-A Data Centers Telecom Infrastructure Co-chair BICSI Data Center Subcommittee Vice-chair Vice chair TIA TR-42.6 TR 42.6 Telecom Administration Vice-chair TIA TR-42.1 Commercial Buildings www.j-and-m.com

What are the standards? • ANSI/TIA-942-A Telecommunications Infrastructure Standard for Data Centers (US, approved April 2012, published Aug 2012) • ISO/IEC 24764 Information Technology – Generic Cabling for Data Centre Premises (2010, international). Addendum 1 will b published be bli h d iin 2012 • ANSI/BICSI-002 Data Center Design and Implementation Best P ti Practices (2011 (2011, iinternational) t ti l) • CENELEC EN 50173-5 Information Technology – Generic Cabling S t Systems P Partt 5 5: Data D t C Centers t (2007 (2007, European E Union) U i )

Fit TIA-942 into New TIA Cabling Standards Structure • In TIA-568-C series, cabling standards were reorganized to permit premises specific standards to be developed without duplication of content. • TIA-942-A was rewritten to fit into the new structure

Reorganization of TIA Standards

Move Content to Proper Standards • Reference generic cabling topology, terms, and MICE (mechanical, ingress, climatic, electromagnetic) environmental classifications from TIA-568-C.0 • Move bonding & grounding content to TIA-607-B • Move administration & labeling to TIA-606-B • Move racks & cabinets, power and telecom separation, and temperature/humidity requirements to TIA-569-C • Move outside plant pathways to TIA-758-B • ISO/IEC 11801 series also being reorganized

Reorganization of ISO/IEC Standards

TIA to Match with ISO •

LC connector for up to 2 fibers (ISO/IEC specifies angled LC for SM at the External Network I Interface) f )



MPO connector for more than two fibers



Removed 100m channel length limitation for horizontal cabling of fiber Now limited by application length restrictions of the type of fiber used



Match some terminology (ENI (ENI, EO)

LC

MPO

Higher Bandwidths • Specify higher bandwidth cabling types to support – Higher performance systems and applications – Higher performance networks (switch fabrics) – LAN & SAN convergence

Benefits of LAN/SAN Convergence • Reduce number of server connections • Allow use of small servers ((blade & 1U)) that can’t support large number of adapters adapters • Reduce cost and administration (fewer adapters, fewer switches, less cabling ) • Simplify support – Ethernet only (no separate Fibre Channel infrastructure) • But B it i requires i high hi h bandwidth b d id h and d low l latency l data center LAN

TIA-942-A Higher Bandwidth Copper • Retained 734/735 coax cable for T-3/E-3 • Removed support for Category 3 and 5e for horizontal cabling, but kept for backbone cabling (WAN, voice, console) • Category 6 min for horizontal cabling • Category C t 6A or higher hi h iis recommended d d ((e.g. Category 7A from ISO standards) • Category 6A is the minimum in ISO/IEC 24764 734 coax

Cat 7A

Cat 6A

10GBase-T • To support 10GBaseT, Category 6A or better recommended in TIA-942-A and minimum in ISO/IEC 24754 10GBase-TT will be widely adopted in 2012 and is • 10GBase predicted to be the most widely shipped version of 10G Ethernet in 2014

Factors in Adoption of 10Base-T • Rapidly declining cost • Improved power efficiency, now = 40Gbps (for 40GBase-T) • Length L th ttargett tto b be d determined t i d – probably b bl ~25 ~25m ffor Cat 6A & Cat 7 and ~50 m for Cat 7A (with 2 connector onne tor channels hannels and 2 m cords) ords) • Corresponding IEEE 802.3 study group created in July 2012

Higher Bandwidth Optical Fiber • Removed OM1 and OM2 (62.5 µm and non-laseroptimized 50/125 µm multimode fiber)

• OM3 (50/125 µm laser optimized) is the minimum requirement • OM4 is recommended for more bandwidth

Ethernet Channel Lengths over Multimode Fiber Fiber Type

1G

10G

40G

100G

100G

# fibers

2 275 m

2 26 m

8 -

20 -

8 -

OM1 550 m 82 m OM2 800 m 300 m 100 m 100 m >=20m* OM3 1040 m 550 m 150 m 150 m >= 100m* OM4 Distances in red are specified by manufacturers but not in IEEE standards. standards *Standard for 4-lane 100G not finalized

40G / 100G over Optical Fiber • Multimode fiber more cost effective than singlemode for lengths 150m will need single mode fiber for 40/100G Ethernet • 2 SM fibers for current standard (10/40km) • 4-lane100G SMF standard in development (500m - 2 km, 8 fibers or 2 fibers with WDM) • Future 400G/1000G (Terabit Ethernet)

TIA-942-A Energy Efficiency • New section on energy efficiency • Wider range of temperatures and humidity (see TIA-568-C) based on 2011 ASHRAE TC 9 9.9 9 guidelines • Other guidelines for energy efficiency relating l i to cabling, bli pathways, h and d spaces

Energy Efficiency • New 2011 ASHRAE guidelines being considered (ANSI/TIA569-C-1) – Temperature: 15 – 35 oC (59 – 95 oF) – Relative humidity (RH): 20 – 80% • ESD could be a problem with low humidity (= sum server port bandwidth • All connections active • More M scalable l bl than th full-mesh f ll h • Another layer of inter-connection switches can be added for very large data centers

Fat-Tree with Port Extenders

• Same as fat-tree,, but with port p extenders at top p of racks • May be non-blocking if bandwidth from access switch to port extender >= sum of bandwidth of server ports

Data Center Fabrics • Much more cabling and higher bandwidth needed for data center backbones • Possible need for longer cable runs to connect switches • Fabrics can be built using the cabling topology in ANSI/TIA-942-A – May need IDA-to-IDA IDA to IDA & HDA HDA-to-HDA to HDA cabling – Point-to-point cabling in EDAs should be less th or equall 15 m and than d within ithi a cabinet bi t row

Other Convergence • Structured cabling is being used to support other building systems y and should be considered when planning p g data centers: – – – –

IP cameras Security systems Building automation/monitoring Possibly even lighting

• See BICSI Electronics Safety & Security Design Reference Manual & TIA-862-A

Summary • Standards are being updated to support industry changes and new technologies • Consider C id ffuture t needs d tto supportt 10/40/100G to t supportt LAN/SAN convergence, data center fabrics, virtualization – Cat 6A or better (e.g. (e g Cat 7/7A) for balanced-pair balanced pair cable – OM4 for multimode fiber (with LC & MPO connectors) gy efficiencyy recommendations • Consider energy • Build modularly (in phases) • Consider the impact of data center fabrics • Consider other systems (e.g. cameras & security) that can use structured cabling

Jonathan Jew President J&M Consultants, Inc. Website: www.j www j-and-m and m.com com Email: [email protected] Co-chair BICSI data center subcommittee Co-editor TIA-942-A Vice-Chair TIA TR-42.6 telecom administration subcommittee Vice Chair TIA TR Vice-Chair TR-42.1 42 1 commercial building cabling Editor ISO/IEC TR 14763-2-1 telecom administration identifiers US National Committee Project Manager ISO/IEC 24764 data center standard Data Center & Administration Section Editor – ISO/IEC 14763-2 cabling planning & installation