122309 EIP Book of Knowledge

8/2/2019 122309 EIP Book of Knowledge

1/120

1

EIP Book of KnowledgeDecember 23, 2009

KnowBase 57174


2/120

2

Purpose

This document includes practical information that may or may not beincluded in other documentation.

With time, some of the information may be included in formal

publications. Likewise, a previously not widely understood topicmay become widely know and can be deleted from this document.

Changes, additions & deletions, are made over time.

If you have an EtherNet/IP topic that should be described but is notalready covered elsewhere, contact Dan Zaniewski.


3/120

3

Outline

References Topologies Connectivity Segmentation Performance

Availability Manageability Troubleshooting Scalability Security Switches

Media Some list prices (2008) General topics Whats new in v18 Appendix


4/120

4

References

www.odva.org/Home/ODVATECHNOLOGIES/EtherNetIP/EtherNetIPLibrary/tabid/76/Default.aspx

www.rockwellautomation.com/knowledgebase/?OpenForm

samplecode.rockwellautomation.com/idc/groups/public/documents/webassets/sc_home_page.hcst

Product: Network Communications

Technology: Faceplates

Title: Ethernet

www.ab.com/networks/site-index.html

www.ab.com/networks/architectures.html

Rockwell/Cisco reference archtictures, Design & Implementation Guide

Publication ENET-UM001G-EN-P

Provides connection and packet rate specs for modules
http://www.odva.org/Home/ODVATECHNOLOGIES/EtherNetIP/EtherNetIPLibrary/tabid/76/Default.aspxhttp://www.odva.org/Home/ODVATECHNOLOGIES/EtherNetIP/EtherNetIPLibrary/tabid/76/Default.aspxhttp://www.rockwellautomation.com/knowledgebase/?OpenFormhttp://samplecode.rockwellautomation.com/idc/groups/public/documents/webassets/sc_home_page.hcsthttp://samplecode.rockwellautomation.com/idc/groups/public/documents/webassets/sc_home_page.hcsthttp://www.ab.com/networks/site-index.htmlhttp://www.ab.com/networks/architectures.htmlhttp://www.ab.com/networks/architectures.htmlhttp://www.ab.com/networks/site-index.htmlhttp://www.ab.com/networks/site-index.htmlhttp://www.ab.com/networks/site-index.htmlhttp://samplecode.rockwellautomation.com/idc/groups/public/documents/webassets/sc_home_page.hcsthttp://samplecode.rockwellautomation.com/idc/groups/public/documents/webassets/sc_home_page.hcsthttp://www.rockwellautomation.com/knowledgebase/?OpenFormhttp://www.odva.org/Home/ODVATECHNOLOGIES/EtherNetIP/EtherNetIPLibrary/tabid/76/Default.aspxhttp://www.odva.org/Home/ODVATECHNOLOGIES/EtherNetIP/EtherNetIPLibrary/tabid/76/Default.aspx


5/120

5

Topologies

What topologies are there?

Line Ring (cable redundancy)

Star

Double star (distribution switch redundancy)

Combinations


6/120

6

Linear topology

Advantages Architecturally, a drop-in replacement for RIO.

Disadvantage Some traffic may traverse multiple switches

(Fewer switches in the path is better)

Switch1 Switch2 Switch3 Switch4


7/120

7

Linear topology

How many switches can I have in a line?

ANSWER:

That depends on several factors: Single point of failure consideration

Clients tolerance for delay (e.g. timeout)

Switchs capacity (e.g. wire-speed on all ports, switching fabric)

The amount of traffic (uni, multi, broadcast) queued in front of amessage under test.

Troubleshooting a longer line is more difficult to find the problem


8/120

8

Connectivity

Methods for connecting IP networks:

Isolated

Not connected to any other network Restricted

By protocol, IP address, MAC, etc.

Integrated (full connectivity)

Reference: EtherNet/IP 10 Commandments

(www.ab.com/networks/site-index.html)


9/120

9

Segmentation

How many nodes can I put on a network?

Fewer is better (see notes) because: Broadcast storm size and duration is less Protection against defective device behavior Spanning tree event (re-convergence) reduced exposure

Losing a few nodes to a malfuncton is better than more nodes

Why do I segment? Performance and security

How do I segment automation networks? VLAN (connected thru a router, if needed) Subnetworks (connected thru router, if needed)

Isolation EIP-only protocol (CLGX bridge)

Best approachIdentify who needs to talk to who, how they talk, and THEN we will discuss how-to.


10/120

10

Performance

System performance requires:

- characterizing each component in the system- combining the components for end-end result

Latency (including queuing)

Jitter

Multicast containment

Broadcast limiting

QoS


11/120

11

Availability

Switches

Media

CLGX redundancy inc ENBT/EN2x


12/120

12

Manageability

Manage device/sys changes, inc reconfig

Monitor (determine if we are within specs)

Baseline (take a snapshot of good system)

Troubleshoot (fix a customer anomaly)

Management tools


13/120

13

Troubleshooting - Basics


14/120

14

Troubleshooting - RA Module DiagnosticsModule diagnostics (basic) --- see web server

Link state: Link should be up (connected to a powered switch).

Duplex: Full duplex

Auto/forced: Autonegotiate

Speed: 100Mbps

Errors: In errors and out errors should be 0. Very important!

CIP connection timeouts: 0 is expected

CIP connections:


15/120

15

3 params not onthis page

- Link state

- Errors

- HMI pps


16/120

16

Troubleshooting - common

One common anomaly.duplex mismatchAutonegotiation is out-of-the-box easy to use and reliable. But, if your

company policy is to force the duplex and speed, this is legitimate.However, if you force, remember to force both the switch port and thecorresponding end-device. Other wise, there will be a mismatch and

communications problems will occur.

Depending on the timing of who-transmits-when, the problem may not beobvious or may be very obvious.

Examine both the switch port and the end-device (e.g. 1756-ENBT) for

Ethernet errors. Signature errors for duplex mismatch include:- Late collisions

- FCS/CRC errors

- Alignment errors


17/120

17

Troubleshooting S8000

If you cycle power, the date/time changes to

Feb 28 1993

This is how the product was designed byCisco. There is no battery to retain thedate/time. CompactFlash retains theswitch configuration but not thedate/time.


18/120

18


To gather switch data quickly, especially withmultiple switches, use Cisco Network Assistantto look at the Monitor tab:

1. Reports tab

Port Statistics

2. Views

Topology shows all the switches.

3. System Messages

This info is close, if not identical, to the switch log file.


19/120

19


What do I look at first with a Stratix 8000?(How do I know if the switch is happy?)

a) Log file (Device mgr or CLI)- Dev Mgr, Monitor Alert Log- CLI, show log

b) Interfaces (Device Mgr or CLI)

c) Additional steps are anomaly dependent:

Example:

show spanning-tree

show rep


20/120

20

Troubleshooting - Basics

Provide the required files describe in this document.

If you open a tech support case but do not provide all the files,analysis will take longer and waste everybodys time.

Do NOT use Wireshark without first discussing with Tech Support.

Any customer anomaly needs to have a tech support case opened.

You can call Commercial Engineering to discuss a situation but theywill not work on a post sale event unless you have a tech supportcase open AND tech support has requested help (case wasescalated).

Wireshark trace analysis generally takes time to analyze and create

a user-friendly report. There is no such thing as a quick look.


21/120

21

Troubleshooting - General

Files we need: Network drawing (all switches, routers, copper/fiber converters, wireless, etc.)

IP address of the nodes and also the types of devices

Switch operating status including errors, duplex, forced/auto (CLI or web browser)

Relevant Logix acd file(s)

Configuration file for each switch Firmware versions

If you use HTTrack software, this will be provided by the software.

Search the Knowledgebase for any known anomalies associated with the products inyour system

If 1794-AENT/A is involved, then verify if ground clip helps

Module screen captures (use HTtrack Website Copier, www.httrack.com)

HTtrack software is free and easy to use. It copies all the pages quickly.

Examples: Home, Diagnostics Overview, Ethernet statistics, I/O connections

Possibly a network capture at this time, possibly later (use Wireshark)


22/120

22

Troubleshooting - General

Get a description of the anomaly

What is the problem the customer sees? (simple description)

Example: The I/O tree in RSLogix5000 has a yellow triangle on a Flex I/O module.

Only a single device is being lost?

Example: Only a single device, a 1794-IB16 module, has a yellow triangle

Was it ever operating correctly or did this start recently?

How often does it happen? (constantly, once per hour, once per week?)

For how long does the anomaly last? (3 seconds, forever?)

How do you recover? (cycle power to device?, recovers by itself?)

What additional steps, if any, did you already take to troubleshoot?E.g. hardware changes


23/120

23

Troubleshooting - GeneralAt some point, you might be asked for a network capture

Install Wireshark (free at www.wireshark.org)

Configure port mirroring in a switch (see next pages for details)

In your report, specify which device was port mirrored.

Send a short (e.g. 5-10 seconds) trace to immediately for review

To verify that port mirroring is configured correctly.

Identify the IP addresses that are having a problem and all others in capture

Dont configure any capture filters (we need to see all the frames)

Limit each capture file size to 10Mbytes. (Bigger is time-consuming to analyze.)

See next page for details.

Multiple file capture (circular buffer, see next pages for detail)

If the event cannot be easily put into 1 file, configure Wireshark for multiple files.

The number of files is dependent on how many are needed to insure that you stop the

trace before the circular buffer event is overwritten.

NOTE: If port mirroring functionality is not available (device is not a managedswitch), you need to work around it.
http://www.wireshark.org/http://www.wireshark.org/


24/120

24

Troubleshoot multicast flooding

Verify if multicast is floodingThe customer may be using multicast (produce tag or I/O). If multicast

is flooding, IGMP is not configured or is not working. This may be asignificant factor.

Install Wireshark (free, www.wireshark.org)

Do NOT port mirror

Connect your PC to an unused switch port

Run Wireshark for at least 2 minutes (120 seconds) Provide a list of all IP addresses

Provide network drawing
http://www.wireshark.org/http://www.wireshark.org/


25/120

25

Stratix8000 Port mirroring

In release 4, a port mirroring anomaly wasdiscovered.

In Device Manager, if you mirror a port, FA1/1 for

example, to the target port, FA1/8 for example,all is well. However, if you then decide to mirrora different source port, FA1/2 for example, to thesame destination port, then both source portswill be mirrored.

The workaround is to first select a Smartports roleof None before changing the source port.


26/120

26

Troubleshooting module RejectsRejects means that the Ethernet module hardware passed a frame to the

firmware but the firmware looks at the packet and then dropped it. Thisincrements the Reject diagnostic and also counts toward CPU usage. Rejectswill occur for the following reasons:

-Duplicate multicast streams

The firmware enables module hardware to accept specific multicast groups. The hardwarecannot distinguish duplicates.Recommendation: Avoid duplicate multicast groups by having less than 1025 nodes on a

network.

- The hash table (hardware) is not perfectResulting in some multicast being past to the module firmware.Recommendation: Always configure/verify IGMP. Then, no rejects for this reason.

- One of the CIP bi-directional communication streams stops

One of the participants (e.g. data producer) times out and closes the connection. The otherparticipant has not yet timed out. Then, the absent stream starts arriving again. The restartedstream will be rejected because there no longer is a CIP connection open with that connectionidentifier.Recommend: Replace bad hardware and avoid system disturbances.

All three of the above are the same in that the firmware cant associate a received packet

with an active CIP connection ---- it's rejected .


27/120

27

Troubleshoot Wireshark overview

If a network trace is requested: Install Wireshark (free at www.wireshark.org)

Identify what device (e.g. 1756-ENBT) needs to be mirrored Configure the switch for port mirroring Take a quick (30 seconds) test trace

Examine the test trace to verify That port mirroring was configured That all expected IP addresses are present

Multiple Wireshark files (circular buffer) may be required Max of 10Mbytes per file please

Provide a list of all IP addresses Provide network drawing Provide a simple description of the anomaly

Example: CLGX 1.2.3.4 loses its connection to Point I/O 1.2.3.5 once a week.


28/120

28

Troubleshoot Wireshark

CIP connectionsCIP connections are bi-directional. During trace analysis,

packets in both directions need to be identified by their

connection identifiers. The identifiers are provided in theforward open reply. So, when pursuing a class 1(produce tag or I/O) connection anomaly, the trace mustcontain a forward open and then, of course thesubsequent anomaly. The anomaly could be some

packet loss or loss of the connection.

See the next 2 slides for more information.


29/120

29


CIP connections

If produce tag or I/O connections are being lost and

recovered frequently, then a Wireshark trace shouldinclude these without any additional work on your part.

However, if connection losses occur infrequenently, you will

need to make a forwardOpen (makes a connection)happen. Again, the forwardOpen includes connectionidentifiers for both directions (O->T and T-> O).


30/120

30


CIP connections

If class 1 connections are being lost infrequently, you willneed to do something to make sure there is aforwardOpen in the trace (in addition to the anomaly).

You can make this happen several ways at either of the 2Ethernet modules involved in the CIP connection:

- Remove/reconnect the Ethernet cable- Inhibit the connection and reenable (RSLogix5000)

- Cycle power


31/120

31

Configure port mirroring on a switch1. Identify the device --- is it a switch (recommended) or a hub?

2. Verify that the switch has port-mirroring

If the switch is unmanaged, it does not have this feature.

3. If the switch is managed, see switch documentation fordirections to configure port-mirroring

Common methods:

- web browser (Internet Explorer)

- serial cable

- customer application

4. Verify which port you are to mirror

Identify the device you need to view.

Getting ready for a Wireshark trace


32/120

32


What happens if I have a switch but I dont

port mirror?

By design, multicast and broadcast traffic will flood all switch ports.

If you do not port mirror, your Wireshark trace may see only multicast,broadcast, and traffic related to applications running on yourWireshark trace. Unicast frames will be absent (unless you are

running some networked application on your Wireshark PC).

IT IS IMPORTANT THAT ALL FRAMES, INCLUDING UNICAST, ARE

IN THE TRACE.


33/120

33

What if the device is an unmanaged switch or is ahub?

To get a network trace, you have the following options: Replace the device with a managed switch (preferred)

Replace the device with a hub

Replace the device with a passive tap



34/120

34

Multiple file capture circular buffer

If the event you are trying to capture in a trace happens frequently, youmight be able to capture it in a single small file.

If the event happens infrequently, you will need to configure Wiresharkto run continuously, filling multiple files in a circular buffer. See thenext slide for more information.

NOTE: You must manually stop the trace after the event BEFORE theevent is overwritten in the circular buffer.



35/120

35


Multiple file capture configuration circular buffer

Specifyenough files

to insure thatyou have

time to stopthe capturebefore theevent is

overwritten.

Limit filesize to

10Mbytes


36/120

36

What we need if the basic troubleshooting steps above do not solve theproblem.

Examine grounding (use visual inspection)

Also, see 1794-AENT statement in section B above.

Examine cable lay and re-route (noise could be induced into a cable)

Replace hardware

Cable, switch, RA Ethernet module.

Examine power to the device

Troubleshooting now what?


37/120

37

Scalability/Flexibility

Allow for reserve switch port capacity

Moving devices

Adding devices IP address scheme

Allow for reserve performance capacity


38/120

38

Security

Level1

Level2

Level3 DMZ

How to (ACL, Firewall) secure


39/120

39

Stratix Switches

Family members --- 8000, managed, RA/Cisco, 6-26 ports

Released Summer 2008

6000, managed, RA, 4 or 8 portsReleased Summer 2008

2000, unmanaged, 3-8 ports

March 2008

See RA literature library and search using Stratix fordocumentation.


40/120

40

Ports 6, 10, 14, 18, 22, 26

Base 6 port

10 port

Base with one expansion Base with 8 copper

Base with 8 fiber (10/100Mbps)

Base with 2 expansions Base with 16 copper

Base with 8 copper and 8 fiber


41/120

41

Major Stratix Switch Topics

Four software tools for configuation Device manager (web server), recommended RSLogix5000 AOP CNA (Cisco Network Assistant) CLI (most comprehensive, most difficult)

Reset-to-factory-default procedure Express Setup Password recovery procedure Switch replacement (use compact flash) IOS upgrade Troubleshooting using switch diagnostics RSLinx, RSNetWorx, faceplates switch access Hardware: 2 power supply connectors, compactFlash


42/120

42

S8K Reset-to-factory-default

Cycle power and insert paper clip immediately

Keep paper clip in until 3 LEDs turn solid red

EIP Mode LED EIP Net LED

Setup LED

Remove paper clip and wait until Setup LED is solid

green Both config.txt and VLAN.dat files were both deleted

You are all done.


43/120

43

Stratix8K Express Setup

1. Clear the switch of configuration (previous slide)

2. On your PC disconnect all Enet cables but one.

3. Configure the Ethernet port for DHCP

4. Disconnect the PC from the switch5. Insert paper clip until a port blinks off/green

6. Insert your PC into the blinking port


44/120

44

Stratix8K Express Setup

7. You should see the following screen

Configure the parameters where you see arrows.

8. Select Submit.


45/120

45

Major Stratix Switch Topics

Describe AOP major functions (config, diagnostics)

Describe system tags (program accessible)

Inputs

Outputs (including password)

Comparing S8K and S6K

S6K does not support Spanning-tree or RSTP

S6K supports OSI layer 2 CoS

However, ODVA is going in the direction of layer 3 CoS (DSCP)

S6K supports VLANs local to a switch Does not support VLAN trunking protocol.

Does not tag frames (2 bytes added that include VLAN info)


46/120

46

Config Recommendations

Recommended system configuration Avoid mixed spanning tree protocols

A loop will allow a broadcast storm. A single protocol is the best approach.

Multiple protocols may prevent loops but verification testing is needed.

IGMP

Affect of multiple queriers

Affect of mixing versions (v1-v3)

VLAN

Consider use of VLANs as a default

Configure trunks to carry only needed VLANs

For what common things do I need to use CLI?


47/120

47

Stratix 8000 facts customers asked about

VLANs VLANs are a good thing. Use be default, not exception.

Create VLANs and assign ports to each VLAN

Supports multiple VLANs

Supports configuration of an interface for each VLAN

However, the CIP identity object supports only a single VLANinterface.

If you configure more than 1 VLAN interface, the first willrespond to AB_ETHIP (RSLinx)

- In the Dev Mgr, how do you add ports to an existing VLAN?

Answer: Select nothing in the Smartports Role window. Then,select the Customize button.


48/120

48

VLANs and interfaces

Q: Where do I need to configure interfaces?

A: In general each L2 switch should have one, and not more than one,management interface (IP address) configured.

Additionally, a L3 switch that needs to do inter-VLAN routing, needs tohave an interface to each VLAN. These interfaces are each an IPaddress that is the gateway used by each devices on each VLANincluding Logix Ethernet modules.

Interface Summary

Interfaces are: management, VLAN, or physical port on a L3 switch thatis configured as a router port (ie. In CLI, no switchport)


49/120

49

VLAN important information

L2 switches

- Create VLANs

- Add ports (e.g. FA1/1) to each VLAN

- Specify a gateway address in Express Setup.

L3 switches

- Create VLANs

- Create IP address for each VLAN (gateway address)


50/120

50

Switch/router access

Q: Can I reconfigure any switch or routerwithout knowing the passwords?

A: Yes. For many/most devices, givenphysical access, there is a backdoorprocedure, vendor specific.


51/120

51

Stratix 8000 multicast

The default maximum number of multicastthat a switch can store is 255.

However, the maximum number can be

increased. ( Waiting on Mark to identify the details (11/18/09 email from Markabout multiple items which can be reduced to free up room for multicast groups.)


52/120

52

Stratix 6000 Configuration

Upload/download S6000 configuration


53/120

53

DHCP Description

Present several cases to simplify

The affects of Persistence, Reserved Only, DHCP

Snooping

The affects of local and remote servers.

What to avoid.

NOTE: The Stratix8000 Software Manual describes DHCP.


54/120

54

Stratix 8000 DHCP Description

Describe the DHCP variables and the results

- Number of servers

- Pool size

- Persistence configuration

-Reserved Only

- DHCP Snooping (release 4)


55/120

55

DHCP DescriptionDescribe DHCP including persistence and Reserved Only.

A pool of 10 addresses has been created.

Only 1 of these addresses has been assigned (persistence on FA1/1).

No remote

DHCP server(s)

Local switch

Connected to FA1/1

Connected to FA1/2

DHCP Description nder


56/120

56

DHCP Description underconstruction

Case 1A: Only 1 DHCP server No persistence No Reserved Only

No DHCP Snooping

- Two DHCP requests are received by the local switch FA1/1 andFA1/2 and are broadcast out all ports, including G1/1.

- Both will get DHCP offers from local Stratix8000

- Any device may accept the first offering or a subsequent offering.


57/120

57

DHCP Description

Case 2 - pool w persist but w/o Reserved Only(no remote DHCP server)

- The DHCP request is received by the local switch and broadcast out allports, including G1/1.

- There are no remote DHCP servers active in this example.

- An IP address has been assigned (persistence) to FA1/1 by local switch.

- The device on FA1/1 may accept the local offer.

- The device on FA1/2 will get an offer from the local switch because thereare 9 available addresses from the DHCP pool.

- Any device may accept the first offering or a subsequent offering.


58/120

58

DHCP Description

Case 3 - pool with persistence and with Reserved Only (no remoteDHCP server)

- The DHCP request is received by the local switch and broadcast out all ports, including G1/1.

- There are no remote DHCP servers active in this example.

- The device connected to port FA1/1 is requesting DHCP. This port is in the persistence table.

- The device on FA1/1 may accept the local offer.

- The device connected to port FA1/2, is requesting DHCP, but is not in persistence table.

- The device on FA1/2 will NOT get an offer from the local switch because Reserved Only isselected (even though there are 9 available addresses from the DHCP pool).


59/120

59

DHCP Description

DHCP server(s)

Local switch

Connected to FA1/1

Connected to G1/1

Connected to FA1/2

Describe DHCP including persistence and Reserved Only.

A pool of 10 addresses has been created.

Only 1 of these addresses has been assigned (persistence on FA1/1).

Remote server(s) included


60/120

60

DHCP Description

Case 4 DHCP pool w/o persist and w/oReserved Only

- Devices connected to the local switch issuing DHCP requests willget DHCP offers locally and remotely (assuming remote servers).

- The device may accept the local offering or may accept the remoteoffering, if any.

- The device may accept the first offering or a subsequent offering.


61/120

61

DHCP Description

Case 5 - pool w persist but w/o ReservedOnly

- An IP address has been assigned (persistence) to FA1/1 by local

switch.- The device on FA1/1 may accept the local offering or may accept a

remote offering, if any.

- The device on FA1/2 will get an offer from the local switch IF there is

an available address (not in the persistence table). FA1/2 will alsoget an offer from a remote server.

- The device may accept the first offering or a subsequent offering.


62/120

62

DHCP Description

Case 6 - pool with persist and withReserved Only

- Remote DHCP servers are active in this example and are connected vialocal switch G1/1

- Automation device is connected to port FA1/1 and is requesting DHCP, isin persistence table.

- Automation device is connected to port FA1/2, is requesting DHCP, is notin persistence table.


63/120

63

DHCP Description

Case 6 (continued)

- Remote DHCP servers are active in this example and are connectedvia local switch G1/1

- The DHCP pool consists of 10 addresses on the local switch.

- Only port FA1/1 has been assigned an address from the local pool.

- FA1/2 is requesting an address but is NOT assigned in persist table.


64/120

64

DHCP Description

Case 6 (continued) the results

1. The requests from FA1/1 and FA1/2 are received by the localswitch and are broadcast onto the network via G1/1.

2. The local switch offers only the assigned address 192.168.1.1

3. The remote server offers to both FA1/1 and FA1/2.

4. Because Reserved Only is checked, the local switch never offersfor the 9 unused address (locally or remotely).

NOTE: If remote servers are Stratix8000, and they have ReservedOnly, they will not DHCP offer.


65/120

65

DHCP Description

What to avoid

When using persistence on a port (e.g. FA1/1), do not connect a switch

to that port (e.g. FA1/1).The consequence of connecting a switch will be that every device on

that switch will receive the same IP address.


66/120

66

Media

Copper types for EIP

Category 5e, category 6 recommended by ODVA

RA sells cables and connectors

- http://ab.com/sensors/ethernet/- Unshielded twisted pair in 2008

- Shielded in 2009

See EtherNet/IP Media Selection and Installation

Guidehttp://www.odva.org/Home/ODVATECHNOLOGIES/EtherN

etIP/EtherNetIPLibrary/tabid/76/Default.aspx

Media fiber Offerings at RA
http://ab.com/sensors/ethernet/http://ab.com/sensors/ethernet/


67/120

67

Media, fiber Offerings at RAFiber compatability chart

Fiber type Number of ports Mode Speed Connector type

1783-SFP100FX

(100mbpsmultimode)

1783-SFP100LX

(100mbps singlemode)

1783-SFP1GSX

(1000mbpsmultimode)

1783-SFP1GLX

(1000mbps singlemode)

Stratix 8000

1783-MS06T SFP up to 2 (optional) based on SFP type based on SFP type LC X X X X

1783-MS10T SFP up to 2 (optional) based on SFP type based on SFP type LC X X X X

1783-MX08T Fixed 8 Multimode (FX) 100mbps LC

1783-MX08F NoneStratix 6000

1783-EMS04T None

1783-EMS08T SFP 1 (optional) based on SFP type 1000mbps LC X X

Stratix 2000

1783-US05T None

1783-US08T None1783-US03T01F Fixed 1 Multimode (FX) 100mbps LC

1783-US06T01F Fixed 1 Multimode (FX) 100mbps LC

1756-EN2F Fixed multimode, LC connector, no autonegotiation, Speed = 100M, Duplex=half/full

1783-fiberETAP everything the same as EN2F above.

Stratix6000, See above. Also, autonegotiation not supported.

Stratix8000 (uplinks) See above. Also, autonegotiation not supported.

Stratix8000 (expansion) See above. Also, autonegotiation not supported.


68/120

68

Fiber and autonegotiation

Q: Do fiber media standards supportautonegotiation?

A: Yes.

Q: Do Rockwell Ethernet fiber productssupport autonegotiation?

A: Most do support. Two products that do not are:S8000 expansion (100Mbps only) and S6000(1Gbps only)


69/120

69

Media

Slip ringsTwo basic types: optical, mechanical

Slip-ring vendors used by at least onecustomer for I/O

- Meridian on rotary fillers,http://www.meridianlab.com/index.html

- Label (a French company),http://www.label.fr/accueil_en.html

Slip-rings have not been validated by ODVA or Rockwell.
http://www.label.fr/accueil_en.htmlhttp://www.label.fr/accueil_en.html


70/120

70

Media, slip-rings

Example of how one customer is using


71/120

71

Media color codes

I do not know of any standards that call outspecific color codes, however Red is commonfor safety communications cabling. Teal iscommonly used for robotics and control cabling.


72/120

72

Media RA sells media

The customer should contact our Chelmsford division to arrange topurchase the cables for an application. For those who wish to maketheir own or have requirements that our cables cannot provide, usethe guidance doc. Our robotic cables have weld splatter jackets,meet 10 million flexes, are low noise and are sealed to IP67. ForM12 connectors, see

http://www.ab.com/catalogs/connectivity/onmachinepartno.html

RA sells UTP and STP (2009)media.
http://www.ab.com/catalogs/connectivity/onmachinepartno.htmlhttp://www.ab.com/catalogs/connectivity/onmachinepartno.html


73/120

73

Cisco Network Assistant

Current version is 5.5

A few features

Maintenance

Software upgrade for multiple switches

Monitor

Reports, IOS inventory for all switches

Views, topology for all switches Views, health

Configure


74/120

74

General topics


75/120

75

EIP new in v18

1756-EN2x packet rates

QoS support (EN2x, two-port I/O, K6500)

CIP Sync (Logix AOP, K6500)

Unicast I/O (all I/O families)

Duplicate IP diagnostics (program access, web server access)

Stratix 8300 switch 1783-ETAP fiber ports (1 or 2 ports)


76/120

76

1756-EN2x Increased packet rate

EN2x firmware version 3

Rate depends on the packet size- 1 byte: 26000 pps

- 300 bytes: 15000 pps

- 400 bytes: 11000 pps

- 508 bytes: 9000 pps

Q S


77/120

77

QoS prioritization

QoS can help smooth out the peak loads and make sure that the importanttraffic has priority. However, the most important thing is to make sure youhave enough bandwidth to begin with

QoS = quality of serviceRefers to mechanism that provides precedence to applications.

Mechanisms include ToS and CoS.

TOS = type of service (layer 3)Byte in IP header

6 bits, Differentiated Services Code Point.Of the 6 bits, 3 bits of precedence.

CoS = Class of service (layer 2)3 bit field in Ethernet frame

Priority 0-7

V Q S


78/120

78

V18 QoS support

Any 2-port module will be marking packets with DSCPvalues (at the default values per the EIP spec) Two port 1732 I/O

Two port 1734-AENTR

Two port 1738 I/O

Additionally the EN2T/EN2F will include the QoS Objectbut will only be marking the CIP Motion and CIP Sync

packets with the default DSCP values. The other traffic,including regular I/O, produce tags etc. will have 0 forDSCP

V18 Q S


79/120

79

V18 QoS support

However, you can change the default values ... via MSGinstruction to the QoS Object should one desire that.

ETAP will not remark any packets that are beingproduced by the attached device. So if the devicedoesn't mark ... they won't be marked

CIP S f EIP


80/120

80

CIP Safety on EIP

Number of CIP connections

Input module CRTL

Output module CRTL

Safety task interval maximum (100ms) Safety I/O modules

1791ES-IB16

1791-OBXIB8 1734-IBS

1734-OBS

S f CRTL f 1791ES IB16


81/120

81

Safety CRTL for 1791ES-IB16

S f t CRTL f 1791ES OB16


82/120

82

Safety CRTL for 1791ES-OB16

ADD A RSLogix5000 SCREENCAPTURE FOR THIS MODULE

S i t t l


83/120

83

Spanning-tree protocols

STP (50 sec)

PVST(2?-50 sec), CiscoRSTP (2 sec)

MSTP (2 sec) Rapid PVST (2 sec), Cisco

Question: What are the spanning-tree protocols?

The protocols high-lighted in blue are supported in the Stratix8000.

L ti t l


84/120

84

Loop prevention protocols

STP (50 sec)

RSTP(2 sec)

REP (50ms)

DLR (1 ms)

Question: What is range of recovery times for a single link fault?

Eth h l ili


85/120

85

Etherchannel - resiliency

Switch_1 P P Switch_2

P P

Switch_1

P P

Switch_2

Switch_3

P P

Example: No ring, 0ms link loss recovery

Example: Ring, 0ms link loss recovery

R ili


86/120

86

Resiliency

Rapid spanning-tree

Etherchannel

REP

DLR

S ft f tl d


87/120

87

Software frequently used

RSLogix5000 RSLinx RSNetWorx for Ethernet

Calculates Ethernet module loading (scanners and adapters)

Ping

Web server (in each Ethernet module) Logix Controller task monitor Network management software

Example: IntraVue

Packet capture Examples: Ethereal, Sniffer Centralized module diagnostics application

Use FT View to monitor diagnostics on all EIP modules

CIP C ti


88/120

88

CIP Connections

Most devices use 1 CIP connection

A few devices use more than 1 connection 1756-DNB uses 2 (status, data)

RSLinx opens as many as 5

Produce tag The controller that produces a tag uses connections as follows:

1 + #consumers.

Note that with 125 tags produced (with only 1 consumer each),

a CLGX would be out of connections.

EIP modules count connections as follows:

#consumers

S di il


89/120

89

Sending emails

Sending emails CPX, CLGX, FlexLogix Ethernet modules can

initiate emails (ENET-UM001, KBase 30937,

32295) EWEB modules can also be used to send

emails

Intrinsicall safe


90/120

90

Intrinsically safe

Are there intrinsically safe products on EIP?

Answer:

Not directly on EIP. However, you can useintrinsically safe RA I/O products and put an EIPadapter outside the hazardous area by using1797-BIC and CEC.

Reference:

http://www.odva.org/tabid/154/ctl/Detail/mid/520/xmid/18469/xmfid/8/Default.aspx

Unicast multicast broadcast


91/120

91

Unicast, multicast, broadcastUnicast- Used for point-to-point communications.- Uses IP addressing classes A, B, or C.

- Can be TCP (most frequent) or UDP.- Example: HMI, MSGing, programming.

Multicast- Used for one-to-many communications.- Uses IP addressing class D.- Always is UDP (at least for EtherNet/IP)

- Video (which is not EIP protocol) and EIP I/O are 2 examples.- More switch management knowledge is required than for unicast.

BroadcastUsed for one-to-all communications.Can be either OSI layer 2 (ARP) or OSI layer 3 (AB_ETHIP driver.)

Multicast considerations


92/120

92

Multicast considerations

What are considerations for multicast?

Answer:- EIP uses multicast for I/O and produce tag

- IGMP recommended (Internet Group Management Protocol)- TTL (time-to-live)If the producer and the consumer are in the same network, TTL is not afactor. (TTL is a Internet Protocol parameter). Also, if in the samenetwork, multicast routing is not needed.

IGMP reference: EtherNet/IP 10 Commandments(www.ab.com/networks/site-index.html)

IGMP Snooping


93/120

93

IGMP Snooping

Recommendations Select IGMP Snooping on all switches

Enable IGMP querier on all switches

Verify operation with Wireshark --- look for multicast flooding

Troubleshooting an IGMP Leave message is an indicator

See KnowledgeBase, IGMP Leave 55266

Note: With version 2, all the switches will negotiate and the lowest IPaddress will be the IGMP querier. IGMP v1 enabled queriers will notnegotiate.

IGMP Querier Compatibility


94/120

94

IGMP Querier Compatibility

Version 2Is a superset of version 1. Version 2 added a Leave

function whereas v1 handled this with a timeout.

V1 & V2Interoperability includes consideration of a number of

factors such as the network mix of querier version andhost IGMP version. However, there are some simplestatements such as IGMPv1 multicast consumers willwork with IGMP v2 queries.

V3The author has not seen any v3 messaging.

IGMP Leave happens when?


95/120

95


A Logix Ethernet module sends an IGMP Leave when all CIP connections through thatmodule are broken for the multicast address being consumed.

Case 1: Startup When a consumer receives a successful Forward Open reply for a multicast group,

the consumer starts sending heartbeats and also sends an IGMP Join. If the first multicast is not received in 10 seconds, the consumer sends an IGMP

Leave.The consumer considers the CIP connection as timed out and stops sending unicast. Examples of timeouts after the first data:

A 2ms RPI has a CIP connection timeout of 128ms. Then, X >128ms. A 100ms RPI has a CIP connection timeout of 400ms. Then, X > 400ms.

Case 2: Two controllers consuming same tag thru same ENBx At the consumer Logix chassis, if there are 2 consumer controllers for the same tag

and both are consuming thru the same ENBT module, then that ENBT will send aLeave for that multicast group when both Logix controllers no longer want toconsume that group. A Logix controller will not consume under the followingconditions: consumed tag is inhibited or deleted I/O connection is inhibited or deleted



96/120

96


Case 3: Tag producer dies/disconnected/disappears At the consumer Logix chassis, if the tag producer dies or is

disconnected or the infrastructure (switch) dies, the consumerEthernet module no longer detects the produced tag and the CIPconnection will close.

Case 4: Duplicate multicast address

Consider the case of 2 Logix controllers each consuming data fromdifferent data producers. And, each data producer transmits its datausing the same multicast address. This is allowed in the EIP specbecause each multicast stream includes unique information thatdifferentiates.

If 2 or more multicast producers are using the same multicast

address, the consumer ENBT module will not send a Leave until allconsumer Logix controllers no longer want to receive that multicastgroup.

Unicast produce tag


97/120

97

Unicast produce tag

What do you need to know?

Configure for unicast at both the producer andconsumer.

TTL value is 64 for RA products (at least for CLGX as ofthe year 2008)

Why a socket interface for Logix?


98/120

98

Not every device and application can speak the CIP and EtherNet/IP

protocols. Numerous customer requests for this feature:

Material Handling

Semiconductor

RFID reader integration

OEMs in various businesses

Primary uses for the socket interface:

Connect Logix to devices that dont speak EtherNet/IP

RFID readers, weigh scales, bar code readers, etc.

Connect Logix to applications on OS platforms not well-supported by

RSLinx

Linux, VMS, etc.

Socket style interfaces are supported by competitors such as Siemens andSchneider.




99/120

99

CPX, CLGX, and MicroLogix1400 platforms have EWEB modules

EWEB modules support up to 20 sockets

Each socket specifies a single logical port to receive on

Each socket can be used to transmit to any target port and any target IP

Note that there are a few ports that are EWEB blocked so you shouldnot use (or you will get immediate error status):

- TCP 44818(decimal), used by RSLinx and CLGX MSGing

- UDP 2222(decimal), used for CIP I/O and produce tag

- TCP 80(decimal), used for http

See EWEB user manuals and Knowbase 48879


Remote access basics


100/120

100

PC withenetinterface

(wired orwireless)

and VPNclient sw

Telephone modemor

DSL modem or

Cable modem or

Wireless access ptor

Wirelessbroadband modem

internetVPNconcentrator

E.g. Cisco,

Checkpoint.

(Hardware orsoftware.)

Internal

network

ISP

- First, purchase VPN concentrator and then purchase recommendedVPN client software.

- ISP (internet service provider) provides access to internet.

- VPN client software allows you to be connected to a remote network.

server

Your PC

Remote access basics


101/120

101

Appendix

1756-EN2x buffer and connection


102/120

102

limits

A max of 128 incoming (from wire) buffers

A max of 128 outgoing (to wire) buffers

A buffer is required temporarily to

establish a CIP connection.

A max of 128 TCP connectionsThis is a total of incoming plus outgoing.

A max of 256 CIP connectionsThis is a total of incoming plus outgoing.

Enable CIP object


103/120

103

Enable CIP object

As requested by an IT guy, the following CLI will allow youto place an S8K switch into the Logix I/O tree. However,

running Express Setup is the recommended.

1. In global config mode (config term), enter thefollowing:

cip security password xxxxxxxxx

2. On VLAN interface chosen for automation (CIP objectis supported on only 1 VLAN), enter the following:

cip enable


104/120

104

Timeouts CIP and TCP

TCP Timeouts CIP TCP


105/120

105

TCP Timeouts CIP,TCP CIP inactivity timeout

- Ethernet module monitor CIP unconnected traffic on each TCP connection

- The CIP inactivity timeout can be configured in 1 sec increments from 1 sec to approx120 sec. This can be specified in the MSG Path of the TCP originator. The default is 120seconds. See next slide for an example.If a timeout occurs, the TCP connection will be closed by the originator.

TCP inactivity timeout (CIP connected or CIP unconnected)- Ethernet module monitor any activity on each TCP connection

- Not user configurable- If a TCP packet is not received (at originator or target) within 8 sec, a keep-alive is sent.- If any TCP packet is received on a TCP connection, a keep-alive timer will reset.- If no TCP date or keep-alive packet is received by 75 sec, another keep-live is sent.If no data or keep-alive acknowledge is received by 150 sec, the TCP connection will beclosed (by originator and/or target).

NOTE: MSG instruction timeout- When a MSG (CLGX, CPX) times out, it does not close a TCP connection.- Default is 30 seconds for CLGX and CPX and is user configurable in MSG control structure.- The originator uses this timeout and also the target Ethernet module uses this timeout.

CIP inactivity closes TCP


106/120

106

CIP inactivity closes TCPExample of CIP inactivity timeout configuration. Screen capture belowcopied from Rockwell knowledge base document 22644

Note: Although document 22644 calls this a TCP inactivity timeout, it

is actually a CIP inactivity timeout. However, no matter how you call it,it closes a TCP connection.

TCP Connection Timeouts


107/120

107

TCP Connection Timeouts

1756-EN2x diagnostic shows default TCP timeout.

TCP timeouts MicroLogix 1400


108/120

108

TCP timeouts MicroLogix 1400

Using the break bit in a MSG instruction will causethe TCP connection to break as soon as theMSG completes (DN or ER).

Using the break bit allows the ML to conserve thenumber of TCP connections in use.

DLR project schedule


109/120

109

DLR project schedule

1734-AENTR Released April 2009 1732-AENTR 4Q2009

1738-AENTR Released April 2009

1783-ETAP Released Summer 2009 1783-ETAP fiber December 2009

1756-EN2TR Released Summer 2009

1756-EN3TR (for Motion (100axis), CIP Sync)

Drives -- later

The EN3TR will expand the number of axis supported from (6-256)

Spanning tree & other L2 protocols


110/120

110

Spanning tree & other L2 protocols

Purpose: given a physical switch loop, builds a loop-freeenvironment

Star topology

(no loops)

Double-Startopology

(STP rqrd)

VLANs


111/120

111

VLANs

Add pix to show single switch with red and blueports (2 VLANs with no L3 connectivity)

under construction

Add pix to show single switch with router on astick (red and blue VLANs)

Add pix to show multiple switches connected torouter and connected via VLAN trunking

Domain name services


112/120

112

Domain name services

Q: Do Logix Ethernet modules support DNS?A: Yes.

On a Logix Ethernet module, just configure the

DNS server IP address.

Note: On the Ethernet module, if you configure a name, you must stillconfigure the name server. The host name on the module is only aconvenience.

Q&A


113/120

113

Q&A

How do I clear the configuration of aswitch

Answer: Use the CLI commands as follows:- write erase (deletes startup config file)

- reload (uses the non-existing config file)

Note that the vlan.dat file is not deleted.

More Q & A


114/120

114

More Q & A

What are Network Considerations for CLGX redundancy?Answer:A. CLGX Primary and Secondary must be in same L2 and L3 network

to make IP swapping workNo additional information to add.

B. If source device (e.g. HMI) is in same L2 and L3 network as CLGXredundancy system (target device)

No additional information to add.

C. If source device is in different L2 or L3 network as CLGX

redundancy systemThe routers must update their ARP caches in a timely fashionto allow IP swapping to operate in a timely fashion.

More Q & A


115/120

115

More Q & A

How do I configure a S8K switch Smartport whenconnecting to a DLR?

Answer:

Select None in the Smartport pull-down menu.


116/120

116

Tips

Cannot reconfigure (I/P, mask, gw)I/O d ?


117/120

117

your I/O adapter?

You are probably getting error code 16 because youhave an I/O connection. For security reasons we don'tallow you to set port config params when we have an I/Oconnection. Error code 16 is "Module state conflict". Try

inhibiting the adapter and changing the config again.

If you changed it on the web page, it is probably alreadyset. If you look at the fine print on the bottom of the web

page, you'll see that changes take affect at the nextpower up. Try cycling power to see if the module is thenreachable.

Passwords (out-of-box)


118/120

118

Passwords (out of box)

Stratix8000

When running the web browser for the first time, you will be running

Express Setup.

The password you need to enter will be switch. No username isneeded.

Stratix6000

The default password is PASSWORD (all upper case).

You can change this to whatever you want.

Reset to factory defaults


119/120

119

Reset to factory defaults

Stratix8000Cycle power and use paper clip to select Express Setup.

When you see 3 LEDS (EIP Mod, EIP Net, Setup) turn solid red,release the paper clip. (CLI: delete flash:config.text, delete flash:vlan.dat, reload)

Stratix6000Remove the plastic clip from the rear of the switch and you will see asmall reset button. Remove power from the switch. Then, hold thesmall reset button and then apply power. Keep hold the reset buttonfor 30 seconds. Cycle power to complete the reset. The IP address

is now 192.168.1.1. User = (no username), pw = PASSWORD(when upgrading, user = uploader, pw = PASSWORD)


120/120

Questions?

Documents

122309 EIP Book of Knowledge