Configuration Guide -Server Connection- · Configuration Guide -Server Connection-(iSCSI) for Citrix Hypervisor (XenServer) P3AM-6632-17ENZ0. This page is intentionally left blank

FUJITSU StorageETERNUS AF, ETERNUS DX

Configuration Guide -Server Connection-

(iSCSI) for Citrix Hypervisor (XenServer)

P3AM-6632-17ENZ0

This page is intentionally left blank.

Preface

This manual briefly explains the operations that need to be performed by the user in order to connect anETERNUS AF/DX to a server running Citrix® Citrix Hypervisor (XenServer) via an iSCSI interface.

This manual should be used in conjunction with any other applicable user manuals, such as those for theETERNUS AF/DX, server, OS, adapters, and drivers.

Refer to "Configuration Guide -Server Connection- Notations" for the notations used in this manual such asproduct trademarks and product names. For storage systems that are supported by the OS, refer to the ServerSupport Matrix of the ETERNUS AF/DX.

17th Edition

March 2020

The Contents and Structure of this Manual

This manual is composed of the following seven chapters.

• "Chapter 1 Workflow" (page 6)

This chapter describes how to connect the ETERNUS AF/DX storage systems to a server running Citrix Hyper-visor (XenServer).

• "Chapter 2 Checking the Server Environment" (page 8)

This chapter describes which servers can be connected to ETERNUS AF/DX storage systems.

• "Chapter 3 Notes" (page 9)

This chapter describes issues that should be noted when connecting the ETERNUS AF/DX storage systemsand server.

• "Chapter 4 Setting Up Citrix Hypervisor (XenServer)" (page 13)

This chapter describes how to set up Citrix Hypervisor (XenServer).

• "Chapter 5 Setting Up the ETERNUS AF/DX" (page 15)

This chapter describes how to set up an ETERNUS AF/DX.

• "Chapter 6 Setting Up the Server to Recognize LUNs" (page 16)

This chapter describes how to recognize the LUNs from server.

• "Chapter 7 Setting the Multipaths" (page 24)

This chapter describes what to be set in order to create multipath environment.

3FUJITSU Storage ETERNUS AF, ETERNUS DX Configuration Guide -Server Connection- (iSCSI) for Citrix Hypervisor (XenServer)

Copyright 2020 FUJITSU LIMITEDP3AM-6632-17ENZ0

Citrix Hypervisor (XenServer) Terminology

• Storage Repository (SR)

A container where virtual disk images are stored

• Virtual Disk Image (VDI)

A storage abstraction that is presented to a Virtual Machine

The fundamental unit of virtualized storage in Citrix Hypervisor

• Physical Block Device (PBD)

An interface between a physical server and a Storage Repository

A connector object to map a Storage Repository to a Citrix Hypervisor host

• Virtual Block Device (VBD)

A connector object to map between VDIs and VMs

• Virtual Machine (VM)

A virtual machine that is created on Citrix Hypervisor (Guest OS)

Preface



Table of Contents

Chapter 1 Workflow 6

Chapter 2 Checking the Server Environment 8

2.1 Servers ........................................................................................................................................... 8

2.2 LAN Cards ....................................................................................................................................... 8

2.3 Connection Compatibility of ETERNUS AF/DX Storage Systems to Citrix Hypervisor (XenServer) ..... 8

2.4 Virtual Machine .............................................................................................................................. 8

Chapter 3 Notes 9

3.1 Installation Notes........................................................................................................................... 9

3.2 Operating Notes ............................................................................................................................. 9

3.3 ETERNUS AF/DX Setup Notes........................................................................................................... 9

3.4 Server Startup and Power Supply Control Notes............................................................................ 10

3.5 LAN Environment Notes ............................................................................................................... 10

Chapter 4 Setting Up Citrix Hypervisor (XenServer) 13

4.1 Checking the iSCSI Initiator Package............................................................................................. 13

4.2 Setting Up the Network Interface ................................................................................................. 13

4.3 Checking the iSCSI Qualified Name (IQN) ..................................................................................... 13

4.4 Starting the iSCSI Service .............................................................................................................. 14

Chapter 5 Setting Up the ETERNUS AF/DX 15

Chapter 6 Setting Up the Server to Recognize LUNs 16

6.1 Connecting and Turning On the Server and the ETERNUS AF/DX................................................... 16

6.2 Connecting to the Target, Recognizing LUNs, and Registering the Storage Repository................. 176.2.1 When CHAP Authentication is not Used or Unidirectional CHAP Authentication is Used......................................17

6.2.2 When Bidirectional CHAP Authentication is Used................................................................................................22

Chapter 7 Setting the Multipaths 24



Chapter 1Workflow

This chapter describes how to connect the ETERNUS AF/DX to a server running Citrix Hypervisor (XenServer).This manual explains how to perform various operations not referenced in other documents.

Required Documents

• "Server Support Matrix"

• "Configuration Guide -Server Connection- Storage System Settings" that corresponds to the ETERNUS AF/DXto be connected

• "ETERNUS Web GUI User's Guide"

• Manuals supplied with the server, multipath driver, and LAN card

Workflow

Setting Up Citrix HypervisorSet up the OS, the hardware, the software, and the iSCSI environment.

• "Chapter 4 Setting Up Citrix Hypervisor (XenServer)" (page 13)

Setting Up the ETERNUS AF/DXSet up the ETERNUS AF/DX using ETERNUS Web GUI.

• "Chapter 5 Setting Up the ETERNUS AF/DX" (page 15)

• Checking the setup and maintenance operations

- "ETERNUS Web GUI User's Guide"

• Setting up the ETERNUS AF/DX

- "Configuration Guide -Server Connection- Storage System Settings" that corresponds to the ETER-NUS AF/DX to be connected



Setting Up the Server to Recognize the Logical UnitsSet up the server so that it can recognize the LUNs (logical unit numbers) of the ETERNUS AF/DX.

• "Chapter 6 Setting Up the Server to Recognize LUNs" (page 16)

Setting the MultipathsUse the Citrix Hypervisor multipath to perform a redundant configuration.

• "Chapter 7 Setting the Multipaths" (page 24)

Chapter 1 Workflow



Chapter 2Checking the Server Environment

Connection to servers is possible in the following environments.

Check the "Server Support Matrix" for server environment conditions.

2.1 Servers

For supported servers, refer to "Server Support Matrix" and the following URL:

http://hcl.xensource.com/

2.2 LAN Cards

Refer to the "Server Support Matrix".

2.3 Connection Compatibility of ETERNUS AF/DX Storage Systemsto Citrix Hypervisor (XenServer)

Refer to the "Server Support Matrix".

2.4 Virtual Machine

For details on the procedure and notes about installing a Virtual Machine that is supported by Citrix Hypervi-sor (XenServer), refer to the manuals that can be obtained on the following Citrix web-site:

https://support.citrix.com/en/products/xenserver



Chapter 3Notes

Note the following issues when connecting the ETERNUS AF/DX to a server.

3.1 Installation Notes

• To ensure reliable access to the ETERNUS AF/DX storage systems, multipath configuration is recommended.

Setting up multiple access paths between the server and the ETERNUS AF/DX storage systems, then usingthe Citrix Hypervisor multipath, provides improved access redundancy.

• Enable the virtualization support functions (Intel VT or AMD-V) of the server before installing Citrix Hypervi-sor. For details on the settings, refer to the relevant manual of the server to be used.

• Install Citrix Hypervisor when the ETERNUS AF/DX is not connected to the server.

• The ETERNUS Multipath Driver does not need to be installed on the Citrix Hypervisor Virtual Machine. TheCitrix Hypervisor multipath provides path redundancy.

• When multiple paths are used, a multipath driver must be set. If a multipath driver is not set, the CitrixHypervisor multipath does not perform proper load balancing for the ETERNUS AF/DX.

• Before setting a multipath configuration, create Storage Repositories for all the LUNs that exist in theETERNUS AF/DX.

3.2 Operating Notes

• If a path error occurs in a multipath configuration using Citrix Hypervisor, the status of the failed multipathmay not be displayed. The status is displayed again when the failed path recovers.

• When Citrix Hypervisor is managed and operated with XenCenter, multipath errors may not be detectedproperly by XenCenter. When checking multipath status, also check the status on the Citrix Hypervisor hostside.

3.3 ETERNUS AF/DX Setup Notes

• Host Response must be set for the ETERNUS AF/DX before the ETERNUS AF/DX is connected to Citrix Hyper-visor.

• In a Citrix Hypervisor multipath configuration, disk drive motors cannot be stopped even if the Eco-modefunction of the ETERNUS AF/DX is enabled.



3.4 Server Startup and Power Supply Control Notes

Before turning the server on, check that the ETERNUS AF/DX storage systems and LAN switches are all"Ready". If the server is turned on and they are not "Ready", the server will not be able to recognize theETERNUS AF/DX storage systems.

Also, when the ETERNUS AF/DX power supply is being controlled by a connected server, make sure that theETERNUS AF/DX does not shut down before the connected servers. Similarly, the LAN switches must also beturned off after the connected servers have been shut down. Similarly, the LAN switches must also be turnedoff after the connected servers have been shut down. If turned off, data writes from the running server can-not be saved to the ETERNUS AF/DX storage systems, and already saved data may also be affected.

3.5 LAN Environment Notes

• Configure the iSCSI LAN as a dedicated LAN that is separate from the business LAN or the managementLAN by segmenting the IP address.

Example:

IP address of the LAN for iSCSI: 192.168.10.x/24

IP address of the business/management LAN: 192.168.70.y/24

The iSCSI LAN and the business/management LAN must be configured with different network addresses (upto the value "192.168.10.") as shown in the above example.

If it is not a dedicated LAN, the following may occur.

- Processes may be delayed in the LANs due to traffic conflicts.

- In terms of security, SAN data may leak or the iSCSI port may hang due to DoS attacks.

• iSCSI LAN redundancy is achieved by the use of multipaths. The LAN must be configured as a dedicated LANfor each path from a server to the ETERNUS AF/DX.

Chapter 3 Notes3.4 Server Startup and Power Supply Control Notes



Example of a LAN switch connection configuration

ETERNUS AF/DX

LAN switch

[Business LAN]

LAN

Card#1

LAN

Card#2

LAN

Card#3

LAN

Card#3

LAN

Card#3

LAN

Card#2

LAN

Card#2

LAN

Card#1

LAN

Card#1

Business LAN

Business server A Business server B Business server CSimilarly to FC-SAN, a

dedicated LAN is used for

iSCSI, not the business LAN.

1 2 3 1 2 3

10 11 12 10 11 12

iSCSI LANLAN switch #1

[iSCSI LAN]

LAN switch #2

[iSCSI LAN]LAN switches should not

be inter-connected (*1)

LUN1 LUN2 LUN3 Management

LAN port

Management LAN

LAN switch

[Management LAN]

A separate LAN segment is used for each

Server/Storage grouping (*2).

Here, LAN ports 1, 2 and 10 comprise VLAN1,

while LAN ports 3 and 11 comprise VLAN2.

The iSCSI LAN and management LAN

segments are kept separate in the iSCSI

LAN switches, helping maintain the security

of each.

*1: In this system configuration, multipaths provide redundant connections between the servers and stor-age system. LAN switches #1 and #2 provide physical separation of the network paths.

*2: A separate LAN segment is provided in the LAN switch (using the switch VLAN function) for each group-ing of business servers and storage systems (equivalent to the FC zones).

Chapter 3 Notes3.5 LAN Environment Notes



Example of a network address configurationThe following example shows a configuration in which multiple servers are connected to multiple CAs.

ETERNUS AF/DX

LAN switch #1

(VLAN is

recommended)

LAN switch #2

(VLAN is

recommended)

Server A Server B

CM0 CM1P0 P1P0 P1

192.168.30.10/24

192.168.10.10/24

192.168.30.1/24

192.168.40.1/24

192.168.40.10/24

192.168.20.10/24

192.168.10.1/24

192.168.20.1/24

The following example shows a configuration in which a single server is connected to multiple CAs.

ETERNUS AF/DX

CM0 CM1P0 P1P0 P1

192.168.20.10/24

192.168.10.10/24

192.168.20.1/24

192.168.20.11/24

192.168.10.11/24

192.168.10.1/24

LAN switch #1 LAN switch #2

Server

Chapter 3 Notes3.5 LAN Environment Notes



Chapter 4Setting Up Citrix Hypervisor (XenServer)

Set up Citrix Hypervisor to connect the ETERNUS AF/DX.

The settings described in this manual are performed using Citrix XenCenter applications. Prepare a Citrix Xen-Center environment before setting up Citrix Hypervisor. For details on how to install and operate Citrix Xen-Center, refer to the Citrix documents.

4.1 Checking the iSCSI Initiator Package

Execute the following command to confirm that the "open-iscsi" package is installed. Because the "open-isc-si" package is normally installed as part of the OS installation, no additional installation processes are re-quired.

Note that this confirmation for Citrix Hypervisor 6.5 or later is not required.

# rpm -qa | grep open-iscsi open-iscsi-2.0.871-0.20.3.xs743

4.2 Setting Up the Network Interface

Set the IP information (IP address and subnet mask) of the LAN card.

The LAN card should be set to use the same subnet as that set for the ETERNUS AF/DX that is being con-nected to. For details of the ETERNUS AF/DX settings, refer to "Chapter 5 Setting Up the ETERNUS AF/DX"(page 15).

4.3 Checking the iSCSI Qualified Name (IQN)

Check the iSCSI Qualified Name (IQN) that is required for the settings of the ETERNUS AF/DX.

The IQN can be checked in the [General] tab of Citrix XenCenter.

The IQN is used as the iSCSI name of the server for the settings of the ETERNUS AF/DX.



4.4 Starting the iSCSI Service

Start the iSCSI service. For Citrix Hypervisor 6.5 or later, this operation is not required.

Execute the following command to start the iSCSI service.

# service open-iscsi startStarting iSCSI initiator service: [ OK ]Setting up iSCSI targets: iscsiadm: No records found!iscsiadm: no records found! [ OK ]

Perform the following setting to start the open-iscsi service when the server starts.

# chkconfig open-iscsi on# chkconfig --list open-iscsiopen-iscsi 0:off 1:off 2:on 3:on 4:on 5:on 6:off

Check whether "on" is set for the underlined portion.

Chapter 4 Setting Up Citrix Hypervisor (XenServer)4.4 Starting the iSCSI Service



Chapter 5Setting Up the ETERNUS AF/DX

Set up the ETERNUS AF/DX storage systems using ETERNUS Web GUI.

ETERNUS AF/DX setup can be performed independently of server setup. For details on how to perform thesesettings, refer to the following manuals.

• "Configuration Guide -Server Connection- Storage System Settings" that corresponds to the ETERNUS AF/DXto be connected

• "ETERNUS Web GUI User's Guide"



Chapter 6Setting Up the Server to Recognize LUNs

6.1 Connecting and Turning On the Server and the ETERNUSAF/DX

To turn on the connected devices, use the following procedure:

1 Turn off the server and the ETERNUS AF/DX.

2 Use LAN cables to connect the server to the ETERNUS AF/DX.

3 Turn on the ETERNUS AF/DX.

4 Check that the Ready LED is lit on the ETERNUS AF/DX.

5 Turn on the server.



6.2 Connecting to the Target, Recognizing LUNs, and Register-ing the Storage Repository

Click the [New Storage] button in the XenCenter window and follow the wizard that appears for the settingsto connect to the target, recognize LUNs, and register a Storage Repository.

6.2.1 When CHAP Authentication is not Used or Unidirectional CHAP Authenticationis Used

6.2.1.1 For Citrix Hypervisor 7.0 or later

1 On the menu bar, click the [New Storage] button.

2 Select [Software iSCSI], and then click the [Next] button.

Chapter 6 Setting Up the Server to Recognize LUNs6.2 Connecting to the Target, Recognizing LUNs, and Registering the Storage Repository



3 Enter a name in [Name], and then click the [Next] button.

When the [Autogenerate description based on SR settings] checkbox is clear, enter a comment in the[Description:] text box.

4 Enter the IP address that is set for the iSCSI port of the target ETERNUS AF/DX in the [Target hostname/IP address] text box, and then click the [Scan Target Host] button.

• To set multiple iSCSI ports, insert a comma "," between IP addresses.

• To set unidirectional CHAP authentication, select the [Use CHAP] checkbox and enter the CHAP user-name and CHAP password. Do not select the [Use CHAP] checkbox when CHAP authentication is notused.




5 Confirm that the check is marked next to the [Scan Target Host] button and "Select target IQN" is dis-played in the [Target IQN] field, and then select the [Select target IQN] pull-down menu.

In [Target IQN] field, select the IP address that is specified for the [Target Host] text box.




After selecting the [Target IQN] field, a check is displayed next to the item, and [Select target LUN] isdisplayed in the [Target LUN] field.

6 After a check is displayed on the right of [Target LUN], click the [Select target LUN] pull-down menu toselect the LUNs to register in the Storage Repository, and then click the [Finish] button.

Scanning starts.




7 In the formatting confirmation screen, click the [Yes] button.

Creation of the Storage Repository for the selected LUN starts.

8 After the creation of the Storage Repository is complete, select the registered Storage Repository in thepane on the left on the XenCenter window, and then check the Storage Repository status in the [Gener-al] tab.

To register multiple LUNs as the Storage Repository, repeat Step 1 to Step 7.




6.2.2 When Bidirectional CHAP Authentication is Used

6.2.2.1 For Citrix Hypervisor 7.0 or later

1 Execute the following command to recognize the LUNs and register the Storage Repository.

• Specify all of the following options for a single command. Do not use any line breaks between op-tions.

• A single command recognizes a single LUN and registers the LUN as the Storage Repository.

• To register multiple LUNs as the Storage Repository, execute the command for each LUN.

Command name:xe sr-create

Options:host-uuid=<server_uuid>

content-type=user

name-label=<label_name_for_Storage_Repository>

shared=true

device-config:target=<target_IP,target_IP>

device-config:chapuser=<user>

device-config:chappassword=<password>

device-config:incoming_chapuser=<user>

device-config:incoming_chappassword=<password>

device-config:targetIQN=*

device-config:SCSIid=<SCSI_ID_for_LUN>

type=lvmoiscsi

For the <SCSI_ID_for_LUN> option, specify the UID that is displayed for the volume in ETERNUS WebGUI in all lowercase letters after adding prefix of "3".

Example:

If the volume UID is "600000E00D110000001105B800270000", the <SCSI_ID_for_LUN> is"3600000e00d110000001105b800270000".

Command execution example

# xe sr-create host-uuid=d01ab327-1746-4b08-b0cb-a596f7c1cb76 content-type=user name-label=testkuriSR1 shared=truedevice-config:target=192.168.30.18,192.168.40.18 device-config:chapuser=root device-config:chappassword=rootrootroot device-config:incoming_chapuser=array device-config:incoming_chappassword=arrayarrayarray device-config:targetIQN=*device-config:SCSIid=3600000e00d110000001105b800270000 type=lvmoiscsi




2 After the command is executed, select the registered Storage Repository in the pane on the left on theXenCenter window, and then check the Storage Repository status in the [General] tab.




Chapter 7Setting the Multipaths

The Citrix Hypervisor multipath improves path redundancy.

Complete Storage Repository creation for all the LUNs to be used before starting the setup for multipathconfiguration.

1 Start the maintenance mode for the server in which the multipath is configured.

When the server is in the maintenance mode, the "!" image is displayed next to the Citrix Hypervisoricon.

2 Edit the "/etc/multipath.conf" file.

Check the "/etc/multipath.conf" file for the system that is used and apply the necessary changes accord-ing to the following example.

Depending on the Citrix Hypervisor version, the contents that are shown in the example may not beincluded in the "/etc/multipath.conf" file. In that case, add all the contents shown in the exampleinto the file.



• For Citrix Hypervisor 7.0 and 7.1

Define the settings at the end of the "/etc/multipath.conf" file as shown below.

device { vendor "FUJITSU" product "ETERNUS_DX(L|M|H)" path_grouping_policy "group_by_prio" path_selector "round-robin 0" path_checker "tur" features "1 queue_if_no_path" hardware_handler "0" prio "alua" failback immediate rr_weight "uniform" no_path_retry 10 rr_min_io 1000 }

• For Citrix Hypervisor 8.0 and 8.1

Define the settings at the end of the "/etc/multipath.conf" file as shown below.

device { vendor "FUJITSU" product "ETERNUS_DX(L|M|H)" path_grouping_policy "group_by_prio" path_selector "round-robin 0" path_checker "tur" features "1 queue_if_no_path" hardware_handler "0" prio "alua" failback immediate rr_weight "uniform" no_path_retry 10 rr_min_io 1000 }

Chapter 7 Setting the Multipaths



The parameter for "product" varies depending on the model to be used as detailed in the following ta-ble:

ETERNUS AF/DX to be connected "product" value

ETERNUS AF150 S3/AF250 S3,ETERNUS AF250 S2,ETERNUS AF250,ETERNUS DX60 S5/DX100 S5/DX200 S5,ETERNUS DX60 S4/DX100 S4/DX200 S4,ETERNUS DX60 S3/DX100 S3/DX200 S3,ETERNUS DX200F

ETERNUS_DXL

ETERNUS AF650 S3,ETERNUS AF650 S2,ETERNUS AF650,ETERNUS DX500 S5/DX600 S5,ETERNUS DX500 S4/DX600 S4,ETERNUS DX500 S3/DX600 S3

ETERNUS_DXM

ETERNUS DX900 S5,ETERNUS DX8900 S4,ETERNUS DX8700 S3/DX8900 S3

ETERNUS_DXH

3 Enable multipath.

(1) Select [Server] from the XenCenter menu bar and open [Properties].

(2) Select [Multipathing] in the [Properties] screen, select the [Enable multipathing on this server]checkbox, and click the [OK] button.




"´" marks appear on the Storage Repository icons in the pane on the left of the XenCenter win-dow. Wait until all of the "´" marks disappear. This may take several minutes.

4 Release the maintenance mode, and then reboot the server.

5 Check the multipath status.

Check that all the Storage Repositories that are created in Citrix Hypervisor have multiple paths.

(1) Execute the "mpathutil list" command and check that all the Storage Repositories that were cre-ated in "6.2 Connecting to the Target, Recognizing LUNs, and Registering the Storage Repository"(page 17) are displayed.

Example:

$ mpathutil list3600000e00d00000000010000007200003600000e00d00000000010000007300003600000e00d00000000010000007400003600000e00d00000000010000003200003600000e00d0000000001000000330000




(2) Execute the "mpathutil status" command to check that the devices for all of the paths that areallocated to the server are recognized and that all of the devices are in the normal status.

Output example: When the ETERNUS DX80 S2 is connected in a two-path configuration

# mpathutil status

3600000e00d0000000001000000720000 dm-0 FUJITSU,ETERNUS_DXL

[size=20G ][features=0 ][hwhandler=0 ][rw ]

¥_ round-robin 0 [prio=50][active]

¥_ 1:0:0:0 sdb 8:16 [active][ready]

¥_ round-robin 0 [prio=10][enabled]

¥_ 4:0:0:0 sdn 8:208 [active][ready]

The multipath consists of the block device names "sdb"

and "sdn.

"3600000e00d0000000001000000720000" is created.

When the path status is normal,

"[active][ready]" is displayed.

Two block device names are displayed

for a two-path configuration.

"ETERNUS_DXL" is displayed

since the ETERNUS DX80 S2 is

connected.

Output example: When the ETERNUS DX80 S2 is connected in a four-path configuration

# mpathutil status

3600000e00d0000000001000000720000 dm-0 FUJITSU,ETERNUS_DXL

[size=20G ][features=0 ][hwhandler=0 ][rw ]

\_ round-robin 0 [prio=100][enabled]

\_ 1:0:0:0 sdb 8:16 [active][ready]

\_ 3:0:0:0 sdl 8:176 [active][ready]

\_ round-robin 0 [prio=20][enabled]

\_ 4:0:0:0 sdq 65:0 [active][ready]

\_ 2:0:0:0 sdg 8:96 [active][ready]

The multipath consists of a path group with the block device names "sdb" and "sdl" and

a path group with the block device names "sdq" and "sdg".

"3600000e00d0000000001000000720000" is created.

When the path status is normal,

"[active][ready]" is displayed.

Four block device names are displayed

for a four-path configuration.




FUJITSU Storage ETERNUS AF, ETERNUS DX Configuration Guide -Server Connection-(iSCSI) for Citrix Hypervisor (XenServer)

P3AM-6632-17ENZ0

Date of issuance: March 2020Issuance responsibility: FUJITSU LIMITED

• The content of this manual is subject to change without notice.

• This manual was prepared with the utmost attention to detail. However, Fujitsu shall assume no responsibility for anyoperational problems as the result of errors, omissions, or the use of information in this manual.

• Fujitsu assumes no liability for damages to third party copyrights or other rights arising from the use of any informationin this manual.

• The content of this manual may not be reproduced or distributed in part or in its entirety without prior permission fromFujitsu.