3 steps to use the SORT Data Collector to gather and submit an enhanced vxexplorer troubleshooting archive

Article:HOWTO32575  |  Created: 2010-10-19  |  Updated: 2014-04-30  |  Article URL http://www.symantec.com/docs/HOWTO32575
Article Type
How To



Subject


QUICK SUMMARY

 

Using the SORT Data Collector to gather logs for Storage Foundation Technical Support

http://www.symantec.com/docs/TECH203525



Benefits To Using the SORT Data Collector vs. legacy vxexplorer

 

    • ability to gather vxexplorer data from more than 1 server
    • uses CPI-based rsh or ssh remote functionality (can use hacli in a cluster environment)
    • ability to perform cross-platform data collection
    • sudo is supported
    • automatic ftp upload; currently to ftp.veritas.com as standard
    • ability to check to see if specified server is part of a cluster and prompt to automatically add the other nodes of the cluster to the data collection/vxexplorer process (partial cluster check) *1
    • includes running 'vomgather.pl' to include VOM diagnostic data (VOM=Veritas Operations Manager)
    • same Data Collector script that is used to generate SORT Custom Reports
    • automatic upgrade of Data Collector script (can be disabled) *2
    • the Data Collector is included in the VRTSspt package as of Storage Founation 5.1SP1 and is installed on the system during Storage Foundation installation (see step A below)
    • standardized functionality that will be enhanced going forward (the legacy vxexplorer script will undergo a phased deprecation)
    • the Data Collector/vxexplorer is written in a standard readable perl script (similar to CPI)
    • a responce file may be used for a single command line data collection (similar to CPI)
    • logs are available in standard Data Collector format (similar to CPI)
      (~/sort/log/)
*1 not available when running when using the 'vxexplorer' command line option (ie ... 'sortdc -vxexplorer')
 
*2 this functionality is automatically disabled if the server does not have a connection to the Internet; can also be manually disabled via a configuration file (sortdc.conf)
 
 
There are 3 steps to using the Data Collector to collect an enhanced vxexplorer troubleshooting archive.
 
1)  if not pre-installed, get Data Collector shell archive script (transfer from PC to Unix server if necessary)
2)  run Data Collector archive (think of it as self-extracting .tar.gz file)
3)  run the Data Collector script (the current version will auto-upload if connection to Internet is available)
 
Complete details are available in the SUMMARY and DETAILED procedures below.
 
BACKGROUND
 
While the Data Collector has reporting capabilities in conjuction with SORT (web portal administration tool), it also has the capabilties to generate a vxexplorer troubleshooting archive.  The Data Collector/vxexplorer functionality will eventually replace the legacy vxexplorer script.
 
Solaris examples are used in this document however the Data Collector script supports all Storage Foundation supported Unix OS's; see "What are the UNIX data collector's system requirements?" at:
 
The first step is to get the Data Collecter archive (think of it as a self-extracting .tar.gz file).  While this has a shell script file extension (.sh), this is an OS archive consisting of script and binary code.
 
1)  There are 3 ways to get the Data Collector archive script.  Use one of the following 3 methods (A, B or C).
 
A)  If the server is running any product variation of Storage Foundation version 5.1SP1 or later, the Data Collector has been pre-installed (VRTSspt package) and can be found as follows:
 
# cd /opt/VRTSspt
# ls
CVM             FS              README.VRTSspt  VRTSexplorer
DataCollector   FirstLook       VCS             VVR
# ls DataCollector
README.data_collector  sort_sol_sparc.sh
(version 5.1SP1 uses the filename prefix of "vos" where as 6.0 and later will use "sort as shown here)
 
Skip to the SUMMARY PROCEDURE below.
 
B)  If the freeware utility wget exists on the Unix server and the server has a direct connection to the Internet, the Data Collecter archive can be downloaded directly to the Unix server instead of through the SORT web site to a workstation.  Browse to https://sort.symantec.com/dc_download/readme and search for the string "www.gnu.org" to see the appropriate URLs to use).
 
Example:
 
# wget http://sort.symantec.com/data/sort/collectors/sort_sol_sparc.sh

--2011-12-30 14:36:44-- 
http://sort.symantec.com/data/sort/collectors/sort_sol_sparc.sh
Resolving sort.symantec.com... 216.10.195.50
Connecting to sort.symantec.com|216.10.195.50|:80... connected.
.
 
.
.
 
Saving to: `sort_sol_sparc.sh' 100%[=============================>] 18,521,293  1.64M/s   in 11s 2011-12-30 14:36:55 (1.63 MB/s) - `sort_sol_sparc.sh' saved [18521293/18521293]
 
                               

Some cases may require using the command line option.

--no-check-certificate

Example:

 

# wget --no-check-certificate http://sort.symantec.com/data/sort/
collectors/sort_sol_sparc.sh

 
Skip to the SUMMARY PROCEDURE below.
 
C)  The Data Collector can be downloaded from the Custom Reports widget (panel) at http://mysort.symantec.com (select SORT / My Sort on the grey navigation bar; select the Generate Reports tab at the Custom Reports widget).  If a browser exists on the server and it is connected to the Internet, the Data Collecter archive will be downloaded directly to the server.  Otherwise, if a browser is used at a PC workstation, the Data Collector archive must be transferred to the server.  Please ensure the transfer is done in Image or Binary mode (most GUIs are "automatic" and may choose ascii mode and may need to be forced to transfer in binary mode).  The 2 steps below demonstrate this process.
 
1 - On a PC workstation or the Unix server, browse to http://sort.symantec.com; select SORT from the grey navigation bar menu then MySORT (or browse to http://mysort.symantec.com directly).

 
2 - In the Custom Reports panel (widget) on the My SORT web page, select the Data Collector tab, Command line interface and the Operating System of the server where the Data Collector (DC) will run.  This will download the DC archive script (*.sh file).
(think of this as a self-extracting ".tar.gz" archive)
-   if browsing on a PC, transfer this to the Unix server (FTP or SCP must use binary mode)

 

SUMMARY PROCEDURE
 
1)  Use 1 of the 3 methods above in step C to get the Data Collector
2)  Set the archive script execute permissions and run it (./*.sh).  Unnecessary if using pre-installed copy.
3). After the script has run, a ~/sort subdirectory will be created which will contain the SORT Data Collector script and its supporting hierarchy and files.  Cd to this directory and run the command:

 # ./sortdc -vxexplorer <hostname>

-   this will start the Data Collecter using the vxexplorer option; follow the on-screen instructions and prompts; if unsure, the default response is normally OK (example provided below)
-   if the server has access to the Internet, the SORT Data Collector script will contact the Symantec SORT servers to check for upgrades and download a new archive script if appropriate.  This feature can be disabled by changing a variable in the sortdc.conf file; RUN_LIVE_UPGRADE (see related information below)
-   the script will determine if the host(s) specified are part of a cluster where the other nodes have not been specified; answer "yes" to this question only if a vxexplorer is required from any missing nodes AND ssh or rsh is properly configured to any remote hosts; the typical responce is "no" for a single node vxexplorer
-   in the event that a vxexplorer output is required from more than one system (even if it is a different Unix OS), the SORT Data Collector can use the ssh or rsh remote protocols (passwordless or password based; sudo can also be configured) to collect data from a remote server (like the other node of a cluster) so that a vxexplorer output file can be generated for the local server and/or any remote server(s); the script will provide a menu to enter the host(s) to collect data from
-  if connectivity to the Internet is established, the script will prompt to upload the vxexplorer archive to 
ftp.veritas.com:/incoming .  If a "no" response is entered, the filename displayed here should be manually FTPed to the /incoming directory of ftp.veritas.com (credentials are listed below); please email all uploaded filename(s) to the current case owner (reply to an active case email from enterprise_technical_support@symantec.com without changing the Subject of the email received)
 
Credentials for ftp.veritas.com
(anonymous ftp is disallowed)
 
Login:         iosupport
Password:  d4VWCs.pir-6JLEo  <<<The password change every 3 months,recent password check:http://www.symantec.com/docs/TECH66995  
Directory:    /incoming
 
 
DETAILED PROCEDURE
 
1)  Use 1 of the 3 methods above in step C to get the Data Collector
2)  Set the archive script execute permissions and run it (./*.sh)
(Solaris script used in the example)

# ls -l *sh
-rw-r--r--   1 root     root     15810971 Aug 10 08:38 sort_sol_sparc.sh
# chmod u+x sort_sol_sparc.sh
# ls -l *sh
-rwxr--r--   1 root     root     15810971 Aug 10 08:38 sort_sol_sparc.sh
# ./sort_sol_sparc.sh

"sort" directory already exist. Do you want to backup it? [y,n] (y) y

Uncompressing SORT data collector: 100% |***************************|

Would you like to run the data collector now? [y,n] (y) n
 
The Symantec Operations Readiness Tools (SORT) data collector has been extracted to the current directory. To run it, use:

cd sort
./sortdc

If the Data Collector archive was transferred from a workstation to the server (step 1C above) and the transfer was automatic (most GUIs) or used ftp ascii mode, the following error may be displayed:
 
# ./sort_sol_sparc.sh
Warning: An internal checksum has been corrupted. This is likely due to the use of ascii-mode FTP during a file transfer. Please re-download the tool or re-transfer it to this host using binary-mode FTP. The correct md5 checksum for this file can be found at <https://sort.symantec.com/> and can be checked using the md5sum tool.
 
3)  After the script has run, a /sort subdirectory will be created which will contain the SORT Data Collector script and its supporting hierarchy and files.  Cd to this directory and run the command:

# sortdc -vxexplorer


-   this will start the Data Collecter using the vxexplorer option; follow the on-screen instructions and prompts; if unsure, the default response is normally OK (example provided below)
-   if the server has access to the Internet, the SORT Data Collector script will contact the Symantec SORT servers to check for upgrades and download a new archive script if appropriate.  This feature can be disabled by changing a variable in the sortdc.conf file; RUN_LIVE_UPGRADE (see related information below)
-   the script will determine if the host(s) specified are part of a cluster where the other nodes have not been specified; answer "yes" to this question only if a vxexplorer is required from any missing nodes AND ssh or rsh is properly configured to any remote hosts; the typical responce is "no" for a single node vxexplorer
-   in the event that a vxexplorer output is required from more than one system (even if it is a different Unix OS), the SORT Data Collector can use the ssh or rsh remote protocols (passwordless or password based; sudo can also be configured) to collect data from a remote server (like the other node of a cluster) so that a vxexplorer output file can be generated for the local server and/or any remote server(s); the script will provide a menu to enter the host(s) to collect data from
-  if connectivity to the Internet is established, the script will prompt to upload the vxexplorer archive to 
ftp.veritas.com:/incoming .  If a "no" response is entered, the filename displayed here should be manually FTPed to the /incoming directory of ftp.veritas.com (credentials are listed below); please email all uploaded filename(s) to the current case owner (reply to an active case email from enterprise_technical_support@symantec.com without changing the Subject of the email received)
 

 
Credentials for ftp.veritas.com
(anonymous ftp is disallowed)
 
Login:         iosupport
Password:  d4VWCs.pir-6JLEo  <<<The password change every 3 months,recent password check:http://www.symantec.com/docs/TECH66995   
Directory:    /incoming
 
The following is a sample run of the SORT Data Collector as it runs at the time of this writing.
 
Step 1: Extracting the Data Collector archive (self-extracting.tar.gz)
(to be repeated only when a Data Collector archive has been downloaded; usually an update)
 
# ./sort_sol_sparc.sh
Uncompressing SORT data collector:   0% |*                           |
...
Uncompressing SORT data collector: 100% |****************************|
   

 

 

The Symantec Operations Readiness Tools (SORT) data collector has been extracted to the current directory. To run it, use:

        cd sort
        ./sortdc

 

Step 2:  Running the Data Collector script

 

(may be repeated whenever a new report or vxexplorer needs to be generated)

(hostname is specified at command line here for single sever vxexplorer; eliminate if specifing multiple hostnames is desired)

   
 
# ./sortdc -vxexplorer maztoy

===========================================================================

| Checking available driver (maztoy) resources

===========================================================================

Working directory file system type: ufs

Open files limit: 256

Virtual memory limit: unlimited (KB)

Free swap: 3846 (MB)

Loading Data Collector...

<.. clear ..>

Symantec Operations Readiness Tools

Copyright (c) 2011 Symantec Corporation. All rights reserved.

Symantec and the Symantec logo are trademarks or registered

trademarks of Symantec Corporation or its affiliates in the U.S.

and other countries. Other names may be trademarks of their

respective owners.

The Licensed Software and Documentation are deemed to be

"commercial computer software" and "commercial computer software

documentation" as defined in FAR Sections 12.212 and DFARS Section

227.7202.

The data collector writes logs to /var/tmp/sortdc-201108201240qRw.

Starting the data collector [Build: 3.4.20110815]...

Press [Return] to continue:

<.. clear ..>

Symantec Operations Readiness Tools

Connecting to Symantec to check for the latest data collector version ... Connected

You have the most current data collector version.

 

<.. clear ..>

Systems Discovery and Authentication

Systems Discovery and Authentication

- Discovering transport (ssh,rsh) on maztoy ..... localhost

Authenticating system(s):

Number of systems requiring authentication ............ 0

<.. clear ..>

Symantec Operations Readiness Tools

Logs are being written to /var/tmp/sortdc-201108201240qRw while

sortdc is in progress

Partial clusters check: 0% __________________________________

Estimated time remaining: 0 of 1

Checking for partial clusters among input systems Partial clusters check: 100%

Missing Cluster Nodes

---------------------

Note: This includes nodes which failed during host discovery/authentication

* Node missing for cluster [ ncc ]: karena

As per the detected partial clusters, would you like to include

missing cluster nodes for data collection: [y,n,q] (y) y

Systems Discovery and Authentication

Enter a user name to access the remote system(s): [q,?] (root) root

Discovering transport (ssh,rsh) on karena ... ssh passwordless

Collected basic system information from karena ..... Done

Authenticating system(s):

Number of systems requiring authentication ............ 0

<.. clear ..>

Symantec Operations Readiness Tools

Generating report for VxExplorer:

VRTSexplorer supports these modules: vxvm vxfs dbed db2ed vad vcs

vcsone isis gcm dbac sfsybasece lic vlic vrw nbu cpi vxat vxaz

vxfen sfms slim dcli vom

Do you want to run all these modules on maztoy? [y,n,q] (y) yu

Please enter case number, or just hit enter: 123-456-789

Select a temporary directory to save the collected data on maztoy:

(/var/tmp) /var/tmp

Using '/var/tmp/vxexplorer_maztoy_LOJdQ' as temporary directory on

maztoy.

Do you want to collect core files in / on maztoy [y,n,q] (n) n

maztoy: Core file collection was skipped by the user.

This script can collect more detailed information for VRTSat. This

includes the VRTSat Private Domain Repository and credential store.

Do you want to allow collecting detailed security information about

VRTSat on maztoy? [y,n,q] (n) n

maztoy: Collecting detailed info for VRTSat was skipped by the

user.

CAUTION: answer yes to the following question only if

specifically advised by Symantec

 

Set debug level of VxVM Configuration Daemon on maztoy? [y,n,q] (n) n

maztoy: Setting debug level of vxconfigd was skipped by the user.

<.. clear ..>

Symantec Operations Readiness Tools

Generating report for VxExplorer:

VRTSexplorer supports these modules: vxvm vxfs dbed db2ed vad vcs

vcsone isis gcm dbac sfsybasece lic vlic vrw nbu cpi vxat vxaz

vxfen sfms slim dcli vom

Do you want to run all these modules on karena? [y,n,q] (y) y

Please enter case number, or just hit enter: 123-456-789

Select a temporary directory to save the collected data on karena:

(/var/tmp) /var/tmp

Using '/var/tmp/vxexplorer_karena_YZRnO' as temporary directory on

karena.

Do you want to collect core files in / on karena [y,n,q] (n) n

karena: Core file collection was skipped by the user.

This script can collect more detailed information for VRTSat. This

includes the VRTSat Private Domain Repository and credential store.

Do you want to allow collecting detailed security information about

VRTSat on karena? [y,n,q] (n) n

karena: Collecting detailed info for VRTSat was skipped by the

user.

Set debug level of VxVM Configuration Daemon on karena? [y,n,q] (n) n

karena: Setting debug level of vxconfigd was skipped by the user.

<.. clear ..>

Symantec Operations Readiness Tools

The data collector writes logs to /var/tmp/sortdc-201108201240qRw

maztoy: Collecting system configuration information for SunOS

system.

|karena: Collecting system configuration information for SunOS

system.

/-maztoy: Collecting Veritas package version information.

maztoy: Collecting loadable module information.

maztoy: Collecting zone information.

maztoy: Collecting Patch Logs information.

maztoy: Collecting pkgchk information for Veritas packages.

karena: Collecting Veritas package version information.

karena: Collecting loadable module information.

karena: Collecting zone information.

karena: Collecting Patch Logs information.

karena: Collecting pkgchk information for Veritas packages.

karena: Determining current VxVM operating mode.

karena: Collecting VxVM configuration information.

karena: Collecting VRAS configuration information.

karena: Collecting VxFS configuration information.

karena: Processing /rcb_vol01.

karena: Processing /mnt.

karena: Collecting VCS configuration information.

karena: Collecting ISIS configuration information.

karena: Collecting SIG licensing information.

karena: Collecting Cross Product/Platform Installation (CPI) information.

karena: Collecting VxAT configuration information.

karena: Collecting vxfen specific data...

karena: Collecting console logs...

karena: Collecting related VM data...

karena: Collecting SLIM information.

karena: Collecting SLIM Agent installer logs.

karena: Collecting SLIM Server installer logs.

karena: Collecting DCLI configuration information.

maztoy: Determining current VxVM operating mode.

maztoy: Collecting VxVM configuration information.

maztoy: Collecting VRAS configuration information.

karena: Collecting VOM configuration information.

maztoy: Collecting VxFS configuration information.

maztoy: Processing /appdata.

maztoy: Collecting VCS configuration information.

karena: Script finished, creating output tar file...

maztoy: Collecting ISIS configuration information.

maztoy: Collecting SIG licensing information.

maztoy: Collecting Cross Product/Platform Installation (CPI) information.

maztoy: Collecting VxAT configuration information.

maztoy: Collecting vxfen specific data...

maztoy: Collecting console logs...

maztoy: Collecting related VM data...

maztoy: Collecting SLIM information.

maztoy: Collecting SLIM Agent installer logs.

maztoy: Collecting SLIM Server installer logs.

maztoy: Collecting DCLI configuration information.

maztoy: Collecting VOM configuration information.

maztoy: Collecting SFM configuration information.

maztoy: Script finished, creating output tar file...

 

Moving karena:/var/tmp/VRTSexplorer_123-456-789_karena_vos_20110820_130845.tar.gz to /export/home/sort/sort/reports. ... done

The output file is

/export/home/sort/sort/reports/VRTSexplorer_123-456-789_karena_vos_20110820_130845.tar.gz.

The checksum for the tarfile is

481420556 507481786 /export/home/sort/sort/reports/VRTSexplorer_123-456-789_karena_vos_20110820_130845.tar.gz

Moving maztoy:/var/tmp/VRTSexplorer_123-456-789_maztoy_vos_20110820_132141.tar.gz to /export/home/sort/sort/reports. ... done

The output file is

/export/home/sort/sort/reports/VRTSexplorer_123-456-789_maztoy_vos_20110820_132141.tar.gz.

The checksum for the tarfile is

2753594533 1103416400 /export/home/sort/sort/reports/VRTSexplorer_123-456-789_maztoy_vos_20110820_132141.tar.gz

Do you want to upload

/export/home/sort/sort/reports/VRTSexplorer_123-456-789_maztoy_vos_20110820_132141.tar.gz

to ftp.veritas.com/incoming? [y,n,q] (y) y

Uploading /export/home/sort/sort/reports/VRTSexplorer_123-456-789_maztoy_vos_20110820_132141.tar.gz

to ftp.veritas.com/incoming...

###############################################################

Upload successfully.

Do you want to upload

/export/home/sort/sort/reports/VRTSexplorer_123-456-789_karena_vos_20110820_130845.tar.gz

to ftp.veritas.com/incoming? [y,n,q] (y) y

Uploading /export/home/sort/sort/reports/VRTSexplorer_123-456-789_karena_vos_20110820_130845.tar.gz

to ftp.veritas.com/incoming...

###############################################################

Upload successfully.

SORT data collector current session log files are saved at:

/export/home/sort/sort/log/sortdc-201108201240qRw

#

   


 
 
 
IMPORTANT: Please reply to any case email with the name(s) of the uploaded file(s) even if the file(s) are uploaded by the data collector script.
 
 
The Data Collector has more command line options available but they normally don't need to be used for basic operation.
 
Using the command line:
 
# ./sortdc        

will display menus prompting for system name(s) to scan as well as a menu where "Vxexplorer" can be selected.

 
Additional details can be found in the SORT Online Help system at:
 
 

 

 





Article URL http://www.symantec.com/docs/HOWTO32575


Terms of use for this information are found in Legal Notices