Lucent Technologies DEFINITY Enterprise Communications Server Release 8.2 Upgrades And Additions Manual

							Troubleshooting  an Upgrade 
B-1  
B
DEFINITY Enterprise Communications Server Release 8.2
Upgrades and Additions for R8r  555-233-115  Issue 1
April 2000
B
Troubleshooting  an Upgrade
This ap pend ix p rovid es information to c orrec t some p rob lems when upg rad ing  a 
system. The information in this app end ix is a c omp ilation of the most c ommonly 
rep orted  troub les rec eived b y Tier 4 Sup p ort at Luc ent Tec hnolog ies. For g eneral 
information on troub leshooting  assoc iated  with maintenanc e p roc ed ures, see 
one of the following  referenc es:
nChapter 5, Alarms, Errors and  Troub leshooting , of the Release 8.2, 
Maintenanc e for R8r manual 
This ap p end ix may b e up d ated  with new information at eac h p roduc t/d oc ument 
release. If you have troub leshooting or error rec overy information that you think 
would  b e valuab le to other tec hnic ians, p lease FAX your c omments to us at 
1-303-538-1741 (United  States). 
This ap p end ix is org anized  into three main sec tions, as d esc rib ed  b elow:
nNew for Release 8 – p rovid es information on introd uc tions for Release 8 
that might result in upgrade problems
nTroubleshooting Guidelines – provid es g eneral p roc ed ures to try b efore 
esc alating  a p rob lem
nTroubleshooting Release 8 Upgrades – p rovid es spec ific  troub leshooting  
p roc ed ures for c ommon up g rad e p rob lems 
						

							DEFINITY Enterprise Communications Server Release 8.2
Upgrades and Additions for R8r  555-233-115  Issue 1
April 2000
Troubleshooting  an Upgrade 
B-2 New for Release 8 
B
New for Release 8
nATM PNC Duplication (ATM PNC-DUP)
nATM Expansion Interface (ATM-EI)
nMass Storage System 
nControl LAN (C-LAN)
nControl LAN (C-LAN)
nSystem Links (SYS-LINK)
ATM PNC Duplication (ATM PNC-DUP)
The PNC-DUP maintenanc e ob jec t trac ks the health of the ac tive and  stand b y 
PNCs, c ontrols p lanned  and  sp ontaneous interc hanges, and  manag es related  
func tions suc h as d oub le c all refresh and  unrefresh, antithrashing, and  so on. 
The main resp onsib ility of PNC-DUP is to rec over the system to full servic e in the 
event of a fault. In the event of multip le faults, PNC-DUP d oes its best to 
maximize servic e c ontinuity.
In systems with the Critic al Reliability op tion, the following  c omp onents, whic h 
tog ether c omp rise the Port Network Connec tivity (PNC), are d up lic ated :
nATM-Exp ansion Interfac e (ATM-EI) c irc uit p ac ks in the port networks (PNs)
nFiber-optic  c ab les c onnec ting  the ab ove c irc uit pac ks to the ATM Switc h 
Interfac e Mod ules
nATM  Sw i t c h
Althoug h not p art of the PNC, Tone-Cloc k c irc uit p ac ks are also d up lic ated  in 
eac h PN. All systems have one Proc essor Port Network (PPN). ATM PNC systems 
c an have up  to 43 EPNs.
PNC d up lic ation arc hitec ture utilizes an ac tive/stand b y d up lic ation sc heme in 
whic h one c omplete set of PNC c omp onents sup p orts c all p roc essing , while the 
d up lic ate PNC is held  in reserve. All c alls on the ac tive PNC are simultaneously 
set up , or shad owed , on the stand b y PNC in ord er for it to b e c apab le of instantly 
assuming  ac tive status when nec essary, allowing  for interc hang es without 
servic e d isrup tion (in the c ase of sing le faults).
PNC d up lic ation d oes not introd uc e any ad ditional typ es of hard ware or 
hard ware faults, and  there are no tests assoc iated with the PNC-DUP MO. 
Instead , its error log  entries c ontain useful information ab out the oc c urrenc e and  
c auses of interc hang es in ord er to fac ilitate d iag nosis of p roblems, whic h c an 
then b e ad dressed b y using  the d oc umentation for the ind ivid ual maintenanc e 
ob ject involved. 
						

							DEFINITY Enterprise Communications Server Release 8.2
Upgrades and Additions for R8r  555-233-115  Issue 1
April 2000
Troubleshooting  an Upgrade 
B-3 New for Release 8 
B
The following PNC d up lic ation-related  c ommand s and  their outp ut sc reens are 
fully d esc rib ed in Chap ter 8, Maintenanc e Command s, of the 
DEFINITY ECS 
Release 8 Maintenanc e for Release R8r
 b ook.  The assoc iated  PNC-DUP 
maintenanc e ob jec t is found  in Chap ter 9 of the same referenc e.
ATM Expansion Interface (ATM-EI)
The ATM-EI maintenanc e ob jec t c overs the ATM c irc uit p ac k administered  as an 
ATM-Port Network Connec tivity (PNC) Exp ansion Interfac e (ATM-EI). The ATM-EI 
p rovid es PNC b etween a DEFINTY PPN and  all the EPNs throug h the ATM 
switc h.
The circuit packs listed below are ATM-EI boards 
if they are ad ministered to 
serve the ATM Port Network Connec tivity (ATM-PNC) for DEFINITY
.
Mass Storage System
The Mass Storag e System (MSS) p rovid es non-volatile storag e for system 
software, translation d ata, announc ement d ata and  p rog ram up d ate d ata. As 
shown in the fig ure b elow, the MSS c onsists of a Host Ad ap ter c irc uit on the 
U N 3 3 2 C  M SS- N e t w o r k C o n t ro l c i rc u it  p a c k ( M SSN ET) ,  a  Sm a l l C o m p u t e r  Sy st e m  
Interfac e (SCSI) b us, a TN2211 Op tic al Drive c irc uit p ac k or a TN1656 Tap e 
Drive c irc uit p ac k, and  the TN1657 Disk Drive c irc uit pac k. The Disk Drive ac ts 
as the p rimary storag e d evic e. The TN2211 Op tic al Drive or TN1656 Tap e Drive 
serves as a b ac kup  d evic e and  as a removab le med ium for system d ata.status pnc
Disp lays information ab out the op erational status of b oth 
PNCs inc lud ing  state of health, alarms, b usyouts and  loc ks, 
and so on.
reset pnc 
interchangeUsed to initiate a demand  PNC interc hang e. If the stand by 
is healthy (state of health ind exes all zero), there is no 
effect on service. Otherwise, calls may be dropped.
set pnc
Used to lock or unlock the active PNC, preventing 
interc hang es. It d oes not interfere with d oub le c all setup .
busyout pnc
Removes the stand b y PNC from servic e. 
Circuit pack FiberEcho 
cancellation
TN2305B Multi mod e Y
TN2306B Sing le mode Y
Continued on next page 
						

							DEFINITY Enterprise Communications Server Release 8.2
Upgrades and Additions for R8r  555-233-115  Issue 1
April 2000
Troubleshooting  an Upgrade 
B-4 New for Release 8 
B
Troub leshooting  details for the Mass Storag e System may b e found  und er the 
R-MEDIA
 maintenanc e ob jec t in Chap ter 9, Maintenanc e Ob jec t Rep air 
Proc ed ures, of the Release 8.2, Maintenanc e for R8r manual. Ad d itional related  
maintenanc e ob jec ts assoc iated  with the Mass Storag e System inc lud e 
STO-DATA
, DISK
, and  H-ADAPTR
.
Figure B-1. TN2211 faceplate
The system is usually b ooted  from the b oot imag e stored  on d isk. The save 
translation
 and  save announcements
 commands save to d isk the 
memory-resid ent translation d ata and  TN750-resid ent announc ement data, 
resp ectively. The backup disk
 c ommand c op ies d ata from the d isk to the 
removab le med ia for b ac kup  storag e. The restore disk
 c ommand  c op ies d ata 
f ro m  t h e  re m o v a b l e  m e d ia  b a c k  t o  d i sk .  A ll  M SS c o m p o n e n t s re s id e  in  t h e  SPE,  
o r  PPN  c o n t ro l c a r ri e r  ( c a r r ie r A f o r  a  s im p le x  SPE,  c a rr i e r s A a n d  B f o r  a  
duplicated SPE).
The removab le media c irc uit p ac k c ontains SCSI b us terminators, a -48V to + 12V 
p ower c onverter, an industry stand ard  SCSI-b ased  removab le med ia d rive, and  
interfac e c irc uitry to the p rivate b us to c ontrol the LEDs, d etec t the p resenc e of 
the c irc uit p ac k, and  id entify the vintag e of the hard ware.
Red
Green
Yellow
fpdf2211 KLC 010600TN2211 OPTICAL DRIVE 
						

							DEFINITY Enterprise Communications Server Release 8.2
Upgrades and Additions for R8r  555-233-115  Issue 1
April 2000
Troubleshooting  an Upgrade 
B-5 New for Release 8 
B
A -48V to + 12V c onverter c irc uit on the TN2211 Op tic al Drive c irc uit p ac k 
p rovid es p ower for b oth the Op tic al Drive and  the Disk Drive. The p resenc e of 
+ 12V on these c irc uit p ac ks is monitored  sep arately b y maintenanc e software so 
that a failure of the + 12V c onverter on the Removab le Med ia c irc uit pac k c an b e 
id entified  or ruled  out as the sourc e of the p rob lem when the Disk Drive loses 
+ 12V p ower.
The Host Ad ap ter c irc uit p ac k, Removab le Med ia Drive c irc uit p ac k, and  Disk 
c irc uit p ac k are treated  as sep arate, b ut related , maintenanc e ob jec ts 
(H-ADAPTR, R-MEDIA, and DISK). Sinc e the Disk c irc uit p ac k is c ontrolled  b y 
SCSI c ommand s whic h are g enerated  b y the Host Ad apter, p rob lems with the 
Host Ad ap ter c an p revent c ommunic ations with the Disk. Whenever the Host 
Ad apter is taken out of servic e b y the busy-out host-adapter
 c ommand , or d ue 
to failure of a c ritic al Host Ad apter test, the Removab le Med ia (R-MEDIA) and  
Disk (DISK) maintenanc e ob jec ts are also p lac ed  in a maintenanc e b usyout 
state.
Figure B-2. Mass Storage System interactions
Switch
processorSystem
memory
System bus
Host
adapter MSSNET
circuit
packSCSI bus
Private bus
Disk
circuit
packDisk
driveTape
driveOptical
drive
Disk TapeOptical
disk Tape
circuit
packOptical
drive
circuit
pack
+12V
SPE
Mass
storage
system
cydfmass LJK 092999 
						

							DEFINITY Enterprise Communications Server Release 8.2
Upgrades and Additions for R8r  555-233-115  Issue 1
April 2000
Troubleshooting  an Upgrade 
B-6 New for Release 8 
B
Control LAN (C-LAN)
The TN799 Control LAN (C-LAN) p ac ket p ort c irc uit p ac k p rovid es TCP/IP 
c onnec tion to ad junc ts app lic ations suc h as CMS, Intuity, and  DCS Networking . 
The C-LAN c irc uit p ac k has 1 10b aseT Ethernet c onnec tion and  up  to 16 DS0 
p hy si c al  in t er f ac es  f o r PPP c o nne c t io ns .  Put t i ng  mu lt i p le  C -LAN  c irc ui t  p ac k s  int o 
a -system g ives ad d itional TCP/IP c ap ac ity. In ad d ition to the TCP/IP func tionality, 
CLAN extends the ISDN capabilities for csi models by providing Packet bus 
ac c ess.
A re m o t e  s o c ke t  c o n t ro l  l in k  ( RSC L )  li n k s t h e  C - L AN  a n d  t h e  SPE t o  p a ss  c a ll  
c ontrol and other management information. Sinc e one link serves all the p orts on 
the c irc uit p ac k, maintenanc e of the RSCL is p art of the C-LAN c irc uit p ac k 
maintenanc e.
The C-LAN TN799 c irc uit p ac k c omb ines the func tions of the PGATE and  PI 
c irc uit p ac ks into one c irc uit p ac k. The PGATE or PI c an b e used  with the C-LAN 
to c reate an X.25-to-TCP/IP b rid g e for ad junc t and DCS c onnec tivity.
Maintenanc e ob jec ts assoc iated  und er the Control LAN area inc lud e CLAN-BD 
(Control LAN Circ uit Pac k), ETH-PT
 (Control LAN Ethernet), and PPP-PT 
(Control 
LAN Pac ket/Port).
System Links (SYS-LINK)
System Links are pac ket links that orig inate at the Pac ket Interfac e b oard  and  
traverse various hard ware c omp onents to sp ec ific  end p oints. The hard ware 
c omp onents involved  on the forward  and  reverse routes c an b e d ifferent, 
d ep end ing  upon the c onfig uration and  switc h administration. Various types of 
links are defined  b y their end p oints:
EAL Exp ansion Arc hang el Link terminating  at an Exp ansion Interface b oard . 
This link c arries CCMS messag es.
INL Indirect Neig hbor Link terminating  at a Switc h Nod e Interface b oard
PACL PNC ATM Control Link terminating  at a PNC ATM EI b oard . This link carries 
ATM sig naling  command s from CaPro to the remote TN2238 (ATM-EI) 
boards.
PGC Packet Gateway Call-Control Link terminating  at a Pac ket Gateway b oard
PRI ISDN PRI D-Channel Link terminating  at a Universal DS1 b oard
RSCL Remote Soc ket Control Link terminating  at a C-LAN b oard
RSL Remote Soc ket Link teminating  at a C-LAN board
SAP System (Ac c ess) Port Link terminating  at a Packet Data p ort
X.25 BX.25 Link terminating  at a Pac ket Gateway p ort 
						

							DEFINITY Enterprise Communications Server Release 8.2
Upgrades and Additions for R8r  555-233-115  Issue 1
April 2000
Troubleshooting  an Upgrade 
B-7 Troubleshooting Guidelines 
B
The system links (SYS-LINK
) maintenanc e ob jec t rec ord s all errors enc ountered  
on the links. Most of these events are not extraord inary unless they oc c ur with an 
alarming  freq uenc y. The events are log g ed as they oc c ur, leaving  a “ trail”  to help  
analyze ab normal b ehavior exhib ited  b y the end p oints attac hed  to the links or 
the links themselves.
When a link g oes down, an alarm is raised  immed iately. For EAL, INL, and  PACL 
link typ es a MINOR alarm is raised ; for all other link typ es a WARNING alarm is 
raised . Other alarming  c ond itions that d o not c ause the link to g o d own g et a 
WARNING alarm, reg ard less of the link typ e.
Troubleshooting Guidelines
Before esc alating  a p rob lem, try the troubleshooting  p roc ed ures listed in this 
ap p end ix. Also try the g eneral troub leshooting  p roc ed ures b elow. 
1. Chec k the software c omp atib ility on the Software Release Letter. Be sure 
the software that you are up g rad ing  
from is c omp atib le with the software 
that you are upg rad ing  
to.
2. Chec k the Release 8 software tap e (removab le med ia) for d efec ts. Typ e 
test removable-media 
UUCSS long
 and press En t e r, if you are using  R8 
software. If you are using  R7 or p rior software, type test tape 
UUCSS long
 
and  p ress 
En t e r. If the tap e (removab le med ia) has errors, rep lac e it.
NOTE:
Do not run the test removable-media short command
, or the test 
tape short command
. This test c annot find  all of the b ad  sec tors 
that may b e p resent on the tap e (removable med ia).
3. If upg rad ing  from G3V4 and  earlier systems to a Release 8r, c hec k the 
vintag e of the d isk d rive. The d isk d rive 
must b e TN1657 Vintag e 4 or later.
4. Always use the Software Release Letter that ac c omp anies the software 
tap e (removable med ia). If the letter is not availab le, use the ap p rop riate 
c hap ter in this b ook. 
						

							DEFINITY Enterprise Communications Server Release 8.2
Upgrades and Additions for R8r  555-233-115  Issue 1
April 2000
Troubleshooting  an Upgrade 
B-8 Troubleshooting Guidelines 
B
Removable Media Troubleshooting Guidelines
Use the following  g uid elines when troub leshooting  and  resolving removab le 
media (R-MEDIA) problems.
1.
Avoid  saving  translations or announc ements on the b ac kup  removab le 
d rive until all other removable med ia and Host Adap ter p rob lems have 
b een resolved .
If there is something  wrong  with the Mass Storag e System, an attemp t to 
save translations or announc ements c ould  d estroy a g ood  c op y of the files 
on the removab le med ia.
2. In a system c onfigured  with d up lic ated  SPEs, the tests run on the standb y 
removab le media c irc uit p ac k are id entic al to those run on the ac tive 
removab le media c irc uit p ac k. Communic ations b etween the ac tive and  
stand b y SPEs is provid ed  b y the DUPINT c irc uit p ac k for b oth the c ontrol 
c hannel and  memory shad owing . Therefore, p rob lems with the DUPINT 
c irc uit p ac k may affec t maintenanc e tests of the stand b y removab le med ia 
circuit pack.
3. Chec k the error log  for p ower related p rob lems and refer to the 
maintenanc e d oc umentation on p ower.
4. The data on the removable media will likely be destroyed if:
nThe optic al d isk is removed  when the amb er LED on the removab le 
med ia c irc uit p ac k is on.
nThe removab le med ia c irc uit p ac k is removed  while the amber LED 
on the removab le med ia c irc uit pac k is on.
nPower is removed  from the removab le med ia while the amb er LED 
on the removab le med ia c irc uit pac k is on. 
						

							DEFINITY Enterprise Communications Server Release 8.2
Upgrades and Additions for R8r  555-233-115  Issue 1
April 2000
Troubleshooting  an Upgrade 
B-9 Troubleshooting Release 8 Upgrades 
B
Troubleshooting Release 8 Upgrades
The sub sec tions to follow p resent sp ec ific  p roc edures for c ommon up g rad e 
p rob lems, listed  b elow:
nNo Translations After Upgrade
nOne Side Upgrades, the Other Side Does Not (No Shadowing); Active Side 
Has Correct R8 Load
nRestore Disk Install or Restore Disk Full Fails
nMessage Waiting Lamps On (After Removing an EPN)
nTone Clock Does Not Function in New EPN
nTranslation Corruption Detected
nUnsuccessful Translation Read on System Restart (If Upgrading 
From Pre-R7.1)
nSoftware Incompatibility
nRe-install the ISDN-PRI Links (Only for Failed Upgrades)
No Translations After Upgrade
This problem usually means that the save translation
 c ommand , p erformed  
d uring the up g rad e, was not suc c essful. To rec over:
1. Install the b ac kup  tap e (removab le med ia) into the tap e (removab le 
med ia) d rive. This tap e (removab le med ia) must c ontain the orig inal 
translations b efore the up g rad e started .
2. Verify that the software is Release 8 and  that shad owing  is up .
3. Cop y the translations from the b ac kup  tap e (removab le med ia) to the d isk. 
Ty p e  copy translation disk both
 and p ress 
En t e r. This c op ies the 
translations from tape (removab le med ia) to disk and  takes about 30 
minutes. 
4. Type reset system 3
 and p ress 
En t e r. 
5. When the reb oot is finished , the system should  c ontain all of the 
translations from the b ac kup  tap e (removab le med ia).  
						

							DEFINITY Enterprise Communications Server Release 8.2
Upgrades and Additions for R8r  555-233-115  Issue 1
April 2000
Troubleshooting  an Upgrade 
B-10 Troubleshooting Release 8 Upgrades 
B
One Side Upgrades, the Other Side Does Not (No 
Shadowing); Active Side Has Correct R8 Load
This p rob lem ind ic ates that the software version on the standb y sid e is inc orrec t.
1.Perform a “ hot-swap ”  of the d isk d rives (move the stand b y d isk to the 
active sid e and  vic e versa).
2. Insert the Release 8 software removab le med ia into the ac tive op tic al d isk 
drive.
3. Type list configure software
 and  press 
En t e r to verify the removab le 
med ia c ontains the req uired  Release 8 software.
4. If the software version on the removab le med ia is inc orrec t, typ e restore 
disk full active
 and p ress 
En t e r. This c op ies the entire b ac kup  removab le 
med ia to d isk and  takes ab out 30 minutes. Do not use the “ restore d isk 
install”  c ommand .
5. Perform a “ hot-swap ”  of the d isk d rives (move the stand b y d isk to the 
active sid e and  vic e versa).
6. Perform a power-down reset on the standby side 
only. Disc onnec t the 
p ower c ord s (first from the left sid e and  then the right sid e) from the p ower 
su p p lie s o n  b o t h  s id e s o f  t h e  s t a n d b y  SPE.
Restore Disk Install or Restore Disk Full Fails
This p rob lem assumes that an MSS error was enc ountered, a restore disk full 
failed, or a restore d isk install failed .
1. This usually ind ic ates that a b ad  removab le med ia was used . To verify:
a. Insert the susp ec t removab le med ia into the removab le med ia 
drive.
b. Type test tape 
UUCSS long
 and press En te r.
NOTE:
Do not run the “ test tap e short”  c ommand . The short test 
c annot find  all of the b ad  sec tors that may b e p resent on the 
removable media.
c . If the removab le med ia has errors, rep lac e it. 
2. Insert a good Release 8 software removable media into the removable 
media drive.
3. Test the removab le med ia b efore starting  the upg rad e. Typ e test 
removable-media 
UUCSS long
 and  p ress En te r, if you are using  R8 
software. If you are using  R7 or earlier software, typ e test tape 
UUCSS 
long
 and  p ress 
En t e r.
NOTE:
Do not run the test removable-media short command
, or the test 
tape short command
. The short test c annot find  all of the b ad  
sec tors that may b e p resent on the tap e (removab le med ia).