SEVERE: OUI-25031 – Installing OEM 10.2.0.3.0

When installing Oracle Enterprise Manager 10.2.0.3.0 after 31 december 2010 you can expect the following error during installation on step: OMS configurations. This error comes from the expiration of a certificate on OEM. For more information see Metalink Note: 1228103.1.

Logfile installActions2011-01-31_10-49-54-AM.log:

INFO: Created a new file /u00/oracle/product/10.2.0/oms10g/cfgtoollogs/configToolFailedCommands
INFO: Since the option is to overwrite the existing /u00/oracle/product/10.2.0/oms10g/cfgtoollogs/configToolFailedCommands file, backing it up
INFO: The backed up file name is /u00/oracle/product/10.2.0/oms10g/cfgtoollogs/configToolFailedCommands.bak
INFO: Created a new file /u00/oracle/product/10.2.0/agent10g/cfgtoollogs/configToolFailedCommands
INFO: Since the option is to overwrite the existing /u00/oracle/product/10.2.0/agent10g/cfgtoollogs/configToolFailedCommands file, backing it up
INFO: The backed up file name is /u00/oracle/product/10.2.0/agent10g/cfgtoollogs/configToolFailedCommands.bak
SEVERE: OUI-25031:Some of the configuration assistants failed. It is strongly recommended that you retry the configuration assistants at this time. Not successfully running any "Recommended" assistants means your system will not be correctly configured.
1. Check the Details panel on the Configuration Assistant Screen to see the errors resulting in the failures.
2. Fix the errors causing these failures.
3. Select the failed assistants and click the 'Retry' button to retry them.
INFO: User Selected: Yes/OK

When starting OPMN by hand you get the error below:

opmnctl: starting opmn and all managed processes...
================================================================================
opmn id=ysoms01:6200
    4 of 5 processes started.

ias-instance id=EnterpriseManager0.ysoms01.hosting.yenlo.nl
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
ias-component/process-type/process-set:
    HTTP_Server/HTTP_Server/HTTP_Server

Error
--> Process (pid=21810)
    failed to start a managed process after the maximum retry limit
    Log:
    /u00/oracle/product/10.2.0/oms10g/opmn/logs/HTTP_Server~1

In the log file mentioned you find noting, but when you look in the error log of Apache, you’ll see the following error:

[Mon Jan 31 11:49:43 2011] [error] mod_ossl: Init: Server ysoms01:1159: SSL setup failed: call to nzos_OpenWallet returned error 28750
[Mon Jan 31 11:49:43 2011] [error] mod_ossl: Unknown error

Steps to resolve this issue.

Don’t quite the installer.
Download patch 8430622. And take the actions described below:

Stop the OMS:

[oracle@ysoms01 8430622]$ emctl stop oms
Oracle Enterprise Manager 10g Release 3 Grid Control
Copyright (c) 1996, 2007 Oracle Corporation.  All rights reserved.
Oracle Management Server is Down.
[oracle@ysoms01 8430622]$ opmnctl stopall
opmnctl: stopping opmn and all managed processes...

After unzipping, apply the patch to the OMS home:

[oracle@ysoms01 8430622]$ /u00/oracle/product/10.2.0/oms10g/OPatch/opatch apply
Invoking OPatch 10.2.0.3.0

Oracle interim Patch Installer version 10.2.0.3.0
Copyright (c) 2005, Oracle Corporation.  All rights reserved..

Oracle Home       : /u00/oracle/product/10.2.0/oms10g
Central Inventory : /u00/oracle/oraInventory
   from           : /etc/oraInst.loc
OPatch version    : 10.2.0.3.0
OUI version       : 10.2.0.3.0
OUI location      : /u00/oracle/product/10.2.0/oms10g/oui
Log file location : /u00/oracle/product/10.2.0/oms10g/cfgtoollogs/opatch/opatch2011-01-31_11-55-36AM.log

ApplySession applying interim patch '8430622' to OH '/u00/oracle/product/10.2.0/oms10g'

OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.

Backing up files and inventory (not for auto-rollback) for the Oracle Home
Backing up files affected by the patch '8430622' for restore. This might take a while...
Backing up files affected by the patch '8430622' for rollback. This might take a while...

Patching component oracle.sysman.top.oms, 10.2.0.3.0...
Updating jar file "/u00/oracle/product/10.2.0/oms10g/sysman/jlib/emagentSDK.jar" with "/sysman/jlib/emagentSDK.jar/oracle/sysman/eml/sec/util/RootCert.class"
ApplySession adding interim patch '8430622' to inventory

Verifying the update...
Inventory check OK: Patch ID 8430622 is registered in Oracle Home inventory with proper meta-data.
Files check OK: Files from Patch ID 8430622 are present in Oracle Home.

OPatch succeeded.

Re-secure the Oracle Management Service:

[oracle@ysoms01 8430622]$ emctl secure oms -reset
Oracle Enterprise Manager 10g Release 3 Grid Control
Copyright (c) 1996, 2007 Oracle Corporation.  All rights reserved.
Enter Enterprise Manager Root Password :
Enter Agent Registration password :
OPMN processes already stopped...   Done.
Securing central oms...   Started.
Checking Repository...   Done.
Checking Em Key...   Done.
Checking Repository for an existing Enterprise Manager Root Key...
WARNING! An Enterprise Manager Root Key already exists in
the Repository. This operation will replace your Enterprise
Manager Root Key.
All existing Agents that use HTTPS will need to be
reconfigured if you proceed. Do you wish to continue and
overwrite your Root Key
(Y/N) ?
Y
Are you sure ? Reset of the Enterprise Manager Root Key
will mean that you will need to reconfigure each Agent
that is associated with this OMS before they will be
able to upload any data to it. Monitoring of Targets
associated with these Agents will be unavailable until
after they are reconfigured.
(Y/N) ?
Y
Generating Enterprise Manager Root Key (this takes a minute)...   Done.
Fetching Root Certificate from the Repository...   Done.
Generating Registration Password Verifier in the Repository...   Done.
Generating Oracle Wallet Password for Enterprise Manager OMS...   Done.
Generating Oracle Wallet for Enterprise Manager OMS...   Done.
Generating Oracle Wallet for iAS HTTP Server...   Done.
Updating HTTPS port in emoms.properties file...   Done.
Generating HTTPS Virtual Host for Enterprise Manager OMS...   Done.
Securing central oms...   Ended.

Start OMS:

[oracle@ysoms01 8430622]$ emctl start oms
Oracle Enterprise Manager 10g Release 3 Grid Control
Copyright (c) 1996, 2007 Oracle Corporation.  All rights reserved.
opmnctl: opmn is already running
Starting HTTP Server ...
Starting Oracle Management Server ...
Checking Oracle Management Server Status ...
Oracle Management Server is Up.

Press retry in the OUI, the setup will continue.

Error installing Oracle database 10.2.0.5.0

During the installation of Oracle Database 10.2.0.3.0 and later the upgrade to 10.2.0.5.0 you may encounter the following errors when installing it on the latest version of Oracle Enterprise Linux 5.5 x64.

INFO:  - Linking liborasdkbase
INFO: /u00/oracle/product/10.2.0/db/bin/genorasdksh -base
INFO: $Id: genorasdksh.sh 02-mar-2005.16:22:46 mchengjr Exp $
INFO: Generating BASE ORASDK library...
INFO: Creating /u00/oracle/product/10.2.0/db/lib/liborasdkbase.so.10.2
INFO: gcc: /usr/lib64/libstdc++.so.5: No such file or directory
INFO: /u00/oracle/product/10.2.0/db/bin/genorasdksh: Failed to link liborasdkbase.so.10.2
INFO: make: *** [liborasdkbase] Error 1
INFO: End output from spawned process.
INFO: ----------------------------------
INFO: Exception thrown from action: make
Exception Name: MakefileException
Exception String: Error in invoking target 'all_no_orcl' of makefile '/u00/oracle/product/10.2.0/db/rdbms/lib/ins_rdbms.mk'. See '/u00/oracle/oraInventory/logs/installActions2011-01-28_04-54-06PM.log' for details.

Simply to solve by linking the new lib to the old name:

cd /usr/lib64
ln -s libstdc++.so.6.0.8 libstdc++.so.5

The other error you might encounter:

INFO: /u00/oracle/product/10.2.0/db/ctx/lib/libwv_core.so: undefined reference to `__cxa_pure_virtual@CXXABI_1.2'
/u00/oracle/product/10.2.0/db/ctx/lib//libsc_fa.so: undefined reference to `__gxx_personality_v0@CXXABI_1.2'
/u00/oracle/product/10.2.0/db/ctx/lib/libwv_core.so: undefined reference to `
INFO: vtable for __cxxabiv1::__class_type_info@GLIBCPP_3.2'
/u00/oracle/product/10.2.0/db/ctx/lib/libwv_core.so: undefined reference to `vtable for __cxxabiv1::__si_class_type_info@GLIBCPP_3.2'
/u00/oracle/product/10.2.0/db/ctx/lib/libwv_core.so: undefined reference to `std::ios_base::Init::Init()@GLIBCPP_3.2'
/u00/oracle/product/10.2.0/db/ctx/lib/libwv_core.so: undefined reference to `std::ios_base::Init::~Init()@GLIBCPP_3.2'
/u00/oracle/product/10.2.0/db/ctx/lib/libwv_core.so: undefined reference to `operator d
INFO: elete(void*)@GLIBCPP_3.2'
collect2: ld returned 1 exit status
INFO: make: *** [ctxhx] Error 1
INFO: End output from spawned process.
INFO: ----------------------------------
INFO: Exception thrown from action: make
Exception Name: MakefileException
Exception String: Error in invoking target 'install' of makefile '/u00/oracle/product/10.2.0/db/ctx/lib/ins_ctx.mk'. See '/u00/oracle/oraInventory/logs/installActions2011-01-28_05-16-06PM.log' for details.
Exception Severity: 1

Solve it with:

yum install compat-libstdc++-33.x86_64 -y

How to install Glassfish loadbalancer plugin

Here is a simple straight forward install instruction for the glassfish loadbalancer plugin on linux apache. Notice that this plugin is only available for glassfish 2.x and works only with 32bit apache. All the steps must be run as the root user.

Install the required packages, and enable them:

yum install httpd.i386 mod_ssl.i386 -y
chkconfig httpd on

Download and unzip the glassfish plugin:

cd ~
mkdir glassfish
cd glassfish
wget http://dlc.sun.com.edgesuite.net/javaee5/external/Linux/aslb/jars/aslb-9.1.1-b17.jar
unzip aslb-9.1.1-b17.jar
unzip SUNWaslb.zip
unzip SUNWaspx.zip

Create the appropriate directories:

mkdir /etc/httpd/modules/resource
mkdir /etc/httpd/modules/errorpages
mkdir /etc/httpd/sec_db_files

Next, put all the unzip files on the right location:

cp ~/glassfish/lib/webserver-plugin/linux/apache2.2/LBPlugin*.res /etc/httpd/modules/resource -f
cp ~/glassfish/lib/webserver-plugin/linux/apache2.2/mod_loadbalancer.so /etc/httpd/modules
cp ~/glassfish/lib/webserver-plugin/linux/apache2.2/errorpages/* /etc/httpd/modules/errorpages/
cp ~/glassfish/lib/dtds/sun-loadbalancer* /etc/httpd/conf/
cp ~/glassfish/lib/install/templates/loadbalancer.xml.example /etc/httpd/conf
cp ~/glassfish/lib/webserver-plugin/linux/apache2.2/*.db /etc/httpd/sec_db_files/
cp ~/glassfish/lib/lib* /usr/lib

Enable the plugin:

cat >> /etc/httpd/conf/httpd.conf << EOF
##BEGIN EE LB Plugin Parameters
LoadModule apachelbplugin_module modules/mod_loadbalancer.so

config-file "/etc/httpd/conf/loadbalancer.xml"
locale en


DocumentRoot "/var/www/html"
ServerName [SERVERNAME]

Next, configure the loadbalancer:

vi /etc/httpd/conf/loadbalancer.xml


  
    
    
    
    
  








Remember to add an entry for every context root of your application in the loadbalancer.xml, other wise this part of the application will not be available through the loadbalancer.

Enable and configure apache as a worker:

vi /etc/httpd/conf/httpd.conf

Set the following parameters:


StartServers 1
MaxClients 32
MinSpareThreads 5
MaxSpareThreads 10
ThreadsPerChild 32
MaxRequestsPerChild 0

Enable worker processes:

vi /etc/sysconfig/httpd
HTTPD=/usr/sbin/httpd.worker

Pro’s: this way of balancing your J2EE application, the loadbalancer is aware that he is balancing a java application. Mod_proxy is not.
Con’s: Pretty maintenance intensive, every context root must be added to the configuration.