ORACLE EXADATA 12.1.2.3.7 虚拟环境模拟 （一）

Posted 2023-04-13

参考技术A 环境配置

公司要上新一体机，需要对新版本研究下，自己先在电脑上虚拟一下Oracle exadata环境。方便研究。谢谢大家的关注

一、安装操作系统

[root@masterdb ~]# cat /etc/system-release Oracle Linux Server release 7.4

二、配置网络

配置管理网络和infiniband心跳网络 必须静态

计算节点

nmcli connection add type ethernet con-name static-eth0 ifname eth0 ip4 10.201.0.231/24 gw4 10.201.0.254

nmcli connection add type ethernet con-name static-eth1 ifname eth1 ip4 10.0.0.231/24 gw4 10.0.0.254

cell节点

nmcli connection add type ethernet con-name static-eth0 ifname eth0 ip4 10.201.0.232/24 gw4 10.201.0.254

nmcli connection add type ethernet con-name static-eth1 ifname eth1 ip4 10.0.0.232/24 gw4 10.0.0.254

三、配置yum

vim /etc/yum.repos.d/iso.repo

[ISO] name=iso

baseurl=file:///mnt

#gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-oracle

gpgcheck=0

#priority=20

enabled=1

yum repolist

四、安装cell依赖包

yum install -y lm_sensors net-snmp perl-Compress perl-html perl-libwww

五、配置hosts文件

#db

10.201.0.231 masterdb

10.0.0.231 masterdb

#cell

10.201.0.232 slavecell

10.0.0.232 slavecell

六、创建目录

mkdir /var/log/oracle

chmod 775 /var/log/oracle

mkdir /opt/oracle

chmod 775 /opt/oracle

七、配置系统内核参数

mv /etc/sysctl.conf /etc/sysctl.conf.bak

注：sysctl.conf文件的原有参数可能会对启动celsrv服务有影响，建议不用原有的参数。

vi /etc/sysctl.conf

fs.file-max = 65536

fs.aio-max-nr = 500000000

vm.min_free_kbytes = 512000

net.core.rmem_default = 262144

net.core.wmem_default = 262144

net.core.rmem_max = 8388608

net.core.wmem_max = 4194304

执行/sbin/sysctl -p 使参数生效

vi /etc/security/limits.conf

root soft nofile 131072

root hard nofile 131072

celladmin soft nproc 2047

celladmin hard nproc 16384

celladmin soft nofile 131072

celladmin hard nofile 131072

登录策略

vi /etc/pam.d/login

session required pam_limits.so

八、配置RDS协议

12c后需要RDS协议的支持，否则cellsrv服务无法启动

12c以前，除支持RDS协议，还支持UDP协议

手动加载RDS协议

modprobe rds

modprobe rds_tcp

modprobe rds_rdma

设置RDS随系统启动时自动加载RDS协议

vi /etc/modprobe.d/rds.conf

install rds /sbin/modprobe --ignore -install rds && /sbin/modprobe rds_tcp && /sbin/modprobe rds_rdma

九、关闭防火墙和selinux

systemctl stop firewalld.service

vim /etc/selinux/config

SELINUX=enforcing => disabled

十、安装存储软件

1、安装java

unzip V983555-01.zip

tar -xvf nfsimg-18.1.20.0.0-190911-cell.tar

cd cellbits

tar -xjvf cellrpms.tbz

rpm -ivh jdk1.8-1.8.0_221-fcs.x86_64.rpm

2、解压存储软件、

/usr/local/src/software/cellbits unzip cell.bin rpm -ivh cell-18.1.20.0.0_LINUX.X64_190911-1.x86_64.rpm error: Failed dependencies: net-snmp-utils is needed by cell-18.1.20.0.0_LINUX.X64_190911-1.x86_64 perl(Env) is needed by cell-18.1.20.0.0_LINUX.X64_190911-1.x86_64 perl(LWP) is needed by cell-18.1.20.0.0_LINUX.X64_190911-1.x86_64 perl(XML::Simple) is needed by cell-18.1.20.0.0_LINUX.X64_190911-1.x86_64

安装依赖包

for i in `ls perl*`; do rpm -ivh --nodeps $i; done

继续安装

[root@slavecell cellbits]# rpm -ivh cell-18.1.20.0.0_LINUX.X64_190911-1.x86_64.rpm Preparing... ################################# [100%] Updating / installing... 1:cell-18.1.20.0.0_LINUX.X64_190911################################# [100%] Installation SUCCESSFUL. Done. Please Login as user celladmin, startup RS and MS, then create cell to startup CELLSRV to complete cell configuration. If this is a manual installation, please stop and restart ExaWatcher to pick up newly installed binaries. You can run "/opt/oracle.ExaWatcher/ExaWatcher.sh --stop" and then "/opt/oracle.ExaWatcher/ExaWatcher.sh --fromconf" to stop and restart ExaWatcher. ######################################################### Logout and then re-login to use the new cell environment. #########################################################

说明安装成功

启动服务

cd /opt/oracle/cell/cellsrv/bin

./cellcli

CellCLI> alter cell restart services all

Stopping RS services... CELL-01509:

Restart Server (RS) not responding.

Starting the RS services... Getting the state of RS services... running

Restarting CELLSRV services... The

RESTART of CELLSRV services was not successful.

CELL-01531: Unable to parse the cellinit.ora file due to incorrect parameters in the file.

Restarting MS services... The

RESTART of MS services was successful.

调试存储软件

cellcli -e list cell detail

cellsrvStatus: stopped /var/log/oracle/diag/asm/cell/slavecell/trace [RS]

No IP found in Exadata config file cellinit.ora. Err: 52

添加IP

cd /opt/oracle/cell/cellsrv/deploy/config

vi cellinit.ora

ipaddress1 = 10.0.0.232/24

HTTP_PORT = 8888

参考

cellcli -e create cell cell1 interconnect1=eth0

WARNING: Hugepage allocation failed. CELLSRV is running without hugepage support.

查看状态

CellCLI> list cell detail

name: slavecell cellVersion:

OSS_18.1.20.0.0_LINUX.X64_190911

cpuCount: 4/10 diagHistoryDays: 7 doNotServiceLEDStatus:

off flashCacheMode: WriteThrough id: e8df7589-22ed-42c4-91b3-33db133d76ad

interconnectCount: 0 ipaddress1: 10.0.0.232/24 kernelVersion: 4.1.12-94.3.9.el7uek.x86_64 makeModel: Fake hardware memoryGB: 0 metricHistoryDays: 7

offloadGroupEvents: ramCacheMaxSize: 0 ramCacheMode:

Auto ramCacheSize: 0 releaseImageStatus: success

releaseVersion: 18.1.20.0.0

releaseTrackingBug: 30290356

status: online

upTime: 0 days, 0:00

cellsrvStatus: running

msStatus: running

rsStatus: running

CELLSRV、MS、RS这3个服务已启动，存储节点软件已配置完成。

Spring Boot Oracle Exadata |连接重置错误

【中文标题】Spring Boot Oracle Exadata |连接重置错误

【英文标题】：Spring Boot Oracle Exadata | Connection Reset error

【发布时间】：2018-10-23 08:17:05

【问题描述】：

下面是application.properties文件：

spring.datasource.url=jdbc:oracle:thin:@asdf:1521/asdf
spring.datasource.username=asdf
spring.datasource.password=asdf
spring.datasource.driver-class=oracle.jdbc.driver.OracleDriver

我收到以下错误：

java.sql.SQLRecoverableException: IO Error: Connection reset
at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:682) ~[ojdbc7-6.8.jar:12.1.0.1.0]
at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:715) ~[ojdbc7-6.8.jar:12.1.0.1.0]
at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:385) ~[ojdbc7-6.8.jar:12.1.0.1.0]
at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:30) ~[ojdbc7-6.8.jar:12.1.0.1.0]
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:564) ~[ojdbc7-6.8.jar:12.1.0.1.0]
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:117) ~[HikariCP-2.7.9.jar:na]
at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:123) ~[HikariCP-2.7.9.jar:na]
at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:365) ~[HikariCP-2.7.9.jar:na]
at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:194) ~[HikariCP-2.7.9.jar:na]
at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:460) [HikariCP-2.7.9.jar:na]
at com.zaxxer.hikari.pool.HikariPool.checkFailFast(HikariPool.java:534) [HikariCP-2.7.9.jar:na]
at com.zaxxer.hikari.pool.HikariPool.<init>(HikariPool.java:115) [HikariCP-2.7.9.jar:na]
at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:112) [HikariCP-2.7.9.jar:na]
at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:151) [spring-jdbc-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:115) [spring-jdbc-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:78) [spring-jdbc-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.jdbc.support.JdbcUtils.extractDatabaseMetaData(JdbcUtils.java:319) [spring-jdbc-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.jdbc.support.JdbcUtils.extractDatabaseMetaData(JdbcUtils.java:356) [spring-jdbc-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.boot.autoconfigure.orm.jpa.DatabaseLookup.getDatabase(DatabaseLookup.java:72) [spring-boot-autoconfigure-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at org.springframework.boot.autoconfigure.orm.jpa.JpaProperties.determineDatabase(JpaProperties.java:166) [spring-boot-autoconfigure-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at org.springframework.boot.autoconfigure.orm.jpa.JpaBaseConfiguration.jpaVendorAdapter(JpaBaseConfiguration.java:111) [spring-boot-autoconfigure-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at org.springframework.boot.autoconfigure.orm.jpa.HibernateJpaConfiguration$$EnhancerBySpringCGLIB$$357f2d24.CGLIB$jpaVendorAdapter$4(<generated>) [spring-boot-autoconfigure-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at org.springframework.boot.autoconfigure.orm.jpa.HibernateJpaConfiguration$$EnhancerBySpringCGLIB$$357f2d24$$FastClassBySpringCGLIB$$87756a54.invoke(<generated>) [spring-boot-autoconfigure-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228) [spring-core-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:365) [spring-context-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.boot.autoconfigure.orm.jpa.HibernateJpaConfiguration$$EnhancerBySpringCGLIB$$357f2d24.jpaVendorAdapter(<generated>) [spring-boot-autoconfigure-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_121]
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_121]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_121]
at java.lang.reflect.Method.invoke(Unknown Source) ~[na:1.8.0_121]
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:154) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:583) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1246) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1096) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:535) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:495) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:317) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222) ~[spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:315) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:251) ~[spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1135) ~[spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1062) ~[spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:819) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:725) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:475) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1246) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1096) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:535) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:495) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:317) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222) ~[spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:315) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:251) ~[spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1135) ~[spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1062) ~[spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:819) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:725) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:475) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1246) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1096) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:535) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:495) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:317) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222) ~[spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:315) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199) [spring-beans-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.getBean(AbstractApplicationContext.java:1087) ~[spring-context-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:857) ~[spring-context-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:548) ~[spring-context-5.0.10.RELEASE.jar:5.0.10.RELEASE]
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:140) ~[spring-boot-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:754) ~[spring-boot-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:386) ~[spring-boot-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at org.springframework.boot.SpringApplication.run(SpringApplication.java:307) ~[spring-boot-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at org.springframework.boot.SpringApplication.run(SpringApplication.java:1242) ~[spring-boot-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at org.springframework.boot.SpringApplication.run(SpringApplication.java:1230) ~[spring-boot-2.0.6.RELEASE.jar:2.0.6.RELEASE]
at tesco.finance.gss.remify.RemifyApplication.main(RemifyApplication.java:10) ~[classes/:na]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_121]
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_121]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_121]
at java.lang.reflect.Method.invoke(Unknown Source) ~[na:1.8.0_121]
at org.springframework.boot.devtools.restart.RestartLauncher.run(RestartLauncher.java:49) ~[spring-boot-devtools-2.0.6.RELEASE.jar:2.0.6.RELEASE]

【参考方案1】：

在尝试和测试各种解决方案之后，我发现只能通过特定 IP 连接到 exadata，因此上面的代码从一些服务器中断，但最后在 prod env 上工作。

此外，我很困惑，因为我可以远程登录到 1521 端口，但仍然无法通过 jdbc 客户端连接到 db 服务。

不确定，如何启用此安全性？如果他们已经知道，也想听听他们的意见！

谢谢