Oct 30 22:05:03.935349 ip-10-0-137-160 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Oct 30 22:05:03.935360 ip-10-0-137-160 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Oct 30 22:05:03.935368 ip-10-0-137-160 systemd[1]: kubelet.service: Failed with result 'resources'. Oct 30 22:05:03.935676 ip-10-0-137-160 systemd[1]: Failed to start Kubernetes Kubelet. Oct 30 22:05:14.016751 ip-10-0-137-160 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Oct 30 22:05:14.016767 ip-10-0-137-160 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1ecc3ca4322043de827545b0e6765ffe -- Oct 30 22:07:00.722869 ip-10-0-137-160 systemd[1]: Starting Kubernetes Kubelet... Oct 30 22:07:01.111451 ip-10-0-137-160 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:01.111451 ip-10-0-137-160 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 22:07:01.111451 ip-10-0-137-160 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:01.111451 ip-10-0-137-160 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:01.115956 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115885 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:01.115956 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115957 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115962 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115966 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115970 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115973 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115976 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115978 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115981 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115984 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115987 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115990 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115992 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115995 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.115997 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116000 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116003 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116005 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116008 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116010 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:01.116023 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116013 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116023 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116025 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116029 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116031 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116034 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116037 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116040 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116042 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116045 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116047 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116050 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116052 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116055 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116057 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116060 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116062 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116065 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116068 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116072 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:01.116457 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116075 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116078 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116080 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116083 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116085 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116088 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116090 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116093 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116095 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116098 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116100 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116103 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116106 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116109 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116112 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116115 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116117 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116120 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116123 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116125 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:01.116933 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116128 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116131 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116134 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116136 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116139 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116141 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116144 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116146 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116148 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116151 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116153 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116156 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116159 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116161 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116163 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116166 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116169 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116171 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116174 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116177 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:01.117389 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116179 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116182 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116184 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116187 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116190 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116192 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116196 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116198 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116201 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116203 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116206 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116208 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116211 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116213 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116216 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116218 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116221 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116223 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116226 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:01.117862 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116230 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116232 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116235 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116237 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116240 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116242 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.116245 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117011 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117017 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117021 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117023 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117026 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117029 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117032 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117035 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117038 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117041 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117044 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117047 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117049 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:01.118300 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117052 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117055 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117058 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117060 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117063 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117065 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117068 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117070 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117073 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117075 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117078 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117081 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117083 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117086 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117088 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117091 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117093 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117096 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117098 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:01.118822 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117100 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117103 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117106 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117109 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117111 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117114 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117117 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117120 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117123 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117126 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117129 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117132 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117135 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117137 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117140 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117142 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117145 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117148 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117150 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:01.119271 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117153 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117155 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117157 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117160 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117163 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117165 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117167 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117170 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117172 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117175 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117177 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117180 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117183 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117185 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117188 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117191 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117193 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117196 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117199 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117203 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:01.119721 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117207 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117209 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117212 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117215 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117217 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117220 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117222 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117225 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117228 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117230 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117233 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117235 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117238 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117241 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117243 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117246 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117248 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117251 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117254 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117257 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:01.120204 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117260 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117262 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117265 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117268 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117271 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117274 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117276 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117279 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117281 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117284 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117289 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117292 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117295 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117299 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117301 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117780 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117786 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117788 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117791 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:01.120676 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117794 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117797 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117800 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117802 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117805 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117807 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117812 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117816 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117820 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117823 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117827 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117830 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117833 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117835 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117838 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117841 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117843 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117846 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117848 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:01.121122 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117851 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117853 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117856 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117858 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117861 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117863 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117866 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117869 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117872 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117874 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117877 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117879 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117882 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117884 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117887 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117889 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117892 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117894 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117897 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117901 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:01.121557 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117903 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117906 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117908 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117913 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117916 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117920 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117925 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117928 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117931 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117934 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117937 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117940 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117943 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117945 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117947 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117950 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117952 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117955 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117958 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:01.122047 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117960 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117964 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117966 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117969 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117971 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117974 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117976 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117979 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117981 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117984 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117986 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117988 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117993 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117996 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.117998 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118001 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118005 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118008 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118010 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118013 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:01.122482 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118015 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118018 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118021 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118023 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118026 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118028 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118031 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118035 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118037 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118040 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118042 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118044 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118047 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118050 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118052 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118055 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118057 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118060 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118062 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:01.122955 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118065 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118067 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118070 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118072 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118075 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118165 2578 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118172 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118178 2578 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118183 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118188 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118192 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118198 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118202 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118205 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118208 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118212 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118216 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118219 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118222 2578 flags.go:64] FLAG: --cgroup-root="" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118225 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118228 2578 flags.go:64] FLAG: --client-ca-file="" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118231 2578 flags.go:64] FLAG: --cloud-provider="external" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118234 2578 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 22:07:01.123428 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118237 2578 flags.go:64] FLAG: --cluster-domain="" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118240 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118243 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118246 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118250 2578 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118254 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118257 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118260 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118264 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118267 2578 flags.go:64] FLAG: --contention-profiling="false" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118270 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118272 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118275 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118278 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118283 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118286 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118289 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118292 2578 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118297 2578 flags.go:64] FLAG: --enable-server="true" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118299 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118304 2578 flags.go:64] FLAG: --event-burst="100" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118307 2578 flags.go:64] FLAG: --event-qps="50" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118310 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118313 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 22:07:01.123965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118316 2578 flags.go:64] FLAG: --eviction-hard="" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118320 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118323 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118326 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118329 2578 flags.go:64] FLAG: --eviction-soft="" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118332 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118335 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118338 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118341 2578 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118344 2578 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118347 2578 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118350 2578 flags.go:64] FLAG: --feature-gates="" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118354 2578 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118357 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118361 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118364 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118367 2578 flags.go:64] FLAG: --healthz-port="10248" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118370 2578 flags.go:64] FLAG: --help="false" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118373 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118376 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118379 2578 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118382 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118386 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 22:07:01.124547 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118390 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118392 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118395 2578 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118399 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118401 2578 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118404 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118407 2578 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118410 2578 flags.go:64] FLAG: --kube-reserved="" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118413 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118416 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118419 2578 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118422 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118424 2578 flags.go:64] FLAG: --lock-file="" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118427 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118430 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118433 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118438 2578 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118441 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118444 2578 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118447 2578 flags.go:64] FLAG: --logging-format="text" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118450 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118453 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118456 2578 flags.go:64] FLAG: --manifest-url="" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118459 2578 flags.go:64] FLAG: --manifest-url-header="" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118465 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 22:07:01.125353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118469 2578 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118472 2578 flags.go:64] FLAG: --max-pods="110" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118475 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118478 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118481 2578 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118484 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118487 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118490 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118493 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118500 2578 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118503 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118507 2578 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118510 2578 flags.go:64] FLAG: --pod-cidr="" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118513 2578 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118516 2578 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118519 2578 flags.go:64] FLAG: --pods-per-core="0" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118522 2578 flags.go:64] FLAG: --port="10250" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118525 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118528 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c45fe242508b4522" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118531 2578 flags.go:64] FLAG: --qos-reserved="" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118534 2578 flags.go:64] FLAG: --read-only-port="10255" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118537 2578 flags.go:64] FLAG: --register-node="true" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118540 2578 flags.go:64] FLAG: --register-with-taints="" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118544 2578 flags.go:64] FLAG: --registry-burst="10" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118547 2578 flags.go:64] FLAG: --registry-qps="5" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118550 2578 flags.go:64] FLAG: --reserved-cpus="" Oct 30 22:07:01.126129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118553 2578 flags.go:64] FLAG: --reserved-memory="" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118556 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118559 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118563 2578 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118566 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118568 2578 flags.go:64] FLAG: --runonce="false" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118572 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118575 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118578 2578 flags.go:64] FLAG: --seccomp-default="false" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118581 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118583 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118586 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118590 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118593 2578 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118596 2578 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118599 2578 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118613 2578 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118617 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118620 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118623 2578 flags.go:64] FLAG: --system-cgroups="" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118625 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118631 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118634 2578 flags.go:64] FLAG: --tls-cert-file="" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118637 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118640 2578 flags.go:64] FLAG: --tls-min-version="" Oct 30 22:07:01.126743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118643 2578 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118646 2578 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118648 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118651 2578 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118654 2578 flags.go:64] FLAG: --v="2" Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118658 2578 flags.go:64] FLAG: --version="false" Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118662 2578 flags.go:64] FLAG: --vmodule="" Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118666 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.118669 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118787 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118791 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118793 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118796 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118799 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118802 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118805 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118807 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118810 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118812 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118815 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118818 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:01.127427 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118820 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118823 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118827 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118831 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118833 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118836 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118839 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118841 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118844 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118846 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118849 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118851 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118854 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118857 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118859 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118862 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118865 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118867 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118869 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:01.127930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118872 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118874 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118877 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118879 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118882 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118884 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118887 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118889 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118894 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118896 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118899 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118902 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118904 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118907 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118910 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118913 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118916 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118919 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118921 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118924 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:01.128376 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118926 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118929 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118932 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118934 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118937 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118940 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118944 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118947 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118950 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118953 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118955 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118958 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118960 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118963 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118965 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118968 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118970 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118973 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118976 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:01.128865 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118978 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118982 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118985 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118987 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118990 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118993 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118995 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.118998 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119001 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119004 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119006 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119009 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119012 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119014 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119017 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119019 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119022 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119024 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119027 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119029 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:01.129317 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119032 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119034 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119037 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119039 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119042 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119044 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119047 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119050 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119052 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119055 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119057 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119060 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119062 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119066 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119069 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119079 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:01.129799 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.119104 2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119137 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119141 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119145 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119149 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119151 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119154 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119157 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119160 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119163 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119165 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119168 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119170 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119173 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119175 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119179 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119183 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119186 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119189 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:01.130172 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119191 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119194 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119196 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119199 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119202 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119205 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119208 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119211 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119213 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119216 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119218 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119222 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119225 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119228 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119230 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119233 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119236 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119240 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119243 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119245 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:01.130614 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119248 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119251 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119253 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119256 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119258 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119277 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119280 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119284 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119287 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119289 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119292 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119295 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119297 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119300 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119302 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119305 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119307 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119310 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119314 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:01.131080 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119317 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119320 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119323 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119325 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119329 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119332 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119335 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119338 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119340 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119343 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119347 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119349 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119352 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119355 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119357 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119360 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119362 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119365 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119368 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119370 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:01.131519 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119373 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119375 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119378 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119380 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119383 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119386 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119388 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119391 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119393 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119396 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119398 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119401 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119403 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119406 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119408 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119411 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119414 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119417 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119419 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119423 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:01.131991 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119426 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119428 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119433 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119436 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119438 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119441 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119443 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119446 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.119449 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.127332 2578 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.127349 2578 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.127369 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.127374 2578 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127433 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127439 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127442 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127445 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127448 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127451 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:01.132468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127454 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127458 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127462 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127466 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127469 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127472 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127475 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127478 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127480 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127483 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127487 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127491 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127494 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127497 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127500 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127503 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127509 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127513 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127516 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:01.132930 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127518 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127521 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127524 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127526 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127530 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127533 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127535 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127538 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127541 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127544 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127546 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127549 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127551 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127554 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127557 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127559 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127562 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127565 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127567 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:01.133390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127570 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127572 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127575 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127577 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127580 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127583 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127585 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127588 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127591 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127593 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127596 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127599 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127601 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127616 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127618 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127621 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127624 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127627 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127630 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127633 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:01.133944 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127636 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127639 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127641 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127644 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127647 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127650 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127652 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127655 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127658 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127660 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127663 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127665 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127668 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127671 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127673 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127676 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127679 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127681 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127684 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127686 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:01.134412 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127689 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127691 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127694 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127697 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127699 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127702 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127704 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127707 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127710 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127713 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127716 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127718 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127721 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127723 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127726 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127729 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127731 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127734 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127736 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:01.134885 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127739 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127741 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127743 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.127771 2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127920 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127925 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127928 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127931 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127934 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127938 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127941 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127944 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127947 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127950 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127952 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127955 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:01.135329 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127958 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127960 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127963 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127966 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127968 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127971 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127973 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127976 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127978 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127981 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127983 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127986 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127988 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127991 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127994 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127996 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.127999 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128001 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128004 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:01.135715 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128006 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128009 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128011 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128014 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128016 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128019 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128021 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128025 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128028 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128030 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128033 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128036 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128038 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128041 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128043 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128046 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128048 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128051 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128053 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128056 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:01.137134 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128059 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128063 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128066 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128069 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128071 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128074 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128076 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128079 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128081 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128084 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128086 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128089 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128092 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128095 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128097 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128100 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128103 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128105 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128107 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128110 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:01.137593 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128113 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128116 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128118 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128121 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128123 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128126 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128128 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128131 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128133 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128136 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128138 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128141 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128144 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128147 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128149 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128152 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128154 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128158 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128161 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:01.138073 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128165 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128168 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128171 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128174 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128177 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128180 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128182 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128184 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128187 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128190 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128192 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128195 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128197 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128200 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128203 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128206 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:01.138502 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.128228 2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128274 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128278 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128281 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128284 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128286 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128289 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128291 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128294 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128296 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128299 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128303 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128307 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128310 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128313 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128316 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128318 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128321 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128323 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128326 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:01.138939 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128329 2578 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128331 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128334 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128336 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128339 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128342 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128344 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128347 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128349 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128352 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128355 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128357 2578 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128360 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128363 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128365 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128368 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128370 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128373 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128375 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128378 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:01.139390 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128380 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128383 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128386 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128389 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128392 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128394 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128397 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128399 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128403 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128406 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128412 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128415 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128418 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128421 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128423 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128425 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128428 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128430 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128434 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:01.139878 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128436 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128439 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128441 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128444 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128447 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128450 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128453 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128455 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128458 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128460 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128463 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128465 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128468 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128470 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128473 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128475 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128478 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128480 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128483 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:01.140313 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128485 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128488 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128490 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128493 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128497 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128499 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128502 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128504 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128507 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128509 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128512 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128514 2578 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128517 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128519 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128522 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128525 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128528 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128531 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128533 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:01.140752 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128536 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128539 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128542 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128544 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128547 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128549 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128552 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128554 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128557 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:01.128559 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.128626 2578 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.131889 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.132920 2578 server.go:1014] "Starting client certificate rotation" Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.133009 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.133038 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.136004 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:01.141208 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.138079 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:01.152092 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.152077 2578 log.go:25] "Validated CRI v1 runtime API" Oct 30 22:07:01.156186 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.156173 2578 log.go:25] "Validated CRI v1 image API" Oct 30 22:07:01.157586 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.157557 2578 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 22:07:01.161891 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.161873 2578 fs.go:135] Filesystem UUIDs: map[18d9ac7a-f98e-4ce1-9e60-7d7b5c2066d8:/dev/nvme0n1p4 39ab8db0-9390-434c-b65b-e8845074ebdb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Oct 30 22:07:01.161963 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.161889 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 22:07:01.168025 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.167909 2578 manager.go:217] Machine: {Timestamp:2026-10-30 22:07:01.166468068 +0000 UTC m=+0.333259258 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100182 MemoryCapacity:33164324864 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe874e548ee62f3d962b9b45a599d SystemUUID:ec2fe874-e548-ee62-f3d9-62b9b45a599d BootID:1ecc3ca4-3220-43de-8275-45b0e6765ffe Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582160384 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e1:3b:6d:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e1:3b:6d:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:3b:40:9e:68:07 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164324864 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 22:07:01.168025 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.168017 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 22:07:01.168182 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.168110 2578 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 22:07:01.170993 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.170964 2578 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 22:07:01.171119 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.170995 2578 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 22:07:01.171162 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.171121 2578 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 22:07:01.171162 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.171129 2578 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 22:07:01.171218 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.171163 2578 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:07:01.171956 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.171945 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:07:01.173245 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.173235 2578 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 22:07:01.177997 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.177985 2578 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 22:07:01.178104 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.178095 2578 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 22:07:01.178973 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.178962 2578 kubelet.go:493] "Attempting to sync node with API server" Oct 30 22:07:01.179005 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.178977 2578 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 22:07:01.179005 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.178991 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 22:07:01.179005 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.179000 2578 kubelet.go:405] "Adding apiserver pod source" Oct 30 22:07:01.179127 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.179009 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 22:07:01.179303 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.179293 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:07:01.181801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.181781 2578 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 22:07:01.189070 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.189055 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:07:01.190021 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190007 2578 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 22:07:01.190154 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190047 2578 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 22:07:01.190243 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190231 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 22:07:01.190299 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190250 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 22:07:01.190299 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190259 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 22:07:01.190299 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190269 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 22:07:01.190299 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190278 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 22:07:01.190299 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190287 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 22:07:01.190933 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190922 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 22:07:01.190982 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190935 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 22:07:01.190982 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190947 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 22:07:01.190982 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190957 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 22:07:01.190982 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190970 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 22:07:01.191124 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.190985 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 22:07:01.192469 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.192457 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 22:07:01.192526 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.192473 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 22:07:01.196131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.196116 2578 server.go:1263] "Started kubelet" Oct 30 22:07:01.196204 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.196179 2578 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 22:07:01.196279 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.196208 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 22:07:01.196320 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.196301 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 22:07:01.196760 ip-10-0-137-160 systemd[1]: Started Kubernetes Kubelet. Oct 30 22:07:01.197776 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.197750 2578 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 22:07:01.198351 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.198336 2578 server.go:317] "Adding debug handlers to kubelet server" Oct 30 22:07:01.203542 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.203516 2578 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 22:07:01.205175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.205152 2578 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 22:07:01.205175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.205156 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 22:07:01.205323 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.205261 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:01.205965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.205951 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 22:07:01.205965 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.205954 2578 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 22:07:01.206096 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.205975 2578 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 22:07:01.206096 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.206057 2578 reconstruct.go:97] "Volume reconstruction finished" Oct 30 22:07:01.206096 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.206066 2578 reconciler.go:29] "Reconciler: start to sync state" Oct 30 22:07:01.206175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.206109 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 22:07:01.206175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.206121 2578 factory.go:55] Registering systemd factory Oct 30 22:07:01.206175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.206128 2578 factory.go:223] Registration of the systemd container factory successfully Oct 30 22:07:01.206371 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.206357 2578 factory.go:153] Registering CRI-O factory Oct 30 22:07:01.206448 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.206373 2578 factory.go:223] Registration of the crio container factory successfully Oct 30 22:07:01.206448 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.206390 2578 factory.go:103] Registering Raw factory Oct 30 22:07:01.206448 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.206403 2578 manager.go:1199] Started watching for new ooms in manager Oct 30 22:07:01.207512 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.207492 2578 manager.go:319] Starting recovery of all containers Oct 30 22:07:01.220156 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.220139 2578 manager.go:324] Recovery completed Oct 30 22:07:01.225810 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.225797 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:01.227668 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.227651 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:01.227745 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.227680 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:01.227745 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.227692 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:01.228268 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.228254 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:01.228339 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.228255 2578 cpu_manager.go:226] "Starting" policy="none" Oct 30 22:07:01.228339 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.228286 2578 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 22:07:01.228339 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.228305 2578 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 22:07:01.229064 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.229049 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:01.229174 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.229072 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:01.229174 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.229087 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:01.230511 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.230498 2578 policy_none.go:50] "Start" Oct 30 22:07:01.230511 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.230513 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 22:07:01.230595 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.230523 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 22:07:01.232463 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.232452 2578 policy_none.go:44] "Start" Oct 30 22:07:01.237175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.237155 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 22:07:01.237253 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.237157 2578 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 22:07:01.238291 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.237162 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-160.ec2.internal.18e36dff9a480376 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-160.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-160.ec2.internal,},FirstTimestamp:2026-10-30 22:07:01.196088182 +0000 UTC m=+0.362879371,LastTimestamp:2026-10-30 22:07:01.196088182 +0000 UTC m=+0.362879371,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-160.ec2.internal,}" Oct 30 22:07:01.239011 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.238986 2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 22:07:01.254074 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.254057 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxtz4" Oct 30 22:07:01.256369 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.256211 2578 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 22:07:01.256369 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.256266 2578 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 22:07:01.256369 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.256189 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-160.ec2.internal.18e36dff9c29dce1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-160.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-160.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-160.ec2.internal,},FirstTimestamp:2026-10-30 22:07:01.227666657 +0000 UTC m=+0.394457849,LastTimestamp:2026-10-30 22:07:01.227666657 +0000 UTC m=+0.394457849,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-160.ec2.internal,}" Oct 30 22:07:01.256593 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.256269 2578 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.260206 2578 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.263541 2578 manager.go:341] "Starting Device Plugin manager" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.263561 2578 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.263578 2578 server.go:87] "Starting device plugin registration server" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.263809 2578 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.263819 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.263970 2578 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.264036 2578 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.264041 2578 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.264262 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxtz4" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.264459 2578 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.264500 2578 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.274978 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.276060 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.276083 2578 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.276104 2578 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.276139 2578 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 22:07:01.283927 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.282401 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-160.ec2.internal.18e36dff9c2a2bdd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-160.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-160.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-160.ec2.internal,},FirstTimestamp:2026-10-30 22:07:01.227686877 +0000 UTC m=+0.394478065,LastTimestamp:2026-10-30 22:07:01.227686877 +0000 UTC m=+0.394478065,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-160.ec2.internal,}" Oct 30 22:07:01.311443 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.311425 2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:01.364599 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.364439 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:01.365289 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.365274 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:01.365354 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.365303 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:01.365354 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.365323 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:01.365354 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.365342 2578 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.376644 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.376620 2578 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal"] Oct 30 22:07:01.376724 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.376673 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:01.379417 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.379401 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:01.379471 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.379426 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:01.379471 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.379436 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:01.381678 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.381666 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:01.381799 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.381786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.381843 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.381813 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:01.382439 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.382423 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:01.382505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.382449 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:01.382505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.382423 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:01.382505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.382483 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:01.382505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.382494 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:01.382635 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.382460 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:01.384689 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.384657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.384689 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.384686 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:01.385447 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.385429 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:01.385514 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.385457 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:01.385514 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.385467 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:01.386227 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.386210 2578 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.386309 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.386231 2578 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-160.ec2.internal\": node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:01.415206 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.415188 2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-160.ec2.internal\" not found" node="ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.421504 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.421487 2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-160.ec2.internal\" not found" node="ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.430863 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.430845 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:01.506737 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.506715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bcd859681c6ed3bc37c2cdc12c8d68d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-160.ec2.internal\" (UID: \"4bcd859681c6ed3bc37c2cdc12c8d68d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.506823 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.506738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.506823 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.506756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.530926 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.530907 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:01.607133 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.607113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bcd859681c6ed3bc37c2cdc12c8d68d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-160.ec2.internal\" (UID: \"4bcd859681c6ed3bc37c2cdc12c8d68d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.607191 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.607137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.607191 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.607155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.607261 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.607200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.607261 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.607216 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.607261 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.607217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bcd859681c6ed3bc37c2cdc12c8d68d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-160.ec2.internal\" (UID: \"4bcd859681c6ed3bc37c2cdc12c8d68d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.631341 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.631285 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:01.719549 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.719530 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.726746 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:01.726723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:01.731874 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.731857 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:01.832060 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.832035 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:01.932512 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:01.932465 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:02.033023 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:02.033001 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:02.132450 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.132432 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 22:07:02.132869 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.132546 2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 22:07:02.133515 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:02.133500 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:02.233908 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:02.233874 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:02.270586 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.270549 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 22:02:01 +0000 UTC" deadline="2028-07-12 13:17:06.126320286 +0000 UTC" Oct 30 22:07:02.270586 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.270581 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14895h10m3.85574318s" Oct 30 22:07:02.326715 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.326694 2578 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:02.334796 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:02.334770 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:02.339745 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:02.339718 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2916fe9077ee958236e3180083212c62.slice/crio-5841c4a514294a8b4697cc990a97da5c901867f702553a501bb6085bab17994e WatchSource:0}: Error finding container 5841c4a514294a8b4697cc990a97da5c901867f702553a501bb6085bab17994e: Status 404 returned error can't find the container with id 5841c4a514294a8b4697cc990a97da5c901867f702553a501bb6085bab17994e Oct 30 22:07:02.340255 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:02.340235 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bcd859681c6ed3bc37c2cdc12c8d68d.slice/crio-4ddeaf720c84acc8688e123c9eb023769d11dd04d1635634bcb5e56f6b3f1a53 WatchSource:0}: Error finding container 4ddeaf720c84acc8688e123c9eb023769d11dd04d1635634bcb5e56f6b3f1a53: Status 404 returned error can't find the container with id 4ddeaf720c84acc8688e123c9eb023769d11dd04d1635634bcb5e56f6b3f1a53 Oct 30 22:07:02.346813 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.346797 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:07:02.404059 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.404028 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:02.405109 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.405089 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:02.405188 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.405121 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:02.405188 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.405136 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:02.435167 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:02.435145 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:02.450074 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.450052 2578 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:02.535485 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:02.535435 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:02.636710 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:02.636686 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:02.737038 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:02.737007 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:02.758898 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.758878 2578 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:02.806640 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.806576 2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:02.827698 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.827674 2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:02.828814 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.828798 2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:02.852582 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.852558 2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:02.984895 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:02.984869 2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:03.181086 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.181030 2578 apiserver.go:52] "Watching apiserver" Oct 30 22:07:03.205720 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.205691 2578 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 22:07:03.206063 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.206042 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-fsplc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal","openshift-multus/multus-bfkbs","openshift-multus/network-metrics-daemon-299zc","kube-system/global-pull-secret-syncer-r2hqv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst","openshift-image-registry/node-ca-vvdnv","openshift-ovn-kubernetes/ovnkube-node-hqfbg","kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal","openshift-network-diagnostics/network-check-target-4pd2j","openshift-network-operator/iptables-alerter-nlsq4","openshift-cluster-node-tuning-operator/tuned-t2hsm","openshift-multus/multus-additional-cni-plugins-2k7jl","kube-system/konnectivity-agent-bz4rw"] Oct 30 22:07:03.206514 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.206494 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 22:07:03.208655 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.208619 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.211079 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.211058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.213477 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.213389 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.216069 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.216052 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:03.216139 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.216109 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:03.218202 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.218183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:03.218342 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.218248 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:03.220955 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.220935 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.222971 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.222169 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s9t4n\"" Oct 30 22:07:03.222971 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.222568 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 22:07:03.222971 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.222660 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 22:07:03.222971 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.222742 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 22:07:03.223764 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.223746 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:03.227369 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.227350 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.229992 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.229973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.231332 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.231312 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:03.231418 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.231395 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:03.234010 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.233987 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.236435 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.236418 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.249316 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.249296 2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 22:07:03.249406 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.249365 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z5dpm" Oct 30 22:07:03.262089 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.262071 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z5dpm" Oct 30 22:07:03.281945 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.281902 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" event={"ID":"4bcd859681c6ed3bc37c2cdc12c8d68d","Type":"ContainerStarted","Data":"4ddeaf720c84acc8688e123c9eb023769d11dd04d1635634bcb5e56f6b3f1a53"} Oct 30 22:07:03.283553 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.283533 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" event={"ID":"2916fe9077ee958236e3180083212c62","Type":"ContainerStarted","Data":"5841c4a514294a8b4697cc990a97da5c901867f702553a501bb6085bab17994e"} Oct 30 22:07:03.307657 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.307639 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 22:07:03.316946 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.316922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6t9q\" (UniqueName: \"kubernetes.io/projected/f4714c47-8079-4533-afaf-dfc3ff0f01f3-kube-api-access-z6t9q\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.317055 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.316959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-daemon-config\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.317055 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.316984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-kubernetes\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.317055 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-log-socket\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.317218 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.317218 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cni-binary-copy\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.317218 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-slash\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.317367 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.317367 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-node-log\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.317367 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-745bl\" (UniqueName: \"kubernetes.io/projected/f9ef3359-4ffd-4a26-889a-8f516ef1970a-kube-api-access-745bl\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.317367 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd58d\" (UniqueName: \"kubernetes.io/projected/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-kube-api-access-dd58d\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:03.317367 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cnibin\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.317690 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-etc-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.317690 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-netd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.317690 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.317690 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7nl4\" (UniqueName: \"kubernetes.io/projected/a5ad1eec-94bf-43a5-9541-9415db456d26-kube-api-access-c7nl4\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.317690 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9ef3359-4ffd-4a26-889a-8f516ef1970a-hosts-file\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.317690 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4d718cb-d755-4824-94f5-298a3411b7e5-host-slash\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.317690 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-multus\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.317690 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-var-lib-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.317690 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gnk2\" (UniqueName: \"kubernetes.io/projected/419fe0bc-c964-47f0-82fc-3c5d45969e63-kube-api-access-8gnk2\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.317690 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npr97\" (UniqueName: \"kubernetes.io/projected/f4d718cb-d755-4824-94f5-298a3411b7e5-kube-api-access-npr97\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317724 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-run\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr4t5\" (UniqueName: \"kubernetes.io/projected/3b707bb3-699a-42ba-a5a0-3a52077f1b13-kube-api-access-cr4t5\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-system-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-hostroot\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-ovn\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-script-lib\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ef3359-4ffd-4a26-889a-8f516ef1970a-tmp-dir\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317903 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-conf\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-tuned\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317945 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-kubelet\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.317958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-dbus\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-registration-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-systemd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8005cfc5-780e-4ea3-898e-6a54e0f93158-agent-certs\") pod \"konnectivity-agent-bz4rw\" (UID: \"8005cfc5-780e-4ea3-898e-6a54e0f93158\") " pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-tmp\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.318131 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-sys-fs\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-config\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5ad1eec-94bf-43a5-9541-9415db456d26-ovn-node-metrics-cert\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/419fe0bc-c964-47f0-82fc-3c5d45969e63-serviceca\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-modprobe-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-var-lib-kubelet\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-etc-selinux\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-systemd-units\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-host\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-system-cni-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-etc-kubernetes\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-sys\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-bin\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cnibin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-k8s-cni-cncf-io\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.318934 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-netns\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-bin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-kubelet-config\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-lib-modules\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brgrm\" (UniqueName: \"kubernetes.io/projected/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-kube-api-access-brgrm\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-socket-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-netns\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8005cfc5-780e-4ea3-898e-6a54e0f93158-konnectivity-ca\") pod \"konnectivity-agent-bz4rw\" (UID: \"8005cfc5-780e-4ea3-898e-6a54e0f93158\") " pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysconfig\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-multus-certs\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/419fe0bc-c964-47f0-82fc-3c5d45969e63-host\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-device-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgw9r\" (UniqueName: \"kubernetes.io/projected/a5048872-d721-4990-99e1-6ccb43420b31-kube-api-access-lgw9r\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.319736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.318988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-kubelet\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.320353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.319003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.320353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.319019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-systemd\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.320353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.319047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.320353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.319075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-socket-dir-parent\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.320353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.319100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-env-overrides\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.320353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.319125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4d718cb-d755-4824-94f5-298a3411b7e5-iptables-alerter-script\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.320353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.319149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-conf-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.320353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.319178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.320353 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.319322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:03.323182 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323158 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 22:07:03.323297 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323281 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 22:07:03.323501 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323485 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-22mqf\"" Oct 30 22:07:03.323758 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323731 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 22:07:03.323903 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323816 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vdq5j\"" Oct 30 22:07:03.323903 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323889 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dzfp9\"" Oct 30 22:07:03.323903 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323898 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 22:07:03.324175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323907 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 22:07:03.324175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323951 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 22:07:03.324175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323971 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pjfxj\"" Oct 30 22:07:03.324175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.323994 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 22:07:03.324175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324078 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 22:07:03.324175 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324103 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 22:07:03.324499 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324269 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-7l7rd\"" Oct 30 22:07:03.324499 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324352 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:03.324499 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324390 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 22:07:03.324499 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324429 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zgfdn\"" Oct 30 22:07:03.324499 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324435 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 22:07:03.324676 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324505 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 22:07:03.324676 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324538 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:03.324676 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324556 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 22:07:03.324676 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324574 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 22:07:03.324676 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324602 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gfzqs\"" Oct 30 22:07:03.324676 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324660 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:03.324676 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324676 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 22:07:03.324890 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324695 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:03.324890 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324105 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 22:07:03.324890 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324707 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 22:07:03.324890 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324721 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x4nws\"" Oct 30 22:07:03.324890 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324662 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 22:07:03.324890 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324757 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 22:07:03.324890 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.324775 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 22:07:03.420503 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.420478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.420689 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.420512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:03.420975 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.420950 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:03.421096 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.420999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6t9q\" (UniqueName: \"kubernetes.io/projected/f4714c47-8079-4533-afaf-dfc3ff0f01f3-kube-api-access-z6t9q\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.421096 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.421027 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret podName:960e184e-c2a7-4937-bf04-4c13a434883e nodeName:}" failed. No retries permitted until 2026-10-30 22:07:03.921000048 +0000 UTC m=+3.087791224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret") pod "global-pull-secret-syncer-r2hqv" (UID: "960e184e-c2a7-4937-bf04-4c13a434883e") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:03.421096 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-daemon-config\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.421096 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-kubernetes\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.421298 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-log-socket\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421298 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.421298 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cni-binary-copy\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.421298 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-slash\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421298 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421298 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-node-log\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421298 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-745bl\" (UniqueName: \"kubernetes.io/projected/f9ef3359-4ffd-4a26-889a-8f516ef1970a-kube-api-access-745bl\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.421298 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd58d\" (UniqueName: \"kubernetes.io/projected/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-kube-api-access-dd58d\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:03.421298 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421272 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-kubernetes\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.421298 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cnibin\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-etc-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-netd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421340 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-node-log\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7nl4\" (UniqueName: \"kubernetes.io/projected/a5ad1eec-94bf-43a5-9541-9415db456d26-kube-api-access-c7nl4\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9ef3359-4ffd-4a26-889a-8f516ef1970a-hosts-file\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4d718cb-d755-4824-94f5-298a3411b7e5-host-slash\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-multus\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-var-lib-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421465 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gnk2\" (UniqueName: \"kubernetes.io/projected/419fe0bc-c964-47f0-82fc-3c5d45969e63-kube-api-access-8gnk2\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-etc-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cnibin\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npr97\" (UniqueName: \"kubernetes.io/projected/f4d718cb-d755-4824-94f5-298a3411b7e5-kube-api-access-npr97\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421534 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-netd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.421709 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-run\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421582 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr4t5\" (UniqueName: \"kubernetes.io/projected/3b707bb3-699a-42ba-a5a0-3a52077f1b13-kube-api-access-cr4t5\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-slash\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-var-lib-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421599 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9ef3359-4ffd-4a26-889a-8f516ef1970a-hosts-file\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-log-socket\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-system-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421637 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4d718cb-d755-4824-94f5-298a3411b7e5-host-slash\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-hostroot\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421655 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-multus\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-ovn\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-script-lib\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ef3359-4ffd-4a26-889a-8f516ef1970a-tmp-dir\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-conf\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-tuned\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-kubelet\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-dbus\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:03.422476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-registration-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-systemd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421933 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-run\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8005cfc5-780e-4ea3-898e-6a54e0f93158-agent-certs\") pod \"konnectivity-agent-bz4rw\" (UID: \"8005cfc5-780e-4ea3-898e-6a54e0f93158\") " pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.421998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-tmp\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-sys-fs\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-config\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5ad1eec-94bf-43a5-9541-9415db456d26-ovn-node-metrics-cert\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422160 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-sys-fs\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422315 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/419fe0bc-c964-47f0-82fc-3c5d45969e63-serviceca\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-modprobe-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-var-lib-kubelet\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-etc-selinux\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-systemd-units\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.423171 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422513 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-host\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-system-cni-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-etc-kubernetes\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-sys\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-bin\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cnibin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-k8s-cni-cncf-io\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422708 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-netns\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-bin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-kubelet-config\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422762 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-host\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-lib-modules\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brgrm\" (UniqueName: \"kubernetes.io/projected/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-kube-api-access-brgrm\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-socket-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-netns\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.423871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422918 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8005cfc5-780e-4ea3-898e-6a54e0f93158-konnectivity-ca\") pod \"konnectivity-agent-bz4rw\" (UID: \"8005cfc5-780e-4ea3-898e-6a54e0f93158\") " pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.422989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysconfig\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-multus-certs\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/419fe0bc-c964-47f0-82fc-3c5d45969e63-host\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-device-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgw9r\" (UniqueName: \"kubernetes.io/projected/a5048872-d721-4990-99e1-6ccb43420b31-kube-api-access-lgw9r\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-kubelet\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-systemd\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-socket-dir-parent\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-system-cni-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-env-overrides\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4d718cb-d755-4824-94f5-298a3411b7e5-iptables-alerter-script\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-etc-kubernetes\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.424579 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-conf-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.423351 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-sys\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.425740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysconfig\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.425783 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-kubelet-config\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.425846 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-kubelet\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.425789 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.425894 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.425896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-lib-modules\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.425979 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-system-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.425987 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-socket-dir-parent\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.425784 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.425988 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ef3359-4ffd-4a26-889a-8f516ef1970a-tmp-dir\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.426053 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-hostroot\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.426067 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/419fe0bc-c964-47f0-82fc-3c5d45969e63-host\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.426125 2578 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.426235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-ovn\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.426346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-daemon-config\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.426421 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.426377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-env-overrides\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.427153 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.426745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cni-binary-copy\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.427153 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.426789 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.427153 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.427037 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-conf-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.427153 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.427020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-multus-certs\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.427153 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.427118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-device-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.427349 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.427173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-systemd\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.427349 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.427307 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-conf\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.427771 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.427548 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-registration-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.427771 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.427660 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-etc-selinux\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.427771 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.427722 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-dbus\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:03.427995 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.427975 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:03.428095 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-systemd-units\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.428095 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.428035 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:03.928019299 +0000 UTC m=+3.094810497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:03.428095 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-netns\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.428256 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428176 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-modprobe-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.428256 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428223 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-bin\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.428345 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cnibin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.428345 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-k8s-cni-cncf-io\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.428455 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428383 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-systemd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.428455 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428424 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-var-lib-kubelet\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.428558 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428474 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-bin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.428558 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428480 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4d718cb-d755-4824-94f5-298a3411b7e5-iptables-alerter-script\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.428807 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428787 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-script-lib\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.428969 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.428953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-config\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.429197 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.429180 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-netns\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.429990 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.429966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/419fe0bc-c964-47f0-82fc-3c5d45969e63-serviceca\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.430075 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.430048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-kubelet\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.430165 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.430148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8005cfc5-780e-4ea3-898e-6a54e0f93158-konnectivity-ca\") pod \"konnectivity-agent-bz4rw\" (UID: \"8005cfc5-780e-4ea3-898e-6a54e0f93158\") " pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:03.430312 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.430290 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.430370 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.430350 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-socket-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.430752 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.430732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.433306 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.433260 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-tuned\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.434219 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.434198 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8005cfc5-780e-4ea3-898e-6a54e0f93158-agent-certs\") pod \"konnectivity-agent-bz4rw\" (UID: \"8005cfc5-780e-4ea3-898e-6a54e0f93158\") " pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:03.435078 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.435055 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-tmp\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.435183 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.435141 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5ad1eec-94bf-43a5-9541-9415db456d26-ovn-node-metrics-cert\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.445330 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.445308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd58d\" (UniqueName: \"kubernetes.io/projected/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-kube-api-access-dd58d\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:03.445618 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.445579 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6t9q\" (UniqueName: \"kubernetes.io/projected/f4714c47-8079-4533-afaf-dfc3ff0f01f3-kube-api-access-z6t9q\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.446425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.446401 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-745bl\" (UniqueName: \"kubernetes.io/projected/f9ef3359-4ffd-4a26-889a-8f516ef1970a-kube-api-access-745bl\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.446994 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.446954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gnk2\" (UniqueName: \"kubernetes.io/projected/419fe0bc-c964-47f0-82fc-3c5d45969e63-kube-api-access-8gnk2\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.447377 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.447109 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:03.447377 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.447133 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:03.447377 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.447146 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xvh29 for pod openshift-network-diagnostics/network-check-target-4pd2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:03.447377 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.447142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7nl4\" (UniqueName: \"kubernetes.io/projected/a5ad1eec-94bf-43a5-9541-9415db456d26-kube-api-access-c7nl4\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.447377 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.447226 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29 podName:8b9da187-50be-45aa-9ddd-e49ce94ea488 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:03.947208214 +0000 UTC m=+3.113999419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xvh29" (UniqueName: "kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29") pod "network-check-target-4pd2j" (UID: "8b9da187-50be-45aa-9ddd-e49ce94ea488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:03.449524 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.449359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brgrm\" (UniqueName: \"kubernetes.io/projected/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-kube-api-access-brgrm\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.449524 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.449485 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npr97\" (UniqueName: \"kubernetes.io/projected/f4d718cb-d755-4824-94f5-298a3411b7e5-kube-api-access-npr97\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.449968 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.449947 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr4t5\" (UniqueName: \"kubernetes.io/projected/3b707bb3-699a-42ba-a5a0-3a52077f1b13-kube-api-access-cr4t5\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.453663 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.453643 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgw9r\" (UniqueName: \"kubernetes.io/projected/a5048872-d721-4990-99e1-6ccb43420b31-kube-api-access-lgw9r\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.524877 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.524687 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:03.534161 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:03.534135 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419fe0bc_c964_47f0_82fc_3c5d45969e63.slice/crio-b0c260bec442176552228a90eef0da2724585a23835859630310e22ba3b7593a WatchSource:0}: Error finding container b0c260bec442176552228a90eef0da2724585a23835859630310e22ba3b7593a: Status 404 returned error can't find the container with id b0c260bec442176552228a90eef0da2724585a23835859630310e22ba3b7593a Oct 30 22:07:03.549345 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.549322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bfkbs" Oct 30 22:07:03.553273 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.553253 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:03.557927 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.557900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:03.558458 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:03.558435 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f6b5a3_7817_41b8_800b_3cfeb03c5528.slice/crio-83a1c624ac47413a56b8a03bb993c3eeeabe6e27b6dd4d4c39450ea36a1cff3d WatchSource:0}: Error finding container 83a1c624ac47413a56b8a03bb993c3eeeabe6e27b6dd4d4c39450ea36a1cff3d: Status 404 returned error can't find the container with id 83a1c624ac47413a56b8a03bb993c3eeeabe6e27b6dd4d4c39450ea36a1cff3d Oct 30 22:07:03.560016 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.559999 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:03.564832 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:03.564811 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4714c47_8079_4533_afaf_dfc3ff0f01f3.slice/crio-c7ba3898c132e56dc57faaeb7f835732010a7ad25c7356498be8211c24ceae74 WatchSource:0}: Error finding container c7ba3898c132e56dc57faaeb7f835732010a7ad25c7356498be8211c24ceae74: Status 404 returned error can't find the container with id c7ba3898c132e56dc57faaeb7f835732010a7ad25c7356498be8211c24ceae74 Oct 30 22:07:03.569079 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.569057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:03.569521 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:03.569488 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5048872_d721_4990_99e1_6ccb43420b31.slice/crio-d6e8d1b70ccee7d87d19342eb24ea3bc0d3b1e4dd86eddfc9e302a9d2225c3d4 WatchSource:0}: Error finding container d6e8d1b70ccee7d87d19342eb24ea3bc0d3b1e4dd86eddfc9e302a9d2225c3d4: Status 404 returned error can't find the container with id d6e8d1b70ccee7d87d19342eb24ea3bc0d3b1e4dd86eddfc9e302a9d2225c3d4 Oct 30 22:07:03.570199 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:03.570175 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8005cfc5_780e_4ea3_898e_6a54e0f93158.slice/crio-2d99ef171932a836a703be94365c8b8894f95f10d4370051b43ffacea61c86b7 WatchSource:0}: Error finding container 2d99ef171932a836a703be94365c8b8894f95f10d4370051b43ffacea61c86b7: Status 404 returned error can't find the container with id 2d99ef171932a836a703be94365c8b8894f95f10d4370051b43ffacea61c86b7 Oct 30 22:07:03.579374 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:03.579354 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ef3359_4ffd_4a26_889a_8f516ef1970a.slice/crio-87875604efd44a926d80d586e7dbe308973ec745e297d4a52ff2fc6e0fd1b828 WatchSource:0}: Error finding container 87875604efd44a926d80d586e7dbe308973ec745e297d4a52ff2fc6e0fd1b828: Status 404 returned error can't find the container with id 87875604efd44a926d80d586e7dbe308973ec745e297d4a52ff2fc6e0fd1b828 Oct 30 22:07:03.591629 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.591594 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:03.594785 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.594764 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:03.597251 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.597230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:03.602909 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:03.602886 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d718cb_d755_4824_94f5_298a3411b7e5.slice/crio-0344587dba39c44964d44d9d952dcc37399de061971d438b73db9f8e43677378 WatchSource:0}: Error finding container 0344587dba39c44964d44d9d952dcc37399de061971d438b73db9f8e43677378: Status 404 returned error can't find the container with id 0344587dba39c44964d44d9d952dcc37399de061971d438b73db9f8e43677378 Oct 30 22:07:03.607053 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:03.607029 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b707bb3_699a_42ba_a5a0_3a52077f1b13.slice/crio-01a9097468550f1861f22703225a017499c9441ddd9919f50096a4abc5cd287e WatchSource:0}: Error finding container 01a9097468550f1861f22703225a017499c9441ddd9919f50096a4abc5cd287e: Status 404 returned error can't find the container with id 01a9097468550f1861f22703225a017499c9441ddd9919f50096a4abc5cd287e Oct 30 22:07:03.610099 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:03.610068 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ad1eec_94bf_43a5_9541_9415db456d26.slice/crio-bcf0827d259da3f93d4b4f1aef3ef2207c2fcc4a971deedb6e2a8a8f85266432 WatchSource:0}: Error finding container bcf0827d259da3f93d4b4f1aef3ef2207c2fcc4a971deedb6e2a8a8f85266432: Status 404 returned error can't find the container with id bcf0827d259da3f93d4b4f1aef3ef2207c2fcc4a971deedb6e2a8a8f85266432 Oct 30 22:07:03.927728 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:03.927698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:03.927868 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.927802 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:03.927868 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:03.927852 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret podName:960e184e-c2a7-4937-bf04-4c13a434883e nodeName:}" failed. No retries permitted until 2026-10-30 22:07:04.927839207 +0000 UTC m=+4.094630383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret") pod "global-pull-secret-syncer-r2hqv" (UID: "960e184e-c2a7-4937-bf04-4c13a434883e") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:04.028704 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.028668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:04.028848 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.028723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:04.028848 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:04.028819 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:04.028956 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:04.028853 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:04.028956 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:04.028875 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:04.028956 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:04.028885 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:05.028867794 +0000 UTC m=+4.195658997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:04.028956 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:04.028888 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xvh29 for pod openshift-network-diagnostics/network-check-target-4pd2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:04.028956 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:04.028936 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29 podName:8b9da187-50be-45aa-9ddd-e49ce94ea488 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:05.028923727 +0000 UTC m=+4.195714921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvh29" (UniqueName: "kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29") pod "network-check-target-4pd2j" (UID: "8b9da187-50be-45aa-9ddd-e49ce94ea488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:04.265253 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.265008 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 22:02:03 +0000 UTC" deadline="2028-06-07 16:07:57.436799944 +0000 UTC" Oct 30 22:07:04.265253 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.265252 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14058h0m53.17155304s" Oct 30 22:07:04.288598 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.287793 2578 generic.go:356] "Generic (PLEG): container finished" podID="2916fe9077ee958236e3180083212c62" containerID="c7bba77e82ee9a66f595046dac152921e07b30c9aba3946ab7456ce860598237" exitCode=0 Oct 30 22:07:04.288598 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.288334 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" event={"ID":"2916fe9077ee958236e3180083212c62","Type":"ContainerDied","Data":"c7bba77e82ee9a66f595046dac152921e07b30c9aba3946ab7456ce860598237"} Oct 30 22:07:04.290302 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.290211 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nlsq4" event={"ID":"f4d718cb-d755-4824-94f5-298a3411b7e5","Type":"ContainerStarted","Data":"0344587dba39c44964d44d9d952dcc37399de061971d438b73db9f8e43677378"} Oct 30 22:07:04.292198 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.292142 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fsplc" event={"ID":"f9ef3359-4ffd-4a26-889a-8f516ef1970a","Type":"ContainerStarted","Data":"87875604efd44a926d80d586e7dbe308973ec745e297d4a52ff2fc6e0fd1b828"} Oct 30 22:07:04.293974 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.293917 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" event={"ID":"f4714c47-8079-4533-afaf-dfc3ff0f01f3","Type":"ContainerStarted","Data":"c7ba3898c132e56dc57faaeb7f835732010a7ad25c7356498be8211c24ceae74"} Oct 30 22:07:04.298659 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.298577 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bfkbs" event={"ID":"d0f6b5a3-7817-41b8-800b-3cfeb03c5528","Type":"ContainerStarted","Data":"83a1c624ac47413a56b8a03bb993c3eeeabe6e27b6dd4d4c39450ea36a1cff3d"} Oct 30 22:07:04.312820 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.312738 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" event={"ID":"a5ad1eec-94bf-43a5-9541-9415db456d26","Type":"ContainerStarted","Data":"bcf0827d259da3f93d4b4f1aef3ef2207c2fcc4a971deedb6e2a8a8f85266432"} Oct 30 22:07:04.327358 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.326792 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" event={"ID":"3b707bb3-699a-42ba-a5a0-3a52077f1b13","Type":"ContainerStarted","Data":"01a9097468550f1861f22703225a017499c9441ddd9919f50096a4abc5cd287e"} Oct 30 22:07:04.334217 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.334192 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bz4rw" event={"ID":"8005cfc5-780e-4ea3-898e-6a54e0f93158","Type":"ContainerStarted","Data":"2d99ef171932a836a703be94365c8b8894f95f10d4370051b43ffacea61c86b7"} Oct 30 22:07:04.340723 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.340690 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" event={"ID":"a5048872-d721-4990-99e1-6ccb43420b31","Type":"ContainerStarted","Data":"d6e8d1b70ccee7d87d19342eb24ea3bc0d3b1e4dd86eddfc9e302a9d2225c3d4"} Oct 30 22:07:04.342722 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.342698 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vvdnv" event={"ID":"419fe0bc-c964-47f0-82fc-3c5d45969e63","Type":"ContainerStarted","Data":"b0c260bec442176552228a90eef0da2724585a23835859630310e22ba3b7593a"} Oct 30 22:07:04.940506 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:04.940466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:04.940760 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:04.940642 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:04.940760 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:04.940700 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret podName:960e184e-c2a7-4937-bf04-4c13a434883e nodeName:}" failed. No retries permitted until 2026-10-30 22:07:06.940682182 +0000 UTC m=+6.107473373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret") pod "global-pull-secret-syncer-r2hqv" (UID: "960e184e-c2a7-4937-bf04-4c13a434883e") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:05.041392 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.041348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:05.041670 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.041404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:05.041670 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:05.041515 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:05.041670 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:05.041568 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:07.041551387 +0000 UTC m=+6.208342564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:05.042005 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:05.041979 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:05.042066 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:05.042012 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:05.042066 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:05.042025 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xvh29 for pod openshift-network-diagnostics/network-check-target-4pd2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:05.042166 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:05.042070 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29 podName:8b9da187-50be-45aa-9ddd-e49ce94ea488 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:07.042055447 +0000 UTC m=+6.208846629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvh29" (UniqueName: "kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29") pod "network-check-target-4pd2j" (UID: "8b9da187-50be-45aa-9ddd-e49ce94ea488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:05.266435 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.266338 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 22:02:03 +0000 UTC" deadline="2028-07-09 19:00:40.289242482 +0000 UTC" Oct 30 22:07:05.266435 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.266374 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14828h53m35.022873121s" Oct 30 22:07:05.280652 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.279875 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:05.280652 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:05.280006 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:05.280652 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.280377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:05.280652 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:05.280463 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:05.280652 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.280522 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:05.280652 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:05.280594 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:05.359586 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.358971 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" event={"ID":"4bcd859681c6ed3bc37c2cdc12c8d68d","Type":"ContainerStarted","Data":"19c42e10ec1e04c0514d10ef989648604fd39a8fb20586f1915427e835ce91ac"} Oct 30 22:07:05.368073 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.368043 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" event={"ID":"2916fe9077ee958236e3180083212c62","Type":"ContainerStarted","Data":"80ae055d8a648646e523f6744c4e652dc166a8eee0716212b1cb606cc1c9497e"} Oct 30 22:07:05.393266 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.393204 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" podStartSLOduration=3.393188548 podStartE2EDuration="3.393188548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:05.392906345 +0000 UTC m=+4.559697545" watchObservedRunningTime="2026-10-30 22:07:05.393188548 +0000 UTC m=+4.559979747" Oct 30 22:07:05.431796 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:05.431747 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" podStartSLOduration=3.431731194 podStartE2EDuration="3.431731194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:05.43158564 +0000 UTC m=+4.598376838" watchObservedRunningTime="2026-10-30 22:07:05.431731194 +0000 UTC m=+4.598522393" Oct 30 22:07:06.957888 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:06.957802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:06.958312 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:06.958008 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:06.958312 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:06.958067 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret podName:960e184e-c2a7-4937-bf04-4c13a434883e nodeName:}" failed. No retries permitted until 2026-10-30 22:07:10.958049864 +0000 UTC m=+10.124841042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret") pod "global-pull-secret-syncer-r2hqv" (UID: "960e184e-c2a7-4937-bf04-4c13a434883e") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:07.058656 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:07.058597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:07.058830 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:07.058665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:07.058830 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:07.058806 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:07.058929 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:07.058861 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:11.058845377 +0000 UTC m=+10.225636555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:07.059264 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:07.059240 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:07.059349 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:07.059273 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:07.059349 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:07.059286 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xvh29 for pod openshift-network-diagnostics/network-check-target-4pd2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:07.059349 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:07.059331 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29 podName:8b9da187-50be-45aa-9ddd-e49ce94ea488 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:11.05931455 +0000 UTC m=+10.226105733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvh29" (UniqueName: "kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29") pod "network-check-target-4pd2j" (UID: "8b9da187-50be-45aa-9ddd-e49ce94ea488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:07.285770 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:07.285717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:07.285770 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:07.285746 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:07.286007 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:07.285717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:07.286007 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:07.285915 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:07.286110 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:07.286032 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:07.286229 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:07.286209 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:07.379484 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:07.379452 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="0c7fb26c863f79994cc352e410f13194cf94d423ed887171c1a1f9144d3ec6da" exitCode=0 Oct 30 22:07:07.379666 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:07.379494 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" event={"ID":"f4714c47-8079-4533-afaf-dfc3ff0f01f3","Type":"ContainerDied","Data":"0c7fb26c863f79994cc352e410f13194cf94d423ed887171c1a1f9144d3ec6da"} Oct 30 22:07:08.385563 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:08.385503 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bz4rw" event={"ID":"8005cfc5-780e-4ea3-898e-6a54e0f93158","Type":"ContainerStarted","Data":"c37947676d6d358af43fed0273ac9a3c4a10837e39ed6dd81ca1fad1c2ec3265"} Oct 30 22:07:09.278552 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:09.278520 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:09.278735 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:09.278667 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:09.278735 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:09.278725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:09.278862 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:09.278795 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:09.278862 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:09.278835 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:09.278955 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:09.278894 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:09.390562 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:09.390482 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" event={"ID":"a5048872-d721-4990-99e1-6ccb43420b31","Type":"ContainerStarted","Data":"d84b77a4244c1a5493842c00801236b709bcd03f8d3578bf1b2c58bd471e1321"} Oct 30 22:07:09.394080 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:09.394053 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vvdnv" event={"ID":"419fe0bc-c964-47f0-82fc-3c5d45969e63","Type":"ContainerStarted","Data":"c102a982bb5fe439db38c3526f8763ab091ff8a493eed44b27b2ef6c94580763"} Oct 30 22:07:09.428815 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:09.428480 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bz4rw" podStartSLOduration=4.552824912 podStartE2EDuration="8.428461931s" totalImagesPullingTime="3.875637019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:08.421639217 +0000 UTC m=+7.588430416" watchObservedRunningTime="2026-10-30 22:07:09.428461931 +0000 UTC m=+8.595253133" Oct 30 22:07:10.769153 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:10.768953 2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:10.770101 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:10.770080 2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:10.805233 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:10.805147 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vvdnv" podStartSLOduration=4.9538399250000005 podStartE2EDuration="9.805129753s" totalImagesPullingTime="4.851289828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:09.428803067 +0000 UTC m=+8.595594269" watchObservedRunningTime="2026-10-30 22:07:10.805129753 +0000 UTC m=+9.971920954" Oct 30 22:07:10.981462 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:10.981432 2578 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 22:07:10.991908 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:10.991876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:10.992031 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:10.992016 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:10.992094 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:10.992074 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret podName:960e184e-c2a7-4937-bf04-4c13a434883e nodeName:}" failed. No retries permitted until 2026-10-30 22:07:18.992056144 +0000 UTC m=+18.158847325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret") pod "global-pull-secret-syncer-r2hqv" (UID: "960e184e-c2a7-4937-bf04-4c13a434883e") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:11.093024 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:11.092997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:11.093133 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:11.093044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:11.093225 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:11.093176 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:11.093280 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:11.093228 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:19.093211442 +0000 UTC m=+18.260002633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:11.093569 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:11.093553 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:11.093671 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:11.093575 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:11.093671 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:11.093587 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xvh29 for pod openshift-network-diagnostics/network-check-target-4pd2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:11.093671 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:11.093646 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29 podName:8b9da187-50be-45aa-9ddd-e49ce94ea488 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:19.093630786 +0000 UTC m=+18.260421966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvh29" (UniqueName: "kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29") pod "network-check-target-4pd2j" (UID: "8b9da187-50be-45aa-9ddd-e49ce94ea488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:11.268289 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:11.268201 2578 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T22:07:10.98145535Z","UUID":"79a0b989-db0d-463b-86c4-205dd17d635e","Handler":null,"Name":"","Endpoint":""} Oct 30 22:07:11.274079 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:11.273905 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 22:07:11.274079 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:11.273946 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 22:07:11.278795 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:11.278767 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:11.278870 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:11.278802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:11.278912 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:11.278884 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:11.279012 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:11.278985 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:11.279067 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:11.279051 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:11.279139 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:11.279119 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:11.400566 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:11.400541 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" event={"ID":"a5048872-d721-4990-99e1-6ccb43420b31","Type":"ContainerStarted","Data":"35a121bfabfbc80da7db8a3ac4364928fa042e841b618050141d4d3e1f2d6d71"} Oct 30 22:07:12.404901 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:12.404662 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="2914077aa84e08c365fcbd799075783bc0fb3efd654868c0343728d1325ac7fc" exitCode=0 Oct 30 22:07:12.405370 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:12.404746 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" event={"ID":"f4714c47-8079-4533-afaf-dfc3ff0f01f3","Type":"ContainerDied","Data":"2914077aa84e08c365fcbd799075783bc0fb3efd654868c0343728d1325ac7fc"} Oct 30 22:07:12.407907 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:12.407880 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bfkbs" event={"ID":"d0f6b5a3-7817-41b8-800b-3cfeb03c5528","Type":"ContainerStarted","Data":"c51e4e5e4ed4b3074b15f6cf30dd98b3d7b58b0f3b89b02448e4b85993f9e48f"} Oct 30 22:07:12.410163 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:12.410133 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" event={"ID":"a5048872-d721-4990-99e1-6ccb43420b31","Type":"ContainerStarted","Data":"9644c31aaf3b3321c17f37aac24d0dac953c0f20bce4d330e9e3a4d3c64c38c1"} Oct 30 22:07:12.412129 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:12.412107 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fsplc" event={"ID":"f9ef3359-4ffd-4a26-889a-8f516ef1970a","Type":"ContainerStarted","Data":"9e348038b00ee1f8c30150bb4adf3595e48f8368905642144b6563ba56aadaeb"} Oct 30 22:07:12.502727 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:12.502674 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-bfkbs" podStartSLOduration=3.72254102 podStartE2EDuration="11.502658338s" totalImagesPullingTime="7.780117318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:12.501823615 +0000 UTC m=+11.668614814" watchObservedRunningTime="2026-10-30 22:07:12.502658338 +0000 UTC m=+11.669449537" Oct 30 22:07:12.539376 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:12.539327 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" podStartSLOduration=3.474705552 podStartE2EDuration="11.539310979s" totalImagesPullingTime="8.064605427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:12.538914813 +0000 UTC m=+11.705706010" watchObservedRunningTime="2026-10-30 22:07:12.539310979 +0000 UTC m=+11.706102177" Oct 30 22:07:12.574066 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:12.574019 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-fsplc" podStartSLOduration=3.904779209 podStartE2EDuration="11.57400099s" totalImagesPullingTime="7.669221781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:12.573727712 +0000 UTC m=+11.740518936" watchObservedRunningTime="2026-10-30 22:07:12.57400099 +0000 UTC m=+11.740792190" Oct 30 22:07:13.276586 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:13.276502 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:13.276715 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:13.276636 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:13.277014 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:13.276992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:13.277125 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:13.277104 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:13.277193 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:13.277175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:13.277282 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:13.277250 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:13.415727 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:13.415700 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nlsq4" event={"ID":"f4d718cb-d755-4824-94f5-298a3411b7e5","Type":"ContainerStarted","Data":"e2b0a02e1c33461f1c3d30bd85b1e345da02c0e9b16fb6371f19e0ae80f49ca1"} Oct 30 22:07:13.418900 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:13.418877 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="3cf973bc4125175eae444e38e9c8ab8639a405a960d291c205cb49f5c772e495" exitCode=0 Oct 30 22:07:13.418990 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:13.418951 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" event={"ID":"f4714c47-8079-4533-afaf-dfc3ff0f01f3","Type":"ContainerDied","Data":"3cf973bc4125175eae444e38e9c8ab8639a405a960d291c205cb49f5c772e495"} Oct 30 22:07:13.491969 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:13.491928 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nlsq4" podStartSLOduration=5.0229684 podStartE2EDuration="12.491915132s" totalImagesPullingTime="7.468946732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:13.450093841 +0000 UTC m=+12.616885039" watchObservedRunningTime="2026-10-30 22:07:13.491915132 +0000 UTC m=+12.658706330" Oct 30 22:07:14.423822 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:14.423793 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="5b1482351fedfe46d231949f3a881609c0dd7004e130ddf40554b75aa01a5f10" exitCode=0 Oct 30 22:07:14.424345 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:14.423875 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" event={"ID":"f4714c47-8079-4533-afaf-dfc3ff0f01f3","Type":"ContainerDied","Data":"5b1482351fedfe46d231949f3a881609c0dd7004e130ddf40554b75aa01a5f10"} Oct 30 22:07:14.425509 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:14.425485 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" event={"ID":"3b707bb3-699a-42ba-a5a0-3a52077f1b13","Type":"ContainerStarted","Data":"e12d758ea2826730dcfbc7cb6dca5372630da7d36f6cca5a0602ed4bdad4c1f6"} Oct 30 22:07:14.520336 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:14.520281 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" podStartSLOduration=3.717803086 podStartE2EDuration="13.520269122s" totalImagesPullingTime="9.802466036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:14.520014972 +0000 UTC m=+13.686806171" watchObservedRunningTime="2026-10-30 22:07:14.520269122 +0000 UTC m=+13.687060319" Oct 30 22:07:15.276760 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:15.276727 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:15.276925 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:15.276763 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:15.276925 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:15.276849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:15.277052 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:15.276974 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:15.277667 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:15.277632 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:15.277776 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:15.277725 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:16.432581 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:16.432314 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="69f277724ea8b68343129ff72171110877e447523a5f877b5ad0dce3f6f3fdd3" exitCode=0 Oct 30 22:07:16.432581 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:16.432395 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" event={"ID":"f4714c47-8079-4533-afaf-dfc3ff0f01f3","Type":"ContainerDied","Data":"69f277724ea8b68343129ff72171110877e447523a5f877b5ad0dce3f6f3fdd3"} Oct 30 22:07:17.276389 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:17.276359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:17.276389 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:17.276382 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:17.276564 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:17.276454 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:17.276564 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:17.276493 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:17.276663 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:17.276588 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:17.276695 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:17.276675 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:17.443652 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:17.443624 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="63c842a0990afb6a32cde704223af698b65474f4f94e609da5c85d0530c642fb" exitCode=0 Oct 30 22:07:17.443988 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:17.443659 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" event={"ID":"f4714c47-8079-4533-afaf-dfc3ff0f01f3","Type":"ContainerDied","Data":"63c842a0990afb6a32cde704223af698b65474f4f94e609da5c85d0530c642fb"} Oct 30 22:07:18.449859 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:18.449833 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" event={"ID":"f4714c47-8079-4533-afaf-dfc3ff0f01f3","Type":"ContainerStarted","Data":"a6f552d451106ab95b36c499f755523113742550d11fac2e15721f2fdf85086c"} Oct 30 22:07:18.453347 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:18.453321 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" event={"ID":"a5ad1eec-94bf-43a5-9541-9415db456d26","Type":"ContainerStarted","Data":"0e28ebdce5b44bf3774163412b45babea29fa60ea24a742b27d4da68323e4d58"} Oct 30 22:07:18.453433 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:18.453374 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" event={"ID":"a5ad1eec-94bf-43a5-9541-9415db456d26","Type":"ContainerStarted","Data":"5be1d19449d0ede85ded1d654ea837d6c75e98c1d8303a42bae4f9b990e87b9d"} Oct 30 22:07:18.453433 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:18.453403 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" event={"ID":"a5ad1eec-94bf-43a5-9541-9415db456d26","Type":"ContainerStarted","Data":"c69947e350ff22f78c6ad728867942788bccfa815d9e561b6e1d13fef0e5a72c"} Oct 30 22:07:18.453433 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:18.453430 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" event={"ID":"a5ad1eec-94bf-43a5-9541-9415db456d26","Type":"ContainerStarted","Data":"659cf74af825d11d16f36cbd7fa94b6ea6807d7ca36567238b32febdeafa8642"} Oct 30 22:07:18.453536 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:18.453455 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" event={"ID":"a5ad1eec-94bf-43a5-9541-9415db456d26","Type":"ContainerStarted","Data":"62a0e62310a18178f265e8d1e8c4767825cbcd742c125851ed9f6ea6e0d2a4f3"} Oct 30 22:07:18.453536 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:18.453481 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" event={"ID":"a5ad1eec-94bf-43a5-9541-9415db456d26","Type":"ContainerStarted","Data":"3152929c729a36ed4edfe2089893f46c4d7b54be9d723caa85d258242b2217ca"} Oct 30 22:07:18.493431 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:18.493386 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2k7jl" podStartSLOduration=7.361228788 podStartE2EDuration="17.493375918s" totalImagesPullingTime="10.13214713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:18.492994724 +0000 UTC m=+17.659785922" watchObservedRunningTime="2026-10-30 22:07:18.493375918 +0000 UTC m=+17.660167116" Oct 30 22:07:19.051999 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:19.051968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:19.052169 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.052072 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:19.052169 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.052121 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret podName:960e184e-c2a7-4937-bf04-4c13a434883e nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.052107477 +0000 UTC m=+34.218898653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret") pod "global-pull-secret-syncer-r2hqv" (UID: "960e184e-c2a7-4937-bf04-4c13a434883e") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:19.152454 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:19.152426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:19.152666 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:19.152464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:19.152666 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.152568 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:19.152666 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.152581 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:19.152666 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.152598 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:19.152666 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.152628 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xvh29 for pod openshift-network-diagnostics/network-check-target-4pd2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:19.152666 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.152644 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.152624964 +0000 UTC m=+34.319416143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:19.152666 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.152665 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29 podName:8b9da187-50be-45aa-9ddd-e49ce94ea488 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.15265425 +0000 UTC m=+34.319445430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvh29" (UniqueName: "kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29") pod "network-check-target-4pd2j" (UID: "8b9da187-50be-45aa-9ddd-e49ce94ea488") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:19.276619 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:19.276587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:19.276766 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:19.276656 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:19.276766 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:19.276656 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:19.276766 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.276732 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:19.276917 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.276816 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:19.276917 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:19.276894 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:21.277202 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:21.277165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:21.277783 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:21.277305 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:21.277783 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:21.277357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:21.277783 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:21.277485 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:21.277783 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:21.277519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:21.277783 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:21.277590 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:21.462214 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:21.462184 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" event={"ID":"a5ad1eec-94bf-43a5-9541-9415db456d26","Type":"ContainerStarted","Data":"c91887d1e1f33bb6a823db8090790406ead8df2a8896476b28f325fd8f2e36bd"} Oct 30 22:07:23.276860 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:23.276827 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:23.276860 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:23.276853 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:23.277703 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:23.276924 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:23.277703 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:23.276979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:23.277703 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:23.277085 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:23.277703 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:23.277171 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:23.470054 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:23.470028 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" event={"ID":"a5ad1eec-94bf-43a5-9541-9415db456d26","Type":"ContainerStarted","Data":"2935a6da4f353ef195336210480163fceded28065544276f8aaa62d319e73aee"} Oct 30 22:07:23.470324 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:23.470306 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:23.485665 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:23.485642 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:23.546478 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:23.546409 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" podStartSLOduration=7.997617012 podStartE2EDuration="22.546399373s" totalImagesPullingTime="14.548782361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:23.546081173 +0000 UTC m=+22.712872370" watchObservedRunningTime="2026-10-30 22:07:23.546399373 +0000 UTC m=+22.713190571" Oct 30 22:07:24.334675 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.334645 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:24.335065 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.334780 2578 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 22:07:24.335270 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.335248 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:24.473089 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.473054 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:24.473236 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.473127 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:24.487245 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.487222 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:24.641207 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.641111 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r2hqv"] Oct 30 22:07:24.641320 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.641241 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:24.641381 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:24.641359 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:24.642130 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.642108 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4pd2j"] Oct 30 22:07:24.642243 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.642194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:24.642333 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:24.642296 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:24.643109 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.643086 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-299zc"] Oct 30 22:07:24.643194 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:24.643176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:24.643269 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:24.643252 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:26.276581 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:26.276556 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:26.277015 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:26.276656 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:26.277015 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:26.276696 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:26.277015 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:26.276746 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:26.277015 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:26.276767 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:26.277015 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:26.276816 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:28.276375 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:28.276346 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:28.276375 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:28.276351 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:28.276901 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:28.276506 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:28.276901 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:28.276546 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:28.276901 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:28.276625 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:28.276901 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:28.276682 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:30.276881 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:30.276838 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:30.277343 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:30.276949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:30.277343 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:30.276955 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:30.277343 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:30.276951 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2hqv" podUID="960e184e-c2a7-4937-bf04-4c13a434883e" Oct 30 22:07:30.277343 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:30.277166 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-299zc" podUID="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" Oct 30 22:07:30.277343 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:30.277074 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4pd2j" podUID="8b9da187-50be-45aa-9ddd-e49ce94ea488" Oct 30 22:07:31.093189 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.093162 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeReady" Oct 30 22:07:31.093354 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.093273 2578 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 22:07:31.147736 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.147708 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-92wb6"] Oct 30 22:07:31.214911 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.214882 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm"] Oct 30 22:07:31.215114 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.215088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-92wb6" Oct 30 22:07:31.231075 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.231046 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-8xtlm"] Oct 30 22:07:31.231187 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.231159 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm" Oct 30 22:07:31.231253 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.231204 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.231313 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.231265 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.243726 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.243707 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.243832 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.243799 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.244168 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.244149 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6v65q\"" Oct 30 22:07:31.249986 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.249972 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-t8fj7"] Oct 30 22:07:31.250079 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.250066 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-8xtlm" Oct 30 22:07:31.263994 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.263979 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph"] Oct 30 22:07:31.264081 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.264064 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-t8fj7" Oct 30 22:07:31.278280 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.278261 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g"] Oct 30 22:07:31.278600 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.278360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:31.295890 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.295870 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.298738 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.298722 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j"] Oct 30 22:07:31.310339 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.310320 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-hdt8n"] Oct 30 22:07:31.310484 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.310469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:31.324544 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.324524 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-8ddx2"] Oct 30 22:07:31.324663 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.324641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.331248 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.331226 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 30 22:07:31.331248 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.331243 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.331248 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.331248 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.331418 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.331301 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.331418 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.331334 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.331418 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.331408 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.331533 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.331437 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.331533 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.331456 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 30 22:07:31.331869 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.331856 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 30 22:07:31.336752 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.336738 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 22:07:31.337038 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.337024 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.337158 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.337145 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.342198 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.342182 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 22:07:31.346793 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.346753 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-mmh7p"] Oct 30 22:07:31.346863 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.346804 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 30 22:07:31.346863 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.346837 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 30 22:07:31.346960 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.346859 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 30 22:07:31.346960 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.346874 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 30 22:07:31.346960 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.346891 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f5bxv\"" Oct 30 22:07:31.346960 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.346938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.347094 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.346972 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zkqvk\"" Oct 30 22:07:31.347319 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.347298 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9s65x\"" Oct 30 22:07:31.347458 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.347445 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-89fxd\"" Oct 30 22:07:31.347642 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.347624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-659vs\" (UniqueName: \"kubernetes.io/projected/4c8ed0be-6573-4bf7-aa93-572c5c0e4bce-kube-api-access-659vs\") pod \"kas-connection-checker-685895c7c9-8xtlm\" (UID: \"4c8ed0be-6573-4bf7-aa93-572c5c0e4bce\") " pod="kube-system/kas-connection-checker-685895c7c9-8xtlm" Oct 30 22:07:31.347712 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.347697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v28td\" (UniqueName: \"kubernetes.io/projected/43cebd0d-8293-4c7c-9469-4b211733bb79-kube-api-access-v28td\") pod \"kas-connection-checker-685895c7c9-92wb6\" (UID: \"43cebd0d-8293-4c7c-9469-4b211733bb79\") " pod="kube-system/kas-connection-checker-685895c7c9-92wb6" Oct 30 22:07:31.347759 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.347723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9d369819-d29c-48a6-b03b-41f2145bac41-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:31.347799 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.347758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qc7s\" (UniqueName: \"kubernetes.io/projected/a918696f-7dcd-4942-bbe2-1f59aaf991fe-kube-api-access-4qc7s\") pod \"kas-connection-checker-685895c7c9-t8fj7\" (UID: \"a918696f-7dcd-4942-bbe2-1f59aaf991fe\") " pod="kube-system/kas-connection-checker-685895c7c9-t8fj7" Oct 30 22:07:31.347834 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.347806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lngqk\" (UniqueName: \"kubernetes.io/projected/3f904583-6409-4a27-b9b8-cf8e1167a0b4-kube-api-access-lngqk\") pod \"volume-data-source-validator-58c9f5f46d-dsswm\" (UID: \"3f904583-6409-4a27-b9b8-cf8e1167a0b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm" Oct 30 22:07:31.347866 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.347842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:31.347903 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.347893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blpzl\" (UniqueName: \"kubernetes.io/projected/9d369819-d29c-48a6-b03b-41f2145bac41-kube-api-access-blpzl\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:31.360900 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.360885 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-589dd864bc-k9hqj"] Oct 30 22:07:31.361014 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.361002 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:31.377944 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.377929 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5df9566755-smt7x"] Oct 30 22:07:31.378069 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.378048 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.381836 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.381820 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv"] Oct 30 22:07:31.381942 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.381927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.390878 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.390861 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb"] Oct 30 22:07:31.390972 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.390956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.404790 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.404773 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d566bbdf8-jn8p4"] Oct 30 22:07:31.404898 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.404884 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb" Oct 30 22:07:31.416982 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.416966 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7vvjk"] Oct 30 22:07:31.417081 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.417066 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.435732 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435711 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 30 22:07:31.435732 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435723 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.435885 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435730 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.435885 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435760 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.435885 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435762 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.435885 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435774 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 30 22:07:31.435885 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435783 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.436098 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435929 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.436098 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435968 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 30 22:07:31.436098 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435969 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.436098 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.435995 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.436098 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.436014 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 30 22:07:31.436893 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.436879 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 30 22:07:31.437409 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.437395 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 22:07:31.439592 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.439579 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qg8m6"] Oct 30 22:07:31.439705 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.439692 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.445889 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.445864 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 30 22:07:31.445978 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.445940 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 30 22:07:31.445978 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.445944 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 22:07:31.445978 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.445964 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 30 22:07:31.446113 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.445992 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 30 22:07:31.446196 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.446183 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 22:07:31.446196 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.446189 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-68vsx\"" Oct 30 22:07:31.446296 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.446197 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tmsjf\"" Oct 30 22:07:31.446296 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.446199 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 30 22:07:31.446296 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.446248 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nsszl\"" Oct 30 22:07:31.446296 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.446291 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5trx7\"" Oct 30 22:07:31.446429 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.446308 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-ftknn\"" Oct 30 22:07:31.446429 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.446309 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wkgtq\"" Oct 30 22:07:31.446429 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.446348 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 22:07:31.446429 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.446384 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 30 22:07:31.448389 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-image-registry-private-configuration\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.448467 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-trusted-ca\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.448467 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-trusted-ca\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.448544 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3748d1a1-641f-4259-84b0-a009feb248a8-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.448544 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-certificates\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.448659 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9d369819-d29c-48a6-b03b-41f2145bac41-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:31.448659 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgkcb\" (UniqueName: \"kubernetes.io/projected/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-kube-api-access-mgkcb\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.448659 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-service-ca-bundle\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.448659 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lngqk\" (UniqueName: \"kubernetes.io/projected/3f904583-6409-4a27-b9b8-cf8e1167a0b4-kube-api-access-lngqk\") pod \"volume-data-source-validator-58c9f5f46d-dsswm\" (UID: \"3f904583-6409-4a27-b9b8-cf8e1167a0b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm" Oct 30 22:07:31.448852 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:31.448852 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:31.448852 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-ca-trust-extracted\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.448852 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-installation-pull-secrets\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.448852 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-default-certificate\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.448852 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d72a205f-a6c2-4510-989f-cfd6c8aa045d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:31.448852 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:31.449187 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.448857 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:31.449187 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.448906 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls podName:9d369819-d29c-48a6-b03b-41f2145bac41 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:31.948893366 +0000 UTC m=+31.115684541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xvqph" (UID: "9d369819-d29c-48a6-b03b-41f2145bac41") : secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:31.449187 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.448964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3748d1a1-641f-4259-84b0-a009feb248a8-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.449187 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blpzl\" (UniqueName: \"kubernetes.io/projected/9d369819-d29c-48a6-b03b-41f2145bac41-kube-api-access-blpzl\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:31.449187 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96rhx\" (UniqueName: \"kubernetes.io/projected/3748d1a1-641f-4259-84b0-a009feb248a8-kube-api-access-96rhx\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.449187 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449051 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9rnk\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-kube-api-access-f9rnk\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.449187 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n25r6\" (UniqueName: \"kubernetes.io/projected/c1bc2f81-1e3d-426a-a25f-829a30545dc6-kube-api-access-n25r6\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:31.449187 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-tmp\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.449505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-config\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.449505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff224fb4-ef29-4599-aca1-38595e23d592-serving-cert\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.449505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v28td\" (UniqueName: \"kubernetes.io/projected/43cebd0d-8293-4c7c-9469-4b211733bb79-kube-api-access-v28td\") pod \"kas-connection-checker-685895c7c9-92wb6\" (UID: \"43cebd0d-8293-4c7c-9469-4b211733bb79\") " pod="kube-system/kas-connection-checker-685895c7c9-92wb6" Oct 30 22:07:31.449505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qc7s\" (UniqueName: \"kubernetes.io/projected/a918696f-7dcd-4942-bbe2-1f59aaf991fe-kube-api-access-4qc7s\") pod \"kas-connection-checker-685895c7c9-t8fj7\" (UID: \"a918696f-7dcd-4942-bbe2-1f59aaf991fe\") " pod="kube-system/kas-connection-checker-685895c7c9-t8fj7" Oct 30 22:07:31.449505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2be079bb-4896-4a19-8a9f-0313a9bffea8-config\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.449505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.449505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449318 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9d369819-d29c-48a6-b03b-41f2145bac41-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:31.449505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-serving-cert\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.449505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-bound-sa-token\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.449801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.449801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449553 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.449801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-stats-auth\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.449801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:31.449801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-snapshots\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.449801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ttn9\" (UniqueName: \"kubernetes.io/projected/ff224fb4-ef29-4599-aca1-38595e23d592-kube-api-access-7ttn9\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.449801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c8ps\" (UniqueName: \"kubernetes.io/projected/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-kube-api-access-4c8ps\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.449801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84fd\" (UniqueName: \"kubernetes.io/projected/2be079bb-4896-4a19-8a9f-0313a9bffea8-kube-api-access-j84fd\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.449801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449762 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-659vs\" (UniqueName: \"kubernetes.io/projected/4c8ed0be-6573-4bf7-aa93-572c5c0e4bce-kube-api-access-659vs\") pod \"kas-connection-checker-685895c7c9-8xtlm\" (UID: \"4c8ed0be-6573-4bf7-aa93-572c5c0e4bce\") " pod="kube-system/kas-connection-checker-685895c7c9-8xtlm" Oct 30 22:07:31.449801 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.450110 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.449816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2be079bb-4896-4a19-8a9f-0313a9bffea8-serving-cert\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.451744 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.451730 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 22:07:31.451796 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.451781 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 22:07:31.451827 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.451803 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hk5lx\"" Oct 30 22:07:31.459786 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459769 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-92wb6"] Oct 30 22:07:31.459874 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459800 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-8xtlm"] Oct 30 22:07:31.459874 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459820 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm"] Oct 30 22:07:31.459874 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459846 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g"] Oct 30 22:07:31.459874 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459865 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph"] Oct 30 22:07:31.460056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459885 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-mmh7p"] Oct 30 22:07:31.460056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459906 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j"] Oct 30 22:07:31.460056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459933 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv"] Oct 30 22:07:31.460056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:31.460056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459956 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5df9566755-smt7x"] Oct 30 22:07:31.460056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459975 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-hdt8n"] Oct 30 22:07:31.460056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.459994 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-t8fj7"] Oct 30 22:07:31.460056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.460013 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d566bbdf8-jn8p4"] Oct 30 22:07:31.460056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.460035 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-8ddx2"] Oct 30 22:07:31.460056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.460055 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-589dd864bc-k9hqj"] Oct 30 22:07:31.460458 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.460075 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb"] Oct 30 22:07:31.460458 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.460095 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vvjk"] Oct 30 22:07:31.460458 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.460120 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qg8m6"] Oct 30 22:07:31.471345 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.471326 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v28td\" (UniqueName: \"kubernetes.io/projected/43cebd0d-8293-4c7c-9469-4b211733bb79-kube-api-access-v28td\") pod \"kas-connection-checker-685895c7c9-92wb6\" (UID: \"43cebd0d-8293-4c7c-9469-4b211733bb79\") " pod="kube-system/kas-connection-checker-685895c7c9-92wb6" Oct 30 22:07:31.471345 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.471344 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-659vs\" (UniqueName: \"kubernetes.io/projected/4c8ed0be-6573-4bf7-aa93-572c5c0e4bce-kube-api-access-659vs\") pod \"kas-connection-checker-685895c7c9-8xtlm\" (UID: \"4c8ed0be-6573-4bf7-aa93-572c5c0e4bce\") " pod="kube-system/kas-connection-checker-685895c7c9-8xtlm" Oct 30 22:07:31.471471 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.471374 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qc7s\" (UniqueName: \"kubernetes.io/projected/a918696f-7dcd-4942-bbe2-1f59aaf991fe-kube-api-access-4qc7s\") pod \"kas-connection-checker-685895c7c9-t8fj7\" (UID: \"a918696f-7dcd-4942-bbe2-1f59aaf991fe\") " pod="kube-system/kas-connection-checker-685895c7c9-t8fj7" Oct 30 22:07:31.471471 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.471443 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blpzl\" (UniqueName: \"kubernetes.io/projected/9d369819-d29c-48a6-b03b-41f2145bac41-kube-api-access-blpzl\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:31.471700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.471677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngqk\" (UniqueName: \"kubernetes.io/projected/3f904583-6409-4a27-b9b8-cf8e1167a0b4-kube-api-access-lngqk\") pod \"volume-data-source-validator-58c9f5f46d-dsswm\" (UID: \"3f904583-6409-4a27-b9b8-cf8e1167a0b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm" Oct 30 22:07:31.532906 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.532889 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 22:07:31.533007 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.532912 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 22:07:31.543058 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.543038 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-92wb6" Oct 30 22:07:31.546775 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.546753 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 22:07:31.546855 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.546781 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-7vf6q\"" Oct 30 22:07:31.551093 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-trusted-ca\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.551135 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3748d1a1-641f-4259-84b0-a009feb248a8-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.551135 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-certificates\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.551224 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmfv7\" (UniqueName: \"kubernetes.io/projected/abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6-kube-api-access-jmfv7\") pod \"network-check-source-6f78d59f99-gw2gb\" (UID: \"abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb" Oct 30 22:07:31.551224 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgkcb\" (UniqueName: \"kubernetes.io/projected/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-kube-api-access-mgkcb\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.551224 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9cab6006-eafd-41a7-8035-22dfb992b4e6-config-volume\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.551224 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-service-ca-bundle\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.551415 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-installation-pull-secrets\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.551415 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:31.551516 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-ca-trust-extracted\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.551516 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-installation-pull-secrets\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.551516 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-default-certificate\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.551516 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d72a205f-a6c2-4510-989f-cfd6c8aa045d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:31.551516 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cab6006-eafd-41a7-8035-22dfb992b4e6-tmp-dir\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.551772 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:31.551772 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w5zt\" (UniqueName: \"kubernetes.io/projected/2996b6af-d6da-494d-b7d9-219a40969a19-kube-api-access-9w5zt\") pod \"ingress-canary-qg8m6\" (UID: \"2996b6af-d6da-494d-b7d9-219a40969a19\") " pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:31.551772 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.551772 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3748d1a1-641f-4259-84b0-a009feb248a8-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.551772 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-trusted-ca\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.551772 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96rhx\" (UniqueName: \"kubernetes.io/projected/3748d1a1-641f-4259-84b0-a009feb248a8-kube-api-access-96rhx\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.551772 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9rnk\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-kube-api-access-f9rnk\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.551772 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-image-registry-private-configuration\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.552135 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n25r6\" (UniqueName: \"kubernetes.io/projected/c1bc2f81-1e3d-426a-a25f-829a30545dc6-kube-api-access-n25r6\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:31.552135 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551816 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-certificates\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.552135 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551867 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-service-ca-bundle\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.552135 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552104 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-trusted-ca\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.552135 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-tmp\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.552135 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.551822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-tmp\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552147 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq6s6\" (UniqueName: \"kubernetes.io/projected/9cab6006-eafd-41a7-8035-22dfb992b4e6-kube-api-access-qq6s6\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552218 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-config\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff224fb4-ef29-4599-aca1-38595e23d592-serving-cert\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b62a4890-77fb-4ee6-b710-aadb9a5b9463-ca-trust-extracted\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-bound-sa-token\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2996b6af-d6da-494d-b7d9-219a40969a19-cert\") pod \"ingress-canary-qg8m6\" (UID: \"2996b6af-d6da-494d-b7d9-219a40969a19\") " pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2be079bb-4896-4a19-8a9f-0313a9bffea8-config\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552374 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-ca-trust-extracted\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552399 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3748d1a1-641f-4259-84b0-a009feb248a8-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.552425 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjdb8\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-kube-api-access-bjdb8\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.553014 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.552462 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 22:07:31.553014 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-serving-cert\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.553014 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-bound-sa-token\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.553014 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.553014 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.553014 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.552999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-stats-auth\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.553290 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.553026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:31.553290 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.553057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-snapshots\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.553290 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.553070 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2be079bb-4896-4a19-8a9f-0313a9bffea8-config\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.553290 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.553146 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-config\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.553290 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.553171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d72a205f-a6c2-4510-989f-cfd6c8aa045d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:31.553290 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.553208 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:32.053191605 +0000 UTC m=+31.219982807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : configmap references non-existent config key: service-ca.crt Oct 30 22:07:31.553290 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.553244 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.553799 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.553803 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-snapshots\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554101 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3748d1a1-641f-4259-84b0-a009feb248a8-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.554163 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:32.054145947 +0000 UTC m=+31.220937124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : secret "router-metrics-certs-default" not found Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.554181 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert podName:d72a205f-a6c2-4510-989f-cfd6c8aa045d nodeName:}" failed. No retries permitted until 2026-10-30 22:07:32.054172066 +0000 UTC m=+31.220963247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-mmh7p" (UID: "d72a205f-a6c2-4510-989f-cfd6c8aa045d") : secret "networking-console-plugin-cert" not found Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.554201 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls podName:c1bc2f81-1e3d-426a-a25f-829a30545dc6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:32.054187679 +0000 UTC m=+31.220978861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-qsf8j" (UID: "c1bc2f81-1e3d-426a-a25f-829a30545dc6") : secret "samples-operator-tls" not found Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ttn9\" (UniqueName: \"kubernetes.io/projected/ff224fb4-ef29-4599-aca1-38595e23d592-kube-api-access-7ttn9\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-installation-pull-secrets\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8ps\" (UniqueName: \"kubernetes.io/projected/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-kube-api-access-4c8ps\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84fd\" (UniqueName: \"kubernetes.io/projected/2be079bb-4896-4a19-8a9f-0313a9bffea8-kube-api-access-j84fd\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.554459 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554424 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.555083 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.555083 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.555083 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554761 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-default-certificate\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.555083 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.554812 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:31.555083 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2be079bb-4896-4a19-8a9f-0313a9bffea8-serving-cert\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.555083 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.554826 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589dd864bc-k9hqj: secret "image-registry-tls" not found Oct 30 22:07:31.555083 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-certificates\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.555083 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.554871 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls podName:5ca11ae4-ddf1-49bb-b9fe-fe708bdea984 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:32.054854524 +0000 UTC m=+31.221645705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls") pod "image-registry-589dd864bc-k9hqj" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984") : secret "image-registry-tls" not found Oct 30 22:07:31.555083 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-image-registry-private-configuration\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.555083 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.554985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-trusted-ca\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.555845 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.555823 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-trusted-ca\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.555926 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.555829 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-stats-auth\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.556189 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.556171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-serving-cert\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.556262 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.556249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm" Oct 30 22:07:31.556892 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.556871 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff224fb4-ef29-4599-aca1-38595e23d592-serving-cert\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.557208 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.557188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2be079bb-4896-4a19-8a9f-0313a9bffea8-serving-cert\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.557300 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.557283 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-image-registry-private-configuration\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.572439 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.572418 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgkcb\" (UniqueName: \"kubernetes.io/projected/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-kube-api-access-mgkcb\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.574187 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.573736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9rnk\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-kube-api-access-f9rnk\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.574706 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.574685 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-8xtlm" Oct 30 22:07:31.576167 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.576136 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n25r6\" (UniqueName: \"kubernetes.io/projected/c1bc2f81-1e3d-426a-a25f-829a30545dc6-kube-api-access-n25r6\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:31.577072 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.577016 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96rhx\" (UniqueName: \"kubernetes.io/projected/3748d1a1-641f-4259-84b0-a009feb248a8-kube-api-access-96rhx\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.579743 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.579671 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-bound-sa-token\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:31.581154 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.581134 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ttn9\" (UniqueName: \"kubernetes.io/projected/ff224fb4-ef29-4599-aca1-38595e23d592-kube-api-access-7ttn9\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.582027 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.582004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84fd\" (UniqueName: \"kubernetes.io/projected/2be079bb-4896-4a19-8a9f-0313a9bffea8-kube-api-access-j84fd\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.582437 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.582420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c8ps\" (UniqueName: \"kubernetes.io/projected/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-kube-api-access-4c8ps\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:31.605901 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.605854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-t8fj7" Oct 30 22:07:31.655273 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:31.655558 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmfv7\" (UniqueName: \"kubernetes.io/projected/abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6-kube-api-access-jmfv7\") pod \"network-check-source-6f78d59f99-gw2gb\" (UID: \"abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb" Oct 30 22:07:31.655599 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9cab6006-eafd-41a7-8035-22dfb992b4e6-config-volume\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.655656 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-installation-pull-secrets\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.655711 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cab6006-eafd-41a7-8035-22dfb992b4e6-tmp-dir\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.655757 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w5zt\" (UniqueName: \"kubernetes.io/projected/2996b6af-d6da-494d-b7d9-219a40969a19-kube-api-access-9w5zt\") pod \"ingress-canary-qg8m6\" (UID: \"2996b6af-d6da-494d-b7d9-219a40969a19\") " pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-trusted-ca\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-image-registry-private-configuration\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq6s6\" (UniqueName: \"kubernetes.io/projected/9cab6006-eafd-41a7-8035-22dfb992b4e6-kube-api-access-qq6s6\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b62a4890-77fb-4ee6-b710-aadb9a5b9463-ca-trust-extracted\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-bound-sa-token\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.655965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2996b6af-d6da-494d-b7d9-219a40969a19-cert\") pod \"ingress-canary-qg8m6\" (UID: \"2996b6af-d6da-494d-b7d9-219a40969a19\") " pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.656028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjdb8\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-kube-api-access-bjdb8\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.656125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9cab6006-eafd-41a7-8035-22dfb992b4e6-config-volume\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.656143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.656156 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cab6006-eafd-41a7-8035-22dfb992b4e6-tmp-dir\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.656237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-certificates\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.656245 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.656344 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d566bbdf8-jn8p4: secret "image-registry-tls" not found Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.656398 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls podName:b62a4890-77fb-4ee6-b710-aadb9a5b9463 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:32.156380414 +0000 UTC m=+31.323171605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls") pod "image-registry-6d566bbdf8-jn8p4" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463") : secret "image-registry-tls" not found Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.656944 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:31.657700 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.656998 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls podName:9cab6006-eafd-41a7-8035-22dfb992b4e6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:32.15698123 +0000 UTC m=+31.323772426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls") pod "dns-default-7vvjk" (UID: "9cab6006-eafd-41a7-8035-22dfb992b4e6") : secret "dns-default-metrics-tls" not found Oct 30 22:07:31.660393 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.657045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b62a4890-77fb-4ee6-b710-aadb9a5b9463-ca-trust-extracted\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.660393 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.657142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-trusted-ca\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.660393 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.657525 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-certificates\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.660393 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.659044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-image-registry-private-configuration\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.660393 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.659365 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-installation-pull-secrets\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.661542 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.661519 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2996b6af-d6da-494d-b7d9-219a40969a19-cert\") pod \"ingress-canary-qg8m6\" (UID: \"2996b6af-d6da-494d-b7d9-219a40969a19\") " pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:31.675993 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.675212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:31.682733 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.682165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:31.686056 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.686009 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w5zt\" (UniqueName: \"kubernetes.io/projected/2996b6af-d6da-494d-b7d9-219a40969a19-kube-api-access-9w5zt\") pod \"ingress-canary-qg8m6\" (UID: \"2996b6af-d6da-494d-b7d9-219a40969a19\") " pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:31.687903 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.687861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjdb8\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-kube-api-access-bjdb8\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.689677 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.689469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmfv7\" (UniqueName: \"kubernetes.io/projected/abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6-kube-api-access-jmfv7\") pod \"network-check-source-6f78d59f99-gw2gb\" (UID: \"abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb" Oct 30 22:07:31.692872 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.692329 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq6s6\" (UniqueName: \"kubernetes.io/projected/9cab6006-eafd-41a7-8035-22dfb992b4e6-kube-api-access-qq6s6\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:31.700773 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.700584 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-bound-sa-token\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:31.725854 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.725835 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:31.772096 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.771872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb" Oct 30 22:07:31.815807 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.815471 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:31.917345 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.917259 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm"] Oct 30 22:07:31.921723 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.920662 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-8xtlm"] Oct 30 22:07:31.921723 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.921287 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-92wb6"] Oct 30 22:07:31.942500 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:31.942477 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43cebd0d_8293_4c7c_9469_4b211733bb79.slice/crio-a8d8062d3a6e126d66931020eeaead0a7317d28b108accea3f6fd07dc9a3bfd1 WatchSource:0}: Error finding container a8d8062d3a6e126d66931020eeaead0a7317d28b108accea3f6fd07dc9a3bfd1: Status 404 returned error can't find the container with id a8d8062d3a6e126d66931020eeaead0a7317d28b108accea3f6fd07dc9a3bfd1 Oct 30 22:07:31.943183 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:31.943165 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8ed0be_6573_4bf7_aa93_572c5c0e4bce.slice/crio-28b749d0eb8c2ede23ce746a6cf43190a6f5c82b8cd9ccb7ade5b60f59fde710 WatchSource:0}: Error finding container 28b749d0eb8c2ede23ce746a6cf43190a6f5c82b8cd9ccb7ade5b60f59fde710: Status 404 returned error can't find the container with id 28b749d0eb8c2ede23ce746a6cf43190a6f5c82b8cd9ccb7ade5b60f59fde710 Oct 30 22:07:31.946335 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.946288 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-t8fj7"] Oct 30 22:07:31.950198 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:31.950176 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda918696f_7dcd_4942_bbe2_1f59aaf991fe.slice/crio-c11a12e3ea56788ee5a1ac99edfe71d668ec60630be0d1c24fcc0e61c3ceb88d WatchSource:0}: Error finding container c11a12e3ea56788ee5a1ac99edfe71d668ec60630be0d1c24fcc0e61c3ceb88d: Status 404 returned error can't find the container with id c11a12e3ea56788ee5a1ac99edfe71d668ec60630be0d1c24fcc0e61c3ceb88d Oct 30 22:07:31.960778 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:31.960758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:31.960886 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.960870 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:31.961001 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:31.960913 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls podName:9d369819-d29c-48a6-b03b-41f2145bac41 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:32.960900356 +0000 UTC m=+32.127691533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xvqph" (UID: "9d369819-d29c-48a6-b03b-41f2145bac41") : secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:32.010673 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.010647 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g"] Oct 30 22:07:32.014063 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.014038 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-8ddx2"] Oct 30 22:07:32.020136 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:32.020105 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff224fb4_ef29_4599_aca1_38595e23d592.slice/crio-6e59ffec8d8d73ad8787109fc9e6f100eeb2b3534027e988ce3e0942d437ca2b WatchSource:0}: Error finding container 6e59ffec8d8d73ad8787109fc9e6f100eeb2b3534027e988ce3e0942d437ca2b: Status 404 returned error can't find the container with id 6e59ffec8d8d73ad8787109fc9e6f100eeb2b3534027e988ce3e0942d437ca2b Oct 30 22:07:32.020522 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:32.020500 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be079bb_4896_4a19_8a9f_0313a9bffea8.slice/crio-749984187b350d7660e19ddc86f01ac030d55c0e65bcf6c20d008b289ece953f WatchSource:0}: Error finding container 749984187b350d7660e19ddc86f01ac030d55c0e65bcf6c20d008b289ece953f: Status 404 returned error can't find the container with id 749984187b350d7660e19ddc86f01ac030d55c0e65bcf6c20d008b289ece953f Oct 30 22:07:32.044946 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.044912 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-hdt8n"] Oct 30 22:07:32.048119 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:32.048090 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d187ab_b86b_42f8_9bdb_2cdad6e6d518.slice/crio-34806fda5d08e84bc3670d8e35ccbb3677b7e66a41c50b29d7bd20844cccd41a WatchSource:0}: Error finding container 34806fda5d08e84bc3670d8e35ccbb3677b7e66a41c50b29d7bd20844cccd41a: Status 404 returned error can't find the container with id 34806fda5d08e84bc3670d8e35ccbb3677b7e66a41c50b29d7bd20844cccd41a Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.061964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.062017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.062074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.062149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.062232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.062380 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.062438 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:33.0624207 +0000 UTC m=+32.229211886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : secret "router-metrics-certs-default" not found Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.062469 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv"] Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.062596 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:33.06257523 +0000 UTC m=+32.229366414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : configmap references non-existent config key: service-ca.crt Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.062686 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.062722 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls podName:c1bc2f81-1e3d-426a-a25f-829a30545dc6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:33.062710804 +0000 UTC m=+32.229501980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-qsf8j" (UID: "c1bc2f81-1e3d-426a-a25f-829a30545dc6") : secret "samples-operator-tls" not found Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.062787 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.062797 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589dd864bc-k9hqj: secret "image-registry-tls" not found Oct 30 22:07:32.062850 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.062826 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls podName:5ca11ae4-ddf1-49bb-b9fe-fe708bdea984 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:33.062817364 +0000 UTC m=+32.229608547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls") pod "image-registry-589dd864bc-k9hqj" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984") : secret "image-registry-tls" not found Oct 30 22:07:32.063514 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.062883 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 22:07:32.063514 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.062924 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert podName:d72a205f-a6c2-4510-989f-cfd6c8aa045d nodeName:}" failed. No retries permitted until 2026-10-30 22:07:33.062912603 +0000 UTC m=+32.229703779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-mmh7p" (UID: "d72a205f-a6c2-4510-989f-cfd6c8aa045d") : secret "networking-console-plugin-cert" not found Oct 30 22:07:32.096366 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.096338 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb"] Oct 30 22:07:32.099468 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:32.099438 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb7a08a_bbbf_42f7_92f4_340cc0ed7fb6.slice/crio-09bfed56642b460f0dde927193e805a62554680d1b5ec471a562f4a2522d5bd6 WatchSource:0}: Error finding container 09bfed56642b460f0dde927193e805a62554680d1b5ec471a562f4a2522d5bd6: Status 404 returned error can't find the container with id 09bfed56642b460f0dde927193e805a62554680d1b5ec471a562f4a2522d5bd6 Oct 30 22:07:32.141996 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.141966 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qg8m6"] Oct 30 22:07:32.145129 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:32.145103 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2996b6af_d6da_494d_b7d9_219a40969a19.slice/crio-7ecbcd6c93a848f6191e44c673fd7a323e7c856cdfcf5049fca41ea8c635dbaf WatchSource:0}: Error finding container 7ecbcd6c93a848f6191e44c673fd7a323e7c856cdfcf5049fca41ea8c635dbaf: Status 404 returned error can't find the container with id 7ecbcd6c93a848f6191e44c673fd7a323e7c856cdfcf5049fca41ea8c635dbaf Oct 30 22:07:32.163491 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.163467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:32.163591 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.163535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:32.163659 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.163639 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:32.163659 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.163654 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:32.163735 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.163663 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d566bbdf8-jn8p4: secret "image-registry-tls" not found Oct 30 22:07:32.163735 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.163713 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls podName:9cab6006-eafd-41a7-8035-22dfb992b4e6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:33.163690712 +0000 UTC m=+32.330481893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls") pod "dns-default-7vvjk" (UID: "9cab6006-eafd-41a7-8035-22dfb992b4e6") : secret "dns-default-metrics-tls" not found Oct 30 22:07:32.163735 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.163726 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls podName:b62a4890-77fb-4ee6-b710-aadb9a5b9463 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:33.163720107 +0000 UTC m=+32.330511284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls") pod "image-registry-6d566bbdf8-jn8p4" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463") : secret "image-registry-tls" not found Oct 30 22:07:32.277263 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.277226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:32.277263 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.277245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:32.277450 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.277333 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:32.290891 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.290852 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 22:07:32.290891 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.290872 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hmbsc\"" Oct 30 22:07:32.291207 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.290896 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5nx2r\"" Oct 30 22:07:32.291207 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.290916 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 22:07:32.291207 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.290952 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gq78g\"" Oct 30 22:07:32.497120 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.497074 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" event={"ID":"3748d1a1-641f-4259-84b0-a009feb248a8","Type":"ContainerStarted","Data":"3de285584b902821f35702e8d3b3f489e5766581e7e581d41725c836dcdd5bc4"} Oct 30 22:07:32.498891 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.498864 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-8xtlm" event={"ID":"4c8ed0be-6573-4bf7-aa93-572c5c0e4bce","Type":"ContainerStarted","Data":"4a4b0b44a15ae893822fe63edd57f336e0cd88652240c6d069400c84cbe6350a"} Oct 30 22:07:32.499017 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.498926 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-8xtlm" event={"ID":"4c8ed0be-6573-4bf7-aa93-572c5c0e4bce","Type":"ContainerStarted","Data":"28b749d0eb8c2ede23ce746a6cf43190a6f5c82b8cd9ccb7ade5b60f59fde710"} Oct 30 22:07:32.500424 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.500391 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm" event={"ID":"3f904583-6409-4a27-b9b8-cf8e1167a0b4","Type":"ContainerStarted","Data":"2b69377741ebae68692b68c0de1b3dc42a97418fe9bec59fec750527d6b2f225"} Oct 30 22:07:32.501887 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.501859 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qg8m6" event={"ID":"2996b6af-d6da-494d-b7d9-219a40969a19","Type":"ContainerStarted","Data":"7ecbcd6c93a848f6191e44c673fd7a323e7c856cdfcf5049fca41ea8c635dbaf"} Oct 30 22:07:32.503202 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.503177 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb" event={"ID":"abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6","Type":"ContainerStarted","Data":"09bfed56642b460f0dde927193e805a62554680d1b5ec471a562f4a2522d5bd6"} Oct 30 22:07:32.504451 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.504424 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" event={"ID":"ff224fb4-ef29-4599-aca1-38595e23d592","Type":"ContainerStarted","Data":"6e59ffec8d8d73ad8787109fc9e6f100eeb2b3534027e988ce3e0942d437ca2b"} Oct 30 22:07:32.505871 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.505832 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-hdt8n" event={"ID":"60d187ab-b86b-42f8-9bdb-2cdad6e6d518","Type":"ContainerStarted","Data":"34806fda5d08e84bc3670d8e35ccbb3677b7e66a41c50b29d7bd20844cccd41a"} Oct 30 22:07:32.507202 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.507179 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" event={"ID":"2be079bb-4896-4a19-8a9f-0313a9bffea8","Type":"ContainerStarted","Data":"749984187b350d7660e19ddc86f01ac030d55c0e65bcf6c20d008b289ece953f"} Oct 30 22:07:32.508961 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.508927 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-t8fj7" event={"ID":"a918696f-7dcd-4942-bbe2-1f59aaf991fe","Type":"ContainerStarted","Data":"462abe83f54764a6bf198bc8be59bd55e6ec95ec487e1638a135430489090b65"} Oct 30 22:07:32.508961 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.508967 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-t8fj7" event={"ID":"a918696f-7dcd-4942-bbe2-1f59aaf991fe","Type":"ContainerStarted","Data":"c11a12e3ea56788ee5a1ac99edfe71d668ec60630be0d1c24fcc0e61c3ceb88d"} Oct 30 22:07:32.510742 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.510712 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-92wb6" event={"ID":"43cebd0d-8293-4c7c-9469-4b211733bb79","Type":"ContainerStarted","Data":"65cef56da0d8b4ae4194c27de2f459f51c91769a74e5734f960aff68573a3567"} Oct 30 22:07:32.510834 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.510751 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-92wb6" event={"ID":"43cebd0d-8293-4c7c-9469-4b211733bb79","Type":"ContainerStarted","Data":"a8d8062d3a6e126d66931020eeaead0a7317d28b108accea3f6fd07dc9a3bfd1"} Oct 30 22:07:32.535348 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.535302 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-8xtlm" podStartSLOduration=406.535289064 podStartE2EDuration="6m46.535289064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:32.533779441 +0000 UTC m=+31.700570634" watchObservedRunningTime="2026-10-30 22:07:32.535289064 +0000 UTC m=+31.702080265" Oct 30 22:07:32.611778 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.610798 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-t8fj7" podStartSLOduration=406.610781537 podStartE2EDuration="6m46.610781537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:32.570783464 +0000 UTC m=+31.737574663" watchObservedRunningTime="2026-10-30 22:07:32.610781537 +0000 UTC m=+31.777572738" Oct 30 22:07:32.971704 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:32.971618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:32.971895 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.971879 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:32.971954 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:32.971934 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls podName:9d369819-d29c-48a6-b03b-41f2145bac41 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:34.97192174 +0000 UTC m=+34.138712919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xvqph" (UID: "9d369819-d29c-48a6-b03b-41f2145bac41") : secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:33.073028 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:33.072995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:33.073190 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:33.073058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:33.073190 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:33.073091 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:33.073190 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:33.073132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:33.073190 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:33.073187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:33.073330 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.073293 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 22:07:33.073372 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.073351 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert podName:d72a205f-a6c2-4510-989f-cfd6c8aa045d nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.073333023 +0000 UTC m=+34.240124213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-mmh7p" (UID: "d72a205f-a6c2-4510-989f-cfd6c8aa045d") : secret "networking-console-plugin-cert" not found Oct 30 22:07:33.074016 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.073690 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 22:07:33.074016 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.073739 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.073725794 +0000 UTC m=+34.240516985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : secret "router-metrics-certs-default" not found Oct 30 22:07:33.074016 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.073787 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.073781148 +0000 UTC m=+34.240572337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : configmap references non-existent config key: service-ca.crt Oct 30 22:07:33.074016 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.073837 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 22:07:33.074016 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.073867 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls podName:c1bc2f81-1e3d-426a-a25f-829a30545dc6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.073854372 +0000 UTC m=+34.240645560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-qsf8j" (UID: "c1bc2f81-1e3d-426a-a25f-829a30545dc6") : secret "samples-operator-tls" not found Oct 30 22:07:33.074016 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.073912 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:33.074016 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.073923 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589dd864bc-k9hqj: secret "image-registry-tls" not found Oct 30 22:07:33.074016 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.073951 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls podName:5ca11ae4-ddf1-49bb-b9fe-fe708bdea984 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.073941379 +0000 UTC m=+34.240732571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls") pod "image-registry-589dd864bc-k9hqj" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984") : secret "image-registry-tls" not found Oct 30 22:07:33.174285 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:33.174248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:33.174435 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:33.174376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:33.174541 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.174525 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:33.174597 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.174586 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls podName:9cab6006-eafd-41a7-8035-22dfb992b4e6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.174568478 +0000 UTC m=+34.341359656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls") pod "dns-default-7vvjk" (UID: "9cab6006-eafd-41a7-8035-22dfb992b4e6") : secret "dns-default-metrics-tls" not found Oct 30 22:07:33.174914 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.174898 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:33.174990 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.174916 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d566bbdf8-jn8p4: secret "image-registry-tls" not found Oct 30 22:07:33.174990 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:33.174966 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls podName:b62a4890-77fb-4ee6-b710-aadb9a5b9463 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.17495135 +0000 UTC m=+34.341742527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls") pod "image-registry-6d566bbdf8-jn8p4" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463") : secret "image-registry-tls" not found Oct 30 22:07:34.521392 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:34.520683 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm" event={"ID":"3f904583-6409-4a27-b9b8-cf8e1167a0b4","Type":"ContainerStarted","Data":"dd141c45a9a2a610e11d9952f649faca93ff43e9d4ee6a00ea5e46751bc6176c"} Oct 30 22:07:34.558671 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:34.557356 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-92wb6" podStartSLOduration=408.557339061 podStartE2EDuration="6m48.557339061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:32.610623488 +0000 UTC m=+31.777414686" watchObservedRunningTime="2026-10-30 22:07:34.557339061 +0000 UTC m=+33.724130338" Oct 30 22:07:34.558671 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:34.558248 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm" podStartSLOduration=379.657670888 podStartE2EDuration="6m21.558238265s" totalImagesPullingTime="1.900567377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:34.556273284 +0000 UTC m=+33.723064484" watchObservedRunningTime="2026-10-30 22:07:34.558238265 +0000 UTC m=+33.725029466" Oct 30 22:07:34.780583 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:34.780530 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:34.963535 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:34.963276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:34.994988 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:34.994914 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:34.995149 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:34.995055 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:34.995149 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:34.995122 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls podName:9d369819-d29c-48a6-b03b-41f2145bac41 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:38.995104417 +0000 UTC m=+38.161895596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xvqph" (UID: "9d369819-d29c-48a6-b03b-41f2145bac41") : secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:35.096429 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.096396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:35.096600 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.096441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:35.096600 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.096462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:35.096600 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.096519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:35.096811 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.096718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:35.096811 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.096761 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 22:07:35.096811 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.096774 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.096757633 +0000 UTC m=+38.263548827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : configmap references non-existent config key: service-ca.crt Oct 30 22:07:35.097061 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.096825 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls podName:c1bc2f81-1e3d-426a-a25f-829a30545dc6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.09680945 +0000 UTC m=+38.263600627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-qsf8j" (UID: "c1bc2f81-1e3d-426a-a25f-829a30545dc6") : secret "samples-operator-tls" not found Oct 30 22:07:35.097061 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.096836 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 22:07:35.097061 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.096879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:35.097061 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.096884 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert podName:d72a205f-a6c2-4510-989f-cfd6c8aa045d nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.096870639 +0000 UTC m=+38.263661843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-mmh7p" (UID: "d72a205f-a6c2-4510-989f-cfd6c8aa045d") : secret "networking-console-plugin-cert" not found Oct 30 22:07:35.097061 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.096946 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 22:07:35.097061 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.096986 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.096971903 +0000 UTC m=+38.263763097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : secret "router-metrics-certs-default" not found Oct 30 22:07:35.097352 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.097287 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:35.097352 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.097305 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589dd864bc-k9hqj: secret "image-registry-tls" not found Oct 30 22:07:35.097352 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.097344 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls podName:5ca11ae4-ddf1-49bb-b9fe-fe708bdea984 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.0973304 +0000 UTC m=+38.264121600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls") pod "image-registry-589dd864bc-k9hqj" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984") : secret "image-registry-tls" not found Oct 30 22:07:35.100641 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.100571 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:35.198027 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.197993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:35.198195 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.198059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:35.198195 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.198124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:35.198299 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.198217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:35.198366 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.198349 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:35.198454 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.198412 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls podName:9cab6006-eafd-41a7-8035-22dfb992b4e6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.198395001 +0000 UTC m=+38.365186197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls") pod "dns-default-7vvjk" (UID: "9cab6006-eafd-41a7-8035-22dfb992b4e6") : secret "dns-default-metrics-tls" not found Oct 30 22:07:35.198527 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.198480 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:07:35.198527 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.198516 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:08:07.198504643 +0000 UTC m=+66.365295833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : secret "metrics-daemon-secret" not found Oct 30 22:07:35.198652 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.198569 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:35.198652 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.198588 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d566bbdf8-jn8p4: secret "image-registry-tls" not found Oct 30 22:07:35.198749 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:35.198653 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls podName:b62a4890-77fb-4ee6-b710-aadb9a5b9463 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.198636338 +0000 UTC m=+38.365427545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls") pod "image-registry-6d566bbdf8-jn8p4" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463") : secret "image-registry-tls" not found Oct 30 22:07:35.201201 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.201181 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:35.308775 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.308524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:35.361908 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.361710 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:35.378858 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.378685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:35.490950 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.490922 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:35.649028 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.648963 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4pd2j"] Oct 30 22:07:35.656049 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:35.656022 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9da187_50be_45aa_9ddd_e49ce94ea488.slice/crio-7d405afeb3723c9d7c0f089fcd8070b73fe779bcc12d6e12644a61c3b70ba6df WatchSource:0}: Error finding container 7d405afeb3723c9d7c0f089fcd8070b73fe779bcc12d6e12644a61c3b70ba6df: Status 404 returned error can't find the container with id 7d405afeb3723c9d7c0f089fcd8070b73fe779bcc12d6e12644a61c3b70ba6df Oct 30 22:07:35.707738 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.707709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:35.710822 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.710797 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r2hqv"] Oct 30 22:07:35.714391 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:35.714370 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960e184e_c2a7_4937_bf04_4c13a434883e.slice/crio-99298b05d860308f22f3e90bf96d6fb9a440e246a776224ae9e1c0547cd1f3c2 WatchSource:0}: Error finding container 99298b05d860308f22f3e90bf96d6fb9a440e246a776224ae9e1c0547cd1f3c2: Status 404 returned error can't find the container with id 99298b05d860308f22f3e90bf96d6fb9a440e246a776224ae9e1c0547cd1f3c2 Oct 30 22:07:35.834999 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:35.834939 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:36.534377 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:36.533410 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r2hqv" event={"ID":"960e184e-c2a7-4937-bf04-4c13a434883e","Type":"ContainerStarted","Data":"99298b05d860308f22f3e90bf96d6fb9a440e246a776224ae9e1c0547cd1f3c2"} Oct 30 22:07:36.536621 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:36.534879 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4pd2j" event={"ID":"8b9da187-50be-45aa-9ddd-e49ce94ea488","Type":"ContainerStarted","Data":"7d405afeb3723c9d7c0f089fcd8070b73fe779bcc12d6e12644a61c3b70ba6df"} Oct 30 22:07:36.537658 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:36.536796 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/0.log" Oct 30 22:07:36.537658 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:36.536832 2578 generic.go:356] "Generic (PLEG): container finished" podID="ff224fb4-ef29-4599-aca1-38595e23d592" containerID="2cfe210a3b312bcbb7107e9cef1d9f2709a9520f721f33aac62b4ef44ce1bdee" exitCode=255 Oct 30 22:07:36.537658 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:36.536878 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" event={"ID":"ff224fb4-ef29-4599-aca1-38595e23d592","Type":"ContainerDied","Data":"2cfe210a3b312bcbb7107e9cef1d9f2709a9520f721f33aac62b4ef44ce1bdee"} Oct 30 22:07:36.537658 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:36.537195 2578 scope.go:122] "RemoveContainer" containerID="2cfe210a3b312bcbb7107e9cef1d9f2709a9520f721f33aac62b4ef44ce1bdee" Oct 30 22:07:37.218011 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.217894 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:37.270309 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.269111 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-86mjd"] Oct 30 22:07:37.299875 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.299847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.305686 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.305656 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-86mjd"] Oct 30 22:07:37.368326 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.368253 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:37.400092 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.400064 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 22:07:37.400297 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.400274 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 22:07:37.400385 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.400366 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r7nlg\"" Oct 30 22:07:37.424829 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.424798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fwn8\" (UniqueName: \"kubernetes.io/projected/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-api-access-4fwn8\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.424950 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.424877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0f427f4-1c06-4556-8645-8932bcd7b653-data-volume\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.424950 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.424906 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.425070 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.424976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0f427f4-1c06-4556-8645-8932bcd7b653-crio-socket\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.425070 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.425003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.501941 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.501901 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:37.526060 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.526022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0f427f4-1c06-4556-8645-8932bcd7b653-crio-socket\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.526206 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.526070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.526206 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.526185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fwn8\" (UniqueName: \"kubernetes.io/projected/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-api-access-4fwn8\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.526313 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.526224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0f427f4-1c06-4556-8645-8932bcd7b653-data-volume\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.526313 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.526248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.526409 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:37.526370 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:37.526469 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:37.526432 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:38.026412861 +0000 UTC m=+37.193204057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:37.526710 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.526691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0f427f4-1c06-4556-8645-8932bcd7b653-crio-socket\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.526775 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:37.526757 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:07:37.526828 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:37.526797 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:38.026785886 +0000 UTC m=+37.193577061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : configmap "kube-rbac-proxy" not found Oct 30 22:07:37.527257 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.527239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0f427f4-1c06-4556-8645-8932bcd7b653-data-volume\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.548120 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.548092 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fwn8\" (UniqueName: \"kubernetes.io/projected/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-api-access-4fwn8\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:37.550505 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.550484 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/1.log" Oct 30 22:07:37.551064 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.550996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/0.log" Oct 30 22:07:37.551064 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.551059 2578 generic.go:356] "Generic (PLEG): container finished" podID="ff224fb4-ef29-4599-aca1-38595e23d592" containerID="f0f390cd89e84ede353cec463599d4716a38f1d9a494c9512f4a6a44c7a28b84" exitCode=255 Oct 30 22:07:37.551224 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.551124 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" event={"ID":"ff224fb4-ef29-4599-aca1-38595e23d592","Type":"ContainerDied","Data":"f0f390cd89e84ede353cec463599d4716a38f1d9a494c9512f4a6a44c7a28b84"} Oct 30 22:07:37.551224 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.551164 2578 scope.go:122] "RemoveContainer" containerID="2cfe210a3b312bcbb7107e9cef1d9f2709a9520f721f33aac62b4ef44ce1bdee" Oct 30 22:07:37.551476 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.551460 2578 scope.go:122] "RemoveContainer" containerID="f0f390cd89e84ede353cec463599d4716a38f1d9a494c9512f4a6a44c7a28b84" Oct 30 22:07:37.551663 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:37.551642 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8ddx2_openshift-console-operator(ff224fb4-ef29-4599-aca1-38595e23d592)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" podUID="ff224fb4-ef29-4599-aca1-38595e23d592" Oct 30 22:07:37.554168 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.554139 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-hdt8n" event={"ID":"60d187ab-b86b-42f8-9bdb-2cdad6e6d518","Type":"ContainerStarted","Data":"cdf6b44181269f4a6cc527544f78ca051e1422f3c3d6fb3d1bad5648e61a7e6a"} Oct 30 22:07:37.556594 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.556571 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" event={"ID":"2be079bb-4896-4a19-8a9f-0313a9bffea8","Type":"ContainerStarted","Data":"ae35100746e32165ec2b5a0315f2175645ad8e050f27c4bc7a785255a69becb2"} Oct 30 22:07:37.558456 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.558434 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" event={"ID":"3748d1a1-641f-4259-84b0-a009feb248a8","Type":"ContainerStarted","Data":"fa4ad542d22929c0645b68a495a08f06cc2e1bee644887747aa51800a71af1f0"} Oct 30 22:07:37.630111 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.630028 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" podStartSLOduration=377.224618526 podStartE2EDuration="6m21.630011434s" totalImagesPullingTime="4.405392908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:37.629749621 +0000 UTC m=+36.796540821" watchObservedRunningTime="2026-10-30 22:07:37.630011434 +0000 UTC m=+36.796802635" Oct 30 22:07:37.672211 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.672134 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" podStartSLOduration=379.904086324 podStartE2EDuration="6m24.672117042s" totalImagesPullingTime="4.768030718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:37.671200829 +0000 UTC m=+36.837992029" watchObservedRunningTime="2026-10-30 22:07:37.672117042 +0000 UTC m=+36.838908242" Oct 30 22:07:37.698551 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.698489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:37.709833 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.709780 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-hdt8n" podStartSLOduration=380.299536126 podStartE2EDuration="6m24.709762848s" totalImagesPullingTime="4.410226722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:37.708289803 +0000 UTC m=+36.875081004" watchObservedRunningTime="2026-10-30 22:07:37.709762848 +0000 UTC m=+36.876554050" Oct 30 22:07:37.727775 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.727040 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5"] Oct 30 22:07:37.746260 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.745920 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5" Oct 30 22:07:37.756187 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.752870 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5"] Oct 30 22:07:37.828469 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.828436 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:37.839498 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.839473 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:37.839646 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.839583 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 22:07:37.839717 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.839696 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4wqfg\"" Oct 30 22:07:37.929517 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.929447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h64c\" (UniqueName: \"kubernetes.io/projected/66704037-d682-431e-b477-c0010e52e84d-kube-api-access-5h64c\") pod \"migrator-66df5d496b-xpld5\" (UID: \"66704037-d682-431e-b477-c0010e52e84d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5" Oct 30 22:07:37.965785 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:37.965754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:38.030491 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.030461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:38.030664 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.030550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h64c\" (UniqueName: \"kubernetes.io/projected/66704037-d682-431e-b477-c0010e52e84d-kube-api-access-5h64c\") pod \"migrator-66df5d496b-xpld5\" (UID: \"66704037-d682-431e-b477-c0010e52e84d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5" Oct 30 22:07:38.030759 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:38.030740 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:07:38.030842 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:38.030805 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.030792606 +0000 UTC m=+38.197583782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : configmap "kube-rbac-proxy" not found Oct 30 22:07:38.031121 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.031103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:38.031266 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:38.031249 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:38.031342 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:38.031307 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.031292363 +0000 UTC m=+38.198083542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:38.060502 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.060470 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h64c\" (UniqueName: \"kubernetes.io/projected/66704037-d682-431e-b477-c0010e52e84d-kube-api-access-5h64c\") pod \"migrator-66df5d496b-xpld5\" (UID: \"66704037-d682-431e-b477-c0010e52e84d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5" Oct 30 22:07:38.081628 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.081575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5" Oct 30 22:07:38.434587 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.434552 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5"] Oct 30 22:07:38.444467 ip-10-0-137-160 kubenswrapper[2578]: W1030 22:07:38.444435 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66704037_d682_431e_b477_c0010e52e84d.slice/crio-4a8099d35f285705698d342224f2abaf3929309b2e113783320d0d3a48ede583 WatchSource:0}: Error finding container 4a8099d35f285705698d342224f2abaf3929309b2e113783320d0d3a48ede583: Status 404 returned error can't find the container with id 4a8099d35f285705698d342224f2abaf3929309b2e113783320d0d3a48ede583 Oct 30 22:07:38.456715 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.456690 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:38.564168 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.564124 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb" event={"ID":"abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6","Type":"ContainerStarted","Data":"999e08f86ea6c16d2bb29ba432c25ab07071ca6662bb4736bd20c987c0a97f35"} Oct 30 22:07:38.566916 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.566884 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/1.log" Oct 30 22:07:38.567440 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.567286 2578 scope.go:122] "RemoveContainer" containerID="f0f390cd89e84ede353cec463599d4716a38f1d9a494c9512f4a6a44c7a28b84" Oct 30 22:07:38.567542 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:38.567469 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8ddx2_openshift-console-operator(ff224fb4-ef29-4599-aca1-38595e23d592)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" podUID="ff224fb4-ef29-4599-aca1-38595e23d592" Oct 30 22:07:38.568677 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.568647 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5" event={"ID":"66704037-d682-431e-b477-c0010e52e84d","Type":"ContainerStarted","Data":"4a8099d35f285705698d342224f2abaf3929309b2e113783320d0d3a48ede583"} Oct 30 22:07:38.570632 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.570542 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qg8m6" event={"ID":"2996b6af-d6da-494d-b7d9-219a40969a19","Type":"ContainerStarted","Data":"5dff3d1e91addb7243b8ff1536315ec0828323f85bf9565bd6539e19534857d7"} Oct 30 22:07:38.601765 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.601714 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb" podStartSLOduration=375.652798538 podStartE2EDuration="6m21.601699007s" totalImagesPullingTime="5.948900469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:38.600552899 +0000 UTC m=+37.767344096" watchObservedRunningTime="2026-10-30 22:07:38.601699007 +0000 UTC m=+37.768490205" Oct 30 22:07:38.606763 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.606731 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:38.646249 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:38.646207 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qg8m6" podStartSLOduration=1.7277390929999998 podStartE2EDuration="7.646190704s" totalImagesPullingTime="5.918451611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:38.644068023 +0000 UTC m=+37.810859222" watchObservedRunningTime="2026-10-30 22:07:38.646190704 +0000 UTC m=+37.812981903" Oct 30 22:07:39.042125 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.042079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:39.042313 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.042224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:39.042313 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.042292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:39.042463 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.042442 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:39.042534 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.042512 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:41.042492861 +0000 UTC m=+40.209284049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:39.042918 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.042900 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:07:39.043000 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.042954 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:41.042939139 +0000 UTC m=+40.209730322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : configmap "kube-rbac-proxy" not found Oct 30 22:07:39.043042 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.043017 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:39.043081 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.043049 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls podName:9d369819-d29c-48a6-b03b-41f2145bac41 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.043039074 +0000 UTC m=+46.209830253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xvqph" (UID: "9d369819-d29c-48a6-b03b-41f2145bac41") : secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:39.100219 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.100117 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.143631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.143748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.143841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.143908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.143969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.144118 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.144175 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls podName:c1bc2f81-1e3d-426a-a25f-829a30545dc6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.144157757 +0000 UTC m=+46.310948939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-qsf8j" (UID: "c1bc2f81-1e3d-426a-a25f-829a30545dc6") : secret "samples-operator-tls" not found Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.144510 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.144527 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589dd864bc-k9hqj: secret "image-registry-tls" not found Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.144564 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls podName:5ca11ae4-ddf1-49bb-b9fe-fe708bdea984 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.14455136 +0000 UTC m=+46.311342535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls") pod "image-registry-589dd864bc-k9hqj" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984") : secret "image-registry-tls" not found Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.144634 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.144677 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert podName:d72a205f-a6c2-4510-989f-cfd6c8aa045d nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.144664474 +0000 UTC m=+46.311455657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-mmh7p" (UID: "d72a205f-a6c2-4510-989f-cfd6c8aa045d") : secret "networking-console-plugin-cert" not found Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.144738 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.144768 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.144757104 +0000 UTC m=+46.311548282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : secret "router-metrics-certs-default" not found Oct 30 22:07:39.144866 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.144827 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.144817905 +0000 UTC m=+46.311609085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : configmap references non-existent config key: service-ca.crt Oct 30 22:07:39.244458 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.244431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:39.244653 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.244587 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:39.244653 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.244624 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d566bbdf8-jn8p4: secret "image-registry-tls" not found Oct 30 22:07:39.244653 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.244623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:39.244790 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.244682 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls podName:b62a4890-77fb-4ee6-b710-aadb9a5b9463 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.244665171 +0000 UTC m=+46.411456348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls") pod "image-registry-6d566bbdf8-jn8p4" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463") : secret "image-registry-tls" not found Oct 30 22:07:39.244790 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.244692 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:39.244790 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:39.244723 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls podName:9cab6006-eafd-41a7-8035-22dfb992b4e6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.244715779 +0000 UTC m=+46.411506981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls") pod "dns-default-7vvjk" (UID: "9cab6006-eafd-41a7-8035-22dfb992b4e6") : secret "dns-default-metrics-tls" not found Oct 30 22:07:39.576332 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.575946 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4pd2j" event={"ID":"8b9da187-50be-45aa-9ddd-e49ce94ea488","Type":"ContainerStarted","Data":"4957b0c16ed5eeb1c77a7513af04bd5fbafa97e4da5a8604dd06d08c53886391"} Oct 30 22:07:39.576332 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.576036 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:39.613178 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.613134 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4pd2j" podStartSLOduration=34.871288175 podStartE2EDuration="38.613120493s" totalImagesPullingTime="3.741832318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:39.611829947 +0000 UTC m=+38.778621150" watchObservedRunningTime="2026-10-30 22:07:39.613120493 +0000 UTC m=+38.779911690" Oct 30 22:07:39.641065 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:39.641038 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:40.580775 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:40.580740 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5" event={"ID":"66704037-d682-431e-b477-c0010e52e84d","Type":"ContainerStarted","Data":"5aaff5e5832e63f65d8e4b7da3e6dd4b429e80ca7f108633428abe25b7e78075"} Oct 30 22:07:40.618898 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:40.617488 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5" podStartSLOduration=2.117526472 podStartE2EDuration="3.617455999s" totalImagesPullingTime="1.499929527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:40.616775438 +0000 UTC m=+39.783566637" watchObservedRunningTime="2026-10-30 22:07:40.617455999 +0000 UTC m=+39.784247198" Oct 30 22:07:41.062411 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:41.062376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:41.062588 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:41.062476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:41.062588 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:41.062554 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:41.062705 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:41.062594 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:07:41.062705 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:41.062647 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:45.062626671 +0000 UTC m=+44.229417851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:41.062705 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:41.062667 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:45.062657633 +0000 UTC m=+44.229448816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : configmap "kube-rbac-proxy" not found Oct 30 22:07:41.676205 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:41.676177 2578 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:41.676565 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:41.676237 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:41.676647 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:41.676632 2578 scope.go:122] "RemoveContainer" containerID="f0f390cd89e84ede353cec463599d4716a38f1d9a494c9512f4a6a44c7a28b84" Oct 30 22:07:41.676826 ip-10-0-137-160 kubenswrapper[2578]: E1030 22:07:41.676803 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8ddx2_openshift-console-operator(ff224fb4-ef29-4599-aca1-38595e23d592)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" podUID="ff224fb4-ef29-4599-aca1-38595e23d592" Oct 30 22:07:41.866667 ip-10-0-137-160 kubenswrapper[2578]: I1030 22:07:41.866508 2578 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:41.866688 ip-10-0-137-160 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 22:07:41.877993 ip-10-0-137-160 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 22:07:41.878156 ip-10-0-137-160 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 22:07:41.878205 ip-10-0-137-160 systemd[1]: kubelet.service: Consumed 2.890s CPU time. Oct 30 22:07:41.889208 ip-10-0-137-160 systemd[1]: Starting Kubernetes Kubelet... Oct 30 22:07:41.990489 ip-10-0-137-160 kubenswrapper[4933]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:41.990489 ip-10-0-137-160 kubenswrapper[4933]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 22:07:41.990489 ip-10-0-137-160 kubenswrapper[4933]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:41.990982 ip-10-0-137-160 kubenswrapper[4933]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:41.993117 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993042 4933 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:41.993117 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993117 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993122 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993126 4933 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993129 4933 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993131 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993135 4933 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993137 4933 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993141 4933 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993144 4933 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993147 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993149 4933 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993152 4933 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993155 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993158 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993161 4933 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993163 4933 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993166 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993169 4933 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993171 4933 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:41.993199 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993174 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993177 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993180 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993182 4933 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993185 4933 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993187 4933 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993190 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993193 4933 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993196 4933 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993199 4933 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993203 4933 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993211 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993215 4933 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993218 4933 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993221 4933 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993224 4933 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993227 4933 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993229 4933 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993232 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:41.993694 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993235 4933 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993237 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993240 4933 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993243 4933 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993245 4933 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993248 4933 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993251 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993253 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993256 4933 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993258 4933 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993262 4933 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993264 4933 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993267 4933 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993275 4933 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993278 4933 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993282 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993285 4933 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993289 4933 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993293 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:41.994167 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993296 4933 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993300 4933 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993303 4933 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993306 4933 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993309 4933 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993311 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993314 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993317 4933 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993319 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993322 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993325 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993327 4933 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993330 4933 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993332 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993335 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993338 4933 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993341 4933 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993343 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993346 4933 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:41.994659 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993349 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993352 4933 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993354 4933 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993357 4933 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993361 4933 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993363 4933 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993366 4933 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993369 4933 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993372 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993375 4933 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993378 4933 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993381 4933 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993384 4933 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993386 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993389 4933 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993391 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993394 4933 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993397 4933 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993399 4933 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993402 4933 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:41.995161 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993404 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993407 4933 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993410 4933 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993412 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993415 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993417 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993421 4933 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993424 4933 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.993426 4933 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994213 4933 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994221 4933 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994224 4933 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994228 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994231 4933 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994234 4933 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994238 4933 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994242 4933 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994246 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994249 4933 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994252 4933 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:41.995675 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994255 4933 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994259 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994262 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994265 4933 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994268 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994270 4933 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994273 4933 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994276 4933 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994278 4933 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994281 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994284 4933 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994287 4933 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994290 4933 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994292 4933 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994295 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994298 4933 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994300 4933 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994303 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994305 4933 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994308 4933 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:41.996204 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994310 4933 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994313 4933 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994316 4933 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994318 4933 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994321 4933 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994324 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994326 4933 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994329 4933 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994332 4933 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994335 4933 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994338 4933 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994341 4933 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994344 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994347 4933 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994349 4933 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994352 4933 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994355 4933 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994358 4933 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994361 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994363 4933 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:41.996724 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994366 4933 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994369 4933 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994371 4933 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994374 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994377 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994380 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994382 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994385 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994387 4933 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994390 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994392 4933 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994395 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994398 4933 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994400 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994403 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994406 4933 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994408 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994411 4933 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994413 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994416 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:41.997216 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994419 4933 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994422 4933 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994425 4933 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994428 4933 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994431 4933 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994434 4933 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994437 4933 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994439 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994442 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994445 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994447 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994450 4933 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994453 4933 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994455 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994458 4933 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994461 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994463 4933 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994466 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994468 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:41.997746 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994472 4933 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994477 4933 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994480 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994483 4933 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994486 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994488 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994491 4933 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994493 4933 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994496 4933 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994499 4933 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994501 4933 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994504 4933 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994507 4933 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994510 4933 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994514 4933 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.994517 4933 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995054 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995061 4933 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995065 4933 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:41.998224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995069 4933 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995073 4933 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995076 4933 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995079 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995082 4933 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995085 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995088 4933 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995090 4933 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995093 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995096 4933 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995099 4933 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995102 4933 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995104 4933 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995107 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995110 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995112 4933 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995115 4933 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995118 4933 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995120 4933 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995125 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:41.998716 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995128 4933 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995130 4933 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995133 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995136 4933 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995138 4933 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995141 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995143 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995150 4933 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995152 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995155 4933 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995158 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995161 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995164 4933 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995167 4933 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995170 4933 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995172 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995175 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995178 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995181 4933 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995183 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:41.999282 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995186 4933 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995189 4933 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995191 4933 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995194 4933 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995196 4933 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995199 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995202 4933 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995204 4933 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995207 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995209 4933 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995212 4933 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995216 4933 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995219 4933 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995222 4933 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995225 4933 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995227 4933 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995230 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995232 4933 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995235 4933 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995239 4933 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:41.999821 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995242 4933 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995244 4933 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995247 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995250 4933 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995253 4933 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995255 4933 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995258 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995261 4933 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995264 4933 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995266 4933 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995269 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995272 4933 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995274 4933 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995277 4933 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995279 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995282 4933 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995284 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995287 4933 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995290 4933 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:42.000316 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995292 4933 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995295 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995298 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995300 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995303 4933 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995306 4933 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995309 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995313 4933 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995317 4933 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995319 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995322 4933 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995325 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995329 4933 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995332 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995334 4933 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995337 4933 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995340 4933 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995343 4933 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:42.000822 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995346 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995349 4933 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995351 4933 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995354 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995357 4933 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.995359 4933 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995452 4933 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995466 4933 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995472 4933 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995477 4933 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995482 4933 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995485 4933 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995489 4933 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995494 4933 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995498 4933 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995501 4933 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995504 4933 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995507 4933 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995511 4933 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995514 4933 flags.go:64] FLAG: --cgroup-root="" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995517 4933 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995520 4933 flags.go:64] FLAG: --client-ca-file="" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995522 4933 flags.go:64] FLAG: --cloud-provider="external" Oct 30 22:07:42.001258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995526 4933 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995530 4933 flags.go:64] FLAG: --cluster-domain="" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995533 4933 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995537 4933 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995540 4933 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995544 4933 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995548 4933 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995551 4933 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995554 4933 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995558 4933 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995561 4933 flags.go:64] FLAG: --contention-profiling="false" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995564 4933 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995567 4933 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995570 4933 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995573 4933 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995578 4933 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995581 4933 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995584 4933 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995587 4933 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995590 4933 flags.go:64] FLAG: --enable-server="true" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995593 4933 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995598 4933 flags.go:64] FLAG: --event-burst="100" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995613 4933 flags.go:64] FLAG: --event-qps="50" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995617 4933 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 22:07:42.001858 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995620 4933 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995623 4933 flags.go:64] FLAG: --eviction-hard="" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995628 4933 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995631 4933 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995634 4933 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995637 4933 flags.go:64] FLAG: --eviction-soft="" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995641 4933 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995643 4933 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995646 4933 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995649 4933 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995652 4933 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995657 4933 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995660 4933 flags.go:64] FLAG: --feature-gates="" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995664 4933 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995667 4933 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995670 4933 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995673 4933 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995676 4933 flags.go:64] FLAG: --healthz-port="10248" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995680 4933 flags.go:64] FLAG: --help="false" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995683 4933 flags.go:64] FLAG: --hostname-override="ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995687 4933 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995691 4933 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995695 4933 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995698 4933 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 22:07:42.002495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995701 4933 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995704 4933 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995707 4933 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995710 4933 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995714 4933 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995717 4933 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995720 4933 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995723 4933 flags.go:64] FLAG: --kube-reserved="" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995726 4933 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995729 4933 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995732 4933 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995735 4933 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995738 4933 flags.go:64] FLAG: --lock-file="" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995741 4933 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995743 4933 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995747 4933 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995753 4933 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995755 4933 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995759 4933 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995764 4933 flags.go:64] FLAG: --logging-format="text" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995767 4933 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995770 4933 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995773 4933 flags.go:64] FLAG: --manifest-url="" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995776 4933 flags.go:64] FLAG: --manifest-url-header="" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995780 4933 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 22:07:42.003180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995783 4933 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995788 4933 flags.go:64] FLAG: --max-pods="110" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995791 4933 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995794 4933 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995798 4933 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995801 4933 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995805 4933 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995807 4933 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995810 4933 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995817 4933 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995820 4933 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995823 4933 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995826 4933 flags.go:64] FLAG: --pod-cidr="" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995829 4933 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995832 4933 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995835 4933 flags.go:64] FLAG: --pods-per-core="0" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995838 4933 flags.go:64] FLAG: --port="10250" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995841 4933 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995844 4933 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c45fe242508b4522" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995847 4933 flags.go:64] FLAG: --qos-reserved="" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995850 4933 flags.go:64] FLAG: --read-only-port="10255" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995853 4933 flags.go:64] FLAG: --register-node="true" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995856 4933 flags.go:64] FLAG: --register-with-taints="" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995860 4933 flags.go:64] FLAG: --registry-burst="10" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995863 4933 flags.go:64] FLAG: --registry-qps="5" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995865 4933 flags.go:64] FLAG: --reserved-cpus="" Oct 30 22:07:42.012020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995870 4933 flags.go:64] FLAG: --reserved-memory="" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995873 4933 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995877 4933 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995880 4933 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995883 4933 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995886 4933 flags.go:64] FLAG: --runonce="false" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995889 4933 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995892 4933 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995895 4933 flags.go:64] FLAG: --seccomp-default="false" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995904 4933 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995908 4933 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995911 4933 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995914 4933 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995917 4933 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995920 4933 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995923 4933 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995926 4933 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995929 4933 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995932 4933 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995935 4933 flags.go:64] FLAG: --system-cgroups="" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995938 4933 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995944 4933 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995947 4933 flags.go:64] FLAG: --tls-cert-file="" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995950 4933 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995954 4933 flags.go:64] FLAG: --tls-min-version="" Oct 30 22:07:42.012703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995957 4933 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995960 4933 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995963 4933 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995966 4933 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995969 4933 flags.go:64] FLAG: --v="2" Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995973 4933 flags.go:64] FLAG: --version="false" Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995977 4933 flags.go:64] FLAG: --vmodule="" Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995983 4933 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.995986 4933 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996129 4933 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996134 4933 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996138 4933 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996141 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996144 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996147 4933 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996149 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996152 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996165 4933 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996168 4933 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996171 4933 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996173 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:42.013332 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996176 4933 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996179 4933 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996182 4933 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996185 4933 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996187 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996190 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996193 4933 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996195 4933 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996198 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996206 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996211 4933 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996215 4933 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996218 4933 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996221 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996224 4933 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996226 4933 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996229 4933 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996231 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996235 4933 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:42.013945 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996238 4933 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996241 4933 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996244 4933 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996246 4933 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996249 4933 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996252 4933 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996254 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996257 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996260 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996264 4933 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996273 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996276 4933 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996278 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996281 4933 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996284 4933 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996288 4933 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996292 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996295 4933 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996298 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996301 4933 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:42.014587 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996304 4933 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996307 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996310 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996313 4933 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996315 4933 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996318 4933 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996320 4933 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996323 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996326 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996328 4933 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996331 4933 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996335 4933 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996338 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996340 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996343 4933 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996346 4933 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996349 4933 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996351 4933 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996354 4933 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996357 4933 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:42.015120 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996359 4933 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996363 4933 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996366 4933 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996374 4933 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996377 4933 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996380 4933 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996382 4933 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996385 4933 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996388 4933 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996390 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996393 4933 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996395 4933 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996398 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996400 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996403 4933 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996405 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996408 4933 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996411 4933 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996413 4933 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996416 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:42.015618 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996418 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996421 4933 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996424 4933 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996427 4933 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996430 4933 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996433 4933 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996435 4933 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996438 4933 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996441 4933 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996444 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996446 4933 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996449 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996452 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996455 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996458 4933 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:42.016103 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:41.996485 4933 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996522 4933 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996526 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996529 4933 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996532 4933 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996534 4933 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996537 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996539 4933 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996542 4933 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996545 4933 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996547 4933 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996550 4933 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996553 4933 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996556 4933 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996558 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996561 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996564 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996566 4933 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996569 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996572 4933 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:42.016487 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996574 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996578 4933 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996581 4933 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996585 4933 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996590 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996592 4933 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996595 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996598 4933 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996601 4933 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996614 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996619 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996621 4933 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996624 4933 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996627 4933 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996630 4933 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996633 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996636 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996638 4933 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996641 4933 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996644 4933 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:42.017041 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996647 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996649 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996652 4933 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996655 4933 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996658 4933 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996660 4933 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996663 4933 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996665 4933 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996669 4933 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996671 4933 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996674 4933 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996677 4933 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996679 4933 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996683 4933 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996686 4933 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996689 4933 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996692 4933 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996694 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996697 4933 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996699 4933 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:42.017571 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996702 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996705 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996708 4933 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996711 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996714 4933 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996716 4933 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996719 4933 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996722 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996725 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996728 4933 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996731 4933 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996733 4933 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996736 4933 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996739 4933 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996742 4933 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996745 4933 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996748 4933 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996750 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996753 4933 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:42.018087 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996756 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996758 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996761 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996764 4933 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996766 4933 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996769 4933 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996773 4933 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996775 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996778 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996781 4933 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996783 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996786 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996788 4933 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996791 4933 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996794 4933 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996797 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996800 4933 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996802 4933 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996805 4933 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:42.018561 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996808 4933 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996810 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996816 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996819 4933 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996822 4933 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996825 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996827 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996832 4933 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:41.996836 4933 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.000482 4933 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.000497 4933 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.000515 4933 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.000520 4933 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000577 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000582 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000586 4933 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000590 4933 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000594 4933 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000597 4933 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:42.019066 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000600 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000618 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000622 4933 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000625 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000628 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000630 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000633 4933 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000636 4933 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000638 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000642 4933 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000645 4933 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000647 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000650 4933 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000653 4933 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000655 4933 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000658 4933 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000661 4933 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000663 4933 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000666 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000668 4933 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:42.019840 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000671 4933 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000673 4933 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000677 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000680 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000683 4933 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000685 4933 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000688 4933 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000691 4933 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000694 4933 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000696 4933 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000699 4933 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000702 4933 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000705 4933 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000707 4933 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000710 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000713 4933 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000715 4933 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000718 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000721 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000723 4933 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:42.020765 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000726 4933 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000729 4933 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000732 4933 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000735 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000737 4933 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000740 4933 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000743 4933 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000745 4933 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000748 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000750 4933 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000753 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000756 4933 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000758 4933 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000761 4933 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000764 4933 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000766 4933 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000769 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000772 4933 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000775 4933 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:42.021565 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000777 4933 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000780 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000782 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000786 4933 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000788 4933 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000791 4933 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000794 4933 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000797 4933 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000799 4933 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000802 4933 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000804 4933 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000807 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000809 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000812 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000815 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000818 4933 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000820 4933 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000823 4933 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000826 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:42.022319 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000829 4933 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000832 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000835 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000838 4933 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000840 4933 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000843 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000845 4933 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000848 4933 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000851 4933 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000855 4933 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000860 4933 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000864 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000868 4933 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000871 4933 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000874 4933 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000878 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000881 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000884 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000887 4933 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:42.023155 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000890 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000892 4933 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.000895 4933 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.000923 4933 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001056 4933 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001060 4933 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001063 4933 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001066 4933 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001069 4933 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001071 4933 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001074 4933 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001076 4933 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001079 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001082 4933 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001084 4933 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001087 4933 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:42.023985 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001090 4933 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001092 4933 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001095 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001098 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001101 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001103 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001106 4933 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001109 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001111 4933 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001114 4933 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001117 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001119 4933 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001122 4933 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001125 4933 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001127 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001131 4933 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001134 4933 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001140 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001143 4933 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:42.024666 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001145 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001148 4933 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001151 4933 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001153 4933 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001156 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001159 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001161 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001164 4933 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001167 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001169 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001172 4933 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001174 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001177 4933 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001180 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001182 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001185 4933 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001187 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001190 4933 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001192 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:42.025511 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001195 4933 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001198 4933 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001200 4933 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001203 4933 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001206 4933 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001209 4933 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001211 4933 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001214 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001217 4933 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001219 4933 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001222 4933 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001226 4933 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001229 4933 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001232 4933 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001235 4933 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001237 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001240 4933 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001243 4933 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001245 4933 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001248 4933 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:42.026286 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001250 4933 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001253 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001256 4933 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001259 4933 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001262 4933 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001265 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001268 4933 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001271 4933 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001273 4933 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001276 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001279 4933 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001282 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001284 4933 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001287 4933 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001290 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001292 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001295 4933 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001298 4933 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001302 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:42.026847 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001305 4933 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001308 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001311 4933 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001315 4933 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001319 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001322 4933 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001325 4933 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001327 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001330 4933 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001333 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001335 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001338 4933 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001341 4933 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001343 4933 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001346 4933 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001349 4933 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:42.027385 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001351 4933 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.001373 4933 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001403 4933 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001407 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001410 4933 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001413 4933 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001416 4933 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001418 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001421 4933 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001424 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001426 4933 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001429 4933 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001432 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001434 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001437 4933 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001440 4933 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:42.027788 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001445 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001448 4933 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001450 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001453 4933 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001457 4933 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001461 4933 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001465 4933 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001467 4933 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001470 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001473 4933 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001475 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001478 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001481 4933 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001484 4933 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001487 4933 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001489 4933 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001492 4933 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001494 4933 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001497 4933 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:42.028207 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001499 4933 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001502 4933 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001505 4933 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001508 4933 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001510 4933 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001513 4933 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001515 4933 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001518 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001521 4933 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001523 4933 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001526 4933 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001529 4933 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001532 4933 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001538 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001541 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001544 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001547 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001550 4933 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001552 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001555 4933 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:42.028735 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001557 4933 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001560 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001563 4933 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001565 4933 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001568 4933 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001571 4933 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001575 4933 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001578 4933 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001581 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001584 4933 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001587 4933 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001590 4933 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001593 4933 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001595 4933 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001598 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001601 4933 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001624 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001628 4933 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001632 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:42.029225 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001636 4933 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001641 4933 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001644 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001647 4933 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001650 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001652 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001658 4933 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001661 4933 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001664 4933 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001667 4933 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001670 4933 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001672 4933 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001675 4933 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001678 4933 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001680 4933 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001683 4933 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001685 4933 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001688 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001691 4933 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001693 4933 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:42.029881 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001696 4933 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001698 4933 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001701 4933 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001704 4933 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001706 4933 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001709 4933 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001712 4933 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001714 4933 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001717 4933 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001719 4933 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001722 4933 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001725 4933 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001727 4933 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:42.001730 4933 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.001777 4933 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.002690 4933 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.002747 4933 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.002932 4933 server.go:1014] "Starting client certificate rotation" Oct 30 22:07:42.030905 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.003083 4933 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 22:07:42.030075 ip-10-0-137-160 systemd[1]: Started Kubernetes Kubelet. Oct 30 22:07:42.031843 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.003127 4933 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 22:02:01 +0000 UTC" deadline="2028-07-14 11:11:44.210520502 +0000 UTC" Oct 30 22:07:42.031843 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.003164 4933 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14941h4m2.207359911s" Oct 30 22:07:42.031843 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.003435 4933 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:42.031843 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.004460 4933 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:42.031843 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.006796 4933 log.go:25] "Validated CRI v1 runtime API" Oct 30 22:07:42.031843 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.008310 4933 log.go:25] "Validated CRI v1 image API" Oct 30 22:07:42.031843 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.009027 4933 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 22:07:42.031843 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.010727 4933 fs.go:135] Filesystem UUIDs: map[18d9ac7a-f98e-4ce1-9e60-7d7b5c2066d8:/dev/nvme0n1p4 39ab8db0-9390-434c-b65b-e8845074ebdb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Oct 30 22:07:42.032212 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.010747 4933 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0344587dba39c44964d44d9d952dcc37399de061971d438b73db9f8e43677378/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0344587dba39c44964d44d9d952dcc37399de061971d438b73db9f8e43677378/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/09bfed56642b460f0dde927193e805a62554680d1b5ec471a562f4a2522d5bd6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/09bfed56642b460f0dde927193e805a62554680d1b5ec471a562f4a2522d5bd6/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/28b749d0eb8c2ede23ce746a6cf43190a6f5c82b8cd9ccb7ade5b60f59fde710/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/28b749d0eb8c2ede23ce746a6cf43190a6f5c82b8cd9ccb7ade5b60f59fde710/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2b69377741ebae68692b68c0de1b3dc42a97418fe9bec59fec750527d6b2f225/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2b69377741ebae68692b68c0de1b3dc42a97418fe9bec59fec750527d6b2f225/userdata/shm major:0 minor:222 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2d99ef171932a836a703be94365c8b8894f95f10d4370051b43ffacea61c86b7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2d99ef171932a836a703be94365c8b8894f95f10d4370051b43ffacea61c86b7/userdata/shm major:0 minor:81 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/34806fda5d08e84bc3670d8e35ccbb3677b7e66a41c50b29d7bd20844cccd41a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/34806fda5d08e84bc3670d8e35ccbb3677b7e66a41c50b29d7bd20844cccd41a/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3de285584b902821f35702e8d3b3f489e5766581e7e581d41725c836dcdd5bc4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3de285584b902821f35702e8d3b3f489e5766581e7e581d41725c836dcdd5bc4/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4a8099d35f285705698d342224f2abaf3929309b2e113783320d0d3a48ede583/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4a8099d35f285705698d342224f2abaf3929309b2e113783320d0d3a48ede583/userdata/shm major:0 minor:336 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4ddeaf720c84acc8688e123c9eb023769d11dd04d1635634bcb5e56f6b3f1a53/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4ddeaf720c84acc8688e123c9eb023769d11dd04d1635634bcb5e56f6b3f1a53/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5841c4a514294a8b4697cc990a97da5c901867f702553a501bb6085bab17994e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5841c4a514294a8b4697cc990a97da5c901867f702553a501bb6085bab17994e/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6e59ffec8d8d73ad8787109fc9e6f100eeb2b3534027e988ce3e0942d437ca2b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6e59ffec8d8d73ad8787109fc9e6f100eeb2b3534027e988ce3e0942d437ca2b/userdata/shm major:0 minor:237 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/749984187b350d7660e19ddc86f01ac030d55c0e65bcf6c20d008b289ece953f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/749984187b350d7660e19ddc86f01ac030d55c0e65bcf6c20d008b289ece953f/userdata/shm major:0 minor:231 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7d405afeb3723c9d7c0f089fcd8070b73fe779bcc12d6e12644a61c3b70ba6df/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7d405afeb3723c9d7c0f089fcd8070b73fe779bcc12d6e12644a61c3b70ba6df/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7ecbcd6c93a848f6191e44c673fd7a323e7c856cdfcf5049fca41ea8c635dbaf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7ecbcd6c93a848f6191e44c673fd7a323e7c856cdfcf5049fca41ea8c635dbaf/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/83a1c624ac47413a56b8a03bb993c3eeeabe6e27b6dd4d4c39450ea36a1cff3d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/83a1c624ac47413a56b8a03bb993c3eeeabe6e27b6dd4d4c39450ea36a1cff3d/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/87875604efd44a926d80d586e7dbe308973ec745e297d4a52ff2fc6e0fd1b828/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/87875604efd44a926d80d586e7dbe308973ec745e297d4a52ff2fc6e0fd1b828/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/99298b05d860308f22f3e90bf96d6fb9a440e246a776224ae9e1c0547cd1f3c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/99298b05d860308f22f3e90bf96d6fb9a440e246a776224ae9e1c0547cd1f3c2/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a8d8062d3a6e126d66931020eeaead0a7317d28b108accea3f6fd07dc9a3bfd1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a8d8062d3a6e126d66931020eeaead0a7317d28b108accea3f6fd07dc9a3bfd1/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b0c260bec442176552228a90eef0da2724585a23835859630310e22ba3b7593a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b0c260bec442176552228a90eef0da2724585a23835859630310e22ba3b7593a/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bcf0827d259da3f93d4b4f1aef3ef2207c2fcc4a971deedb6e2a8a8f85266432/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bcf0827d259da3f93d4b4f1aef3ef2207c2fcc4a971deedb6e2a8a8f85266432/userdata/shm major:0 minor:97 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c11a12e3ea56788ee5a1ac99edfe71d668ec60630be0d1c24fcc0e61c3ceb88d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c11a12e3ea56788ee5a1ac99edfe71d668ec60630be0d1c24fcc0e61c3ceb88d/userdata/shm major:0 minor:226 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c7ba3898c132e56dc57faaeb7f835732010a7ad25c7356498be8211c24ceae74/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c7ba3898c132e56dc57faaeb7f835732010a7ad25c7356498be8211c24ceae74/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d6e8d1b70ccee7d87d19342eb24ea3bc0d3b1e4dd86eddfc9e302a9d2225c3d4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d6e8d1b70ccee7d87d19342eb24ea3bc0d3b1e4dd86eddfc9e302a9d2225c3d4/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2996b6af-d6da-494d-b7d9-219a40969a19/volumes/kubernetes.io~projected/kube-api-access-9w5zt:{mountpoint:/var/lib/kubelet/pods/2996b6af-d6da-494d-b7d9-219a40969a19/volumes/kubernetes.io~projected/kube-api-access-9w5zt major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2996b6af-d6da-494d-b7d9-219a40969a19/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/2996b6af-d6da-494d-b7d9-219a40969a19/volumes/kubernetes.io~secret/cert major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2be079bb-4896-4a19-8a9f-0313a9bffea8/volumes/kubernetes.io~projected/kube-api-access-j84fd:{mountpoint:/var/lib/kubelet/pods/2be079bb-4896-4a19-8a9f-0313a9bffea8/volumes/kubernetes.io~projected/kube-api-access-j84fd major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2be079bb-4896-4a19-8a9f-0313a9bffea8/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/2be079bb-4896-4a19-8a9f-0313a9bffea8/volumes/kubernetes.io~secret/serving-cert major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3748d1a1-641f-4259-84b0-a009feb248a8/volumes/kubernetes.io~projected/kube-api-access-96rhx:{mountpoint:/var/lib/kubelet/pods/3748d1a1-641f-4259-84b0-a009feb248a8/volumes/kubernetes.io~projected/kube-api-access-96rhx major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3748d1a1-641f-4259-84b0-a009feb248a8/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3748d1a1-641f-4259-84b0-a009feb248a8/volumes/kubernetes.io~secret/serving-cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3b707bb3-699a-42ba-a5a0-3a52077f1b13/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/3b707bb3-699a-42ba-a5a0-3a52077f1b13/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3b707bb3-699a-42ba-a5a0-3a52077f1b13/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/3b707bb3-699a-42ba-a5a0-3a52077f1b13/volumes/kubernetes.io~empty-dir/tmp major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3b707bb3-699a-42ba-a5a0-3a52077f1b13/volumes/kubernetes.io~projected/kube-api-access-cr4t5:{mountpoint:/var/lib/kubelet/pods/3b707bb3-699a-42ba-a5a0-3a52077f1b13/volumes/kubernetes.io~projected/kube-api-access-cr4t5 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3f904583-6409-4a27-b9b8-cf8e1167a0b4/volumes/kubernetes.io~projected/kube-api-access-lngqk:{mountpoint:/var/lib/kubelet/pods/3f904583-6409-4a27-b9b8-cf8e1167a0b4/volumes/kubernetes.io~projected/kube-api-access-lngqk major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/419fe0bc-c964-47f0-82fc-3c5d45969e63/volumes/kubernetes.io~projected/kube-api-access-8gnk2:{mountpoint:/var/lib/kubelet/pods/419fe0bc-c964-47f0-82fc-3c5d45969e63/volumes/kubernetes.io~projected/kube-api-access-8gnk2 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/43cebd0d-8293-4c7c-9469-4b211733bb79/volumes/kubernetes.io~projected/kube-api-access-v28td:{mountpoint:/var/lib/kubelet/pods/43cebd0d-8293-4c7c-9469-4b211733bb79/volumes/kubernetes.io~projected/kube-api-access-v28td major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a/volumes/kubernetes.io~projected/kube-api-access-dd58d:{mountpoint:/var/lib/kubelet/pods/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a/volumes/kubernetes.io~projected/kube-api-access-dd58d major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c8ed0be-6573-4bf7-aa93-572c5c0e4bce/volumes/kubernetes.io~projected/kube-api-access-659vs:{mountpoint:/var/lib/kubelet/pods/4c8ed0be-6573-4bf7-aa93-572c5c0e4bce/volumes/kubernetes.io~projected/kube-api-access-659vs major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33/volumes/kubernetes.io~projected/kube-api-access-4c8ps:{mountpoint:/var/lib/kubelet/pods/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33/volumes/kubernetes.io~projected/kube-api-access-4c8ps major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33/volumes/kubernetes.io~secret/default-certificate major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33/volumes/kubernetes.io~secret/stats-auth major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~projected/kube-api-access-f9rnk:{mountpoint:/var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~projected/kube-api-access-f9rnk major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/60d187ab-b86b-42f8-9bdb-2cdad6e6d518/volumes/kubernetes.io~projected/kube-api-access-mgkcb:{mountpoint:/var/lib/kubelet/pods/60d187ab-b86b-42f8-9bdb-2cdad6e6d518/volumes/kubernetes.io~projected/kube-api-access-mgkcb major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/60d187ab-b86b-42f8-9bdb-2cdad6e6d518/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/60d187ab-b86b-42f8-9bdb-2cdad6e6d518/volumes/kubernetes.io~secret/serving-cert major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/66704037-d682-431e-b477-c0010e52e84d/volumes/kubernetes.io~projected/kube-api-access-5h64c:{mountpoint:/var/lib/kubelet/pods/66704037-d682-431e-b477-c0010e52e84d/volumes/kubernetes.io~projected/kube-api-access-5h64c major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8005cfc5-780e-4ea3-898e-6a54e0f93158/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/8005cfc5-780e-4ea3-898e-6a54e0f93158/volumes/kubernetes.io~secret/agent-certs major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b9da187-50be-45aa-9ddd-e49ce94ea488/volumes/kubernetes.io~projected/kube-api-access-xvh29:{mountpoint:/var/lib/kubelet/pods/8b9da187-50be-45aa-9ddd-e49ce94ea488/volumes/kubernetes.io~projected/kube-api-access-xvh29 major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/960e184e-c2a7-4937-bf04-4c13a434883e/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/960e184e-c2a7-4937-bf04-4c13a434883e/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9cab6006-eafd-41a7-8035-22dfb992b4e6/volumes/kubernetes.io~projected/kube-api-access-qq6s6:{mountpoint:/var/lib/kubelet/pods/9cab6006-eafd-41a7-8035-22dfb992b4e6/volumes/kubernetes.io~projected/kube-api-access-qq6s6 major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d369819-d29c-48a6-b03b-41f2145bac41/volumes/kubernetes.io~projected/kube-api-access-blpzl:{mountpoint:/var/lib/kubelet/pods/9d369819-d29c-48a6-b03b-41f2145bac41/volumes/kubernetes.io~projected/kube-api-access-blpzl major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5048872-d721-4990-99e1-6ccb43420b31/volumes/kubernetes.io~projected/kube-api-access-lgw9r:{mountpoint:/var/lib/kubelet/pods/a5048872-d721-4990-99e1-6ccb43420b31/volumes/kubernetes.io~projected/kube-api-access-lgw9r major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5ad1eec-94bf-43a5-9541-9415db456d26/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/a5ad1eec-94bf-43a5-9541-9415db456d26/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5ad1eec-94bf-43a5-9541-9415db456d26/volumes/kubernetes.io~projected/kube-api-access-c7nl4:{mountpoint:/var/lib/kubelet/pods/a5ad1eec-94bf-43a5-9541-9415db456d26/volumes/kubernetes.io~projected/kube-api-access-c7nl4 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5ad1eec-94bf-43a5-9541-9415db456d26/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/a5ad1eec-94bf-43a5-9541-9415db456d26/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a918696f-7dcd-4942-bbe2-1f59aaf991fe/volumes/kubernetes.io~projected/kube-api-access-4qc7s:{mountpoint:/var/lib/kubelet/pods/a918696f-7dcd-4942-bbe2-1f59aaf991fe/volumes/kubernetes.io~projected/kube-api-access-4qc7s major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6/volumes/kubernetes.io~projected/kube-api-access-jmfv7:{mountpoint:/var/lib/kubelet/pods/abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6/volumes/kubernetes.io~projected/kube-api-access-jmfv7 major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:238 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~projected/kube-api-access-bjdb8:{mountpoint:/var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~projected/kube-api-access-bjdb8 major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1bc2f81-1e3d-426a-a25f-829a30545dc6/volumes/kubernetes.io~projected/kube-api-access-n25r6:{mountpoint:/var/lib/kubelet/pods/c1bc2f81-1e3d-426a-a25f-829a30545dc6/volumes/kubernetes.io~projected/kube-api-access-n25r6 major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d0f6b5a3-7817-41b8-800b-3cfeb03c5528/volumes/kubernetes.io~projected/kube-api-access-brgrm:{mountpoint:/var/lib/kubelet/pods/d0f6b5a3-7817-41b8-800b-3cfeb03c5528/volumes/kubernetes.io~projected/kube-api-access-brgrm major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f0f427f4-1c06-4556-8645-8932bcd7b653/volumes/kubernetes.io~projected/kube-api-access-4fwn8:{mountpoint:/var/lib/kubelet/pods/f0f427f4-1c06-4556-8645-8932bcd7b653/volumes/kubernetes.io~projected/kube-api-access-4fwn8 major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4714c47-8079-4533-afaf-dfc3ff0f01f3/volumes/kubernetes.io~projected/kube-api-access-z6t9q:{mountpoint:/var/lib/kubelet/pods/f4714c47-8079-4533-afaf-dfc3ff0f01f3/volumes/kubernetes.io~projected/kube-api-access-z6t9q major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f4d718cb-d755-4824-94f5-298a3411b7e5/volumes/kubernetes.io~projected/kube-api-access-npr97:{mountpoint:/var/lib/kubelet/pods/f4d718cb-d755-4824-94f5-298a3411b7e5/volumes/kubernetes.io~projected/kube-api-access-npr97 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f9ef3359-4ffd-4a26-889a-8f516ef1970a/volumes/kubernetes.io~projected/kube-api-access-745bl:{mountpoint:/var/lib/kubelet/pods/f9ef3359-4ffd-4a26-889a-8f516ef1970a/volumes/kubernetes.io~projected/kube-api-access-745bl major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ff224fb4-ef29-4599-aca1-38595e23d592/volumes/kubernetes.io~projected/kube-api-access-7ttn9:{mountpoint:/var/lib/kubelet/pods/ff224fb4-ef29-4599-aca1-38595e23d592/volumes/kubernetes.io~projected/kube-api-access-7ttn9 major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ff224fb4-ef29-4599-aca1-38595e23d592/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ff224fb4-ef29-4599-aca1-38595e23d592/volumes/kubernetes.io~secret/serving-cert major:0 minor:209 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/de41d804d81c08de6e9a38b46c15daf4c835aa367160222ff229142a78f4acd2/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/10b1137596363e01a062f7d2e70280c64adf51b6bdd753a69719e495cc965847/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/addb6ae49e3ec11152e3a849f842aaefd464dc85b1cd174b59dc520c9c520825/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-108:{mountpoint:/var/lib/containers/storage/overlay/cae54b65c378dc2a5c120f1c809f28d8fbf487877e75898cadc480781e9822b8/merged major:0 minor:108 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/723d5095da02ae6b1b515eef5da3a725361215c5e25a9e9cf747d838c82ec15e/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/4a6bacb32e35e992d26fe99d28de0ea0a1e73d85a40f0313c30f7bfde6d32e58/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/9f6b097ee07a91d287da20d09242f2f61b272dd9fde91d85f1b6ee732701242d/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/dbce5705c8ad6258545c0cb87f61021aae8ced2eeb3718e7b274a5d5304321c3/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/15459404678aedd4010f0887e20c40e5f94f8eb740183fcfd4bb9f9443921ced/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/be5d1893b4aa90fbd7255823574ce58b307456dac4f08e6283a77ffd2a7ffe8d/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/f44e5fb3b09243c7f787cd56b8f008f9ab517a8db74decb5717a836648675c14/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/669c30a7f5d156cfcaa8d0054767f56319876ea6484fde5a8cf4cb6bcb9946cd/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/b54bf58c3b62480d8aab2009d4ddcc789d536e063260612d7f749d63b327e392/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/b89268fdd8bcd2aeaf91ff687cd47b3926a168a93f9c91e8b2b5f5d9963ec774/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/1cfea39d00ce4cbb90e7e0e7e090635df9439f92640be78fa14a9946f8e7cf58/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/578e3b1fae3aed1039e9118cba666aa3dbfd5b807b40c2c536e8b5c33a765add/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/1124ffd1565df821585254a909bc2337f2ba4b25784152d82566146a2a3e299a/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/6519ebf9393ce62c9cb7eef585002c72fd075bd575de3e8980a439b3f82844ac/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/467acc4bcb1b7b19b78b20c4105f1e1944701c6309c9e9708f37b370f2d2ed7a/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/fff9eb87bb17a46659d3dbaddd0b23d21dafd173063b834a7537df6156a77772/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/0326187b5682bf313113bcfd8802e9c1f3f1caef46f90996356ce747052f1631/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/001eff6ce306f36a5883d1842fee143efa599ca5717d418c4463893f4875964e/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/aa05a01dfb83bc9c3024c3952e5b0a54966a4be03e4a7aaf1bfb104efcdf4d07/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/7aa9f6a34611a5d3a041436b9810611cb9b155bf832c10b5d657337a32252755/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/f7d2930595cf098598e3e0330d9cbe7b4e11971b2a8a7b72e253e990a1c1093e/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/fbca01498731dba0b446603efa13bf653982f5a844140043ab8e8183ed03098c/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/d8e9ecbed657d34604d37ce169ff307aef8c5749051532beb4232fcdea83ffc8/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/46d8583d11d5092cfa169878bf921344b2e929255cd4e52103977e3d17c823af/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/92fa7a0f79fe0001f93dd7e6d0622de3df757b2b5c46645255a8ab6dd1fb4e7c/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/c9640bf6e0774304be0a7b9e58735d28ad6208c53ed06e84c03a78987ebd6093/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/8288fcac5ca5c3c3b238af00c2fa5ef88916270b64645acdc792f7aab1f8afa8/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/66ac34a730daa0ddf5c98a32af66c6705fd723e51fc16edba609a4deabbb54f0/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/9ac593970aa63beb6625f5900f6f1dff78ac9bd7685e4d5e8805b3fcdad287c5/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/ab085a3782fa2e6355dbdd799aaaa18aa7ee45f02c4e3d016c50601ecf0c6876/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-285:{mountpoint:/var/lib/containers/storage/overlay/153ef978e8e0cb93a86f20492031f7cee36fbf337a3e826496ed2e235af29a4d/merged major:0 minor:285 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/467f93f9fef83219778400e414800539032b563557eeccd2b4bf218d9fd567b9/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/ba9d6b3f5cc97ad791b8113726e46f47403fe628ae8c5c5d3e616f29db682d48/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/73e7af45935242add0679950b484fad65ce85fa15b742e64f46724d2db2f105c/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/bce7babe62257cdd2ef5c4e916ae7551202e141bff1da5a97c9e511fe0bbd625/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/8e9fb1aa00519b6044b91092763ff5996c275d2144838da5911df9ec532ea575/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/004dad66a388a0f4e169ec004415fd6cea2e57fd56a73899232dfd8f7f26fb0b/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/ef1794c1d5339bae854ac9cb7adc89fa76f38c7961c98cf3fae3a6dc9cbd9275/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/b5a7917f9e3c2d9618b4b44932c24b1cc02060074a48db907820883d7a4e55c1/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/f9b0cf1d25a689d9117af5fc1ce8f3987663f2b91a128f40edee70f7ed098c9b/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/41c1b90be70ba93068bd72871bb0e868c445fc976bfc0fdf6a4703b70b265d89/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/e94e2d113d102d7526cc2219947e7ee85cbe31b81d10f492b16fa353a6ba7936/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/d0268647af40eea962913f7f9af169bd8de439202731a8f2efa40dfa3cf86d00/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/b786f46458a10f1fdc95c7801607b0fe604be68bdedc66a70541e61017ab8201/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/10fc88c7af6cb6c8b9adf0349b53570cc90f38d74c1da4db37a11ca20251e1da/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/ab4af24c32550bdfcf7c1791640c67f2fb2bd08dc2eec925064d9f9f26e9cacd/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/caf90de694d7058c33cacbfafe149b6f60d39ab32eb41128f508eff160cb7048/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-83:{mountpoint:/var/lib/containers/storage/overlay/5c5c4720e760c20b4279282da82aadfaf3319f58cff4736304d80a6434d6cb27/merged major:0 minor:83 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/3a0c26ed19600f684611de7c3cba4dbc51222590e48c36f96a3c31a082105376/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/b334aa7978b33e8f54d9412b11b16b58610faaad6c8b43b0ba75791efb0995ff/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/8ccd64ac9b3d82c4b00e52e51edcdf18273bb2eb216a5324a62b3d1aac1a6217/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/36a42be608f3a018d68b5e553a0d82407c61162a4b4a46bc5c89c6aaaab39147/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018033 4933 manager.go:217] Machine: {Timestamp:2026-10-30 22:07:42.017549978 +0000 UTC m=+0.088448746 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3123003 MemoryCapacity:33164324864 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe874e548ee62f3d962b9b45a599d SystemUUID:ec2fe874-e548-ee62-f3d9-62b9b45a599d BootID:1ecc3ca4-3220-43de-8275-45b0e6765ffe Filesystems:[{Device:/var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:214 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/99298b05d860308f22f3e90bf96d6fb9a440e246a776224ae9e1c0547cd1f3c2/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4ddeaf720c84acc8688e123c9eb023769d11dd04d1635634bcb5e56f6b3f1a53/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/3b707bb3-699a-42ba-a5a0-3a52077f1b13/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a8d8062d3a6e126d66931020eeaead0a7317d28b108accea3f6fd07dc9a3bfd1/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a/volumes/kubernetes.io~projected/kube-api-access-dd58d DeviceMajor:0 DeviceMinor:59 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d6e8d1b70ccee7d87d19342eb24ea3bc0d3b1e4dd86eddfc9e302a9d2225c3d4/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:228 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5841c4a514294a8b4697cc990a97da5c901867f702553a501bb6085bab17994e/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/a5ad1eec-94bf-43a5-9541-9415db456d26/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/4c8ed0be-6573-4bf7-aa93-572c5c0e4bce/volumes/kubernetes.io~projected/kube-api-access-659vs DeviceMajor:0 DeviceMinor:202 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/60d187ab-b86b-42f8-9bdb-2cdad6e6d518/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:208 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/f9ef3359-4ffd-4a26-889a-8f516ef1970a/volumes/kubernetes.io~projected/kube-api-access-745bl DeviceMajor:0 DeviceMinor:61 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/43cebd0d-8293-4c7c-9469-4b211733bb79/volumes/kubernetes.io~projected/kube-api-access-v28td DeviceMajor:0 DeviceMinor:203 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/c1bc2f81-1e3d-426a-a25f-829a30545dc6/volumes/kubernetes.io~projected/kube-api-access-n25r6 DeviceMajor:0 DeviceMinor:215 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/3748d1a1-641f-4259-84b0-a009feb248a8/volumes/kubernetes.io~projected/kube-api-access-96rhx DeviceMajor:0 DeviceMinor:217 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33/volumes/kubernetes.io~projected/kube-api-access-4c8ps DeviceMajor:0 DeviceMinor:221 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a5048872-d721-4990-99e1-6ccb43420b31/volumes/kubernetes.io~projected/kube-api-access-lgw9r DeviceMajor:0 DeviceMinor:67 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/83a1c624ac47413a56b8a03bb993c3eeeabe6e27b6dd4d4c39450ea36a1cff3d/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c7ba3898c132e56dc57faaeb7f835732010a7ad25c7356498be8211c24ceae74/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~projected/kube-api-access-f9rnk DeviceMajor:0 DeviceMinor:213 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8005cfc5-780e-4ea3-898e-6a54e0f93158/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:58 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/3b707bb3-699a-42ba-a5a0-3a52077f1b13/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:55 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2b69377741ebae68692b68c0de1b3dc42a97418fe9bec59fec750527d6b2f225/userdata/shm DeviceMajor:0 DeviceMinor:222 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/28b749d0eb8c2ede23ce746a6cf43190a6f5c82b8cd9ccb7ade5b60f59fde710/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a5ad1eec-94bf-43a5-9541-9415db456d26/volumes/kubernetes.io~projected/kube-api-access-c7nl4 DeviceMajor:0 DeviceMinor:63 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6/volumes/kubernetes.io~projected/kube-api-access-jmfv7 DeviceMajor:0 DeviceMinor:233 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d0f6b5a3-7817-41b8-800b-3cfeb03c5528/volumes/kubernetes.io~projected/kube-api-access-brgrm DeviceMajor:0 DeviceMinor:64 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-285 DeviceMajor:0 DeviceMinor:285 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-108 DeviceMajor:0 DeviceMinor:108 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/60d187ab-b86b-42f8-9bdb-2cdad6e6d518/volumes/kubernetes.io~projected/kube-api-access-mgkcb DeviceMajor:0 DeviceMinor:212 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/960e184e-c2a7-4937-bf04-4c13a434883e/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7d405afeb3723c9d7c0f089fcd8070b73fe779bcc12d6e12644a61c3b70ba6df/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582160384 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/87875604efd44a926d80d586e7dbe308973ec745e297d4a52ff2fc6e0fd1b828/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f4714c47-8079-4533-afaf-dfc3ff0f01f3/volumes/kubernetes.io~projected/kube-api-access-z6t9q DeviceMajor:0 DeviceMinor:60 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/09bfed56642b460f0dde927193e805a62554680d1b5ec471a562f4a2522d5bd6/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:210 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3de285584b902821f35702e8d3b3f489e5766581e7e581d41725c836dcdd5bc4/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/3b707bb3-699a-42ba-a5a0-3a52077f1b13/volumes/kubernetes.io~projected/kube-api-access-cr4t5 DeviceMajor:0 DeviceMinor:66 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:206 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/2996b6af-d6da-494d-b7d9-219a40969a19/volumes/kubernetes.io~projected/kube-api-access-9w5zt DeviceMajor:0 DeviceMinor:234 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/419fe0bc-c964-47f0-82fc-3c5d45969e63/volumes/kubernetes.io~projected/kube-api-access-8gnk2 DeviceMajor:0 DeviceMinor:62 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2996b6af-d6da-494d-b7d9-219a40969a19/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:230 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f0f427f4-1c06-4556-8645-8932bcd7b653/volumes/kubernetes.io~projected/kube-api-access-4fwn8 DeviceMajor:0 DeviceMinor:316 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a5ad1eec-94bf-43a5-9541-9415db456d26/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f4d718cb-d755-4824-94f5-298a3411b7e5/volumes/kubernetes.io~projected/kube-api-access-npr97 DeviceMajor:0 DeviceMinor:65 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/66704037-d682-431e-b477-c0010e52e84d/volumes/kubernetes.io~projected/kube-api-access-5h64c DeviceMajor:0 DeviceMinor:321 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2be079bb-4896-4a19-8a9f-0313a9bffea8/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:211 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/ff224fb4-ef29-4599-aca1-38595e23d592/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:209 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:207 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/2be079bb-4896-4a19-8a9f-0313a9bffea8/volumes/kubernetes.io~projected/kube-api-access-j84fd DeviceMajor:0 DeviceMinor:220 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b0c260bec442176552228a90eef0da2724585a23835859630310e22ba3b7593a/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0344587dba39c44964d44d9d952dcc37399de061971d438b73db9f8e43677378/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c11a12e3ea56788ee5a1ac99edfe71d668ec60630be0d1c24fcc0e61c3ceb88d/userdata/shm DeviceMajor:0 DeviceMinor:226 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:229 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6e59ffec8d8d73ad8787109fc9e6f100eeb2b3534027e988ce3e0942d437ca2b/userdata/shm DeviceMajor:0 DeviceMinor:237 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/8b9da187-50be-45aa-9ddd-e49ce94ea488/volumes/kubernetes.io~projected/kube-api-access-xvh29 DeviceMajor:0 DeviceMinor:293 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-83 DeviceMajor:0 DeviceMinor:83 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ff224fb4-ef29-4599-aca1-38595e23d592/volumes/kubernetes.io~projected/kube-api-access-7ttn9 DeviceMajor:0 DeviceMinor:219 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~projected/kube-api-access-bjdb8 DeviceMajor:0 DeviceMinor:235 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7ecbcd6c93a848f6191e44c673fd7a323e7c856cdfcf5049fca41ea8c635dbaf/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:238 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2d99ef171932a836a703be94365c8b8894f95f10d4370051b43ffacea61c86b7/userdata/shm DeviceMajor:0 DeviceMinor:81 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/3f904583-6409-4a27-b9b8-cf8e1167a0b4/volumes/kubernetes.io~projected/kube-api-access-lngqk DeviceMajor:0 DeviceMinor:45 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/34806fda5d08e84bc3670d8e35ccbb3677b7e66a41c50b29d7bd20844cccd41a/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bcf0827d259da3f93d4b4f1aef3ef2207c2fcc4a971deedb6e2a8a8f85266432/userdata/shm DeviceMajor:0 DeviceMinor:97 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9d369819-d29c-48a6-b03b-41f2145bac41/volumes/kubernetes.io~projected/kube-api-access-blpzl DeviceMajor:0 DeviceMinor:201 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/a918696f-7dcd-4942-bbe2-1f59aaf991fe/volumes/kubernetes.io~projected/kube-api-access-4qc7s DeviceMajor:0 DeviceMinor:197 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/3748d1a1-641f-4259-84b0-a009feb248a8/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:204 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/9cab6006-eafd-41a7-8035-22dfb992b4e6/volumes/kubernetes.io~projected/kube-api-access-qq6s6 DeviceMajor:0 DeviceMinor:236 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:205 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/749984187b350d7660e19ddc86f01ac030d55c0e65bcf6c20d008b289ece953f/userdata/shm DeviceMajor:0 DeviceMinor:231 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4a8099d35f285705698d342224f2abaf3929309b2e113783320d0d3a48ede583/userdata/shm DeviceMajor:0 DeviceMinor:336 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:09bfed56642b460 MacAddress:42:10:17:f3:69:b3 Speed:10000 Mtu:8901} {Name:28b749d0eb8c2ed MacAddress:fe:2c:30:39:bb:cd Speed:10000 Mtu:8901} {Name:2b69377741ebae6 MacAddress:6a:2e:78:16:1d:14 Speed:10000 Mtu:8901} {Name:34806fda5d08e84 MacAddress:c6:27:db:95:c7:1a Speed:10000 Mtu:8901} {Name:3de285584b90282 MacAddress:ee:db:e0:ab:f9:13 Speed:10000 Mtu:8901} {Name:4a8099d35f28570 MacAddress:fa:07:db:10:8f:84 Speed:10000 Mtu:8901} {Name:6e59ffec8d8d73a MacAddress:5a:99:5a:77:3e:77 Speed:10000 Mtu:8901} {Name:749984187b350d7 MacAddress:6e:79:54:20:6d:6b Speed:10000 Mtu:8901} {Name:7d405afeb3723c9 MacAddress:be:3b:76:9a:05:a1 Speed:10000 Mtu:8901} {Name:7ecbcd6c93a848f MacAddress:ea:64:6c:be:d5:73 Speed:10000 Mtu:8901} {Name:99298b05d860308 MacAddress:2a:78:af:33:89:17 Speed:10000 Mtu:8901} {Name:a8d8062d3a6e126 MacAddress:52:63:37:3f:e0:70 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:e1:3b:6d:c7 Speed:0 Mtu:9001} {Name:br-int MacAddress:d2:4c:c6:d2:fc:2e Speed:0 Mtu:8901} {Name:c11a12e3ea56788 MacAddress:32:b4:b2:63:68:16 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:e1:3b:6d:c7 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:fa:14:6b:07:9a:82 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:e2:3b:40:9e:68:07 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164324864 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018339 4933 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018376 4933 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018624 4933 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018644 4933 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018773 4933 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018781 4933 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018790 4933 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018809 4933 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018828 4933 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.018959 4933 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.019068 4933 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.019102 4933 kubelet.go:493] "Attempting to sync node with API server" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.019115 4933 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.019124 4933 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.019133 4933 kubelet.go:405] "Adding apiserver pod source" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.019140 4933 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.020227 4933 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.020239 4933 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.020981 4933 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.024625 4933 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.024647 4933 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.024804 4933 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025019 4933 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025058 4933 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025202 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025227 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025241 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025247 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025254 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025259 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025265 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025271 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025279 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025287 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 22:07:42.032555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025296 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025306 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025330 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.025339 4933 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.029411 4933 server.go:1263] "Started kubelet" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.029591 4933 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.029620 4933 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.029688 4933 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.030085 4933 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.030831 4933 server.go:317] "Adding debug handlers to kubelet server" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.033161 4933 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.033182 4933 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.033723 4933 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 22:02:03 +0000 UTC" deadline="2028-04-25 08:09:15.838154495 +0000 UTC" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.033764 4933 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13018h1m33.804393751s" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:42.033795 4933 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-160.ec2.internal\" not found" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.033813 4933 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.033828 4933 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.034010 4933 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.034776 4933 factory.go:55] Registering systemd factory Oct 30 22:07:42.035467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.034793 4933 factory.go:223] Registration of the systemd container factory successfully Oct 30 22:07:42.036285 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.035716 4933 factory.go:153] Registering CRI-O factory Oct 30 22:07:42.036285 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.035734 4933 factory.go:223] Registration of the crio container factory successfully Oct 30 22:07:42.036285 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.035811 4933 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 22:07:42.036285 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.035840 4933 factory.go:103] Registering Raw factory Oct 30 22:07:42.036285 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.035885 4933 manager.go:1199] Started watching for new ooms in manager Oct 30 22:07:42.036503 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.036304 4933 manager.go:319] Starting recovery of all containers Oct 30 22:07:42.038223 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038141 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8005cfc5-780e-4ea3-898e-6a54e0f93158" volumeName="kubernetes.io/secret/8005cfc5-780e-4ea3-898e-6a54e0f93158-agent-certs" seLinuxMountContext="" Oct 30 22:07:42.038316 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038228 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d369819-d29c-48a6-b03b-41f2145bac41" volumeName="kubernetes.io/configmap/9d369819-d29c-48a6-b03b-41f2145bac41-telemetry-config" seLinuxMountContext="" Oct 30 22:07:42.038316 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038258 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff224fb4-ef29-4599-aca1-38595e23d592" volumeName="kubernetes.io/secret/ff224fb4-ef29-4599-aca1-38595e23d592-serving-cert" seLinuxMountContext="" Oct 30 22:07:42.038316 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038287 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b4095ea-eeca-4f26-8f4f-aa033aef4d5a" volumeName="kubernetes.io/projected/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-kube-api-access-dd58d" seLinuxMountContext="" Oct 30 22:07:42.038316 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038304 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60d187ab-b86b-42f8-9bdb-2cdad6e6d518" volumeName="kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-snapshots" seLinuxMountContext="" Oct 30 22:07:42.038534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038320 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b707bb3-699a-42ba-a5a0-3a52077f1b13" volumeName="kubernetes.io/projected/3b707bb3-699a-42ba-a5a0-3a52077f1b13-kube-api-access-cr4t5" seLinuxMountContext="" Oct 30 22:07:42.038534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038347 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="419fe0bc-c964-47f0-82fc-3c5d45969e63" volumeName="kubernetes.io/configmap/419fe0bc-c964-47f0-82fc-3c5d45969e63-serviceca" seLinuxMountContext="" Oct 30 22:07:42.038534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038363 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" volumeName="kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-bound-sa-token" seLinuxMountContext="" Oct 30 22:07:42.038534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038382 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b707bb3-699a-42ba-a5a0-3a52077f1b13" volumeName="kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-tuned" seLinuxMountContext="" Oct 30 22:07:42.038534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038408 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a918696f-7dcd-4942-bbe2-1f59aaf991fe" volumeName="kubernetes.io/projected/a918696f-7dcd-4942-bbe2-1f59aaf991fe-kube-api-access-4qc7s" seLinuxMountContext="" Oct 30 22:07:42.038534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038446 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d0f6b5a3-7817-41b8-800b-3cfeb03c5528" volumeName="kubernetes.io/projected/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-kube-api-access-brgrm" seLinuxMountContext="" Oct 30 22:07:42.038534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038474 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4714c47-8079-4533-afaf-dfc3ff0f01f3" volumeName="kubernetes.io/projected/f4714c47-8079-4533-afaf-dfc3ff0f01f3-kube-api-access-z6t9q" seLinuxMountContext="" Oct 30 22:07:42.038534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038497 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60d187ab-b86b-42f8-9bdb-2cdad6e6d518" volumeName="kubernetes.io/secret/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-serving-cert" seLinuxMountContext="" Oct 30 22:07:42.038534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038517 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8005cfc5-780e-4ea3-898e-6a54e0f93158" volumeName="kubernetes.io/configmap/8005cfc5-780e-4ea3-898e-6a54e0f93158-konnectivity-ca" seLinuxMountContext="" Oct 30 22:07:42.038534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038533 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5ad1eec-94bf-43a5-9541-9415db456d26" volumeName="kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-config" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038552 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b62a4890-77fb-4ee6-b710-aadb9a5b9463" volumeName="kubernetes.io/empty-dir/b62a4890-77fb-4ee6-b710-aadb9a5b9463-ca-trust-extracted" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038565 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4714c47-8079-4533-afaf-dfc3ff0f01f3" volumeName="kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038583 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4d718cb-d755-4824-94f5-298a3411b7e5" volumeName="kubernetes.io/projected/f4d718cb-d755-4824-94f5-298a3411b7e5-kube-api-access-npr97" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038626 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3748d1a1-641f-4259-84b0-a009feb248a8" volumeName="kubernetes.io/configmap/3748d1a1-641f-4259-84b0-a009feb248a8-config" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038639 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60d187ab-b86b-42f8-9bdb-2cdad6e6d518" volumeName="kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-service-ca-bundle" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038649 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60d187ab-b86b-42f8-9bdb-2cdad6e6d518" volumeName="kubernetes.io/projected/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-kube-api-access-mgkcb" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038676 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff224fb4-ef29-4599-aca1-38595e23d592" volumeName="kubernetes.io/projected/ff224fb4-ef29-4599-aca1-38595e23d592-kube-api-access-7ttn9" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038705 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2be079bb-4896-4a19-8a9f-0313a9bffea8" volumeName="kubernetes.io/projected/2be079bb-4896-4a19-8a9f-0313a9bffea8-kube-api-access-j84fd" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038732 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="960e184e-c2a7-4937-bf04-4c13a434883e" volumeName="kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038751 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cab6006-eafd-41a7-8035-22dfb992b4e6" volumeName="kubernetes.io/configmap/9cab6006-eafd-41a7-8035-22dfb992b4e6-config-volume" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038779 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cab6006-eafd-41a7-8035-22dfb992b4e6" volumeName="kubernetes.io/empty-dir/9cab6006-eafd-41a7-8035-22dfb992b4e6-tmp-dir" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038791 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4714c47-8079-4533-afaf-dfc3ff0f01f3" volumeName="kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-binary-copy" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038808 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff224fb4-ef29-4599-aca1-38595e23d592" volumeName="kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-trusted-ca" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038824 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff224fb4-ef29-4599-aca1-38595e23d592" volumeName="kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-config" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038835 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" volumeName="kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-installation-pull-secrets" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038847 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f904583-6409-4a27-b9b8-cf8e1167a0b4" volumeName="kubernetes.io/projected/3f904583-6409-4a27-b9b8-cf8e1167a0b4-kube-api-access-lngqk" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038858 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b9da187-50be-45aa-9ddd-e49ce94ea488" volumeName="kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038869 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d369819-d29c-48a6-b03b-41f2145bac41" volumeName="kubernetes.io/projected/9d369819-d29c-48a6-b03b-41f2145bac41-kube-api-access-blpzl" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038885 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b62a4890-77fb-4ee6-b710-aadb9a5b9463" volumeName="kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-installation-pull-secrets" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038895 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0f427f4-1c06-4556-8645-8932bcd7b653" volumeName="kubernetes.io/projected/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-api-access-4fwn8" seLinuxMountContext="" Oct 30 22:07:42.039046 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.038906 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9ef3359-4ffd-4a26-889a-8f516ef1970a" volumeName="kubernetes.io/empty-dir/f9ef3359-4ffd-4a26-889a-8f516ef1970a-tmp-dir" seLinuxMountContext="" Oct 30 22:07:42.041905 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.041845 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3748d1a1-641f-4259-84b0-a009feb248a8" volumeName="kubernetes.io/projected/3748d1a1-641f-4259-84b0-a009feb248a8-kube-api-access-96rhx" seLinuxMountContext="" Oct 30 22:07:42.042001 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.041906 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b707bb3-699a-42ba-a5a0-3a52077f1b13" volumeName="kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-tmp" seLinuxMountContext="" Oct 30 22:07:42.042001 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.041931 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" volumeName="kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-trusted-ca" seLinuxMountContext="" Oct 30 22:07:42.042001 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.041955 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" volumeName="kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-kube-api-access-f9rnk" seLinuxMountContext="" Oct 30 22:07:42.042001 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.041969 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2be079bb-4896-4a19-8a9f-0313a9bffea8" volumeName="kubernetes.io/configmap/2be079bb-4896-4a19-8a9f-0313a9bffea8-config" seLinuxMountContext="" Oct 30 22:07:42.042001 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.041986 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d0f6b5a3-7817-41b8-800b-3cfeb03c5528" volumeName="kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-daemon-config" seLinuxMountContext="" Oct 30 22:07:42.042001 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042000 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4d718cb-d755-4824-94f5-298a3411b7e5" volumeName="kubernetes.io/configmap/f4d718cb-d755-4824-94f5-298a3411b7e5-iptables-alerter-script" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042019 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c8ed0be-6573-4bf7-aa93-572c5c0e4bce" volumeName="kubernetes.io/projected/4c8ed0be-6573-4bf7-aa93-572c5c0e4bce-kube-api-access-659vs" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042032 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5048872-d721-4990-99e1-6ccb43420b31" volumeName="kubernetes.io/projected/a5048872-d721-4990-99e1-6ccb43420b31-kube-api-access-lgw9r" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042043 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b62a4890-77fb-4ee6-b710-aadb9a5b9463" volumeName="kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-trusted-ca" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042060 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1bc2f81-1e3d-426a-a25f-829a30545dc6" volumeName="kubernetes.io/projected/c1bc2f81-1e3d-426a-a25f-829a30545dc6-kube-api-access-n25r6" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042071 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f4714c47-8079-4533-afaf-dfc3ff0f01f3" volumeName="kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042092 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2996b6af-d6da-494d-b7d9-219a40969a19" volumeName="kubernetes.io/secret/2996b6af-d6da-494d-b7d9-219a40969a19-cert" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042107 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3748d1a1-641f-4259-84b0-a009feb248a8" volumeName="kubernetes.io/secret/3748d1a1-641f-4259-84b0-a009feb248a8-serving-cert" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042118 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33" volumeName="kubernetes.io/projected/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-kube-api-access-4c8ps" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042134 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33" volumeName="kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-default-certificate" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042146 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60d187ab-b86b-42f8-9bdb-2cdad6e6d518" volumeName="kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-trusted-ca-bundle" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042163 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5ad1eec-94bf-43a5-9541-9415db456d26" volumeName="kubernetes.io/projected/a5ad1eec-94bf-43a5-9541-9415db456d26-kube-api-access-c7nl4" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042189 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5ad1eec-94bf-43a5-9541-9415db456d26" volumeName="kubernetes.io/secret/a5ad1eec-94bf-43a5-9541-9415db456d26-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042202 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b62a4890-77fb-4ee6-b710-aadb9a5b9463" volumeName="kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-certificates" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042239 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2996b6af-d6da-494d-b7d9-219a40969a19" volumeName="kubernetes.io/projected/2996b6af-d6da-494d-b7d9-219a40969a19-kube-api-access-9w5zt" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042252 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2be079bb-4896-4a19-8a9f-0313a9bffea8" volumeName="kubernetes.io/secret/2be079bb-4896-4a19-8a9f-0313a9bffea8-serving-cert" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042270 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d72a205f-a6c2-4510-989f-cfd6c8aa045d" volumeName="kubernetes.io/configmap/d72a205f-a6c2-4510-989f-cfd6c8aa045d-nginx-conf" seLinuxMountContext="" Oct 30 22:07:42.042277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042281 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f0f427f4-1c06-4556-8645-8932bcd7b653" volumeName="kubernetes.io/empty-dir/f0f427f4-1c06-4556-8645-8932bcd7b653-data-volume" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042295 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="43cebd0d-8293-4c7c-9469-4b211733bb79" volumeName="kubernetes.io/projected/43cebd0d-8293-4c7c-9469-4b211733bb79-kube-api-access-v28td" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042312 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33" volumeName="kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-stats-auth" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042325 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5ad1eec-94bf-43a5-9541-9415db456d26" volumeName="kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-script-lib" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042342 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6" volumeName="kubernetes.io/projected/abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6-kube-api-access-jmfv7" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042355 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9ef3359-4ffd-4a26-889a-8f516ef1970a" volumeName="kubernetes.io/projected/f9ef3359-4ffd-4a26-889a-8f516ef1970a-kube-api-access-745bl" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042366 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" volumeName="kubernetes.io/empty-dir/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-ca-trust-extracted" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042382 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66704037-d682-431e-b477-c0010e52e84d" volumeName="kubernetes.io/projected/66704037-d682-431e-b477-c0010e52e84d-kube-api-access-5h64c" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042395 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b62a4890-77fb-4ee6-b710-aadb9a5b9463" volumeName="kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-image-registry-private-configuration" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042412 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1bc2f81-1e3d-426a-a25f-829a30545dc6" volumeName="kubernetes.io/configmap/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-config" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042424 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b62a4890-77fb-4ee6-b710-aadb9a5b9463" volumeName="kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-bound-sa-token" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042434 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b62a4890-77fb-4ee6-b710-aadb9a5b9463" volumeName="kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-kube-api-access-bjdb8" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042449 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="419fe0bc-c964-47f0-82fc-3c5d45969e63" volumeName="kubernetes.io/projected/419fe0bc-c964-47f0-82fc-3c5d45969e63-kube-api-access-8gnk2" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042460 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" volumeName="kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-certificates" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042477 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cab6006-eafd-41a7-8035-22dfb992b4e6" volumeName="kubernetes.io/projected/9cab6006-eafd-41a7-8035-22dfb992b4e6-kube-api-access-qq6s6" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042490 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5ad1eec-94bf-43a5-9541-9415db456d26" volumeName="kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-env-overrides" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042503 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d0f6b5a3-7817-41b8-800b-3cfeb03c5528" volumeName="kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cni-binary-copy" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042518 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" volumeName="kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-image-registry-private-configuration" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042536 4933 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60d187ab-b86b-42f8-9bdb-2cdad6e6d518" volumeName="kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-tmp" seLinuxMountContext="" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042548 4933 reconstruct.go:97] "Volume reconstruction finished" Oct 30 22:07:42.043009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.042556 4933 reconciler.go:29] "Reconciler: start to sync state" Oct 30 22:07:42.059097 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.059070 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/1.log" Oct 30 22:07:42.062222 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.062204 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/1.log" Oct 30 22:07:42.072163 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.072135 4933 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 22:07:42.074098 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.074076 4933 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 22:07:42.074098 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.074099 4933 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 22:07:42.074253 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.074120 4933 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 22:07:42.074253 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:42.074160 4933 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 22:07:42.078228 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.078206 4933 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:42.079476 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.079451 4933 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:42.079982 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.079964 4933 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 22:07:42.091157 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.091137 4933 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:42.091349 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.091328 4933 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:42.106812 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.106786 4933 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="63c842a0990afb6a32cde704223af698b65474f4f94e609da5c85d0530c642fb" exitCode=0 Oct 30 22:07:42.106895 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.106815 4933 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="69f277724ea8b68343129ff72171110877e447523a5f877b5ad0dce3f6f3fdd3" exitCode=0 Oct 30 22:07:42.106895 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.106826 4933 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="5b1482351fedfe46d231949f3a881609c0dd7004e130ddf40554b75aa01a5f10" exitCode=0 Oct 30 22:07:42.106895 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.106834 4933 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="3cf973bc4125175eae444e38e9c8ab8639a405a960d291c205cb49f5c772e495" exitCode=0 Oct 30 22:07:42.106895 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.106843 4933 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="2914077aa84e08c365fcbd799075783bc0fb3efd654868c0343728d1325ac7fc" exitCode=0 Oct 30 22:07:42.106895 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.106852 4933 generic.go:356] "Generic (PLEG): container finished" podID="f4714c47-8079-4533-afaf-dfc3ff0f01f3" containerID="0c7fb26c863f79994cc352e410f13194cf94d423ed887171c1a1f9144d3ec6da" exitCode=0 Oct 30 22:07:42.110165 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.110141 4933 generic.go:356] "Generic (PLEG): container finished" podID="2916fe9077ee958236e3180083212c62" containerID="c7bba77e82ee9a66f595046dac152921e07b30c9aba3946ab7456ce860598237" exitCode=0 Oct 30 22:07:42.117215 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.117169 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/1.log" Oct 30 22:07:42.117215 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.117200 4933 generic.go:356] "Generic (PLEG): container finished" podID="ff224fb4-ef29-4599-aca1-38595e23d592" containerID="f0f390cd89e84ede353cec463599d4716a38f1d9a494c9512f4a6a44c7a28b84" exitCode=255 Oct 30 22:07:42.135664 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.135648 4933 manager.go:324] Recovery completed Oct 30 22:07:42.155032 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155009 4933 cpu_manager.go:226] "Starting" policy="none" Oct 30 22:07:42.155032 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155027 4933 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 22:07:42.155130 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155048 4933 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 22:07:42.155171 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155160 4933 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 22:07:42.155217 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155171 4933 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 22:07:42.155217 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155187 4933 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 22:07:42.155217 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155193 4933 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 22:07:42.155217 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155198 4933 policy_none.go:50] "Start" Oct 30 22:07:42.155217 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155206 4933 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 22:07:42.155217 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155216 4933 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 22:07:42.155388 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155330 4933 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 22:07:42.155388 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155337 4933 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 22:07:42.155388 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.155342 4933 policy_none.go:44] "Start" Oct 30 22:07:42.159491 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.159466 4933 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 22:07:42.162040 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.162025 4933 manager.go:341] "Starting Device Plugin manager" Oct 30 22:07:42.162750 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:42.162056 4933 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 22:07:42.162800 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.162756 4933 server.go:87] "Starting device plugin registration server" Oct 30 22:07:42.163080 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.163068 4933 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 22:07:42.163114 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.163083 4933 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 22:07:42.163209 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.163189 4933 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 22:07:42.163337 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.163299 4933 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 22:07:42.163337 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.163342 4933 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 22:07:42.163493 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.163350 4933 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 22:07:42.163493 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.163399 4933 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T22:07:42.163331614Z","UUID":"56c099a9-5451-414b-b782-a00a8cf378d6","Handler":null,"Name":"","Endpoint":""} Oct 30 22:07:42.164504 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.164483 4933 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 22:07:42.164596 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.164511 4933 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 22:07:42.164727 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:42.164704 4933 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 22:07:42.174231 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.174196 4933 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal"] Oct 30 22:07:42.175657 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.175597 4933 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.175751 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.175648 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" event={"ID":"4bcd859681c6ed3bc37c2cdc12c8d68d","Type":"ContainerStarted","Data":"19c42e10ec1e04c0514d10ef989648604fd39a8fb20586f1915427e835ce91ac"} Oct 30 22:07:42.175751 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.175710 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" event={"ID":"4bcd859681c6ed3bc37c2cdc12c8d68d","Type":"ContainerStarted","Data":"4ddeaf720c84acc8688e123c9eb023769d11dd04d1635634bcb5e56f6b3f1a53"} Oct 30 22:07:42.175833 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.175809 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" event={"ID":"2916fe9077ee958236e3180083212c62","Type":"ContainerStarted","Data":"80ae055d8a648646e523f6744c4e652dc166a8eee0716212b1cb606cc1c9497e"} Oct 30 22:07:42.175833 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.175830 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" event={"ID":"2916fe9077ee958236e3180083212c62","Type":"ContainerDied","Data":"c7bba77e82ee9a66f595046dac152921e07b30c9aba3946ab7456ce860598237"} Oct 30 22:07:42.175912 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.175857 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" event={"ID":"2916fe9077ee958236e3180083212c62","Type":"ContainerStarted","Data":"5841c4a514294a8b4697cc990a97da5c901867f702553a501bb6085bab17994e"} Oct 30 22:07:42.176052 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.176035 4933 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.201794 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.201774 4933 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:42.201869 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:42.201812 4933 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-160.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.202698 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.202684 4933 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:42.202752 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:42.202716 4933 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.263506 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.263485 4933 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:42.264482 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.264467 4933 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:42.264545 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.264494 4933 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:42.264545 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.264508 4933 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-160.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:42.264625 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.264549 4933 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.280506 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.280486 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.280569 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.280510 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bcd859681c6ed3bc37c2cdc12c8d68d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-160.ec2.internal\" (UID: \"4bcd859681c6ed3bc37c2cdc12c8d68d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.280569 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.280526 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.298009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.297991 4933 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.298076 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.298040 4933 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.381056 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.381003 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.381056 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.381013 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.381056 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.381036 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.381056 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.381054 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bcd859681c6ed3bc37c2cdc12c8d68d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-160.ec2.internal\" (UID: \"4bcd859681c6ed3bc37c2cdc12c8d68d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.381214 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.381094 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4bcd859681c6ed3bc37c2cdc12c8d68d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-160.ec2.internal\" (UID: \"4bcd859681c6ed3bc37c2cdc12c8d68d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:42.381214 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:42.381143 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2916fe9077ee958236e3180083212c62-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" (UID: \"2916fe9077ee958236e3180083212c62\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:43.019674 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.019639 4933 apiserver.go:52] "Watching apiserver" Oct 30 22:07:43.070258 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.070232 4933 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 22:07:43.070907 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.070885 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-mmh7p","openshift-multus/multus-bfkbs","openshift-ingress/router-default-5df9566755-smt7x","openshift-ingress-canary/ingress-canary-qg8m6","openshift-multus/multus-additional-cni-plugins-2k7jl","openshift-console-operator/console-operator-7cd56b8dbc-8ddx2","openshift-network-operator/iptables-alerter-nlsq4","kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst","openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g","kube-system/global-pull-secret-syncer-r2hqv","openshift-dns/dns-default-7vvjk","kube-system/kas-connection-checker-685895c7c9-t8fj7","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv","openshift-image-registry/node-ca-vvdnv","kube-system/kas-connection-checker-685895c7c9-8xtlm","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j","openshift-dns/node-resolver-fsplc","openshift-image-registry/image-registry-589dd864bc-k9hqj","kube-system/kas-connection-checker-685895c7c9-92wb6","openshift-multus/network-metrics-daemon-299zc","kube-system/konnectivity-agent-bz4rw","openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph","openshift-insights/insights-operator-7c4986d449-hdt8n","openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm","openshift-ovn-kubernetes/ovnkube-node-hqfbg","openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb","openshift-cluster-node-tuning-operator/tuned-t2hsm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal","openshift-insights/insights-runtime-extractor-86mjd","openshift-image-registry/image-registry-6d566bbdf8-jn8p4","openshift-network-diagnostics/network-check-target-4pd2j"] Oct 30 22:07:43.072293 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.072277 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:43.076117 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.076090 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.076917 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.076893 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.077024 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.076949 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:43.078193 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.078177 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:43.080887 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.080870 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:43.084270 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.084254 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.085600 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.085586 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:43.086968 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.086950 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.087071 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087014 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.087071 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087037 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.087071 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087053 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 22:07:43.087071 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087070 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 30 22:07:43.087265 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087086 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 30 22:07:43.087265 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087126 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.087265 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087137 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.087265 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087149 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.087265 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087186 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f5bxv\"" Oct 30 22:07:43.087265 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087248 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-89fxd\"" Oct 30 22:07:43.087592 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.087576 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 30 22:07:43.099178 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.099162 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 22:07:43.126458 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.126439 4933 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:43.126602 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.126587 4933 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:43.136487 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.136473 4933 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 22:07:43.149543 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.149527 4933 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:43.149593 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.149567 4933 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-160.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-160.ec2.internal" Oct 30 22:07:43.158743 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.158727 4933 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:43.158797 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.158759 4933 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-160.ec2.internal" Oct 30 22:07:43.185215 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185194 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-certificates\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.185358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185220 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-serving-cert\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.185358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185239 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blpzl\" (UniqueName: \"kubernetes.io/projected/9d369819-d29c-48a6-b03b-41f2145bac41-kube-api-access-blpzl\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:43.185358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185260 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-hostroot\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.185358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185284 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-stats-auth\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.185358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185308 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.185594 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185376 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-conf\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.185594 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185420 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npr97\" (UniqueName: \"kubernetes.io/projected/f4d718cb-d755-4824-94f5-298a3411b7e5-kube-api-access-npr97\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:43.185594 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185425 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-serving-cert\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.185594 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185471 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff224fb4-ef29-4599-aca1-38595e23d592-serving-cert\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:43.185594 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185515 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.185594 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.185542 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-node-log\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.186676 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186470 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/419fe0bc-c964-47f0-82fc-3c5d45969e63-host\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:43.186676 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186519 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-conf-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.186676 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186549 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-daemon-config\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.186676 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186635 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-slash\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.186676 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186668 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.186845 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186678 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:43.186845 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186713 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:43.186845 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186741 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-kubernetes\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.186845 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186788 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cnibin\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.186845 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186816 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h64c\" (UniqueName: \"kubernetes.io/projected/66704037-d682-431e-b477-c0010e52e84d-kube-api-access-5h64c\") pod \"migrator-66df5d496b-xpld5\" (UID: \"66704037-d682-431e-b477-c0010e52e84d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5" Oct 30 22:07:43.186845 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186842 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-script-lib\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.187075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186866 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.187075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186874 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.187075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186895 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-installation-pull-secrets\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.187075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186920 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84fd\" (UniqueName: \"kubernetes.io/projected/2be079bb-4896-4a19-8a9f-0313a9bffea8-kube-api-access-j84fd\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:43.187075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.186975 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.187075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187005 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 22:07:43.187075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187028 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0f427f4-1c06-4556-8645-8932bcd7b653-crio-socket\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.187075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187052 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-tuned\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.187075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187067 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.187429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187086 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-ovn\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.187429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187148 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-tuned\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.187429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187184 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.187429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187239 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.187429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187246 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-bound-sa-token\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.187429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187292 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8005cfc5-780e-4ea3-898e-6a54e0f93158-agent-certs\") pod \"konnectivity-agent-bz4rw\" (UID: \"8005cfc5-780e-4ea3-898e-6a54e0f93158\") " pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:43.187429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187320 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-systemd\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.187429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187341 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.187429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187347 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-var-lib-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.187429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187386 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-etc-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187439 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd58d\" (UniqueName: \"kubernetes.io/projected/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-kube-api-access-dd58d\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187469 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ef3359-4ffd-4a26-889a-8f516ef1970a-tmp-dir\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187494 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b62a4890-77fb-4ee6-b710-aadb9a5b9463-ca-trust-extracted\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187520 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-745bl\" (UniqueName: \"kubernetes.io/projected/f9ef3359-4ffd-4a26-889a-8f516ef1970a-kube-api-access-745bl\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187561 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq6s6\" (UniqueName: \"kubernetes.io/projected/9cab6006-eafd-41a7-8035-22dfb992b4e6-kube-api-access-qq6s6\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187574 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9ef3359-4ffd-4a26-889a-8f516ef1970a-tmp-dir\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187656 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187644 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b62a4890-77fb-4ee6-b710-aadb9a5b9463-ca-trust-extracted\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187706 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-multus\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187745 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4d718cb-d755-4824-94f5-298a3411b7e5-iptables-alerter-script\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187812 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lngqk\" (UniqueName: \"kubernetes.io/projected/3f904583-6409-4a27-b9b8-cf8e1167a0b4-kube-api-access-lngqk\") pod \"volume-data-source-validator-58c9f5f46d-dsswm\" (UID: \"3f904583-6409-4a27-b9b8-cf8e1167a0b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187821 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.187841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187844 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96rhx\" (UniqueName: \"kubernetes.io/projected/3748d1a1-641f-4259-84b0-a009feb248a8-kube-api-access-96rhx\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187875 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187902 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187928 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-var-lib-kubelet\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187956 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3748d1a1-641f-4259-84b0-a009feb248a8-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187982 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.187999 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188006 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-log-socket\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188033 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgw9r\" (UniqueName: \"kubernetes.io/projected/a5048872-d721-4990-99e1-6ccb43420b31-kube-api-access-lgw9r\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188058 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188078 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188076 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjdb8\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-kube-api-access-bjdb8\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188148 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188148 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qc7s\" (UniqueName: \"kubernetes.io/projected/a918696f-7dcd-4942-bbe2-1f59aaf991fe-kube-api-access-4qc7s\") pod \"kas-connection-checker-685895c7c9-t8fj7\" (UID: \"a918696f-7dcd-4942-bbe2-1f59aaf991fe\") " pod="kube-system/kas-connection-checker-685895c7c9-t8fj7" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188183 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188194 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-socket-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188224 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4d718cb-d755-4824-94f5-298a3411b7e5-host-slash\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188254 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-tmp\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188300 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8ps\" (UniqueName: \"kubernetes.io/projected/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-kube-api-access-4c8ps\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188322 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188334 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188364 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188363 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hmbsc\"" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188376 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fwn8\" (UniqueName: \"kubernetes.io/projected/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-api-access-4fwn8\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188409 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-kubelet\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.188447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188436 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-device-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188512 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b707bb3-699a-42ba-a5a0-3a52077f1b13-tmp\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188515 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-bin\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188553 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9d369819-d29c-48a6-b03b-41f2145bac41-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188573 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gq78g\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188580 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2996b6af-d6da-494d-b7d9-219a40969a19-cert\") pod \"ingress-canary-qg8m6\" (UID: \"2996b6af-d6da-494d-b7d9-219a40969a19\") " pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188630 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188658 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2be079bb-4896-4a19-8a9f-0313a9bffea8-config\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188690 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188719 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188814 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-ca-trust-extracted\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188839 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188846 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-kubelet-config\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188860 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188887 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188873 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-dbus\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188870 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9d369819-d29c-48a6-b03b-41f2145bac41-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188927 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188918 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-ca-trust-extracted\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188937 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmfv7\" (UniqueName: \"kubernetes.io/projected/abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6-kube-api-access-jmfv7\") pod \"network-check-source-6f78d59f99-gw2gb\" (UID: \"abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188970 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.188970 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-system-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189026 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-netd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189057 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7nl4\" (UniqueName: \"kubernetes.io/projected/a5ad1eec-94bf-43a5-9541-9415db456d26-kube-api-access-c7nl4\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189078 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189086 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n25r6\" (UniqueName: \"kubernetes.io/projected/c1bc2f81-1e3d-426a-a25f-829a30545dc6-kube-api-access-n25r6\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189094 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189117 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-snapshots\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189146 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0f427f4-1c06-4556-8645-8932bcd7b653-data-volume\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189173 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brgrm\" (UniqueName: \"kubernetes.io/projected/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-kube-api-access-brgrm\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189202 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-default-certificate\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189231 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189255 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-bound-sa-token\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189264 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0f427f4-1c06-4556-8645-8932bcd7b653-data-volume\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189274 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189264 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-snapshots\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189287 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189315 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5ad1eec-94bf-43a5-9541-9415db456d26-ovn-node-metrics-cert\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189340 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-etc-selinux\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189366 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2be079bb-4896-4a19-8a9f-0313a9bffea8-serving-cert\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189389 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-system-cni-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189414 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189416 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-k8s-cni-cncf-io\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189424 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189442 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-env-overrides\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189467 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9cab6006-eafd-41a7-8035-22dfb992b4e6-config-volume\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189482 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189512 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w5zt\" (UniqueName: \"kubernetes.io/projected/2996b6af-d6da-494d-b7d9-219a40969a19-kube-api-access-9w5zt\") pod \"ingress-canary-qg8m6\" (UID: \"2996b6af-d6da-494d-b7d9-219a40969a19\") " pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189527 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189536 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5ad1eec-94bf-43a5-9541-9415db456d26-ovn-node-metrics-cert\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189544 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d72a205f-a6c2-4510-989f-cfd6c8aa045d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:43.189549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189512 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-default-certificate\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189595 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-modprobe-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189645 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6t9q\" (UniqueName: \"kubernetes.io/projected/f4714c47-8079-4533-afaf-dfc3ff0f01f3-kube-api-access-z6t9q\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189673 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cni-binary-copy\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189691 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-installation-pull-secrets\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189708 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189708 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9cab6006-eafd-41a7-8035-22dfb992b4e6-config-volume\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189759 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-systemd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189775 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189782 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189795 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/419fe0bc-c964-47f0-82fc-3c5d45969e63-serviceca\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189814 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189817 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2be079bb-4896-4a19-8a9f-0313a9bffea8-serving-cert\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189828 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-659vs\" (UniqueName: \"kubernetes.io/projected/4c8ed0be-6573-4bf7-aa93-572c5c0e4bce-kube-api-access-659vs\") pod \"kas-connection-checker-685895c7c9-8xtlm\" (UID: \"4c8ed0be-6573-4bf7-aa93-572c5c0e4bce\") " pod="kube-system/kas-connection-checker-685895c7c9-8xtlm" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189822 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189885 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189892 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gfzqs\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189898 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189941 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189968 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189966 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189996 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8005cfc5-780e-4ea3-898e-6a54e0f93158-konnectivity-ca\") pod \"konnectivity-agent-bz4rw\" (UID: \"8005cfc5-780e-4ea3-898e-6a54e0f93158\") " pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.189971 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190022 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190031 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190116 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190119 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190166 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190166 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-trusted-ca\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190186 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190207 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgkcb\" (UniqueName: \"kubernetes.io/projected/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-kube-api-access-mgkcb\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190230 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190235 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190267 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190275 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190276 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-trusted-ca\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190311 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190316 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cni-binary-copy\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190324 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190383 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-tmp\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190415 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-multus-certs\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190438 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-7vf6q\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190444 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hk5lx\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190461 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cab6006-eafd-41a7-8035-22dfb992b4e6-tmp-dir\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190478 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-tmp\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190487 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190490 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-registration-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190511 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190519 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190527 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190520 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-sys-fs\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190547 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190545 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190564 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cab6006-eafd-41a7-8035-22dfb992b4e6-tmp-dir\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190568 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v28td\" (UniqueName: \"kubernetes.io/projected/43cebd0d-8293-4c7c-9469-4b211733bb79-kube-api-access-v28td\") pod \"kas-connection-checker-685895c7c9-92wb6\" (UID: \"43cebd0d-8293-4c7c-9469-4b211733bb79\") " pod="kube-system/kas-connection-checker-685895c7c9-92wb6" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190581 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190589 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190493 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190582 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190597 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190634 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190629 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190675 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-systemd-units\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190699 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-netns\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190727 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-service-ca-bundle\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190778 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cnibin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190803 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-bin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190807 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190832 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-config\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190860 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-service-ca-bundle\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190872 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ttn9\" (UniqueName: \"kubernetes.io/projected/ff224fb4-ef29-4599-aca1-38595e23d592-kube-api-access-7ttn9\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190900 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190916 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3748d1a1-641f-4259-84b0-a009feb248a8-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190934 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-image-registry-private-configuration\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190971 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-trusted-ca\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.190989 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-run\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191009 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191049 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-config\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191073 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-config\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191106 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191114 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-etc-kubernetes\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191142 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3748d1a1-641f-4259-84b0-a009feb248a8-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191144 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-kubelet\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191176 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gnk2\" (UniqueName: \"kubernetes.io/projected/419fe0bc-c964-47f0-82fc-3c5d45969e63-kube-api-access-8gnk2\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191203 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191232 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-config\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191235 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9ef3359-4ffd-4a26-889a-8f516ef1970a-hosts-file\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191278 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-image-registry-private-configuration\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191309 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysconfig\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191343 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-lib-modules\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191387 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-netns\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191414 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-sys\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191440 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-host\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191460 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr4t5\" (UniqueName: \"kubernetes.io/projected/3b707bb3-699a-42ba-a5a0-3a52077f1b13-kube-api-access-cr4t5\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191487 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-image-registry-private-configuration\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.191474 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191488 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-image-registry-private-configuration\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191530 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191559 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-socket-dir-parent\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191587 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-certificates\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191622 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191624 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9rnk\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-kube-api-access-f9rnk\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191659 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191699 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191753 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nsszl\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191762 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s9t4n\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191787 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5trx7\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191811 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191815 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pjfxj\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191811 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191830 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r7nlg\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191845 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zkqvk\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191852 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tmsjf\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191863 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191863 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6v65q\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191877 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191882 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-68vsx\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191944 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9s65x\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191950 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-7l7rd\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191987 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191987 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wkgtq\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.191997 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4wqfg\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192058 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vdq5j\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192136 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5nx2r\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192171 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192211 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x4nws\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192258 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192342 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192389 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zgfdn\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192522 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192619 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192653 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-ftknn\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192676 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dzfp9\"" Oct 30 22:07:43.194880 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.192919 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-22mqf\"" Oct 30 22:07:43.195848 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.195738 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-stats-auth\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.195848 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.195772 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff224fb4-ef29-4599-aca1-38595e23d592-serving-cert\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:43.195848 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.195799 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-certificates\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.196910 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.196888 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-daemon-config\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.197453 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.197435 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-installation-pull-secrets\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.197484 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.197455 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-ovnkube-script-lib\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.197711 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.197695 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8005cfc5-780e-4ea3-898e-6a54e0f93158-agent-certs\") pod \"konnectivity-agent-bz4rw\" (UID: \"8005cfc5-780e-4ea3-898e-6a54e0f93158\") " pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:43.198624 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.198598 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3748d1a1-641f-4259-84b0-a009feb248a8-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:43.198736 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.198723 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:43.198835 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.198821 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4d718cb-d755-4824-94f5-298a3411b7e5-iptables-alerter-script\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:43.198901 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.198885 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2996b6af-d6da-494d-b7d9-219a40969a19-cert\") pod \"ingress-canary-qg8m6\" (UID: \"2996b6af-d6da-494d-b7d9-219a40969a19\") " pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:43.198966 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.198954 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2be079bb-4896-4a19-8a9f-0313a9bffea8-config\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:43.199564 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.199550 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/960e184e-c2a7-4937-bf04-4c13a434883e-original-pull-secret\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:43.200041 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.200003 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5ad1eec-94bf-43a5-9541-9415db456d26-env-overrides\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.200041 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.200011 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-installation-pull-secrets\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.200183 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.200064 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d72a205f-a6c2-4510-989f-cfd6c8aa045d-nginx-conf\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:43.200694 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.200228 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/419fe0bc-c964-47f0-82fc-3c5d45969e63-serviceca\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:43.200694 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.200348 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8005cfc5-780e-4ea3-898e-6a54e0f93158-konnectivity-ca\") pod \"konnectivity-agent-bz4rw\" (UID: \"8005cfc5-780e-4ea3-898e-6a54e0f93158\") " pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:43.200694 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.200408 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.202375 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.202141 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 30 22:07:43.202375 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.202281 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 22:07:43.202375 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.202329 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-certificates\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.202832 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.202572 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-trusted-ca\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.207207 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.207182 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blpzl\" (UniqueName: \"kubernetes.io/projected/9d369819-d29c-48a6-b03b-41f2145bac41-kube-api-access-blpzl\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:43.208596 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.208578 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npr97\" (UniqueName: \"kubernetes.io/projected/f4d718cb-d755-4824-94f5-298a3411b7e5-kube-api-access-npr97\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:43.210556 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.210538 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff224fb4-ef29-4599-aca1-38595e23d592-trusted-ca\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:43.210688 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.210669 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-trusted-ca\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.212263 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.212246 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-bound-sa-token\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.212373 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.212315 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84fd\" (UniqueName: \"kubernetes.io/projected/2be079bb-4896-4a19-8a9f-0313a9bffea8-kube-api-access-j84fd\") pod \"service-ca-operator-544d749c8c-m9f7g\" (UID: \"2be079bb-4896-4a19-8a9f-0313a9bffea8\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" Oct 30 22:07:43.212373 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.212342 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h64c\" (UniqueName: \"kubernetes.io/projected/66704037-d682-431e-b477-c0010e52e84d-kube-api-access-5h64c\") pod \"migrator-66df5d496b-xpld5\" (UID: \"66704037-d682-431e-b477-c0010e52e84d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xpld5" Oct 30 22:07:43.213100 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.213080 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq6s6\" (UniqueName: \"kubernetes.io/projected/9cab6006-eafd-41a7-8035-22dfb992b4e6-kube-api-access-qq6s6\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:43.213100 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.213090 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96rhx\" (UniqueName: \"kubernetes.io/projected/3748d1a1-641f-4259-84b0-a009feb248a8-kube-api-access-96rhx\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv\" (UID: \"3748d1a1-641f-4259-84b0-a009feb248a8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" Oct 30 22:07:43.213320 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.213302 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c8ps\" (UniqueName: \"kubernetes.io/projected/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-kube-api-access-4c8ps\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.214308 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.214289 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngqk\" (UniqueName: \"kubernetes.io/projected/3f904583-6409-4a27-b9b8-cf8e1167a0b4-kube-api-access-lngqk\") pod \"volume-data-source-validator-58c9f5f46d-dsswm\" (UID: \"3f904583-6409-4a27-b9b8-cf8e1167a0b4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-dsswm" Oct 30 22:07:43.214598 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.214579 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qc7s\" (UniqueName: \"kubernetes.io/projected/a918696f-7dcd-4942-bbe2-1f59aaf991fe-kube-api-access-4qc7s\") pod \"kas-connection-checker-685895c7c9-t8fj7\" (UID: \"a918696f-7dcd-4942-bbe2-1f59aaf991fe\") " pod="kube-system/kas-connection-checker-685895c7c9-t8fj7" Oct 30 22:07:43.215194 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.215175 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7nl4\" (UniqueName: \"kubernetes.io/projected/a5ad1eec-94bf-43a5-9541-9415db456d26-kube-api-access-c7nl4\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.215255 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.215196 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvh29\" (UniqueName: \"kubernetes.io/projected/8b9da187-50be-45aa-9ddd-e49ce94ea488-kube-api-access-xvh29\") pod \"network-check-target-4pd2j\" (UID: \"8b9da187-50be-45aa-9ddd-e49ce94ea488\") " pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:43.215296 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.215267 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgw9r\" (UniqueName: \"kubernetes.io/projected/a5048872-d721-4990-99e1-6ccb43420b31-kube-api-access-lgw9r\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.215337 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.215323 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd58d\" (UniqueName: \"kubernetes.io/projected/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-kube-api-access-dd58d\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:43.216408 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.216393 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmfv7\" (UniqueName: \"kubernetes.io/projected/abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6-kube-api-access-jmfv7\") pod \"network-check-source-6f78d59f99-gw2gb\" (UID: \"abb7a08a-bbbf-42f7-92f4-340cc0ed7fb6\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-gw2gb" Oct 30 22:07:43.217448 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.217433 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjdb8\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-kube-api-access-bjdb8\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.219517 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.219501 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n25r6\" (UniqueName: \"kubernetes.io/projected/c1bc2f81-1e3d-426a-a25f-829a30545dc6-kube-api-access-n25r6\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:43.219709 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.219693 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-659vs\" (UniqueName: \"kubernetes.io/projected/4c8ed0be-6573-4bf7-aa93-572c5c0e4bce-kube-api-access-659vs\") pod \"kas-connection-checker-685895c7c9-8xtlm\" (UID: \"4c8ed0be-6573-4bf7-aa93-572c5c0e4bce\") " pod="kube-system/kas-connection-checker-685895c7c9-8xtlm" Oct 30 22:07:43.221065 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.221047 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v28td\" (UniqueName: \"kubernetes.io/projected/43cebd0d-8293-4c7c-9469-4b211733bb79-kube-api-access-v28td\") pod \"kas-connection-checker-685895c7c9-92wb6\" (UID: \"43cebd0d-8293-4c7c-9469-4b211733bb79\") " pod="kube-system/kas-connection-checker-685895c7c9-92wb6" Oct 30 22:07:43.221343 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.221328 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgkcb\" (UniqueName: \"kubernetes.io/projected/60d187ab-b86b-42f8-9bdb-2cdad6e6d518-kube-api-access-mgkcb\") pod \"insights-operator-7c4986d449-hdt8n\" (UID: \"60d187ab-b86b-42f8-9bdb-2cdad6e6d518\") " pod="openshift-insights/insights-operator-7c4986d449-hdt8n" Oct 30 22:07:43.221628 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.221597 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w5zt\" (UniqueName: \"kubernetes.io/projected/2996b6af-d6da-494d-b7d9-219a40969a19-kube-api-access-9w5zt\") pod \"ingress-canary-qg8m6\" (UID: \"2996b6af-d6da-494d-b7d9-219a40969a19\") " pod="openshift-ingress-canary/ingress-canary-qg8m6" Oct 30 22:07:43.222565 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.222546 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6t9q\" (UniqueName: \"kubernetes.io/projected/f4714c47-8079-4533-afaf-dfc3ff0f01f3-kube-api-access-z6t9q\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.223093 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.223078 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-bound-sa-token\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.224510 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.224491 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brgrm\" (UniqueName: \"kubernetes.io/projected/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-kube-api-access-brgrm\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.224650 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.224633 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ttn9\" (UniqueName: \"kubernetes.io/projected/ff224fb4-ef29-4599-aca1-38595e23d592-kube-api-access-7ttn9\") pod \"console-operator-7cd56b8dbc-8ddx2\" (UID: \"ff224fb4-ef29-4599-aca1-38595e23d592\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:43.224808 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.224793 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gnk2\" (UniqueName: \"kubernetes.io/projected/419fe0bc-c964-47f0-82fc-3c5d45969e63-kube-api-access-8gnk2\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:43.224987 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.224973 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr4t5\" (UniqueName: \"kubernetes.io/projected/3b707bb3-699a-42ba-a5a0-3a52077f1b13-kube-api-access-cr4t5\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.225903 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.225885 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9rnk\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-kube-api-access-f9rnk\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.227035 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.227020 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-745bl\" (UniqueName: \"kubernetes.io/projected/f9ef3359-4ffd-4a26-889a-8f516ef1970a-kube-api-access-745bl\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:43.227205 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.227190 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fwn8\" (UniqueName: \"kubernetes.io/projected/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-api-access-4fwn8\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.292645 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292588 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-kubelet\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.292645 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292631 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-device-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.292782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292647 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-bin\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.292782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292665 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.292782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292697 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:43.292782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292700 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-kubelet\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.292782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292719 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-device-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.292782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292712 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-kubelet-config\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:43.292782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292713 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-bin\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.292782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292747 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-kubelet-config\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:43.292782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292746 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.292782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292758 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-dbus\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292795 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/960e184e-c2a7-4937-bf04-4c13a434883e-dbus\") pod \"global-pull-secret-syncer-r2hqv\" (UID: \"960e184e-c2a7-4937-bf04-4c13a434883e\") " pod="kube-system/global-pull-secret-syncer-r2hqv" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292795 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-system-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292822 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-netd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.292828 4933 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292848 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-cni-netd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292852 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292849 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-system-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292880 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-etc-selinux\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.292910 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls podName:9d369819-d29c-48a6-b03b-41f2145bac41 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.79288642 +0000 UTC m=+1.863785188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xvqph" (UID: "9d369819-d29c-48a6-b03b-41f2145bac41") : secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292939 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-system-cni-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292947 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-etc-selinux\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292964 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-k8s-cni-cncf-io\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292972 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292974 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-system-cni-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.292990 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-modprobe-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293012 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-k8s-cni-cncf-io\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293018 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293033 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-systemd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293050 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293069 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293084 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-modprobe-d\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293097 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-systemd\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293126 4933 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293130 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-cni-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293126 4933 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293176 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls podName:9cab6006-eafd-41a7-8035-22dfb992b4e6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.793161646 +0000 UTC m=+1.864060401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls") pod "dns-default-7vvjk" (UID: "9cab6006-eafd-41a7-8035-22dfb992b4e6") : secret "dns-default-metrics-tls" not found Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293190 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-multus-certs\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293205 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.793194433 +0000 UTC m=+1.864093203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : secret "router-metrics-certs-default" not found Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293213 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-multus-certs\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293225 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-registration-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293241 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-sys-fs\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293257 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-systemd-units\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293272 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-netns\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293277 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-sys-fs\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293287 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cnibin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293291 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-systemd-units\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293271 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-registration-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293302 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-bin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293323 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-bin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293302 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-netns\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293366 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-run\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293335 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-run\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293385 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293395 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-cnibin\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293400 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-etc-kubernetes\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293417 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-kubelet\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293431 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-kubelet-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293432 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293453 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9ef3359-4ffd-4a26-889a-8f516ef1970a-hosts-file\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293471 4933 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293480 4933 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589dd864bc-k9hqj: secret "image-registry-tls" not found Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293473 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysconfig\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293514 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-lib-modules\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293517 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9ef3359-4ffd-4a26-889a-8f516ef1970a-hosts-file\") pod \"node-resolver-fsplc\" (UID: \"f9ef3359-4ffd-4a26-889a-8f516ef1970a\") " pod="openshift-dns/node-resolver-fsplc" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293529 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls podName:5ca11ae4-ddf1-49bb-b9fe-fe708bdea984 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.793520964 +0000 UTC m=+1.864419750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls") pod "image-registry-589dd864bc-k9hqj" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984") : secret "image-registry-tls" not found Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293485 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-kubelet\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293479 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-etc-kubernetes\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293517 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysconfig\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293571 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-netns\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293586 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-lib-modules\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293586 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-sys\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293620 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-run-netns\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293629 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-host\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293636 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-sys\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293655 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293673 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-socket-dir-parent\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293687 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-host\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293692 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-hostroot\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293722 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-socket-dir-parent\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293726 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-hostroot\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293732 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-conf\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293744 4933 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293759 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293780 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.793771444 +0000 UTC m=+1.864670230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:43.293786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293792 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-node-log\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293823 4933 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293831 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/419fe0bc-c964-47f0-82fc-3c5d45969e63-host\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293852 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-sysctl-conf\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293852 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-conf-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293834 4933 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d566bbdf8-jn8p4: secret "image-registry-tls" not found Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293877 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-multus-conf-dir\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293880 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-slash\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293892 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/419fe0bc-c964-47f0-82fc-3c5d45969e63-host\") pod \"node-ca-vvdnv\" (UID: \"419fe0bc-c964-47f0-82fc-3c5d45969e63\") " pod="openshift-image-registry/node-ca-vvdnv" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293904 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-slash\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293915 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-node-log\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293918 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293924 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls podName:b62a4890-77fb-4ee6-b710-aadb9a5b9463 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.793911165 +0000 UTC m=+1.864809945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls") pod "image-registry-6d566bbdf8-jn8p4" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463") : secret "image-registry-tls" not found Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.293973 4933 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.294009 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls podName:c1bc2f81-1e3d-426a-a25f-829a30545dc6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.793996445 +0000 UTC m=+1.864895214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-qsf8j" (UID: "c1bc2f81-1e3d-426a-a25f-829a30545dc6") : secret "samples-operator-tls" not found Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.293969 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.294022 4933 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294039 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-kubernetes\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.294069 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert podName:d72a205f-a6c2-4510-989f-cfd6c8aa045d nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.79405737 +0000 UTC m=+1.864956138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-mmh7p" (UID: "d72a205f-a6c2-4510-989f-cfd6c8aa045d") : secret "networking-console-plugin-cert" not found Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294075 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-kubernetes\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294082 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cnibin\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294100 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294118 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0f427f4-1c06-4556-8645-8932bcd7b653-crio-socket\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294140 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-cnibin\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294164 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294168 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f0f427f4-1c06-4556-8645-8932bcd7b653-crio-socket\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294189 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-ovn\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.294195 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.794186812 +0000 UTC m=+1.865085603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : configmap references non-existent config key: service-ca.crt Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294218 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4714c47-8079-4533-afaf-dfc3ff0f01f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2k7jl\" (UID: \"f4714c47-8079-4533-afaf-dfc3ff0f01f3\") " pod="openshift-multus/multus-additional-cni-plugins-2k7jl" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294222 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-ovn\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294219 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294238 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294259 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-systemd\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294275 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-var-lib-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294289 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-etc-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294309 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-multus\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294326 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-etc-systemd\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294324 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-etc-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294324 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294354 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-var-lib-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294349 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0f6b5a3-7817-41b8-800b-3cfeb03c5528-host-var-lib-cni-multus\") pod \"multus-bfkbs\" (UID: \"d0f6b5a3-7817-41b8-800b-3cfeb03c5528\") " pod="openshift-multus/multus-bfkbs" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294371 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-var-lib-kubelet\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.294384 4933 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294392 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.294408 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.794399678 +0000 UTC m=+1.865298432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : secret "metrics-daemon-secret" not found Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294415 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-run-openvswitch\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294419 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-log-socket\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294448 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-socket-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294453 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b707bb3-699a-42ba-a5a0-3a52077f1b13-var-lib-kubelet\") pod \"tuned-t2hsm\" (UID: \"3b707bb3-699a-42ba-a5a0-3a52077f1b13\") " pod="openshift-cluster-node-tuning-operator/tuned-t2hsm" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294464 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4d718cb-d755-4824-94f5-298a3411b7e5-host-slash\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294480 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294485 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4d718cb-d755-4824-94f5-298a3411b7e5-host-slash\") pod \"iptables-alerter-nlsq4\" (UID: \"f4d718cb-d755-4824-94f5-298a3411b7e5\") " pod="openshift-network-operator/iptables-alerter-nlsq4" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294486 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5048872-d721-4990-99e1-6ccb43420b31-socket-dir\") pod \"aws-ebs-csi-driver-node-szkst\" (UID: \"a5048872-d721-4990-99e1-6ccb43420b31\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-szkst" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294464 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5ad1eec-94bf-43a5-9541-9415db456d26-log-socket\") pod \"ovnkube-node-hqfbg\" (UID: \"a5ad1eec-94bf-43a5-9541-9415db456d26\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:43.295313 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.294899 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f0f427f4-1c06-4556-8645-8932bcd7b653-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.377100 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.377072 4933 scope.go:122] "RemoveContainer" containerID="f0f390cd89e84ede353cec463599d4716a38f1d9a494c9512f4a6a44c7a28b84" Oct 30 22:07:43.606256 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.606212 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fsplc_f9ef3359-4ffd-4a26-889a-8f516ef1970a/dns-node-resolver/0.log" Oct 30 22:07:43.798233 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.798208 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:43.798367 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.798251 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:43.798367 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.798278 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:43.798367 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.798306 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798368 4933 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798382 4933 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798402 4933 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d566bbdf8-jn8p4: secret "image-registry-tls" not found Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798411 4933 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798457 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls podName:b62a4890-77fb-4ee6-b710-aadb9a5b9463 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:44.798437946 +0000 UTC m=+2.869336715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls") pod "image-registry-6d566bbdf8-jn8p4" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463") : secret "image-registry-tls" not found Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798385 4933 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589dd864bc-k9hqj: secret "image-registry-tls" not found Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798475 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls podName:c1bc2f81-1e3d-426a-a25f-829a30545dc6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:44.798465974 +0000 UTC m=+2.869364739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-qsf8j" (UID: "c1bc2f81-1e3d-426a-a25f-829a30545dc6") : secret "samples-operator-tls" not found Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798476 4933 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.798498 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798510 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls podName:5ca11ae4-ddf1-49bb-b9fe-fe708bdea984 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:44.798494223 +0000 UTC m=+2.869392999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls") pod "image-registry-589dd864bc-k9hqj" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984") : secret "image-registry-tls" not found Oct 30 22:07:43.798530 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798534 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:44.798524551 +0000 UTC m=+2.869423316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798558 4933 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.798569 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798592 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert podName:d72a205f-a6c2-4510-989f-cfd6c8aa045d nodeName:}" failed. No retries permitted until 2026-10-30 22:07:44.798582732 +0000 UTC m=+2.869481487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-mmh7p" (UID: "d72a205f-a6c2-4510-989f-cfd6c8aa045d") : secret "networking-console-plugin-cert" not found Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.798648 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798665 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:44.798654801 +0000 UTC m=+2.869553559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : configmap references non-existent config key: service-ca.crt Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798691 4933 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.798701 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798714 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:44.798707816 +0000 UTC m=+2.869606570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : secret "metrics-daemon-secret" not found Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.798746 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798756 4933 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.798765 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798782 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls podName:9d369819-d29c-48a6-b03b-41f2145bac41 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:44.79877414 +0000 UTC m=+2.869672894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xvqph" (UID: "9d369819-d29c-48a6-b03b-41f2145bac41") : secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798809 4933 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798829 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls podName:9cab6006-eafd-41a7-8035-22dfb992b4e6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:44.7988233 +0000 UTC m=+2.869722054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls") pod "dns-default-7vvjk" (UID: "9cab6006-eafd-41a7-8035-22dfb992b4e6") : secret "dns-default-metrics-tls" not found Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798837 4933 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 22:07:43.799030 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:43.798857 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:44.798851031 +0000 UTC m=+2.869749785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : secret "router-metrics-certs-default" not found Oct 30 22:07:43.804768 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.804740 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:43.929911 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:43.929851 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:44.069565 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.069537 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:44.132443 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.132420 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:07:44.132868 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.132852 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/1.log" Oct 30 22:07:44.132931 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.132883 4933 generic.go:356] "Generic (PLEG): container finished" podID="ff224fb4-ef29-4599-aca1-38595e23d592" containerID="242fe22cc53de9067c4b2d53e5688b0f37c3b2548d286563696ad6c96f76f9bd" exitCode=255 Oct 30 22:07:44.132983 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.132959 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" event={"ID":"ff224fb4-ef29-4599-aca1-38595e23d592","Type":"ContainerDied","Data":"242fe22cc53de9067c4b2d53e5688b0f37c3b2548d286563696ad6c96f76f9bd"} Oct 30 22:07:44.133039 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.133023 4933 scope.go:122] "RemoveContainer" containerID="f0f390cd89e84ede353cec463599d4716a38f1d9a494c9512f4a6a44c7a28b84" Oct 30 22:07:44.135687 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.134142 4933 scope.go:122] "RemoveContainer" containerID="242fe22cc53de9067c4b2d53e5688b0f37c3b2548d286563696ad6c96f76f9bd" Oct 30 22:07:44.135687 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.134526 4933 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8ddx2_openshift-console-operator(ff224fb4-ef29-4599-aca1-38595e23d592)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" podUID="ff224fb4-ef29-4599-aca1-38595e23d592" Oct 30 22:07:44.240728 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.240676 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:44.798182 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.798156 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:44.808116 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808096 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:44.808193 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808136 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:44.808193 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808182 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:44.808257 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808209 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:44.808257 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808242 4933 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:07:44.808347 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808255 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:44.808347 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808286 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:44.808347 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808301 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:46.808284248 +0000 UTC m=+4.879183020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : secret "metrics-daemon-secret" not found Oct 30 22:07:44.808347 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808306 4933 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:44.808347 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808340 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808358 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls podName:9d369819-d29c-48a6-b03b-41f2145bac41 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:46.808345704 +0000 UTC m=+4.879244457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xvqph" (UID: "9d369819-d29c-48a6-b03b-41f2145bac41") : secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808359 4933 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808392 4933 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808395 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808404 4933 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d566bbdf8-jn8p4: secret "image-registry-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808416 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls podName:9cab6006-eafd-41a7-8035-22dfb992b4e6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:46.808400425 +0000 UTC m=+4.879299196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls") pod "dns-default-7vvjk" (UID: "9cab6006-eafd-41a7-8035-22dfb992b4e6") : secret "dns-default-metrics-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808358 4933 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808436 4933 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589dd864bc-k9hqj: secret "image-registry-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808452 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls podName:b62a4890-77fb-4ee6-b710-aadb9a5b9463 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:46.808442371 +0000 UTC m=+4.879341130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls") pod "image-registry-6d566bbdf8-jn8p4" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463") : secret "image-registry-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808464 4933 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808472 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808504 4933 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808510 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:46.808497898 +0000 UTC m=+4.879396670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808508 4933 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808535 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert podName:d72a205f-a6c2-4510-989f-cfd6c8aa045d nodeName:}" failed. No retries permitted until 2026-10-30 22:07:46.808524163 +0000 UTC m=+4.879422951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-mmh7p" (UID: "d72a205f-a6c2-4510-989f-cfd6c8aa045d") : secret "networking-console-plugin-cert" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808551 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls podName:5ca11ae4-ddf1-49bb-b9fe-fe708bdea984 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:46.808542771 +0000 UTC m=+4.879441525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls") pod "image-registry-589dd864bc-k9hqj" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984") : secret "image-registry-tls" not found Oct 30 22:07:44.808560 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.808531 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:44.809096 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:44.808626 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:46.808598139 +0000 UTC m=+4.879496916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : configmap references non-existent config key: service-ca.crt Oct 30 22:07:44.810520 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.810499 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-metrics-certs\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:44.810520 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.810509 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1bc2f81-1e3d-426a-a25f-829a30545dc6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-qsf8j\" (UID: \"c1bc2f81-1e3d-426a-a25f-829a30545dc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:44.877348 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:44.877317 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" Oct 30 22:07:45.007917 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:45.007894 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vvdnv_419fe0bc-c964-47f0-82fc-3c5d45969e63/node-ca/0.log" Oct 30 22:07:45.137228 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:45.137170 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:07:45.189364 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:45.189344 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j"] Oct 30 22:07:45.233748 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:45.233732 4933 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:07:45.384454 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:45.384422 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:45.587408 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:45.587376 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:45.604254 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:45.604233 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qg8m6_2996b6af-d6da-494d-b7d9-219a40969a19/serve-healthcheck-canary/0.log" Oct 30 22:07:45.781180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:45.781140 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:45.984036 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:45.983956 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:46.004830 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.004801 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-xpld5_66704037-d682-431e-b477-c0010e52e84d/migrator/0.log" Oct 30 22:07:46.061919 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.061887 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:07:46.141338 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.141308 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" event={"ID":"c1bc2f81-1e3d-426a-a25f-829a30545dc6","Type":"ContainerStarted","Data":"0a276206d3b9a87677f98acb4147e6b95274f5fd86af4dde2a6017a0ffd19f79"} Oct 30 22:07:46.175540 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.175494 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:46.205373 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.205352 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv_3748d1a1-641f-4259-84b0-a009feb248a8/kube-storage-version-migrator-operator/0.log" Oct 30 22:07:46.627089 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.627061 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:46.827146 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.827115 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:46.827304 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.827161 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:46.827304 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.827187 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:46.827304 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827276 4933 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:46.827304 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.827296 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:46.827467 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827319 4933 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:46.827467 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827329 4933 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-589dd864bc-k9hqj: secret "image-registry-tls" not found Oct 30 22:07:46.827467 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827277 4933 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 22:07:46.827467 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827329 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.827315598 +0000 UTC m=+8.898214352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:46.827467 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827360 4933 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d566bbdf8-jn8p4: secret "image-registry-tls" not found Oct 30 22:07:46.827467 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827380 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls podName:5ca11ae4-ddf1-49bb-b9fe-fe708bdea984 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.827365964 +0000 UTC m=+8.898264718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls") pod "image-registry-589dd864bc-k9hqj" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984") : secret "image-registry-tls" not found Oct 30 22:07:46.827467 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827377 4933 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 22:07:46.827467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.827404 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:46.827467 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827440 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls podName:b62a4890-77fb-4ee6-b710-aadb9a5b9463 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.827427203 +0000 UTC m=+8.898325985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls") pod "image-registry-6d566bbdf8-jn8p4" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463") : secret "image-registry-tls" not found Oct 30 22:07:46.827467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.827462 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:46.827864 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827477 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.827467038 +0000 UTC m=+8.898365796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : configmap references non-existent config key: service-ca.crt Oct 30 22:07:46.827864 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827495 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert podName:d72a205f-a6c2-4510-989f-cfd6c8aa045d nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.827490169 +0000 UTC m=+8.898388922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-mmh7p" (UID: "d72a205f-a6c2-4510-989f-cfd6c8aa045d") : secret "networking-console-plugin-cert" not found Oct 30 22:07:46.827864 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827505 4933 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:07:46.827864 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.827528 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:46.827864 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827535 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs podName:4b4095ea-eeca-4f26-8f4f-aa033aef4d5a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.827526229 +0000 UTC m=+8.898424983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs") pod "network-metrics-daemon-299zc" (UID: "4b4095ea-eeca-4f26-8f4f-aa033aef4d5a") : secret "metrics-daemon-secret" not found Oct 30 22:07:46.827864 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827571 4933 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:46.827864 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:46.827589 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:46.827864 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827595 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls podName:9d369819-d29c-48a6-b03b-41f2145bac41 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.827586882 +0000 UTC m=+8.898485637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-xvqph" (UID: "9d369819-d29c-48a6-b03b-41f2145bac41") : secret "cluster-monitoring-operator-tls" not found Oct 30 22:07:46.827864 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827655 4933 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:46.827864 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:46.827679 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls podName:9cab6006-eafd-41a7-8035-22dfb992b4e6 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.827673643 +0000 UTC m=+8.898572397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls") pod "dns-default-7vvjk" (UID: "9cab6006-eafd-41a7-8035-22dfb992b4e6") : secret "dns-default-metrics-tls" not found Oct 30 22:07:47.146492 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:47.146458 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" event={"ID":"c1bc2f81-1e3d-426a-a25f-829a30545dc6","Type":"ContainerStarted","Data":"9c287ba638a15536afd4397002cbc4f2b6855f46ebc8b3f689e95fd83c2d97e2"} Oct 30 22:07:47.146921 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:47.146530 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-qsf8j" event={"ID":"c1bc2f81-1e3d-426a-a25f-829a30545dc6","Type":"ContainerStarted","Data":"48e63fa3ced2938fe8fd29aeed9d507c3036863d9ffac3d7efd5415b75b9f5ca"} Oct 30 22:07:47.394429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:47.394398 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:47.435591 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:47.435520 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:47.435744 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:47.435722 4933 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 22:07:47.585490 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:47.585459 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:47.774134 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:47.774103 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:48.078805 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:48.078736 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:48.211481 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:48.211454 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:48.452185 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:48.452117 4933 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:48.452469 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:48.452456 4933 scope.go:122] "RemoveContainer" containerID="242fe22cc53de9067c4b2d53e5688b0f37c3b2548d286563696ad6c96f76f9bd" Oct 30 22:07:48.452664 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:48.452646 4933 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8ddx2_openshift-console-operator(ff224fb4-ef29-4599-aca1-38595e23d592)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" podUID="ff224fb4-ef29-4599-aca1-38595e23d592" Oct 30 22:07:49.392097 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:49.392059 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:49.600955 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:49.600924 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:49.785442 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:49.785409 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:49.980307 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:49.980279 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:50.185279 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.185204 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:50.866522 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.866482 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:50.866522 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.866522 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:50.867170 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.866551 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:50.867170 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.866592 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:50.867170 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.866658 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:50.867170 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.866702 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:50.867170 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.866733 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:50.867170 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:50.866792 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle podName:5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:58.866736618 +0000 UTC m=+16.937635384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle") pod "router-default-5df9566755-smt7x" (UID: "5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33") : configmap references non-existent config key: service-ca.crt Oct 30 22:07:50.867170 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:50.866808 4933 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:50.867170 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.866873 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:50.867170 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:50.866948 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls podName:f0f427f4-1c06-4556-8645-8932bcd7b653 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:58.866930179 +0000 UTC m=+16.937828946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls") pod "insights-runtime-extractor-86mjd" (UID: "f0f427f4-1c06-4556-8645-8932bcd7b653") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:50.869520 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.869485 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b4095ea-eeca-4f26-8f4f-aa033aef4d5a-metrics-certs\") pod \"network-metrics-daemon-299zc\" (UID: \"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a\") " pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:50.870398 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.870371 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"image-registry-6d566bbdf8-jn8p4\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:50.870497 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.870412 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d72a205f-a6c2-4510-989f-cfd6c8aa045d-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-mmh7p\" (UID: \"d72a205f-a6c2-4510-989f-cfd6c8aa045d\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:50.870675 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.870650 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d369819-d29c-48a6-b03b-41f2145bac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-xvqph\" (UID: \"9d369819-d29c-48a6-b03b-41f2145bac41\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:50.870740 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.870670 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cab6006-eafd-41a7-8035-22dfb992b4e6-metrics-tls\") pod \"dns-default-7vvjk\" (UID: \"9cab6006-eafd-41a7-8035-22dfb992b4e6\") " pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:50.871038 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.871015 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"image-registry-589dd864bc-k9hqj\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:50.872901 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.872869 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" Oct 30 22:07:50.878260 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.878235 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:50.879334 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.879305 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" Oct 30 22:07:50.881489 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.881467 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-299zc" Oct 30 22:07:50.884808 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.884785 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:07:50.886533 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:50.886515 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:51.036010 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.035986 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:51.187157 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.187134 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph"] Oct 30 22:07:51.188750 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:51.188727 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d369819_d29c_48a6_b03b_41f2145bac41.slice/crio-6c7758adafba1f4d4f9efd43bb0f00162ad7b5b2bde8af4388e95df49ab471a2 WatchSource:0}: Error finding container 6c7758adafba1f4d4f9efd43bb0f00162ad7b5b2bde8af4388e95df49ab471a2: Status 404 returned error can't find the container with id 6c7758adafba1f4d4f9efd43bb0f00162ad7b5b2bde8af4388e95df49ab471a2 Oct 30 22:07:51.235097 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.235075 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-299zc"] Oct 30 22:07:51.235548 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.235520 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-mmh7p"] Oct 30 22:07:51.237533 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:51.237510 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72a205f_a6c2_4510_989f_cfd6c8aa045d.slice/crio-5496f328449dcb95eab5deb2a55a3423be1711cdae0f260d7870e58c202724c5 WatchSource:0}: Error finding container 5496f328449dcb95eab5deb2a55a3423be1711cdae0f260d7870e58c202724c5: Status 404 returned error can't find the container with id 5496f328449dcb95eab5deb2a55a3423be1711cdae0f260d7870e58c202724c5 Oct 30 22:07:51.238064 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:51.237985 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4095ea_eeca_4f26_8f4f_aa033aef4d5a.slice/crio-312c112b975a6389b509088ab23f833ab15f22daba9c17aaf3d0506d8b64f610 WatchSource:0}: Error finding container 312c112b975a6389b509088ab23f833ab15f22daba9c17aaf3d0506d8b64f610: Status 404 returned error can't find the container with id 312c112b975a6389b509088ab23f833ab15f22daba9c17aaf3d0506d8b64f610 Oct 30 22:07:51.239832 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:51.239811 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca11ae4_ddf1_49bb_b9fe_fe708bdea984.slice/crio-f9b07d3468c14e1ce62127195ab7b5a09448bd3a465e5267eb218c9d8c5195e5 WatchSource:0}: Error finding container f9b07d3468c14e1ce62127195ab7b5a09448bd3a465e5267eb218c9d8c5195e5: Status 404 returned error can't find the container with id f9b07d3468c14e1ce62127195ab7b5a09448bd3a465e5267eb218c9d8c5195e5 Oct 30 22:07:51.247126 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.247106 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-589dd864bc-k9hqj"] Oct 30 22:07:51.247883 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.247870 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vvjk"] Oct 30 22:07:51.248629 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.248595 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d566bbdf8-jn8p4"] Oct 30 22:07:51.251377 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:51.251357 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62a4890_77fb_4ee6_b710_aadb9a5b9463.slice/crio-e5188121706c898f0a49e74f08e47bd375ec10fa1ebded9d3b431bdbe999f91d WatchSource:0}: Error finding container e5188121706c898f0a49e74f08e47bd375ec10fa1ebded9d3b431bdbe999f91d: Status 404 returned error can't find the container with id e5188121706c898f0a49e74f08e47bd375ec10fa1ebded9d3b431bdbe999f91d Oct 30 22:07:51.252224 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:51.252204 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cab6006_eafd_41a7_8035_22dfb992b4e6.slice/crio-3e40159afc08f3522ad132447f5b47a346e61053c54ed90a349dfb1e40dd9a70 WatchSource:0}: Error finding container 3e40159afc08f3522ad132447f5b47a346e61053c54ed90a349dfb1e40dd9a70: Status 404 returned error can't find the container with id 3e40159afc08f3522ad132447f5b47a346e61053c54ed90a349dfb1e40dd9a70 Oct 30 22:07:51.396757 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.396722 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:51.591290 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.591254 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:51.717033 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.716998 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:51.845358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.845234 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:51.993260 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:51.993189 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:52.019438 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.019407 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bz4rw" Oct 30 22:07:52.170824 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.170528 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" event={"ID":"9d369819-d29c-48a6-b03b-41f2145bac41","Type":"ContainerStarted","Data":"6c7758adafba1f4d4f9efd43bb0f00162ad7b5b2bde8af4388e95df49ab471a2"} Oct 30 22:07:52.175099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.174200 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" event={"ID":"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984","Type":"ContainerStarted","Data":"eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1"} Oct 30 22:07:52.175099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.174249 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" event={"ID":"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984","Type":"ContainerStarted","Data":"f9b07d3468c14e1ce62127195ab7b5a09448bd3a465e5267eb218c9d8c5195e5"} Oct 30 22:07:52.177363 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.177210 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" event={"ID":"d72a205f-a6c2-4510-989f-cfd6c8aa045d","Type":"ContainerStarted","Data":"5496f328449dcb95eab5deb2a55a3423be1711cdae0f260d7870e58c202724c5"} Oct 30 22:07:52.181829 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.181795 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" event={"ID":"b62a4890-77fb-4ee6-b710-aadb9a5b9463","Type":"ContainerStarted","Data":"e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724"} Oct 30 22:07:52.181941 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.181838 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" event={"ID":"b62a4890-77fb-4ee6-b710-aadb9a5b9463","Type":"ContainerStarted","Data":"e5188121706c898f0a49e74f08e47bd375ec10fa1ebded9d3b431bdbe999f91d"} Oct 30 22:07:52.183784 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.183727 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vvjk" event={"ID":"9cab6006-eafd-41a7-8035-22dfb992b4e6","Type":"ContainerStarted","Data":"3e40159afc08f3522ad132447f5b47a346e61053c54ed90a349dfb1e40dd9a70"} Oct 30 22:07:52.184992 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.184963 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:52.187358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.187336 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-299zc" event={"ID":"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a","Type":"ContainerStarted","Data":"312c112b975a6389b509088ab23f833ab15f22daba9c17aaf3d0506d8b64f610"} Oct 30 22:07:52.317908 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.317875 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:52.411600 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.411572 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:52.411964 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:52.411948 4933 scope.go:122] "RemoveContainer" containerID="242fe22cc53de9067c4b2d53e5688b0f37c3b2548d286563696ad6c96f76f9bd" Oct 30 22:07:52.412131 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:07:52.412106 4933 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8ddx2_openshift-console-operator(ff224fb4-ef29-4599-aca1-38595e23d592)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" podUID="ff224fb4-ef29-4599-aca1-38595e23d592" Oct 30 22:07:53.192971 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:53.192944 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-mmh7p" event={"ID":"d72a205f-a6c2-4510-989f-cfd6c8aa045d","Type":"ContainerStarted","Data":"714c1cb3100db78226c94c9453241b1783ecbdc689d7b7ddbc60ac9b7d0cc118"} Oct 30 22:07:53.195798 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:53.195776 4933 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 22:07:53.196591 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:53.196563 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-299zc" event={"ID":"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a","Type":"ContainerStarted","Data":"998c3e652172ac58433cc1c31ef1175cde6570dc6df18deffb2af79d439e48fe"} Oct 30 22:07:53.196703 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:53.196627 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-299zc" event={"ID":"4b4095ea-eeca-4f26-8f4f-aa033aef4d5a","Type":"ContainerStarted","Data":"d61cc62a2edb3b20a8add15442a43aacee577b945195f4536b5d3dfe1d10d228"} Oct 30 22:07:53.196758 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:53.196709 4933 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 22:07:53.389528 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:53.389490 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:53.588842 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:53.588805 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:53.793676 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:53.793632 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:53.889092 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:53.889062 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqfbg" Oct 30 22:07:53.925182 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:53.925158 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:54.052339 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.052279 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:54.075574 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.075555 4933 scope.go:122] "RemoveContainer" containerID="242fe22cc53de9067c4b2d53e5688b0f37c3b2548d286563696ad6c96f76f9bd" Oct 30 22:07:54.196164 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.196137 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:54.201372 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.201350 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:07:54.201520 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.201460 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" event={"ID":"ff224fb4-ef29-4599-aca1-38595e23d592","Type":"ContainerStarted","Data":"1852e40a518e7e7ae096faf12db9e5144fcd9131eea32d0de415e85a45fb63fc"} Oct 30 22:07:54.201838 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.201821 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:54.202890 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.202860 4933 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-8ddx2 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.19:8443/readyz\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Oct 30 22:07:54.203000 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.202907 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" podUID="ff224fb4-ef29-4599-aca1-38595e23d592" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.19:8443/readyz\": dial tcp 10.132.0.19:8443: connect: connection refused" Oct 30 22:07:54.203625 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.203579 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vvjk" event={"ID":"9cab6006-eafd-41a7-8035-22dfb992b4e6","Type":"ContainerStarted","Data":"cee0d20403e4dcbc84dc74c2fa8e596a83043a6dba32e36a6bf743d643f52ace"} Oct 30 22:07:54.203713 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.203647 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7vvjk" Oct 30 22:07:54.203713 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.203672 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vvjk" event={"ID":"9cab6006-eafd-41a7-8035-22dfb992b4e6","Type":"ContainerStarted","Data":"c111b5496694fe43a03476dd2c540ffcd61416b89b01d6664988e4d77329b5d3"} Oct 30 22:07:54.205061 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.205038 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-xvqph" event={"ID":"9d369819-d29c-48a6-b03b-41f2145bac41","Type":"ContainerStarted","Data":"d2f849fdfcce42859f5cd71ca480583c813714feaad17e70c4843e0f2cb1629b"} Oct 30 22:07:54.333280 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.333213 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:54.585360 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.585302 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:54.961145 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:54.961070 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:55.093334 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:55.093301 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:55.213130 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:55.213065 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8ddx2" Oct 30 22:07:55.223014 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:55.222989 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:55.358487 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:55.358460 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:55.481897 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:55.481825 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:55.614821 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:55.614791 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:56.540288 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:56.540249 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:56.605157 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:56.605130 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:07:56.670518 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:56.670480 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:58.939317 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:58.939276 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:58.939786 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:58.939325 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:58.940102 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:58.940078 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33-service-ca-bundle\") pod \"router-default-5df9566755-smt7x\" (UID: \"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33\") " pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:58.941988 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:58.941965 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f0f427f4-1c06-4556-8645-8932bcd7b653-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-86mjd\" (UID: \"f0f427f4-1c06-4556-8645-8932bcd7b653\") " pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:58.977986 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:58.977956 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:07:58.987673 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:58.987642 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-86mjd" Oct 30 22:07:59.307410 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:59.307386 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-86mjd"] Oct 30 22:07:59.309109 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:59.309083 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f427f4_1c06_4556_8645_8932bcd7b653.slice/crio-d0df6e2408df0151b5f98404ccb0e579240a43c40daac53aaac2daca0e8f77ec WatchSource:0}: Error finding container d0df6e2408df0151b5f98404ccb0e579240a43c40daac53aaac2daca0e8f77ec: Status 404 returned error can't find the container with id d0df6e2408df0151b5f98404ccb0e579240a43c40daac53aaac2daca0e8f77ec Oct 30 22:07:59.319055 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:59.319033 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5df9566755-smt7x"] Oct 30 22:07:59.320766 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:07:59.320718 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5212eb1f_ffaf_4fd0_b0a3_39a90fdb5c33.slice/crio-4bc92765933a8365f411b9789eae1671a03eeb47210ba6defbeaf14171e80a3e WatchSource:0}: Error finding container 4bc92765933a8365f411b9789eae1671a03eeb47210ba6defbeaf14171e80a3e: Status 404 returned error can't find the container with id 4bc92765933a8365f411b9789eae1671a03eeb47210ba6defbeaf14171e80a3e Oct 30 22:07:59.708778 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:07:59.708709 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:08:00.231096 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:00.231057 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-86mjd" event={"ID":"f0f427f4-1c06-4556-8645-8932bcd7b653","Type":"ContainerStarted","Data":"fc18af1ee7155bcb2baed087cab5d270c7fb15fc29c3b40306e8827bee3984de"} Oct 30 22:08:00.231539 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:00.231131 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-86mjd" event={"ID":"f0f427f4-1c06-4556-8645-8932bcd7b653","Type":"ContainerStarted","Data":"46b52c2fc77e08008880855f4f6cec536b02a60b6a310f18aaf10e2d8335e9b3"} Oct 30 22:08:00.231539 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:00.231160 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-86mjd" event={"ID":"f0f427f4-1c06-4556-8645-8932bcd7b653","Type":"ContainerStarted","Data":"d0df6e2408df0151b5f98404ccb0e579240a43c40daac53aaac2daca0e8f77ec"} Oct 30 22:08:00.232545 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:00.232519 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5df9566755-smt7x" event={"ID":"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33","Type":"ContainerStarted","Data":"73c77b352ee8d9b5275162602c61f785d869134a152ad522dabdc9ec7c36c4c6"} Oct 30 22:08:00.232638 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:00.232566 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5df9566755-smt7x" event={"ID":"5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33","Type":"ContainerStarted","Data":"4bc92765933a8365f411b9789eae1671a03eeb47210ba6defbeaf14171e80a3e"} Oct 30 22:08:00.978868 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:00.978826 4933 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:08:00.981270 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:00.981234 4933 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:08:01.029652 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:01.028829 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-589dd864bc-k9hqj"] Oct 30 22:08:01.154237 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:01.154210 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:01.238331 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:01.238266 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-86mjd" event={"ID":"f0f427f4-1c06-4556-8645-8932bcd7b653","Type":"ContainerStarted","Data":"a1ea40f8fd388eefb4f2f9ed8763282b95376bf980e0d8594c94e744f951f032"} Oct 30 22:08:01.238751 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:01.238542 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:08:01.239664 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:01.239644 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5df9566755-smt7x" Oct 30 22:08:01.292292 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:01.292248 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:01.423419 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:01.423379 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:01.816062 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:01.816027 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:04.211204 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:04.211173 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7vvjk" Oct 30 22:08:04.409421 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:04.409394 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:04.580094 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:04.580065 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:04.725893 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:04.725860 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:06.421581 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:06.421548 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:06.547623 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:06.547585 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:07.213316 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:07.213286 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:07.334358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:07.334327 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:07.463601 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:07.463536 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:08.845572 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:08.845538 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:09.004261 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.004228 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:09.201249 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.201180 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2jxzd"] Oct 30 22:08:09.224036 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.223995 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:09.228446 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.228427 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.279881 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.279855 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 22:08:09.280041 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.279905 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 22:08:09.280041 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.279968 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t24hw\"" Oct 30 22:08:09.313378 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.313358 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.313488 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.313385 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-tls\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.313488 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.313418 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3f223b2-d93e-423f-8c51-15393d8ee691-sys\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.313488 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.313443 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3f223b2-d93e-423f-8c51-15393d8ee691-root\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.313588 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.313515 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h46m\" (UniqueName: \"kubernetes.io/projected/e3f223b2-d93e-423f-8c51-15393d8ee691-kube-api-access-4h46m\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.313588 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.313569 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f223b2-d93e-423f-8c51-15393d8ee691-metrics-client-ca\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.313680 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.313658 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-wtmp\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.313713 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.313679 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-accelerators-collector-config\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.313713 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.313698 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-textfile\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.331618 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.331595 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 22:08:09.331708 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.331654 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 22:08:09.358851 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.358829 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:09.414472 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414448 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3f223b2-d93e-423f-8c51-15393d8ee691-root\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414572 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414492 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h46m\" (UniqueName: \"kubernetes.io/projected/e3f223b2-d93e-423f-8c51-15393d8ee691-kube-api-access-4h46m\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414572 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414519 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f223b2-d93e-423f-8c51-15393d8ee691-metrics-client-ca\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414754 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414591 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e3f223b2-d93e-423f-8c51-15393d8ee691-root\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414754 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414664 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-wtmp\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414754 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414692 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-accelerators-collector-config\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414754 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414712 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-textfile\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414754 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414743 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414986 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414765 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-tls\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414986 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414824 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3f223b2-d93e-423f-8c51-15393d8ee691-sys\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414986 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414842 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-wtmp\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.414986 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.414908 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3f223b2-d93e-423f-8c51-15393d8ee691-sys\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.415170 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.415137 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f223b2-d93e-423f-8c51-15393d8ee691-metrics-client-ca\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.415297 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.415184 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-textfile\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.415297 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.415208 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-accelerators-collector-config\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.417024 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.417006 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.417114 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.417010 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e3f223b2-d93e-423f-8c51-15393d8ee691-node-exporter-tls\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.437108 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.437085 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h46m\" (UniqueName: \"kubernetes.io/projected/e3f223b2-d93e-423f-8c51-15393d8ee691-kube-api-access-4h46m\") pod \"node-exporter-2jxzd\" (UID: \"e3f223b2-d93e-423f-8c51-15393d8ee691\") " pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.473424 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.473360 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:09.582262 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.582235 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2jxzd" Oct 30 22:08:09.608229 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.608183 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:09.613138 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:08:09.612899 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f223b2_d93e_423f_8c51_15393d8ee691.slice/crio-dd7ffb864b6e2ce8cf95765aa833800131bffa073059942019b893763df8e069 WatchSource:0}: Error finding container dd7ffb864b6e2ce8cf95765aa833800131bffa073059942019b893763df8e069: Status 404 returned error can't find the container with id dd7ffb864b6e2ce8cf95765aa833800131bffa073059942019b893763df8e069 Oct 30 22:08:09.713461 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.713437 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:08:09.729548 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:09.729474 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:10.193111 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:10.193076 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:10.271650 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:10.271597 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2jxzd" event={"ID":"e3f223b2-d93e-423f-8c51-15393d8ee691","Type":"ContainerStarted","Data":"dd7ffb864b6e2ce8cf95765aa833800131bffa073059942019b893763df8e069"} Oct 30 22:08:10.312512 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:10.312466 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:10.437767 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:10.437730 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:10.555462 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:10.555426 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:10.671068 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:10.671038 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:11.035297 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:11.035268 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:08:11.277087 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:11.277058 4933 generic.go:356] "Generic (PLEG): container finished" podID="e3f223b2-d93e-423f-8c51-15393d8ee691" containerID="47a2a7e7f5f0a32fac2b1d23c2e104128003b8acf475124e34d1234ed9bde106" exitCode=0 Oct 30 22:08:11.277437 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:11.277134 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2jxzd" event={"ID":"e3f223b2-d93e-423f-8c51-15393d8ee691","Type":"ContainerDied","Data":"47a2a7e7f5f0a32fac2b1d23c2e104128003b8acf475124e34d1234ed9bde106"} Oct 30 22:08:12.283260 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:12.283226 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2jxzd" event={"ID":"e3f223b2-d93e-423f-8c51-15393d8ee691","Type":"ContainerStarted","Data":"d1ceee24de0e423f36ff9950306dc2bcd6a448754e757a3ce587a118e6a47d5a"} Oct 30 22:08:12.283600 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:12.283286 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2jxzd" event={"ID":"e3f223b2-d93e-423f-8c51-15393d8ee691","Type":"ContainerStarted","Data":"0e0b370166ab68d03f5158c7be1017e85ccb5768ae6893ee4ad2dac34c32ff6c"} Oct 30 22:08:12.349717 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:12.349668 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2jxzd" podStartSLOduration=1.943546834 podStartE2EDuration="3.349654772s" totalImagesPullingTime="1.330371217s" totalInitContainerRuntime="75.736721ms" isStatefulPod=true podCreationTimestamp="2026-10-30 22:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:12.337900156 +0000 UTC m=+30.408798914" watchObservedRunningTime="2026-10-30 22:08:12.349654772 +0000 UTC m=+30.420553550" Oct 30 22:08:12.423402 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:12.423372 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:12.552809 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:12.552713 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:12.674301 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:12.674271 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:12.878785 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:12.878688 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:13.012064 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:13.012024 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:13.961853 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:13.961823 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:14.084209 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:14.084173 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:14.213949 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:14.213854 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:16.064499 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:16.064472 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4pd2j" Oct 30 22:08:16.191868 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:16.191826 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:16.475883 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:08:16.475797 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:08:19.194545 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:19.194509 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:19.336078 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:19.336043 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:20.168561 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:20.168520 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:20.288922 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:20.288867 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:20.413811 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:20.413781 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:22.214533 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:22.214494 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:22.339665 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:22.339629 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:22.969205 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:22.969170 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d566bbdf8-jn8p4"] Oct 30 22:08:23.121923 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:23.121883 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:23.260824 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:23.260786 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:26.054679 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.054646 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" podUID="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" containerName="registry" containerID="cri-o://eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1" gracePeriod=30 Oct 30 22:08:26.303503 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.303482 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:08:26.335397 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.335331 4933 generic.go:356] "Generic (PLEG): container finished" podID="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" containerID="eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1" exitCode=0 Oct 30 22:08:26.335397 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.335372 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" Oct 30 22:08:26.335583 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.335415 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" event={"ID":"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984","Type":"ContainerDied","Data":"eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1"} Oct 30 22:08:26.335583 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.335478 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-589dd864bc-k9hqj" event={"ID":"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984","Type":"ContainerDied","Data":"f9b07d3468c14e1ce62127195ab7b5a09448bd3a465e5267eb218c9d8c5195e5"} Oct 30 22:08:26.335583 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.335508 4933 scope.go:122] "RemoveContainer" containerID="eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1" Oct 30 22:08:26.343347 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343331 4933 scope.go:122] "RemoveContainer" containerID="eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1" Oct 30 22:08:26.343485 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343470 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-certificates\") pod \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " Oct 30 22:08:26.343562 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343548 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-kube-api-access-f9rnk\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-kube-api-access-f9rnk\") pod \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " Oct 30 22:08:26.343599 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:08:26.343583 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1\": container with ID starting with eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1 not found: ID does not exist" containerID="eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1" Oct 30 22:08:26.343660 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343627 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1"} err="failed to get container status \"eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1\": rpc error: code = NotFound desc = could not find container \"eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1\": container with ID starting with eb3adb488731efcd392b03962164f76713908a7165ebd0c7ccd06439dab823a1 not found: ID does not exist" Oct 30 22:08:26.343660 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343591 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-installation-pull-secrets\") pod \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " Oct 30 22:08:26.343777 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343685 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-ca-trust-extracted\") pod \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " Oct 30 22:08:26.343777 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343710 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") pod \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " Oct 30 22:08:26.343777 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343727 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-bound-sa-token\") pod \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " Oct 30 22:08:26.343777 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343744 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-image-registry-private-configuration\") pod \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " Oct 30 22:08:26.343777 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343765 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-trusted-ca\") pod \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\" (UID: \"5ca11ae4-ddf1-49bb-b9fe-fe708bdea984\") " Oct 30 22:08:26.344034 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.343893 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-certificates" pod "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:08:26.344156 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.344138 4933 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-certificates\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:26.344259 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.344236 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-trusted-ca" pod "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:08:26.346061 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.346032 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-kube-api-access-f9rnk" pod "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984"). InnerVolumeSpecName "kube-api-access-f9rnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:08:26.346266 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.346235 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls" pod "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:08:26.346367 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.346302 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-installation-pull-secrets" pod "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:08:26.346545 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.346522 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-bound-sa-token" pod "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:08:26.346592 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.346549 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-image-registry-private-configuration" pod "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:08:26.352715 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.352648 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-ca-trust-extracted" pod "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" (UID: "5ca11ae4-ddf1-49bb-b9fe-fe708bdea984"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:08:26.445215 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.445187 4933 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9rnk\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-kube-api-access-f9rnk\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:26.445215 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.445211 4933 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-installation-pull-secrets\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:26.445215 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.445221 4933 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-ca-trust-extracted\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:26.445389 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.445231 4933 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-registry-tls\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:26.445389 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.445240 4933 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-bound-sa-token\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:26.445389 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.445249 4933 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-image-registry-private-configuration\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:26.445389 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.445258 4933 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984-trusted-ca\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:26.675488 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.675458 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-589dd864bc-k9hqj"] Oct 30 22:08:26.684965 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:26.684939 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-589dd864bc-k9hqj"] Oct 30 22:08:27.940662 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:27.940550 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:28.071400 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:28.071374 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:28.078808 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:28.078782 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" path="/var/lib/kubelet/pods/5ca11ae4-ddf1-49bb-b9fe-fe708bdea984/volumes" Oct 30 22:08:30.296265 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:30.296221 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:30.440802 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:30.440755 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:31.251308 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:31.251277 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:31.382547 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:31.382516 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:32.378183 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:32.378153 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:32.578812 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:32.578778 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:37.214078 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:37.214038 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:37.348905 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:37.348876 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:46.012820 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:46.012779 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:46.144283 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:46.144242 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:46.474858 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:08:46.474781 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:08:47.584327 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:47.584289 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:47.715617 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:47.715581 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:47.839897 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:47.839812 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:47.988727 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:47.988689 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" podUID="b62a4890-77fb-4ee6-b710-aadb9a5b9463" containerName="registry" containerID="cri-o://e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724" gracePeriod=30 Oct 30 22:08:48.065361 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.065337 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:48.193913 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.193875 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:48.220752 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.220725 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:08:48.306496 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.306470 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-installation-pull-secrets\") pod \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " Oct 30 22:08:48.306656 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.306513 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") pod \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " Oct 30 22:08:48.306656 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.306542 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-trusted-ca\") pod \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " Oct 30 22:08:48.306656 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.306583 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-kube-api-access-bjdb8\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-kube-api-access-bjdb8\") pod \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " Oct 30 22:08:48.306784 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.306730 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b62a4890-77fb-4ee6-b710-aadb9a5b9463-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b62a4890-77fb-4ee6-b710-aadb9a5b9463-ca-trust-extracted\") pod \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " Oct 30 22:08:48.306842 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.306780 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-certificates\") pod \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " Oct 30 22:08:48.306897 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.306843 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-bound-sa-token\") pod \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " Oct 30 22:08:48.306897 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.306883 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-image-registry-private-configuration\") pod \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\" (UID: \"b62a4890-77fb-4ee6-b710-aadb9a5b9463\") " Oct 30 22:08:48.307009 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.306985 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-trusted-ca" pod "b62a4890-77fb-4ee6-b710-aadb9a5b9463" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:08:48.307156 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.307137 4933 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-trusted-ca\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:48.307237 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.307209 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-certificates" pod "b62a4890-77fb-4ee6-b710-aadb9a5b9463" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:08:48.308888 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.308861 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-installation-pull-secrets" pod "b62a4890-77fb-4ee6-b710-aadb9a5b9463" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:08:48.309254 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.309218 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-bound-sa-token" pod "b62a4890-77fb-4ee6-b710-aadb9a5b9463" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:08:48.309363 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.309283 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-kube-api-access-bjdb8" pod "b62a4890-77fb-4ee6-b710-aadb9a5b9463" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463"). InnerVolumeSpecName "kube-api-access-bjdb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:08:48.309476 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.309459 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-image-registry-private-configuration" pod "b62a4890-77fb-4ee6-b710-aadb9a5b9463" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:08:48.309476 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.309461 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls" pod "b62a4890-77fb-4ee6-b710-aadb9a5b9463" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:08:48.313199 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.313177 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b62a4890-77fb-4ee6-b710-aadb9a5b9463-ca-trust-extracted" pod "b62a4890-77fb-4ee6-b710-aadb9a5b9463" (UID: "b62a4890-77fb-4ee6-b710-aadb9a5b9463"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:08:48.408180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.408122 4933 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-installation-pull-secrets\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:48.408180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.408145 4933 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-tls\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:48.408180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.408155 4933 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjdb8\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-kube-api-access-bjdb8\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:48.408180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.408164 4933 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b62a4890-77fb-4ee6-b710-aadb9a5b9463-ca-trust-extracted\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:48.408180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.408173 4933 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b62a4890-77fb-4ee6-b710-aadb9a5b9463-registry-certificates\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:48.408180 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.408181 4933 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b62a4890-77fb-4ee6-b710-aadb9a5b9463-bound-sa-token\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:48.408435 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.408191 4933 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b62a4890-77fb-4ee6-b710-aadb9a5b9463-image-registry-private-configuration\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:08:48.415325 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.415301 4933 generic.go:356] "Generic (PLEG): container finished" podID="b62a4890-77fb-4ee6-b710-aadb9a5b9463" containerID="e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724" exitCode=0 Oct 30 22:08:48.415423 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.415353 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" Oct 30 22:08:48.415423 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.415363 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" event={"ID":"b62a4890-77fb-4ee6-b710-aadb9a5b9463","Type":"ContainerDied","Data":"e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724"} Oct 30 22:08:48.415423 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.415402 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d566bbdf8-jn8p4" event={"ID":"b62a4890-77fb-4ee6-b710-aadb9a5b9463","Type":"ContainerDied","Data":"e5188121706c898f0a49e74f08e47bd375ec10fa1ebded9d3b431bdbe999f91d"} Oct 30 22:08:48.415537 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.415424 4933 scope.go:122] "RemoveContainer" containerID="e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724" Oct 30 22:08:48.423362 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.423346 4933 scope.go:122] "RemoveContainer" containerID="e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724" Oct 30 22:08:48.423563 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:08:48.423545 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724\": container with ID starting with e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724 not found: ID does not exist" containerID="e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724" Oct 30 22:08:48.423601 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.423571 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724"} err="failed to get container status \"e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724\": rpc error: code = NotFound desc = could not find container \"e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724\": container with ID starting with e513373be8bf761551c460bcb6252c19aa59a89332cb7311dde10f2bf873a724 not found: ID does not exist" Oct 30 22:08:48.461331 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.461311 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d566bbdf8-jn8p4"] Oct 30 22:08:48.466344 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:48.466324 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d566bbdf8-jn8p4"] Oct 30 22:08:50.081884 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:50.081841 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b62a4890-77fb-4ee6-b710-aadb9a5b9463" path="/var/lib/kubelet/pods/b62a4890-77fb-4ee6-b710-aadb9a5b9463/volumes" Oct 30 22:08:52.209588 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:52.209506 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:52.336767 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:52.336727 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:08:52.430292 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:52.430253 4933 generic.go:356] "Generic (PLEG): container finished" podID="3748d1a1-641f-4259-84b0-a009feb248a8" containerID="fa4ad542d22929c0645b68a495a08f06cc2e1bee644887747aa51800a71af1f0" exitCode=0 Oct 30 22:08:52.430434 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:52.430320 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" event={"ID":"3748d1a1-641f-4259-84b0-a009feb248a8","Type":"ContainerDied","Data":"fa4ad542d22929c0645b68a495a08f06cc2e1bee644887747aa51800a71af1f0"} Oct 30 22:08:52.430663 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:52.430650 4933 scope.go:122] "RemoveContainer" containerID="fa4ad542d22929c0645b68a495a08f06cc2e1bee644887747aa51800a71af1f0" Oct 30 22:08:53.435586 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:08:53.435554 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qz9rv" event={"ID":"3748d1a1-641f-4259-84b0-a009feb248a8","Type":"ContainerStarted","Data":"8a4c99ea97c02d46e5076b19e28b3cb909cebe71f2ce53dd8ffc85ec99fcddde"} Oct 30 22:09:02.465746 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:02.465708 4933 generic.go:356] "Generic (PLEG): container finished" podID="60d187ab-b86b-42f8-9bdb-2cdad6e6d518" containerID="cdf6b44181269f4a6cc527544f78ca051e1422f3c3d6fb3d1bad5648e61a7e6a" exitCode=0 Oct 30 22:09:02.466127 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:02.465752 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-hdt8n" event={"ID":"60d187ab-b86b-42f8-9bdb-2cdad6e6d518","Type":"ContainerDied","Data":"cdf6b44181269f4a6cc527544f78ca051e1422f3c3d6fb3d1bad5648e61a7e6a"} Oct 30 22:09:02.466127 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:02.466046 4933 scope.go:122] "RemoveContainer" containerID="cdf6b44181269f4a6cc527544f78ca051e1422f3c3d6fb3d1bad5648e61a7e6a" Oct 30 22:09:03.470326 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:03.470292 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-hdt8n" event={"ID":"60d187ab-b86b-42f8-9bdb-2cdad6e6d518","Type":"ContainerStarted","Data":"6c47f4a9009e6586d90af4c8402d51d8927276f5f0ad0a4a69b7ba97d1e7adf1"} Oct 30 22:09:04.417769 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:04.417733 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:04.550681 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:04.550640 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:07.820876 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:07.820838 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:16.475952 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:09:16.475916 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:09:17.519312 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:17.519284 4933 generic.go:356] "Generic (PLEG): container finished" podID="2be079bb-4896-4a19-8a9f-0313a9bffea8" containerID="ae35100746e32165ec2b5a0315f2175645ad8e050f27c4bc7a785255a69becb2" exitCode=0 Oct 30 22:09:17.519677 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:17.519331 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" event={"ID":"2be079bb-4896-4a19-8a9f-0313a9bffea8","Type":"ContainerDied","Data":"ae35100746e32165ec2b5a0315f2175645ad8e050f27c4bc7a785255a69becb2"} Oct 30 22:09:17.519677 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:17.519600 4933 scope.go:122] "RemoveContainer" containerID="ae35100746e32165ec2b5a0315f2175645ad8e050f27c4bc7a785255a69becb2" Oct 30 22:09:18.524739 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:18.524699 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-m9f7g" event={"ID":"2be079bb-4896-4a19-8a9f-0313a9bffea8","Type":"ContainerStarted","Data":"bc9711a662ebd391e0608731f4d7e0551a59146a5b7ad759ce8a1e1580749247"} Oct 30 22:09:32.508756 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:09:32.508722 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:09:46.476658 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:09:46.476623 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:10:16.475911 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:10:16.475872 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:10:29.895542 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:10:29.895496 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:30.025674 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:10:30.025633 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:32.647870 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:10:32.647799 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:38.851499 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:10:38.851422 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:10:46.475638 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:10:46.475590 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:11:03.198847 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:11:03.198811 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:11:03.355641 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:11:03.355591 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:11:16.476940 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:11:16.476899 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:11:32.741897 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:11:32.741812 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:11:46.476770 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:11:46.476729 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:12:16.477177 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:12:16.477136 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:12:32.904672 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:12:32.904637 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:33.816743 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:12:33.816711 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:42.093983 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:12:42.093951 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:12:42.095559 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:12:42.095521 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:12:46.475980 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:12:46.475942 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:12:52.246738 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:12:52.246702 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:12:52.367329 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:12:52.367296 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:16.477284 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:13:16.477240 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:13:33.050225 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:13:33.050185 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:13:46.478318 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:13:46.478277 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:14:16.476993 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:14:16.476953 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:14:33.139160 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:14:33.139072 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:42.006792 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:14:42.006753 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:42.131538 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:14:42.131462 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:42.854969 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:14:42.854928 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:14:46.476795 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:14:46.476754 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:15:03.148671 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:15:03.148628 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:06.363242 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:15:06.363207 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:06.490048 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:15:06.490017 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:16.475865 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:15:16.475822 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:15:33.233988 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:15:33.233934 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:15:46.475367 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:15:46.475334 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:15:48.223443 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:15:48.223411 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:07.605418 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:07.605340 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:16.477394 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:16:16.477358 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:16:18.848747 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:18.848710 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:19.035158 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:19.035124 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:19.217769 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:19.217679 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:19.371816 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:19.371748 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:20.399303 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.399271 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd"] Oct 30 22:16:20.399832 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.399710 4933 cpu_manager.go:414] "containerMap: removing container" podUID="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" containerName="registry" Oct 30 22:16:20.399832 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.399730 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" containerName="registry" Oct 30 22:16:20.399832 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.399779 4933 cpu_manager.go:414] "containerMap: removing container" podUID="b62a4890-77fb-4ee6-b710-aadb9a5b9463" containerName="registry" Oct 30 22:16:20.399832 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.399787 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b62a4890-77fb-4ee6-b710-aadb9a5b9463" containerName="registry" Oct 30 22:16:20.400043 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.399862 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="b62a4890-77fb-4ee6-b710-aadb9a5b9463" containerName="registry" Oct 30 22:16:20.400043 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.399875 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ca11ae4-ddf1-49bb-b9fe-fe708bdea984" containerName="registry" Oct 30 22:16:20.403072 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.403049 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:20.429154 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.429122 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"98a21a31f7a8ae0212b9c22cc643f9202bfa37-6b211c7f-dockercfg-86k28\"" Oct 30 22:16:20.429266 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.429192 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 22:16:20.429266 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.429250 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 22:16:20.430269 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.430245 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd"] Oct 30 22:16:20.478318 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.478287 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqgmg\" (UniqueName: \"kubernetes.io/projected/5554c9ae-5142-4f35-a477-3d955ca93266-kube-api-access-hqgmg\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:20.478435 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.478347 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:20.478435 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.478394 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:20.579298 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.579262 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:20.579428 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.579333 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:20.579428 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.579372 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqgmg\" (UniqueName: \"kubernetes.io/projected/5554c9ae-5142-4f35-a477-3d955ca93266-kube-api-access-hqgmg\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:20.579656 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.579635 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:20.579733 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.579682 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:20.602544 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.602518 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqgmg\" (UniqueName: \"kubernetes.io/projected/5554c9ae-5142-4f35-a477-3d955ca93266-kube-api-access-hqgmg\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:20.719662 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:20.719590 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:21.030197 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:21.030172 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd"] Oct 30 22:16:21.032115 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:16:21.032089 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5554c9ae_5142_4f35_a477_3d955ca93266.slice/crio-318fb45c06cacc1dd93340e102f0d9526b8537437fee5de6d069235915b3948d WatchSource:0}: Error finding container 318fb45c06cacc1dd93340e102f0d9526b8537437fee5de6d069235915b3948d: Status 404 returned error can't find the container with id 318fb45c06cacc1dd93340e102f0d9526b8537437fee5de6d069235915b3948d Oct 30 22:16:21.034121 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:21.034095 4933 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:16:21.055999 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:21.055976 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" event={"ID":"5554c9ae-5142-4f35-a477-3d955ca93266","Type":"ContainerStarted","Data":"318fb45c06cacc1dd93340e102f0d9526b8537437fee5de6d069235915b3948d"} Oct 30 22:16:27.080011 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:27.079972 4933 generic.go:356] "Generic (PLEG): container finished" podID="5554c9ae-5142-4f35-a477-3d955ca93266" containerID="d170f38915fa536a8cb6520a4baeb80cc51a3f9c44e6f1b2da9a3ccf2a13f697" exitCode=0 Oct 30 22:16:27.080415 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:27.080056 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" event={"ID":"5554c9ae-5142-4f35-a477-3d955ca93266","Type":"ContainerDied","Data":"d170f38915fa536a8cb6520a4baeb80cc51a3f9c44e6f1b2da9a3ccf2a13f697"} Oct 30 22:16:30.091681 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:30.091632 4933 generic.go:356] "Generic (PLEG): container finished" podID="5554c9ae-5142-4f35-a477-3d955ca93266" containerID="c7d289a10ed01938deea4c9b194670d0fc8fb4adeaf7c032789433350c930e6d" exitCode=0 Oct 30 22:16:30.092127 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:30.091740 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" event={"ID":"5554c9ae-5142-4f35-a477-3d955ca93266","Type":"ContainerDied","Data":"c7d289a10ed01938deea4c9b194670d0fc8fb4adeaf7c032789433350c930e6d"} Oct 30 22:16:33.348460 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:33.348417 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:36.121887 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:36.121816 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" event={"ID":"5554c9ae-5142-4f35-a477-3d955ca93266","Type":"ContainerStarted","Data":"76660527ad0cb177948b9d235ec2372cb50b0bff1b63a394a0531699a7e2a562"} Oct 30 22:16:37.127478 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:37.127437 4933 generic.go:356] "Generic (PLEG): container finished" podID="5554c9ae-5142-4f35-a477-3d955ca93266" containerID="76660527ad0cb177948b9d235ec2372cb50b0bff1b63a394a0531699a7e2a562" exitCode=0 Oct 30 22:16:37.127907 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:37.127501 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" event={"ID":"5554c9ae-5142-4f35-a477-3d955ca93266","Type":"ContainerDied","Data":"76660527ad0cb177948b9d235ec2372cb50b0bff1b63a394a0531699a7e2a562"} Oct 30 22:16:38.252277 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:38.252254 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:38.321244 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:38.321217 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-util\" (UniqueName: \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-util\") pod \"5554c9ae-5142-4f35-a477-3d955ca93266\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " Oct 30 22:16:38.321354 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:38.321276 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-bundle\" (UniqueName: \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-bundle\") pod \"5554c9ae-5142-4f35-a477-3d955ca93266\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " Oct 30 22:16:38.321354 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:38.321297 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5554c9ae-5142-4f35-a477-3d955ca93266-kube-api-access-hqgmg\" (UniqueName: \"kubernetes.io/projected/5554c9ae-5142-4f35-a477-3d955ca93266-kube-api-access-hqgmg\") pod \"5554c9ae-5142-4f35-a477-3d955ca93266\" (UID: \"5554c9ae-5142-4f35-a477-3d955ca93266\") " Oct 30 22:16:38.322036 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:38.322008 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-bundle" pod "5554c9ae-5142-4f35-a477-3d955ca93266" (UID: "5554c9ae-5142-4f35-a477-3d955ca93266"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:16:38.323358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:38.323331 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5554c9ae-5142-4f35-a477-3d955ca93266-kube-api-access-hqgmg" pod "5554c9ae-5142-4f35-a477-3d955ca93266" (UID: "5554c9ae-5142-4f35-a477-3d955ca93266"). InnerVolumeSpecName "kube-api-access-hqgmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:16:38.326708 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:38.326685 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-util" pod "5554c9ae-5142-4f35-a477-3d955ca93266" (UID: "5554c9ae-5142-4f35-a477-3d955ca93266"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:16:38.421847 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:38.421786 4933 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-bundle\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:16:38.421847 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:38.421814 4933 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqgmg\" (UniqueName: \"kubernetes.io/projected/5554c9ae-5142-4f35-a477-3d955ca93266-kube-api-access-hqgmg\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:16:38.421847 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:38.421827 4933 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5554c9ae-5142-4f35-a477-3d955ca93266-util\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:16:39.136802 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:39.136768 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" Oct 30 22:16:39.136802 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:39.136778 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cxtkrd" event={"ID":"5554c9ae-5142-4f35-a477-3d955ca93266","Type":"ContainerDied","Data":"318fb45c06cacc1dd93340e102f0d9526b8537437fee5de6d069235915b3948d"} Oct 30 22:16:39.137067 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:39.136820 4933 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="318fb45c06cacc1dd93340e102f0d9526b8537437fee5de6d069235915b3948d" Oct 30 22:16:41.728751 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:41.728714 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:41.872810 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:41.872776 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:43.583736 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.583700 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4"] Oct 30 22:16:43.584141 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.583966 4933 cpu_manager.go:414] "containerMap: removing container" podUID="5554c9ae-5142-4f35-a477-3d955ca93266" containerName="pull" Oct 30 22:16:43.584141 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.583976 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5554c9ae-5142-4f35-a477-3d955ca93266" containerName="pull" Oct 30 22:16:43.584141 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.584008 4933 cpu_manager.go:414] "containerMap: removing container" podUID="5554c9ae-5142-4f35-a477-3d955ca93266" containerName="extract" Oct 30 22:16:43.584141 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.584015 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5554c9ae-5142-4f35-a477-3d955ca93266" containerName="extract" Oct 30 22:16:43.584141 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.584022 4933 cpu_manager.go:414] "containerMap: removing container" podUID="5554c9ae-5142-4f35-a477-3d955ca93266" containerName="util" Oct 30 22:16:43.584141 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.584028 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5554c9ae-5142-4f35-a477-3d955ca93266" containerName="util" Oct 30 22:16:43.584141 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.584091 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="5554c9ae-5142-4f35-a477-3d955ca93266" containerName="extract" Oct 30 22:16:43.587395 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.587378 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" Oct 30 22:16:43.602445 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.602426 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Oct 30 22:16:43.602531 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.602515 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-64ps6\"" Oct 30 22:16:43.613319 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.613298 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Oct 30 22:16:43.613426 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.613346 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Oct 30 22:16:43.614561 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.614542 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4"] Oct 30 22:16:43.657192 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.657162 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2a734157-669d-4f1d-b91e-bcc1592e1033-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-b2nk4\" (UID: \"2a734157-669d-4f1d-b91e-bcc1592e1033\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" Oct 30 22:16:43.657305 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.657226 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7lh8\" (UniqueName: \"kubernetes.io/projected/2a734157-669d-4f1d-b91e-bcc1592e1033-kube-api-access-d7lh8\") pod \"custom-metrics-autoscaler-operator-c667576c8-b2nk4\" (UID: \"2a734157-669d-4f1d-b91e-bcc1592e1033\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" Oct 30 22:16:43.758160 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.758130 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2a734157-669d-4f1d-b91e-bcc1592e1033-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-b2nk4\" (UID: \"2a734157-669d-4f1d-b91e-bcc1592e1033\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" Oct 30 22:16:43.758270 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.758186 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7lh8\" (UniqueName: \"kubernetes.io/projected/2a734157-669d-4f1d-b91e-bcc1592e1033-kube-api-access-d7lh8\") pod \"custom-metrics-autoscaler-operator-c667576c8-b2nk4\" (UID: \"2a734157-669d-4f1d-b91e-bcc1592e1033\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" Oct 30 22:16:43.760532 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.760516 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2a734157-669d-4f1d-b91e-bcc1592e1033-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-b2nk4\" (UID: \"2a734157-669d-4f1d-b91e-bcc1592e1033\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" Oct 30 22:16:43.781325 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.781302 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7lh8\" (UniqueName: \"kubernetes.io/projected/2a734157-669d-4f1d-b91e-bcc1592e1033-kube-api-access-d7lh8\") pod \"custom-metrics-autoscaler-operator-c667576c8-b2nk4\" (UID: \"2a734157-669d-4f1d-b91e-bcc1592e1033\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" Oct 30 22:16:43.899081 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:43.899024 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" Oct 30 22:16:44.221287 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:44.221211 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4"] Oct 30 22:16:44.235101 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:16:44.235071 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a734157_669d_4f1d_b91e_bcc1592e1033.slice/crio-69feb2f2109cbce988144a6551c195ee9e1f54791748ff8538f587e65ad793f3 WatchSource:0}: Error finding container 69feb2f2109cbce988144a6551c195ee9e1f54791748ff8538f587e65ad793f3: Status 404 returned error can't find the container with id 69feb2f2109cbce988144a6551c195ee9e1f54791748ff8538f587e65ad793f3 Oct 30 22:16:45.160477 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:45.160439 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" event={"ID":"2a734157-669d-4f1d-b91e-bcc1592e1033","Type":"ContainerStarted","Data":"69feb2f2109cbce988144a6551c195ee9e1f54791748ff8538f587e65ad793f3"} Oct 30 22:16:46.481059 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:16:46.481024 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:16:47.879500 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:47.879466 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:48.173181 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.173106 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" event={"ID":"2a734157-669d-4f1d-b91e-bcc1592e1033","Type":"ContainerStarted","Data":"ff7d0cf0b38399e1020db231feb11b69f98f8df4bde886f98855d617c2a0472d"} Oct 30 22:16:48.173322 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.173282 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" Oct 30 22:16:48.239224 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.239181 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" podStartSLOduration=2.221309239 podStartE2EDuration="5.23917015s" totalImagesPullingTime="3.017860911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:48.227093593 +0000 UTC m=+546.297992372" watchObservedRunningTime="2026-10-30 22:16:48.23917015 +0000 UTC m=+546.310068922" Oct 30 22:16:48.453312 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.453238 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-7dc85965f-8qv6j"] Oct 30 22:16:48.456578 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.456557 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:48.470198 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.470173 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:48.472543 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.472522 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-tp7x7\"" Oct 30 22:16:48.476079 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.476054 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Oct 30 22:16:48.477465 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.477441 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-8qv6j"] Oct 30 22:16:48.486633 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.486598 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Oct 30 22:16:48.594810 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.594782 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xrwq\" (UniqueName: \"kubernetes.io/projected/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-kube-api-access-6xrwq\") pod \"keda-operator-7dc85965f-8qv6j\" (UID: \"fc0e49f8-b3ca-42aa-84d4-14ede02fd659\") " pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:48.594917 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.594813 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-cabundle0\") pod \"keda-operator-7dc85965f-8qv6j\" (UID: \"fc0e49f8-b3ca-42aa-84d4-14ede02fd659\") " pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:48.594917 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.594836 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-certificates\") pod \"keda-operator-7dc85965f-8qv6j\" (UID: \"fc0e49f8-b3ca-42aa-84d4-14ede02fd659\") " pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:48.608904 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.608876 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:48.695901 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.695874 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-cabundle0\") pod \"keda-operator-7dc85965f-8qv6j\" (UID: \"fc0e49f8-b3ca-42aa-84d4-14ede02fd659\") " pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:48.695988 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.695910 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-certificates\") pod \"keda-operator-7dc85965f-8qv6j\" (UID: \"fc0e49f8-b3ca-42aa-84d4-14ede02fd659\") " pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:48.695988 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.695959 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xrwq\" (UniqueName: \"kubernetes.io/projected/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-kube-api-access-6xrwq\") pod \"keda-operator-7dc85965f-8qv6j\" (UID: \"fc0e49f8-b3ca-42aa-84d4-14ede02fd659\") " pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:48.696065 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:16:48.696033 4933 secret.go:281] references non-existent secret key: ca.crt Oct 30 22:16:48.696065 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:16:48.696046 4933 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Oct 30 22:16:48.696065 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:16:48.696054 4933 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-7dc85965f-8qv6j: references non-existent secret key: ca.crt Oct 30 22:16:48.696155 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:16:48.696101 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-certificates podName:fc0e49f8-b3ca-42aa-84d4-14ede02fd659 nodeName:}" failed. No retries permitted until 2026-10-30 22:16:49.196084957 +0000 UTC m=+547.266983726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-certificates") pod "keda-operator-7dc85965f-8qv6j" (UID: "fc0e49f8-b3ca-42aa-84d4-14ede02fd659") : references non-existent secret key: ca.crt Oct 30 22:16:48.696470 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.696453 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-cabundle0\") pod \"keda-operator-7dc85965f-8qv6j\" (UID: \"fc0e49f8-b3ca-42aa-84d4-14ede02fd659\") " pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:48.718832 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.718788 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xrwq\" (UniqueName: \"kubernetes.io/projected/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-kube-api-access-6xrwq\") pod \"keda-operator-7dc85965f-8qv6j\" (UID: \"fc0e49f8-b3ca-42aa-84d4-14ede02fd659\") " pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:48.909616 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:48.909574 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:49.111847 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:49.111819 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:49.199938 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:49.199910 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-certificates\") pod \"keda-operator-7dc85965f-8qv6j\" (UID: \"fc0e49f8-b3ca-42aa-84d4-14ede02fd659\") " pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:49.202242 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:49.202217 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fc0e49f8-b3ca-42aa-84d4-14ede02fd659-certificates\") pod \"keda-operator-7dc85965f-8qv6j\" (UID: \"fc0e49f8-b3ca-42aa-84d4-14ede02fd659\") " pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:49.270782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:49.270754 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:49.369110 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:49.369053 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:49.421854 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:49.421828 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:49.663644 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:49.663616 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-8qv6j"] Oct 30 22:16:49.665023 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:16:49.664997 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0e49f8_b3ca_42aa_84d4_14ede02fd659.slice/crio-d5c0c519ae6c9df06af16f698f4edbb97e1a3d4b02fbd116906bfff0852a684f WatchSource:0}: Error finding container d5c0c519ae6c9df06af16f698f4edbb97e1a3d4b02fbd116906bfff0852a684f: Status 404 returned error can't find the container with id d5c0c519ae6c9df06af16f698f4edbb97e1a3d4b02fbd116906bfff0852a684f Oct 30 22:16:50.098695 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:50.098664 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:50.181446 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:50.181421 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-8qv6j" event={"ID":"fc0e49f8-b3ca-42aa-84d4-14ede02fd659","Type":"ContainerStarted","Data":"d5c0c519ae6c9df06af16f698f4edbb97e1a3d4b02fbd116906bfff0852a684f"} Oct 30 22:16:50.441965 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:50.441892 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:50.610164 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:50.610133 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:50.746972 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:50.746937 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:16:53.197129 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:53.197095 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-8qv6j" event={"ID":"fc0e49f8-b3ca-42aa-84d4-14ede02fd659","Type":"ContainerStarted","Data":"991f83bfdd97d99cdf8f0f89f92030d1c1dd3dc8b710814813aab9017c11ea2f"} Oct 30 22:16:53.197633 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:53.197167 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:16:53.242215 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:16:53.242162 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-operator-7dc85965f-8qv6j" podStartSLOduration=2.303211656 podStartE2EDuration="5.242150442s" totalImagesPullingTime="2.938938786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:53.240922669 +0000 UTC m=+551.311821445" watchObservedRunningTime="2026-10-30 22:16:53.242150442 +0000 UTC m=+551.313049218" Oct 30 22:17:09.179149 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:17:09.179119 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-b2nk4" Oct 30 22:17:14.202936 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:17:14.202902 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-7dc85965f-8qv6j" Oct 30 22:17:16.474601 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:17:16.474566 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:17:33.485774 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:17:33.485708 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:17:37.307854 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:17:37.307815 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:17:41.744861 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:17:41.744824 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:17:41.872312 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:17:41.872267 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:17:42.118567 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:17:42.118490 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:17:42.118912 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:17:42.118887 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:17:46.477444 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:17:46.477399 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:18:15.526544 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.526508 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:15.592887 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.592856 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-bg429"] Oct 30 22:18:15.596198 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.596174 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:18:15.616352 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.616326 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-bg429"] Oct 30 22:18:15.623721 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.623686 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Oct 30 22:18:15.623721 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.623702 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Oct 30 22:18:15.623932 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.623914 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Oct 30 22:18:15.626668 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.626650 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-dc578\"" Oct 30 22:18:15.627914 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.627893 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc"] Oct 30 22:18:15.630974 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.630956 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:18:15.650288 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.650263 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc"] Oct 30 22:18:15.665519 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.665498 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:15.694901 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.694873 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjbc2\" (UniqueName: \"kubernetes.io/projected/e4895637-fa4b-4d45-890f-214ffb770e89-kube-api-access-wjbc2\") pod \"kserve-controller-manager-76d8b77fbb-bg429\" (UID: \"e4895637-fa4b-4d45-890f-214ffb770e89\") " pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:18:15.694997 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.694909 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4895637-fa4b-4d45-890f-214ffb770e89-cert\") pod \"kserve-controller-manager-76d8b77fbb-bg429\" (UID: \"e4895637-fa4b-4d45-890f-214ffb770e89\") " pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:18:15.694997 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.694948 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6mfm\" (UniqueName: \"kubernetes.io/projected/5a1dce73-31bc-4aa3-815c-167c451a891f-kube-api-access-h6mfm\") pod \"llmisvc-controller-manager-86c86ffb6b-mtkrc\" (UID: \"5a1dce73-31bc-4aa3-815c-167c451a891f\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:18:15.695074 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.695033 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a1dce73-31bc-4aa3-815c-167c451a891f-cert\") pod \"llmisvc-controller-manager-86c86ffb6b-mtkrc\" (UID: \"5a1dce73-31bc-4aa3-815c-167c451a891f\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:18:15.715759 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.715737 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Oct 30 22:18:15.715835 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.715797 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-j54tn\"" Oct 30 22:18:15.796232 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.796179 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6mfm\" (UniqueName: \"kubernetes.io/projected/5a1dce73-31bc-4aa3-815c-167c451a891f-kube-api-access-h6mfm\") pod \"llmisvc-controller-manager-86c86ffb6b-mtkrc\" (UID: \"5a1dce73-31bc-4aa3-815c-167c451a891f\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:18:15.796232 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.796215 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a1dce73-31bc-4aa3-815c-167c451a891f-cert\") pod \"llmisvc-controller-manager-86c86ffb6b-mtkrc\" (UID: \"5a1dce73-31bc-4aa3-815c-167c451a891f\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:18:15.796364 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.796273 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjbc2\" (UniqueName: \"kubernetes.io/projected/e4895637-fa4b-4d45-890f-214ffb770e89-kube-api-access-wjbc2\") pod \"kserve-controller-manager-76d8b77fbb-bg429\" (UID: \"e4895637-fa4b-4d45-890f-214ffb770e89\") " pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:18:15.796364 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.796301 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4895637-fa4b-4d45-890f-214ffb770e89-cert\") pod \"kserve-controller-manager-76d8b77fbb-bg429\" (UID: \"e4895637-fa4b-4d45-890f-214ffb770e89\") " pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:18:15.796466 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:18:15.796405 4933 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Oct 30 22:18:15.796521 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:18:15.796495 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1dce73-31bc-4aa3-815c-167c451a891f-cert podName:5a1dce73-31bc-4aa3-815c-167c451a891f nodeName:}" failed. No retries permitted until 2026-10-30 22:18:16.296473815 +0000 UTC m=+634.367372579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a1dce73-31bc-4aa3-815c-167c451a891f-cert") pod "llmisvc-controller-manager-86c86ffb6b-mtkrc" (UID: "5a1dce73-31bc-4aa3-815c-167c451a891f") : secret "llmisvc-webhook-server-cert" not found Oct 30 22:18:15.798659 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.798639 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4895637-fa4b-4d45-890f-214ffb770e89-cert\") pod \"kserve-controller-manager-76d8b77fbb-bg429\" (UID: \"e4895637-fa4b-4d45-890f-214ffb770e89\") " pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:18:15.805316 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.805295 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:15.819746 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.819718 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjbc2\" (UniqueName: \"kubernetes.io/projected/e4895637-fa4b-4d45-890f-214ffb770e89-kube-api-access-wjbc2\") pod \"kserve-controller-manager-76d8b77fbb-bg429\" (UID: \"e4895637-fa4b-4d45-890f-214ffb770e89\") " pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:18:15.819863 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.819848 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6mfm\" (UniqueName: \"kubernetes.io/projected/5a1dce73-31bc-4aa3-815c-167c451a891f-kube-api-access-h6mfm\") pod \"llmisvc-controller-manager-86c86ffb6b-mtkrc\" (UID: \"5a1dce73-31bc-4aa3-815c-167c451a891f\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:18:15.908875 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.908849 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:18:15.929816 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:15.929795 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:16.204538 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:16.204514 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-bg429"] Oct 30 22:18:16.206212 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:18:16.206188 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4895637_fa4b_4d45_890f_214ffb770e89.slice/crio-81ab952d6fb6683cf90591a286540506ab1574e337876e944514076365e8402b WatchSource:0}: Error finding container 81ab952d6fb6683cf90591a286540506ab1574e337876e944514076365e8402b: Status 404 returned error can't find the container with id 81ab952d6fb6683cf90591a286540506ab1574e337876e944514076365e8402b Oct 30 22:18:16.300505 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:16.300479 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a1dce73-31bc-4aa3-815c-167c451a891f-cert\") pod \"llmisvc-controller-manager-86c86ffb6b-mtkrc\" (UID: \"5a1dce73-31bc-4aa3-815c-167c451a891f\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:18:16.302728 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:16.302706 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a1dce73-31bc-4aa3-815c-167c451a891f-cert\") pod \"llmisvc-controller-manager-86c86ffb6b-mtkrc\" (UID: \"5a1dce73-31bc-4aa3-815c-167c451a891f\") " pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:18:16.475229 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:18:16.475159 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:18:16.522727 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:16.522702 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" event={"ID":"e4895637-fa4b-4d45-890f-214ffb770e89","Type":"ContainerStarted","Data":"81ab952d6fb6683cf90591a286540506ab1574e337876e944514076365e8402b"} Oct 30 22:18:16.543141 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:16.543119 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:18:16.839882 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:16.839851 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc"] Oct 30 22:18:16.844632 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:18:16.842011 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1dce73_31bc_4aa3_815c_167c451a891f.slice/crio-7c1114d5bef2d8a5f242a4e75fe4a581d447df45680284f868ef5c637e2190a5 WatchSource:0}: Error finding container 7c1114d5bef2d8a5f242a4e75fe4a581d447df45680284f868ef5c637e2190a5: Status 404 returned error can't find the container with id 7c1114d5bef2d8a5f242a4e75fe4a581d447df45680284f868ef5c637e2190a5 Oct 30 22:18:16.934335 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:16.934302 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:17.069226 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:17.069194 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:17.208428 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:17.208308 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:17.530223 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:17.530175 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" event={"ID":"5a1dce73-31bc-4aa3-815c-167c451a891f","Type":"ContainerStarted","Data":"7c1114d5bef2d8a5f242a4e75fe4a581d447df45680284f868ef5c637e2190a5"} Oct 30 22:18:19.540706 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:19.540673 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" event={"ID":"e4895637-fa4b-4d45-890f-214ffb770e89","Type":"ContainerStarted","Data":"b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8"} Oct 30 22:18:19.541073 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:19.540815 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:18:19.581420 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:19.581378 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" podStartSLOduration=1.775866207 podStartE2EDuration="4.581365761s" totalImagesPullingTime="2.805499554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:19.580670597 +0000 UTC m=+637.651569372" watchObservedRunningTime="2026-10-30 22:18:19.581365761 +0000 UTC m=+637.652264537" Oct 30 22:18:20.547638 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:20.547571 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" event={"ID":"5a1dce73-31bc-4aa3-815c-167c451a891f","Type":"ContainerStarted","Data":"20b9fd786dc52726a71708475668cb1630ed17b45690464f27cce8142a6b92b2"} Oct 30 22:18:20.548050 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:20.547803 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:18:20.588030 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:20.587981 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" podStartSLOduration=2.8724699940000002 podStartE2EDuration="5.587966821s" totalImagesPullingTime="2.715496827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:20.586743661 +0000 UTC m=+638.657642438" watchObservedRunningTime="2026-10-30 22:18:20.587966821 +0000 UTC m=+638.658865642" Oct 30 22:18:33.609992 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:33.609959 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:18:46.476329 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:18:46.476289 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:18:50.552934 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:50.552900 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:18:51.555589 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:18:51.555554 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-86c86ffb6b-mtkrc" Oct 30 22:19:05.240054 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.239961 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-bg429"] Oct 30 22:19:05.240578 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.240183 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" podUID="e4895637-fa4b-4d45-890f-214ffb770e89" containerName="manager" containerID="cri-o://b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8" gracePeriod=10 Oct 30 22:19:05.284648 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.284620 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-x4kfl"] Oct 30 22:19:05.287484 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.287468 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" Oct 30 22:19:05.310712 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.310683 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-x4kfl"] Oct 30 22:19:05.461829 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.461797 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7f692e6-baaa-41a8-b855-477243d3c488-cert\") pod \"kserve-controller-manager-76d8b77fbb-x4kfl\" (UID: \"a7f692e6-baaa-41a8-b855-477243d3c488\") " pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" Oct 30 22:19:05.461968 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.461946 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2dwt\" (UniqueName: \"kubernetes.io/projected/a7f692e6-baaa-41a8-b855-477243d3c488-kube-api-access-n2dwt\") pod \"kserve-controller-manager-76d8b77fbb-x4kfl\" (UID: \"a7f692e6-baaa-41a8-b855-477243d3c488\") " pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" Oct 30 22:19:05.473732 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.473714 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:19:05.562953 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.562926 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4895637-fa4b-4d45-890f-214ffb770e89-kube-api-access-wjbc2\" (UniqueName: \"kubernetes.io/projected/e4895637-fa4b-4d45-890f-214ffb770e89-kube-api-access-wjbc2\") pod \"e4895637-fa4b-4d45-890f-214ffb770e89\" (UID: \"e4895637-fa4b-4d45-890f-214ffb770e89\") " Oct 30 22:19:05.563112 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.562960 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e4895637-fa4b-4d45-890f-214ffb770e89-cert\" (UniqueName: \"kubernetes.io/secret/e4895637-fa4b-4d45-890f-214ffb770e89-cert\") pod \"e4895637-fa4b-4d45-890f-214ffb770e89\" (UID: \"e4895637-fa4b-4d45-890f-214ffb770e89\") " Oct 30 22:19:05.563112 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.563098 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7f692e6-baaa-41a8-b855-477243d3c488-cert\") pod \"kserve-controller-manager-76d8b77fbb-x4kfl\" (UID: \"a7f692e6-baaa-41a8-b855-477243d3c488\") " pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" Oct 30 22:19:05.563226 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.563143 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dwt\" (UniqueName: \"kubernetes.io/projected/a7f692e6-baaa-41a8-b855-477243d3c488-kube-api-access-n2dwt\") pod \"kserve-controller-manager-76d8b77fbb-x4kfl\" (UID: \"a7f692e6-baaa-41a8-b855-477243d3c488\") " pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" Oct 30 22:19:05.565204 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.565171 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4895637-fa4b-4d45-890f-214ffb770e89-kube-api-access-wjbc2" pod "e4895637-fa4b-4d45-890f-214ffb770e89" (UID: "e4895637-fa4b-4d45-890f-214ffb770e89"). InnerVolumeSpecName "kube-api-access-wjbc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:19:05.565333 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.565201 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4895637-fa4b-4d45-890f-214ffb770e89-cert" pod "e4895637-fa4b-4d45-890f-214ffb770e89" (UID: "e4895637-fa4b-4d45-890f-214ffb770e89"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:19:05.565333 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.565234 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7f692e6-baaa-41a8-b855-477243d3c488-cert\") pod \"kserve-controller-manager-76d8b77fbb-x4kfl\" (UID: \"a7f692e6-baaa-41a8-b855-477243d3c488\") " pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" Oct 30 22:19:05.586513 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.586490 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2dwt\" (UniqueName: \"kubernetes.io/projected/a7f692e6-baaa-41a8-b855-477243d3c488-kube-api-access-n2dwt\") pod \"kserve-controller-manager-76d8b77fbb-x4kfl\" (UID: \"a7f692e6-baaa-41a8-b855-477243d3c488\") " pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" Oct 30 22:19:05.632457 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.632428 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" Oct 30 22:19:05.664354 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.664326 4933 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjbc2\" (UniqueName: \"kubernetes.io/projected/e4895637-fa4b-4d45-890f-214ffb770e89-kube-api-access-wjbc2\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:19:05.664354 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.664350 4933 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4895637-fa4b-4d45-890f-214ffb770e89-cert\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:19:05.725436 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.725409 4933 generic.go:356] "Generic (PLEG): container finished" podID="e4895637-fa4b-4d45-890f-214ffb770e89" containerID="b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8" exitCode=0 Oct 30 22:19:05.725578 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.725452 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" Oct 30 22:19:05.725578 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.725502 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" event={"ID":"e4895637-fa4b-4d45-890f-214ffb770e89","Type":"ContainerDied","Data":"b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8"} Oct 30 22:19:05.725578 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.725558 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-bg429" event={"ID":"e4895637-fa4b-4d45-890f-214ffb770e89","Type":"ContainerDied","Data":"81ab952d6fb6683cf90591a286540506ab1574e337876e944514076365e8402b"} Oct 30 22:19:05.725766 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.725590 4933 scope.go:122] "RemoveContainer" containerID="b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8" Oct 30 22:19:05.738473 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.738450 4933 scope.go:122] "RemoveContainer" containerID="b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8" Oct 30 22:19:05.738753 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:19:05.738733 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8\": container with ID starting with b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8 not found: ID does not exist" containerID="b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8" Oct 30 22:19:05.738823 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.738760 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8"} err="failed to get container status \"b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8\": rpc error: code = NotFound desc = could not find container \"b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8\": container with ID starting with b4a8c4c38b9bd0af05552e394ec4ea0580a39fdef276c926897d6dda3252cba8 not found: ID does not exist" Oct 30 22:19:05.784503 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.784478 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-bg429"] Oct 30 22:19:05.797579 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.797552 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-bg429"] Oct 30 22:19:05.931669 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:05.931649 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-76d8b77fbb-x4kfl"] Oct 30 22:19:05.933097 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:19:05.933072 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f692e6_baaa_41a8_b855_477243d3c488.slice/crio-85859edde9dcff5840239c52284a3953ff0a62c1dc09f0e998e5701dbba34040 WatchSource:0}: Error finding container 85859edde9dcff5840239c52284a3953ff0a62c1dc09f0e998e5701dbba34040: Status 404 returned error can't find the container with id 85859edde9dcff5840239c52284a3953ff0a62c1dc09f0e998e5701dbba34040 Oct 30 22:19:06.079526 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:06.079499 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e4895637-fa4b-4d45-890f-214ffb770e89" path="/var/lib/kubelet/pods/e4895637-fa4b-4d45-890f-214ffb770e89/volumes" Oct 30 22:19:06.734721 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:06.734640 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" event={"ID":"a7f692e6-baaa-41a8-b855-477243d3c488","Type":"ContainerStarted","Data":"bc5ff1d063a471d07ee7bd3cc9a8c51a9281099850418971646d2752edbd8eb8"} Oct 30 22:19:06.734721 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:06.734693 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" event={"ID":"a7f692e6-baaa-41a8-b855-477243d3c488","Type":"ContainerStarted","Data":"85859edde9dcff5840239c52284a3953ff0a62c1dc09f0e998e5701dbba34040"} Oct 30 22:19:06.735107 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:06.734800 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" Oct 30 22:19:06.775874 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:06.775828 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" podStartSLOduration=1.431573477 podStartE2EDuration="1.775812874s" totalImagesPullingTime="344.239397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:06.775204386 +0000 UTC m=+684.846103161" watchObservedRunningTime="2026-10-30 22:19:06.775812874 +0000 UTC m=+684.846711651" Oct 30 22:19:16.478278 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:19:16.478239 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:19:33.693399 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:33.693356 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:19:37.744827 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:37.744797 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-76d8b77fbb-x4kfl" Oct 30 22:19:39.707794 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:39.707759 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:19:39.845021 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:39.844989 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:19:39.962732 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:39.962662 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:19:40.097573 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:40.097543 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:19:43.907144 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:43.907109 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:19:44.037031 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:19:44.036998 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:19:46.478026 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:19:46.477986 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:20:16.476394 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:20:16.476354 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:20:33.841864 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:20:33.841831 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:20:46.477592 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:20:46.477556 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:21:14.602032 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:14.602001 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:14.733264 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:14.733232 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:16.476420 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:21:16.476383 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:21:23.398420 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:23.398379 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:30.501752 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:30.501712 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:30.653105 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:30.653074 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:32.087265 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.087228 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:32.218974 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.218940 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:32.394511 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.394415 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:32.639397 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.639364 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:32.809037 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.808998 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:32.933774 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.933742 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf"] Oct 30 22:21:32.934550 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.934527 4933 cpu_manager.go:414] "containerMap: removing container" podUID="e4895637-fa4b-4d45-890f-214ffb770e89" containerName="manager" Oct 30 22:21:32.934550 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.934551 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4895637-fa4b-4d45-890f-214ffb770e89" containerName="manager" Oct 30 22:21:32.934787 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.934773 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4895637-fa4b-4d45-890f-214ffb770e89" containerName="manager" Oct 30 22:21:32.939427 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.939399 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:32.951294 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.951249 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:32.957600 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.957578 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"default-dockercfg-x6ct5\"" Oct 30 22:21:32.957697 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.957648 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"seaweedfs-s3-creds\"" Oct 30 22:21:32.959821 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.959807 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-raw-sklearn-batcher-0a520-predictor-serving-cert\"" Oct 30 22:21:32.968960 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.968922 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"kube-root-ca.crt\"" Oct 30 22:21:32.969053 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.969009 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"openshift-service-ca.crt\"" Oct 30 22:21:32.969053 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.969029 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:21:32.972705 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:32.972684 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf"] Oct 30 22:21:33.061074 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.061014 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-raw-sklearn-batcher-0a520-kube-rbac-proxy-sar-config\"" Oct 30 22:21:33.067375 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.067355 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.067437 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.067391 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb7k8\" (UniqueName: \"kubernetes.io/projected/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-api-access-wb7k8\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.067437 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.067416 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc3de077-e0f9-4ff8-9470-019217da9f37-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.067503 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.067486 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.067536 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.067523 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc3de077-e0f9-4ff8-9470-019217da9f37-proxy-tls\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.168432 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.168400 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.168854 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.168440 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb7k8\" (UniqueName: \"kubernetes.io/projected/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-api-access-wb7k8\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.168854 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.168475 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc3de077-e0f9-4ff8-9470-019217da9f37-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.168854 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.168504 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.168854 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.168553 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc3de077-e0f9-4ff8-9470-019217da9f37-proxy-tls\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.169085 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.168954 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc3de077-e0f9-4ff8-9470-019217da9f37-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.169269 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.169248 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.169308 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.169248 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.171030 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.171008 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc3de077-e0f9-4ff8-9470-019217da9f37-proxy-tls\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.191470 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.191447 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb7k8\" (UniqueName: \"kubernetes.io/projected/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-api-access-wb7k8\") pod \"isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.258340 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.258317 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:33.575276 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.575249 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf"] Oct 30 22:21:33.576731 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:21:33.576707 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3de077_e0f9_4ff8_9470_019217da9f37.slice/crio-e6e946cdb53dd3d568a87c617eb5be859f43c13746f3e470eb3797bb1e7bd352 WatchSource:0}: Error finding container e6e946cdb53dd3d568a87c617eb5be859f43c13746f3e470eb3797bb1e7bd352: Status 404 returned error can't find the container with id e6e946cdb53dd3d568a87c617eb5be859f43c13746f3e470eb3797bb1e7bd352 Oct 30 22:21:33.579182 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.579164 4933 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:21:33.917735 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:33.917651 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:21:34.339377 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:34.339340 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" event={"ID":"fc3de077-e0f9-4ff8-9470-019217da9f37","Type":"ContainerStarted","Data":"e6e946cdb53dd3d568a87c617eb5be859f43c13746f3e470eb3797bb1e7bd352"} Oct 30 22:21:37.355739 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:37.355697 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" event={"ID":"fc3de077-e0f9-4ff8-9470-019217da9f37","Type":"ContainerStarted","Data":"4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2"} Oct 30 22:21:41.373523 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:41.373493 4933 generic.go:356] "Generic (PLEG): container finished" podID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerID="4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2" exitCode=0 Oct 30 22:21:41.373925 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:41.373568 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" event={"ID":"fc3de077-e0f9-4ff8-9470-019217da9f37","Type":"ContainerDied","Data":"4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2"} Oct 30 22:21:46.481336 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:21:46.481298 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:21:55.444818 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:55.444786 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" event={"ID":"fc3de077-e0f9-4ff8-9470-019217da9f37","Type":"ContainerStarted","Data":"e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea"} Oct 30 22:21:57.456307 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:57.456269 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" event={"ID":"fc3de077-e0f9-4ff8-9470-019217da9f37","Type":"ContainerStarted","Data":"e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536"} Oct 30 22:21:59.467116 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:59.467077 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" event={"ID":"fc3de077-e0f9-4ff8-9470-019217da9f37","Type":"ContainerStarted","Data":"babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563"} Oct 30 22:21:59.467539 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:59.467374 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:59.467539 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:59.467434 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:59.467539 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:59.467459 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:21:59.468644 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:59.468596 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:21:59.469266 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:59.469242 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:21:59.527950 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:21:59.527907 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podStartSLOduration=3.135750404 podStartE2EDuration="27.527894461s" totalImagesPullingTime="20.615233902s" totalInitContainerRuntime="3.776910155s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:32 +0000 UTC" imagePullSessionsCount=4 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:59.526789926 +0000 UTC m=+857.597688702" watchObservedRunningTime="2026-10-30 22:21:59.527894461 +0000 UTC m=+857.598793236" Oct 30 22:22:00.471572 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:00.471532 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:22:00.472062 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:00.471834 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:22:05.475937 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:05.475906 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:22:05.476573 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:05.476545 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:22:05.476824 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:05.476801 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:22:13.687694 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:13.687657 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:22:13.808546 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:13.808510 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:22:15.476621 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:15.476572 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:22:15.477176 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:15.477144 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:22:16.476169 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:22:16.476129 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:22:25.477257 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:25.477214 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:22:25.477864 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:25.477840 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:22:34.044992 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:34.044955 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:22:35.477012 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:35.476964 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:22:35.477527 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:35.477502 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:22:42.144619 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:42.144580 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:22:42.145078 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:42.145043 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:22:45.476424 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:45.476376 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:22:45.476884 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:45.476861 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:22:46.475000 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:22:46.474967 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:22:55.476975 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:55.476933 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:22:55.477479 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:22:55.477452 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:23:02.316074 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:02.316039 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:05.476952 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:05.476906 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:23:05.477372 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:05.477345 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:23:09.075822 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:09.075785 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:23:09.076229 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:09.075884 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:23:16.476660 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:23:16.476594 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:23:18.028819 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:18.028789 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf"] Oct 30 22:23:18.029270 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:18.029049 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" containerID="cri-o://e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea" gracePeriod=30 Oct 30 22:23:18.029270 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:18.029223 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" containerID="cri-o://babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563" gracePeriod=30 Oct 30 22:23:18.029270 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:18.029240 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kube-rbac-proxy" containerID="cri-o://e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536" gracePeriod=30 Oct 30 22:23:18.073214 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:18.073144 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:18.804467 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:18.804434 4933 generic.go:356] "Generic (PLEG): container finished" podID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerID="e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536" exitCode=0 Oct 30 22:23:18.804662 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:18.804509 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" event={"ID":"fc3de077-e0f9-4ff8-9470-019217da9f37","Type":"ContainerDied","Data":"e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536"} Oct 30 22:23:19.075591 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:19.075511 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:23:19.076055 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:19.075833 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:23:20.471776 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:20.471739 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused" Oct 30 22:23:22.330687 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:22.330626 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:22.822694 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:22.822664 4933 generic.go:356] "Generic (PLEG): container finished" podID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerID="e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea" exitCode=0 Oct 30 22:23:22.822854 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:22.822743 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" event={"ID":"fc3de077-e0f9-4ff8-9470-019217da9f37","Type":"ContainerDied","Data":"e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea"} Oct 30 22:23:25.472590 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:25.472502 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused" Oct 30 22:23:29.075627 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:29.075529 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:23:29.076136 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:29.075819 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:23:30.471902 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:30.471857 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused" Oct 30 22:23:30.472331 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:30.471989 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:23:34.154653 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:34.154621 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:35.471863 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:35.471823 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused" Oct 30 22:23:39.075738 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:39.075686 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Oct 30 22:23:39.076208 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:39.075867 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:23:39.076208 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:39.076077 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:23:39.076208 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:39.076201 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:23:40.472429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:40.472392 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused" Oct 30 22:23:45.472508 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:45.472466 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused" Oct 30 22:23:46.477844 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:23:46.477805 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:23:48.183700 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.183676 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:23:48.258134 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.258104 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc3de077-e0f9-4ff8-9470-019217da9f37-proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc3de077-e0f9-4ff8-9470-019217da9f37-proxy-tls\") pod \"fc3de077-e0f9-4ff8-9470-019217da9f37\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " Oct 30 22:23:48.258299 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.258158 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-cabundle-cert\") pod \"fc3de077-e0f9-4ff8-9470-019217da9f37\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " Oct 30 22:23:48.258299 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.258200 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc3de077-e0f9-4ff8-9470-019217da9f37-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc3de077-e0f9-4ff8-9470-019217da9f37-kserve-provision-location\") pod \"fc3de077-e0f9-4ff8-9470-019217da9f37\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " Oct 30 22:23:48.258299 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.258268 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-rbac-proxy-sar-config\") pod \"fc3de077-e0f9-4ff8-9470-019217da9f37\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " Oct 30 22:23:48.258487 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.258306 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-api-access-wb7k8\" (UniqueName: \"kubernetes.io/projected/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-api-access-wb7k8\") pod \"fc3de077-e0f9-4ff8-9470-019217da9f37\" (UID: \"fc3de077-e0f9-4ff8-9470-019217da9f37\") " Oct 30 22:23:48.258572 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.258543 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc3de077-e0f9-4ff8-9470-019217da9f37-kserve-provision-location" pod "fc3de077-e0f9-4ff8-9470-019217da9f37" (UID: "fc3de077-e0f9-4ff8-9470-019217da9f37"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:23:48.258667 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.258586 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-cabundle-cert" pod "fc3de077-e0f9-4ff8-9470-019217da9f37" (UID: "fc3de077-e0f9-4ff8-9470-019217da9f37"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:23:48.258667 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.258598 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-rbac-proxy-sar-config" pod "fc3de077-e0f9-4ff8-9470-019217da9f37" (UID: "fc3de077-e0f9-4ff8-9470-019217da9f37"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:23:48.260315 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.260284 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc3de077-e0f9-4ff8-9470-019217da9f37-proxy-tls" pod "fc3de077-e0f9-4ff8-9470-019217da9f37" (UID: "fc3de077-e0f9-4ff8-9470-019217da9f37"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:23:48.260402 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.260309 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-api-access-wb7k8" pod "fc3de077-e0f9-4ff8-9470-019217da9f37" (UID: "fc3de077-e0f9-4ff8-9470-019217da9f37"). InnerVolumeSpecName "kube-api-access-wb7k8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:23:48.359464 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.359414 4933 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:23:48.359464 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.359435 4933 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb7k8\" (UniqueName: \"kubernetes.io/projected/fc3de077-e0f9-4ff8-9470-019217da9f37-kube-api-access-wb7k8\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:23:48.359464 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.359446 4933 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc3de077-e0f9-4ff8-9470-019217da9f37-proxy-tls\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:23:48.359464 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.359456 4933 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/fc3de077-e0f9-4ff8-9470-019217da9f37-cabundle-cert\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:23:48.359464 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.359464 4933 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fc3de077-e0f9-4ff8-9470-019217da9f37-kserve-provision-location\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:23:48.935092 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.935058 4933 generic.go:356] "Generic (PLEG): container finished" podID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerID="babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563" exitCode=0 Oct 30 22:23:48.935260 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.935138 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" Oct 30 22:23:48.935260 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.935138 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" event={"ID":"fc3de077-e0f9-4ff8-9470-019217da9f37","Type":"ContainerDied","Data":"babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563"} Oct 30 22:23:48.935260 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.935208 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf" event={"ID":"fc3de077-e0f9-4ff8-9470-019217da9f37","Type":"ContainerDied","Data":"e6e946cdb53dd3d568a87c617eb5be859f43c13746f3e470eb3797bb1e7bd352"} Oct 30 22:23:48.935260 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.935239 4933 scope.go:122] "RemoveContainer" containerID="babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563" Oct 30 22:23:48.944906 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.944889 4933 scope.go:122] "RemoveContainer" containerID="e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536" Oct 30 22:23:48.951955 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.951940 4933 scope.go:122] "RemoveContainer" containerID="e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea" Oct 30 22:23:48.959299 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.959275 4933 scope.go:122] "RemoveContainer" containerID="4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2" Oct 30 22:23:48.966144 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.966120 4933 scope.go:122] "RemoveContainer" containerID="babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563" Oct 30 22:23:48.966404 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:23:48.966386 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563\": container with ID starting with babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563 not found: ID does not exist" containerID="babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563" Oct 30 22:23:48.966487 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.966417 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563"} err="failed to get container status \"babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563\": rpc error: code = NotFound desc = could not find container \"babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563\": container with ID starting with babbca9c2e1399e9e0c5f3accec136ee845a53367e2aef9d1400a7f60952d563 not found: ID does not exist" Oct 30 22:23:48.966487 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.966439 4933 scope.go:122] "RemoveContainer" containerID="e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536" Oct 30 22:23:48.966748 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:23:48.966726 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536\": container with ID starting with e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536 not found: ID does not exist" containerID="e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536" Oct 30 22:23:48.966851 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.966755 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536"} err="failed to get container status \"e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536\": rpc error: code = NotFound desc = could not find container \"e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536\": container with ID starting with e178666aa64e37dda80c0ee1ed046d71121ef2b339cbb3f14c465e65bc3a7536 not found: ID does not exist" Oct 30 22:23:48.966851 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.966775 4933 scope.go:122] "RemoveContainer" containerID="e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea" Oct 30 22:23:48.967037 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:23:48.967020 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea\": container with ID starting with e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea not found: ID does not exist" containerID="e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea" Oct 30 22:23:48.967081 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.967044 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea"} err="failed to get container status \"e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea\": rpc error: code = NotFound desc = could not find container \"e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea\": container with ID starting with e06e7a47d508cb80f4023f1a511d94845f9f47fbbfaceb7be896f896d13a3bea not found: ID does not exist" Oct 30 22:23:48.967081 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.967058 4933 scope.go:122] "RemoveContainer" containerID="4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2" Oct 30 22:23:48.967298 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:23:48.967277 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2\": container with ID starting with 4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2 not found: ID does not exist" containerID="4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2" Oct 30 22:23:48.967347 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.967304 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2"} err="failed to get container status \"4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2\": rpc error: code = NotFound desc = could not find container \"4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2\": container with ID starting with 4e1258eefecc3376dd5be44fa68e2fb22023c7b26476708f19e1a86a1e89d9f2 not found: ID does not exist" Oct 30 22:23:48.998777 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:48.998756 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf"] Oct 30 22:23:49.010504 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:49.010482 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2951e75f13/isvc-raw-sklearn-batcher-0a520-predictor-67df6749c6-4cbpf"] Oct 30 22:23:49.883729 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:49.883700 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:50.043788 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.043738 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:50.081137 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.081100 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" path="/var/lib/kubelet/pods/fc3de077-e0f9-4ff8-9470-019217da9f37/volumes" Oct 30 22:23:50.568097 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.568064 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:50.690023 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.689980 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c"] Oct 30 22:23:50.690298 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690286 4933 cpu_manager.go:414] "containerMap: removing container" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kube-rbac-proxy" Oct 30 22:23:50.690351 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690299 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kube-rbac-proxy" Oct 30 22:23:50.690351 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690311 4933 cpu_manager.go:414] "containerMap: removing container" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="storage-initializer" Oct 30 22:23:50.690351 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690316 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="storage-initializer" Oct 30 22:23:50.690351 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690325 4933 cpu_manager.go:414] "containerMap: removing container" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" Oct 30 22:23:50.690351 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690330 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" Oct 30 22:23:50.690351 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690345 4933 cpu_manager.go:414] "containerMap: removing container" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" Oct 30 22:23:50.690351 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690350 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" Oct 30 22:23:50.690583 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690397 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kube-rbac-proxy" Oct 30 22:23:50.690583 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690406 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="agent" Oct 30 22:23:50.690583 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.690414 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc3de077-e0f9-4ff8-9470-019217da9f37" containerName="kserve-container" Oct 30 22:23:50.693350 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.693324 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:23:50.695204 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.695188 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.715490 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.715468 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"openshift-service-ca.crt\"" Oct 30 22:23:50.715788 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.715770 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:23:50.715883 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.715870 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"default-dockercfg-x6ct5\"" Oct 30 22:23:50.715924 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.715914 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"seaweedfs-s3-creds\"" Oct 30 22:23:50.716006 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.715988 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-xgboost-graph-raw-bdc73-kube-rbac-proxy-sar-config\"" Oct 30 22:23:50.716117 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.716073 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-xgboost-graph-raw-bdc73-predictor-serving-cert\"" Oct 30 22:23:50.716161 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.716145 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"kube-root-ca.crt\"" Oct 30 22:23:50.716828 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.716809 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c"] Oct 30 22:23:50.777985 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.777960 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ea88e817-a97e-462b-9f10-a9a3f17de81b-proxy-tls\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.778103 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.777996 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.778103 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.778017 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8ttz\" (UniqueName: \"kubernetes.io/projected/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-api-access-l8ttz\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.778204 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.778111 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea88e817-a97e-462b-9f10-a9a3f17de81b-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.778239 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.778202 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-cabundle-cert\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.878741 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.878682 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8ttz\" (UniqueName: \"kubernetes.io/projected/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-api-access-l8ttz\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.878741 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.878717 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea88e817-a97e-462b-9f10-a9a3f17de81b-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.878911 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.878750 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-cabundle-cert\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.878911 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.878786 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ea88e817-a97e-462b-9f10-a9a3f17de81b-proxy-tls\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.878911 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.878818 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.879160 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.879138 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea88e817-a97e-462b-9f10-a9a3f17de81b-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.879458 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.879435 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.879549 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.879502 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-cabundle-cert\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.881276 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.881257 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ea88e817-a97e-462b-9f10-a9a3f17de81b-proxy-tls\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:50.901900 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:50.901879 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8ttz\" (UniqueName: \"kubernetes.io/projected/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-api-access-l8ttz\") pod \"isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:51.011826 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:51.011801 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:23:51.321983 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:51.321953 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c"] Oct 30 22:23:51.323880 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:23:51.323851 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea88e817_a97e_462b_9f10_a9a3f17de81b.slice/crio-4f2a76f83e4514f0abe06183331396e9e1a62e1a3c7103170fc068fbd47c7c76 WatchSource:0}: Error finding container 4f2a76f83e4514f0abe06183331396e9e1a62e1a3c7103170fc068fbd47c7c76: Status 404 returned error can't find the container with id 4f2a76f83e4514f0abe06183331396e9e1a62e1a3c7103170fc068fbd47c7c76 Oct 30 22:23:51.951350 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:51.951314 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" event={"ID":"ea88e817-a97e-462b-9f10-a9a3f17de81b","Type":"ContainerStarted","Data":"82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4"} Oct 30 22:23:51.951954 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:51.951378 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" event={"ID":"ea88e817-a97e-462b-9f10-a9a3f17de81b","Type":"ContainerStarted","Data":"4f2a76f83e4514f0abe06183331396e9e1a62e1a3c7103170fc068fbd47c7c76"} Oct 30 22:23:55.971286 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:55.971252 4933 generic.go:356] "Generic (PLEG): container finished" podID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerID="82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4" exitCode=0 Oct 30 22:23:55.971712 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:23:55.971321 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" event={"ID":"ea88e817-a97e-462b-9f10-a9a3f17de81b","Type":"ContainerDied","Data":"82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4"} Oct 30 22:24:14.055784 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:14.055750 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" event={"ID":"ea88e817-a97e-462b-9f10-a9a3f17de81b","Type":"ContainerStarted","Data":"17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f"} Oct 30 22:24:14.056272 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:14.055824 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" event={"ID":"ea88e817-a97e-462b-9f10-a9a3f17de81b","Type":"ContainerStarted","Data":"2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d"} Oct 30 22:24:14.056272 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:14.056059 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:24:14.111082 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:14.111035 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podStartSLOduration=2.482413291 podStartE2EDuration="24.111022479s" totalImagesPullingTime="17.757270038s" totalInitContainerRuntime="3.87133915s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:24:14.110685447 +0000 UTC m=+992.181584224" watchObservedRunningTime="2026-10-30 22:24:14.111022479 +0000 UTC m=+992.181921344" Oct 30 22:24:15.060463 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:15.060425 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:24:15.061898 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:15.061866 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Oct 30 22:24:16.064615 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:16.064556 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Oct 30 22:24:16.476356 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:24:16.476278 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:24:21.069115 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:21.069085 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:24:21.069592 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:21.069554 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Oct 30 22:24:31.069531 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:31.069486 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Oct 30 22:24:32.928514 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:32.928482 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:24:34.281913 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:34.281871 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:24:41.069797 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:41.069756 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Oct 30 22:24:46.475785 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:24:46.475747 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:24:51.069841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:51.069797 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Oct 30 22:24:52.709564 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:24:52.709529 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:00.287378 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:00.287303 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:00.444141 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:00.444102 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:00.587233 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:00.587140 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:00.911758 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:00.911684 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:01.070212 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:01.070178 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Oct 30 22:25:11.070028 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:11.069988 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Oct 30 22:25:16.476414 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:25:16.476371 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:25:21.070280 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:21.070243 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:25:30.073070 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.073034 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g"] Oct 30 22:25:30.076388 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.076356 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:30.093875 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.093847 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g"] Oct 30 22:25:30.097406 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.097381 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:30.104123 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.104105 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"model-chainer-raw-bdc73-kube-rbac-proxy-sar-config\"" Oct 30 22:25:30.104195 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.104121 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"model-chainer-raw-bdc73-serving-cert\"" Oct 30 22:25:30.191772 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.191746 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bfe2445-1993-4d21-8c2e-875d41f02f84-openshift-service-ca-bundle\") pod \"model-chainer-raw-bdc73-8b6b84c8-6424g\" (UID: \"2bfe2445-1993-4d21-8c2e-875d41f02f84\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:30.191886 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.191778 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2bfe2445-1993-4d21-8c2e-875d41f02f84-proxy-tls\") pod \"model-chainer-raw-bdc73-8b6b84c8-6424g\" (UID: \"2bfe2445-1993-4d21-8c2e-875d41f02f84\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:30.292965 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.292940 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bfe2445-1993-4d21-8c2e-875d41f02f84-openshift-service-ca-bundle\") pod \"model-chainer-raw-bdc73-8b6b84c8-6424g\" (UID: \"2bfe2445-1993-4d21-8c2e-875d41f02f84\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:30.293087 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.292979 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2bfe2445-1993-4d21-8c2e-875d41f02f84-proxy-tls\") pod \"model-chainer-raw-bdc73-8b6b84c8-6424g\" (UID: \"2bfe2445-1993-4d21-8c2e-875d41f02f84\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:30.293150 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:25:30.293113 4933 secret.go:189] Couldn't get secret e2e-gw1-2951e75f13/model-chainer-raw-bdc73-serving-cert: secret "model-chainer-raw-bdc73-serving-cert" not found Oct 30 22:25:30.293205 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:25:30.293180 4933 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bfe2445-1993-4d21-8c2e-875d41f02f84-proxy-tls podName:2bfe2445-1993-4d21-8c2e-875d41f02f84 nodeName:}" failed. No retries permitted until 2026-10-30 22:25:30.793158743 +0000 UTC m=+1068.864057520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2bfe2445-1993-4d21-8c2e-875d41f02f84-proxy-tls") pod "model-chainer-raw-bdc73-8b6b84c8-6424g" (UID: "2bfe2445-1993-4d21-8c2e-875d41f02f84") : secret "model-chainer-raw-bdc73-serving-cert" not found Oct 30 22:25:30.293744 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.293724 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bfe2445-1993-4d21-8c2e-875d41f02f84-openshift-service-ca-bundle\") pod \"model-chainer-raw-bdc73-8b6b84c8-6424g\" (UID: \"2bfe2445-1993-4d21-8c2e-875d41f02f84\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:30.418357 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.418252 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:30.796415 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.796374 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2bfe2445-1993-4d21-8c2e-875d41f02f84-proxy-tls\") pod \"model-chainer-raw-bdc73-8b6b84c8-6424g\" (UID: \"2bfe2445-1993-4d21-8c2e-875d41f02f84\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:30.798976 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.798946 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2bfe2445-1993-4d21-8c2e-875d41f02f84-proxy-tls\") pod \"model-chainer-raw-bdc73-8b6b84c8-6424g\" (UID: \"2bfe2445-1993-4d21-8c2e-875d41f02f84\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:30.988415 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:30.988382 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:31.285216 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:31.285185 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g"] Oct 30 22:25:31.287122 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:25:31.287097 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfe2445_1993_4d21_8c2e_875d41f02f84.slice/crio-5bb65e8b1538624f5ab211398a9dee9e67d6fcc84cc68bdae1b3ce7c41a3600b WatchSource:0}: Error finding container 5bb65e8b1538624f5ab211398a9dee9e67d6fcc84cc68bdae1b3ce7c41a3600b: Status 404 returned error can't find the container with id 5bb65e8b1538624f5ab211398a9dee9e67d6fcc84cc68bdae1b3ce7c41a3600b Oct 30 22:25:31.357887 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:31.357858 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" event={"ID":"2bfe2445-1993-4d21-8c2e-875d41f02f84","Type":"ContainerStarted","Data":"5bb65e8b1538624f5ab211398a9dee9e67d6fcc84cc68bdae1b3ce7c41a3600b"} Oct 30 22:25:33.368713 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:33.368677 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" event={"ID":"2bfe2445-1993-4d21-8c2e-875d41f02f84","Type":"ContainerStarted","Data":"1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42"} Oct 30 22:25:33.369113 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:33.368811 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:33.409218 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:33.409141 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" podStartSLOduration=1.5736647000000001 podStartE2EDuration="3.409127904s" totalImagesPullingTime="1.835463204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:33.408374926 +0000 UTC m=+1071.479273727" watchObservedRunningTime="2026-10-30 22:25:33.409127904 +0000 UTC m=+1071.480026692" Oct 30 22:25:34.414047 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:34.414013 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:39.378585 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:39.378549 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:25:40.588462 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:40.588431 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:40.641131 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:40.641102 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c"] Oct 30 22:25:40.641358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:40.641331 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" containerID="cri-o://2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d" gracePeriod=30 Oct 30 22:25:40.641438 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:40.641357 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kube-rbac-proxy" containerID="cri-o://17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f" gracePeriod=30 Oct 30 22:25:40.706120 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:40.706092 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:41.064907 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:41.064868 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.32:8643/healthz\": dial tcp 10.132.0.32:8643: connect: connection refused" Oct 30 22:25:41.070314 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:41.070291 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Oct 30 22:25:41.406355 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:41.406282 4933 generic.go:356] "Generic (PLEG): container finished" podID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerID="17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f" exitCode=0 Oct 30 22:25:41.406484 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:41.406350 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" event={"ID":"ea88e817-a97e-462b-9f10-a9a3f17de81b","Type":"ContainerDied","Data":"17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f"} Oct 30 22:25:44.078075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.078043 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:25:44.199012 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.198939 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-rbac-proxy-sar-config\") pod \"ea88e817-a97e-462b-9f10-a9a3f17de81b\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " Oct 30 22:25:44.199012 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.198979 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-cabundle-cert\") pod \"ea88e817-a97e-462b-9f10-a9a3f17de81b\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " Oct 30 22:25:44.199206 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.199069 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea88e817-a97e-462b-9f10-a9a3f17de81b-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ea88e817-a97e-462b-9f10-a9a3f17de81b-proxy-tls\") pod \"ea88e817-a97e-462b-9f10-a9a3f17de81b\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " Oct 30 22:25:44.199206 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.199100 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-api-access-l8ttz\" (UniqueName: \"kubernetes.io/projected/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-api-access-l8ttz\") pod \"ea88e817-a97e-462b-9f10-a9a3f17de81b\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " Oct 30 22:25:44.199206 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.199140 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ea88e817-a97e-462b-9f10-a9a3f17de81b-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea88e817-a97e-462b-9f10-a9a3f17de81b-kserve-provision-location\") pod \"ea88e817-a97e-462b-9f10-a9a3f17de81b\" (UID: \"ea88e817-a97e-462b-9f10-a9a3f17de81b\") " Oct 30 22:25:44.199369 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.199340 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-rbac-proxy-sar-config" pod "ea88e817-a97e-462b-9f10-a9a3f17de81b" (UID: "ea88e817-a97e-462b-9f10-a9a3f17de81b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:25:44.199429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.199404 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-cabundle-cert" pod "ea88e817-a97e-462b-9f10-a9a3f17de81b" (UID: "ea88e817-a97e-462b-9f10-a9a3f17de81b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:25:44.199534 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.199508 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea88e817-a97e-462b-9f10-a9a3f17de81b-kserve-provision-location" pod "ea88e817-a97e-462b-9f10-a9a3f17de81b" (UID: "ea88e817-a97e-462b-9f10-a9a3f17de81b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:25:44.201158 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.201134 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea88e817-a97e-462b-9f10-a9a3f17de81b-proxy-tls" pod "ea88e817-a97e-462b-9f10-a9a3f17de81b" (UID: "ea88e817-a97e-462b-9f10-a9a3f17de81b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:25:44.201247 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.201137 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-api-access-l8ttz" pod "ea88e817-a97e-462b-9f10-a9a3f17de81b" (UID: "ea88e817-a97e-462b-9f10-a9a3f17de81b"). InnerVolumeSpecName "kube-api-access-l8ttz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:25:44.300550 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.300523 4933 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea88e817-a97e-462b-9f10-a9a3f17de81b-kserve-provision-location\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:25:44.300550 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.300544 4933 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:25:44.300701 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.300554 4933 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ea88e817-a97e-462b-9f10-a9a3f17de81b-cabundle-cert\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:25:44.300701 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.300564 4933 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ea88e817-a97e-462b-9f10-a9a3f17de81b-proxy-tls\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:25:44.300701 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.300572 4933 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8ttz\" (UniqueName: \"kubernetes.io/projected/ea88e817-a97e-462b-9f10-a9a3f17de81b-kube-api-access-l8ttz\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:25:44.419060 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.419035 4933 generic.go:356] "Generic (PLEG): container finished" podID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerID="2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d" exitCode=0 Oct 30 22:25:44.419154 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.419091 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" Oct 30 22:25:44.419154 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.419116 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" event={"ID":"ea88e817-a97e-462b-9f10-a9a3f17de81b","Type":"ContainerDied","Data":"2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d"} Oct 30 22:25:44.419222 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.419179 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c" event={"ID":"ea88e817-a97e-462b-9f10-a9a3f17de81b","Type":"ContainerDied","Data":"4f2a76f83e4514f0abe06183331396e9e1a62e1a3c7103170fc068fbd47c7c76"} Oct 30 22:25:44.419222 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.419207 4933 scope.go:122] "RemoveContainer" containerID="17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f" Oct 30 22:25:44.428131 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.428113 4933 scope.go:122] "RemoveContainer" containerID="2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d" Oct 30 22:25:44.435809 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.435791 4933 scope.go:122] "RemoveContainer" containerID="82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4" Oct 30 22:25:44.442899 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.442881 4933 scope.go:122] "RemoveContainer" containerID="17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f" Oct 30 22:25:44.443125 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:25:44.443108 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f\": container with ID starting with 17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f not found: ID does not exist" containerID="17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f" Oct 30 22:25:44.443189 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.443133 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f"} err="failed to get container status \"17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f\": rpc error: code = NotFound desc = could not find container \"17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f\": container with ID starting with 17af653d7a4770fa871cdfe820320b7421658ad8a2153ec00739027491da225f not found: ID does not exist" Oct 30 22:25:44.443189 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.443147 4933 scope.go:122] "RemoveContainer" containerID="2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d" Oct 30 22:25:44.443398 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:25:44.443380 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d\": container with ID starting with 2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d not found: ID does not exist" containerID="2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d" Oct 30 22:25:44.443443 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.443402 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d"} err="failed to get container status \"2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d\": rpc error: code = NotFound desc = could not find container \"2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d\": container with ID starting with 2c17e5a55b7acf899068ffd397aca001b052daba145894444d46ccb8190f857d not found: ID does not exist" Oct 30 22:25:44.443443 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.443415 4933 scope.go:122] "RemoveContainer" containerID="82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4" Oct 30 22:25:44.443671 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:25:44.443645 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4\": container with ID starting with 82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4 not found: ID does not exist" containerID="82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4" Oct 30 22:25:44.443740 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.443681 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4"} err="failed to get container status \"82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4\": rpc error: code = NotFound desc = could not find container \"82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4\": container with ID starting with 82c288cb36eb5ad8971a191762818b108f428dd9068d7633250bc6eda1a39ac4 not found: ID does not exist" Oct 30 22:25:44.469760 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.469712 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c"] Oct 30 22:25:44.481175 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:44.481155 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-bdc73-predictor-dd845d6f6-g8n6c"] Oct 30 22:25:46.080219 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:46.080181 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" path="/var/lib/kubelet/pods/ea88e817-a97e-462b-9f10-a9a3f17de81b/volumes" Oct 30 22:25:46.477189 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:25:46.477103 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:25:47.970749 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:47.970718 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:48.116505 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.116476 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:48.368156 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.368124 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:48.480111 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.480083 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf"] Oct 30 22:25:48.480398 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.480386 4933 cpu_manager.go:414] "containerMap: removing container" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" Oct 30 22:25:48.480446 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.480399 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" Oct 30 22:25:48.480446 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.480427 4933 cpu_manager.go:414] "containerMap: removing container" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kube-rbac-proxy" Oct 30 22:25:48.480446 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.480432 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kube-rbac-proxy" Oct 30 22:25:48.480446 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.480441 4933 cpu_manager.go:414] "containerMap: removing container" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="storage-initializer" Oct 30 22:25:48.480446 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.480446 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="storage-initializer" Oct 30 22:25:48.480585 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.480504 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kube-rbac-proxy" Oct 30 22:25:48.480585 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.480513 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea88e817-a97e-462b-9f10-a9a3f17de81b" containerName="kserve-container" Oct 30 22:25:48.485221 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.485206 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.504843 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.504815 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"seaweedfs-s3-creds\"" Oct 30 22:25:48.516362 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.516335 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-xgboost-graph-raw-hpa-e619c-predictor-serving-cert\"" Oct 30 22:25:48.516495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.516470 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-xgboost-graph-raw-hpa-e619c-kube-rbac-proxy-sar-config\"" Oct 30 22:25:48.516495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.516486 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:25:48.516649 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.516509 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"kube-root-ca.crt\"" Oct 30 22:25:48.517823 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.517803 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf"] Oct 30 22:25:48.528246 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.528226 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:25:48.631753 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.631695 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.631753 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.631736 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94e35449-3b6b-43cb-9b1d-c176ba656158-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.631879 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.631755 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.631912 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.631874 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xv46\" (UniqueName: \"kubernetes.io/projected/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-api-access-7xv46\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.631945 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.631921 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94e35449-3b6b-43cb-9b1d-c176ba656158-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.732949 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.732901 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xv46\" (UniqueName: \"kubernetes.io/projected/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-api-access-7xv46\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.732949 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.732955 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94e35449-3b6b-43cb-9b1d-c176ba656158-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.733147 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.732977 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.733147 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.733019 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94e35449-3b6b-43cb-9b1d-c176ba656158-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.733147 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.733035 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.733486 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.733465 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94e35449-3b6b-43cb-9b1d-c176ba656158-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.733759 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.733737 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.733832 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.733798 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.735452 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.735433 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94e35449-3b6b-43cb-9b1d-c176ba656158-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.756574 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.756546 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xv46\" (UniqueName: \"kubernetes.io/projected/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-api-access-7xv46\") pod \"isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:48.801579 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:48.801544 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:49.111699 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:49.111664 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf"] Oct 30 22:25:49.112951 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:25:49.112923 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e35449_3b6b_43cb_9b1d_c176ba656158.slice/crio-ee6892dfdd87dd8bcb4a6da3e8361035919970028a56fbac10cd7fabda255184 WatchSource:0}: Error finding container ee6892dfdd87dd8bcb4a6da3e8361035919970028a56fbac10cd7fabda255184: Status 404 returned error can't find the container with id ee6892dfdd87dd8bcb4a6da3e8361035919970028a56fbac10cd7fabda255184 Oct 30 22:25:49.449999 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:49.449892 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" event={"ID":"94e35449-3b6b-43cb-9b1d-c176ba656158","Type":"ContainerStarted","Data":"0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa"} Oct 30 22:25:49.450177 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:49.449995 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" event={"ID":"94e35449-3b6b-43cb-9b1d-c176ba656158","Type":"ContainerStarted","Data":"ee6892dfdd87dd8bcb4a6da3e8361035919970028a56fbac10cd7fabda255184"} Oct 30 22:25:53.465968 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:53.465929 4933 generic.go:356] "Generic (PLEG): container finished" podID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerID="0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa" exitCode=0 Oct 30 22:25:53.466337 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:53.466002 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" event={"ID":"94e35449-3b6b-43cb-9b1d-c176ba656158","Type":"ContainerDied","Data":"0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa"} Oct 30 22:25:54.472466 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:54.472429 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" event={"ID":"94e35449-3b6b-43cb-9b1d-c176ba656158","Type":"ContainerStarted","Data":"101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56"} Oct 30 22:25:54.472982 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:54.472501 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" event={"ID":"94e35449-3b6b-43cb-9b1d-c176ba656158","Type":"ContainerStarted","Data":"6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25"} Oct 30 22:25:54.472982 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:54.472822 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:54.472982 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:54.472962 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:25:54.474287 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:54.474254 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused" Oct 30 22:25:54.526897 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:54.526856 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podStartSLOduration=2.74083548 podStartE2EDuration="6.526840381s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.786004901s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:54.525962767 +0000 UTC m=+1092.596861543" watchObservedRunningTime="2026-10-30 22:25:54.526840381 +0000 UTC m=+1092.597739155" Oct 30 22:25:55.476698 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:25:55.476649 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused" Oct 30 22:26:00.481318 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:00.481288 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:26:00.481898 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:00.481862 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused" Oct 30 22:26:10.482147 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:10.482096 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused" Oct 30 22:26:16.476775 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:26:16.476737 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:26:20.482511 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:20.482477 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused" Oct 30 22:26:30.420439 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:30.420363 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:30.482031 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:30.481982 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused" Oct 30 22:26:30.613946 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:30.613909 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:34.499570 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:34.499534 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:39.195095 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:39.195057 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:39.317017 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:39.316975 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:26:40.482326 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:40.482291 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused" Oct 30 22:26:46.484137 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:26:46.484077 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:26:50.482708 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:26:50.482660 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused" Oct 30 22:27:00.483350 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:00.483305 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:27:16.477874 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:27:16.477826 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:27:28.255679 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.255645 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5"] Oct 30 22:27:28.259128 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.259112 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:27:28.272545 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.272522 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:28.282925 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.282901 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5"] Oct 30 22:27:28.286128 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.286108 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"model-chainer-raw-hpa-e619c-kube-rbac-proxy-sar-config\"" Oct 30 22:27:28.286213 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.286191 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"model-chainer-raw-hpa-e619c-serving-cert\"" Oct 30 22:27:28.347956 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.347932 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-proxy-tls\") pod \"model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5\" (UID: \"ef7c0266-80dd-4b1e-b2d7-bc60317e655e\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:27:28.348057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.347996 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5\" (UID: \"ef7c0266-80dd-4b1e-b2d7-bc60317e655e\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:27:28.400273 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.400232 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:28.449077 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.449040 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5\" (UID: \"ef7c0266-80dd-4b1e-b2d7-bc60317e655e\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:27:28.449168 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.449114 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-proxy-tls\") pod \"model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5\" (UID: \"ef7c0266-80dd-4b1e-b2d7-bc60317e655e\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:27:28.449701 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.449681 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5\" (UID: \"ef7c0266-80dd-4b1e-b2d7-bc60317e655e\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:27:28.451595 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.451568 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-proxy-tls\") pod \"model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5\" (UID: \"ef7c0266-80dd-4b1e-b2d7-bc60317e655e\") " pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:27:28.571719 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.571643 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:27:28.870915 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:28.870885 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5"] Oct 30 22:27:28.871971 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:27:28.871947 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7c0266_80dd_4b1e_b2d7_bc60317e655e.slice/crio-e01a2f437879ad923f8be2f223b9cf4b0099df0895598fbfe51811a934984e9b WatchSource:0}: Error finding container e01a2f437879ad923f8be2f223b9cf4b0099df0895598fbfe51811a934984e9b: Status 404 returned error can't find the container with id e01a2f437879ad923f8be2f223b9cf4b0099df0895598fbfe51811a934984e9b Oct 30 22:27:29.859521 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:29.859472 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" event={"ID":"ef7c0266-80dd-4b1e-b2d7-bc60317e655e","Type":"ContainerStarted","Data":"95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417"} Oct 30 22:27:29.859982 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:29.859575 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" event={"ID":"ef7c0266-80dd-4b1e-b2d7-bc60317e655e","Type":"ContainerStarted","Data":"e01a2f437879ad923f8be2f223b9cf4b0099df0895598fbfe51811a934984e9b"} Oct 30 22:27:29.859982 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:29.859629 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:27:29.899833 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:29.899780 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" podStartSLOduration=1.899768097 podStartE2EDuration="1.899768097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:27:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:27:29.898897032 +0000 UTC m=+1187.969795801" watchObservedRunningTime="2026-10-30 22:27:29.899768097 +0000 UTC m=+1187.970666873" Oct 30 22:27:34.604872 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:34.604827 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:35.870888 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:35.870845 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:27:38.840755 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:38.840717 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:38.875584 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:38.875552 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf"] Oct 30 22:27:38.875884 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:38.875858 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" containerID="cri-o://6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25" gracePeriod=30 Oct 30 22:27:38.875974 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:38.875920 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kube-rbac-proxy" containerID="cri-o://101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56" gracePeriod=30 Oct 30 22:27:38.967715 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:38.967684 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:39.902672 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:39.902638 4933 generic.go:356] "Generic (PLEG): container finished" podID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerID="101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56" exitCode=0 Oct 30 22:27:39.903044 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:39.902714 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" event={"ID":"94e35449-3b6b-43cb-9b1d-c176ba656158","Type":"ContainerDied","Data":"101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56"} Oct 30 22:27:40.477535 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:40.477491 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused" Oct 30 22:27:40.481790 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:40.481762 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused" Oct 30 22:27:42.172114 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.172086 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:27:42.180409 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.180389 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:27:42.325588 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.325562 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:27:42.452632 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.452556 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-cabundle-cert\") pod \"94e35449-3b6b-43cb-9b1d-c176ba656158\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " Oct 30 22:27:42.452632 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.452585 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-api-access-7xv46\" (UniqueName: \"kubernetes.io/projected/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-api-access-7xv46\") pod \"94e35449-3b6b-43cb-9b1d-c176ba656158\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " Oct 30 22:27:42.452632 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.452628 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-rbac-proxy-sar-config\") pod \"94e35449-3b6b-43cb-9b1d-c176ba656158\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " Oct 30 22:27:42.452835 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.452648 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/94e35449-3b6b-43cb-9b1d-c176ba656158-proxy-tls\" (UniqueName: \"kubernetes.io/secret/94e35449-3b6b-43cb-9b1d-c176ba656158-proxy-tls\") pod \"94e35449-3b6b-43cb-9b1d-c176ba656158\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " Oct 30 22:27:42.452835 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.452702 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94e35449-3b6b-43cb-9b1d-c176ba656158-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94e35449-3b6b-43cb-9b1d-c176ba656158-kserve-provision-location\") pod \"94e35449-3b6b-43cb-9b1d-c176ba656158\" (UID: \"94e35449-3b6b-43cb-9b1d-c176ba656158\") " Oct 30 22:27:42.453056 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.452930 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-cabundle-cert" pod "94e35449-3b6b-43cb-9b1d-c176ba656158" (UID: "94e35449-3b6b-43cb-9b1d-c176ba656158"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:27:42.453056 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.453045 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-rbac-proxy-sar-config" pod "94e35449-3b6b-43cb-9b1d-c176ba656158" (UID: "94e35449-3b6b-43cb-9b1d-c176ba656158"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:27:42.453201 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.453079 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94e35449-3b6b-43cb-9b1d-c176ba656158-kserve-provision-location" pod "94e35449-3b6b-43cb-9b1d-c176ba656158" (UID: "94e35449-3b6b-43cb-9b1d-c176ba656158"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:27:42.454680 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.454659 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94e35449-3b6b-43cb-9b1d-c176ba656158-proxy-tls" pod "94e35449-3b6b-43cb-9b1d-c176ba656158" (UID: "94e35449-3b6b-43cb-9b1d-c176ba656158"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:27:42.454829 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.454808 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-api-access-7xv46" pod "94e35449-3b6b-43cb-9b1d-c176ba656158" (UID: "94e35449-3b6b-43cb-9b1d-c176ba656158"). InnerVolumeSpecName "kube-api-access-7xv46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:27:42.553427 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.553399 4933 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94e35449-3b6b-43cb-9b1d-c176ba656158-kserve-provision-location\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:27:42.553427 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.553424 4933 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-cabundle-cert\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:27:42.553565 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.553437 4933 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xv46\" (UniqueName: \"kubernetes.io/projected/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-api-access-7xv46\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:27:42.553565 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.553450 4933 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/94e35449-3b6b-43cb-9b1d-c176ba656158-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:27:42.553565 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.553462 4933 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94e35449-3b6b-43cb-9b1d-c176ba656158-proxy-tls\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:27:42.917300 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.917263 4933 generic.go:356] "Generic (PLEG): container finished" podID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerID="6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25" exitCode=0 Oct 30 22:27:42.917491 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.917332 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" Oct 30 22:27:42.917491 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.917333 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" event={"ID":"94e35449-3b6b-43cb-9b1d-c176ba656158","Type":"ContainerDied","Data":"6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25"} Oct 30 22:27:42.917491 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.917398 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf" event={"ID":"94e35449-3b6b-43cb-9b1d-c176ba656158","Type":"ContainerDied","Data":"ee6892dfdd87dd8bcb4a6da3e8361035919970028a56fbac10cd7fabda255184"} Oct 30 22:27:42.917491 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.917427 4933 scope.go:122] "RemoveContainer" containerID="101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56" Oct 30 22:27:42.926122 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.926106 4933 scope.go:122] "RemoveContainer" containerID="6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25" Oct 30 22:27:42.933818 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.933796 4933 scope.go:122] "RemoveContainer" containerID="0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa" Oct 30 22:27:42.940984 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.940964 4933 scope.go:122] "RemoveContainer" containerID="101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56" Oct 30 22:27:42.941258 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:27:42.941239 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56\": container with ID starting with 101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56 not found: ID does not exist" containerID="101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56" Oct 30 22:27:42.941323 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.941264 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56"} err="failed to get container status \"101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56\": rpc error: code = NotFound desc = could not find container \"101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56\": container with ID starting with 101fc5e7c3559f99f57da4fadb980e9a54b2ef346761333109b3ef7441912d56 not found: ID does not exist" Oct 30 22:27:42.941323 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.941281 4933 scope.go:122] "RemoveContainer" containerID="6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25" Oct 30 22:27:42.941497 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:27:42.941481 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25\": container with ID starting with 6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25 not found: ID does not exist" containerID="6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25" Oct 30 22:27:42.941548 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.941499 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25"} err="failed to get container status \"6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25\": rpc error: code = NotFound desc = could not find container \"6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25\": container with ID starting with 6c9dbfe6bc852632d8d3e914c5fc5bc685fd9f30e922d3334378c79242d66f25 not found: ID does not exist" Oct 30 22:27:42.941548 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.941510 4933 scope.go:122] "RemoveContainer" containerID="0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa" Oct 30 22:27:42.941717 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:27:42.941696 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa\": container with ID starting with 0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa not found: ID does not exist" containerID="0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa" Oct 30 22:27:42.941759 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.941723 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa"} err="failed to get container status \"0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa\": rpc error: code = NotFound desc = could not find container \"0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa\": container with ID starting with 0b809990dc23759adeb438573e5526fd1f42c967059a9b7d21209396004fdbaa not found: ID does not exist" Oct 30 22:27:42.971643 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.971623 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf"] Oct 30 22:27:42.985214 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:42.985126 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2951e75f13/isvc-xgboost-graph-raw-hpa-e619c-predictor-9689846d-4pwqf"] Oct 30 22:27:44.079961 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:44.079924 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" path="/var/lib/kubelet/pods/94e35449-3b6b-43cb-9b1d-c176ba656158/volumes" Oct 30 22:27:46.211501 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:46.211465 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:46.470375 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:27:46.470290 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:27:46.475647 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:27:46.475620 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:28:06.351782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.351733 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:06.517843 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.517807 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp"] Oct 30 22:28:06.518143 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.518131 4933 cpu_manager.go:414] "containerMap: removing container" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="storage-initializer" Oct 30 22:28:06.518188 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.518144 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="storage-initializer" Oct 30 22:28:06.518188 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.518167 4933 cpu_manager.go:414] "containerMap: removing container" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" Oct 30 22:28:06.518188 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.518172 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" Oct 30 22:28:06.518188 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.518185 4933 cpu_manager.go:414] "containerMap: removing container" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kube-rbac-proxy" Oct 30 22:28:06.518304 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.518191 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kube-rbac-proxy" Oct 30 22:28:06.518304 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.518242 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kserve-container" Oct 30 22:28:06.518304 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.518250 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="94e35449-3b6b-43cb-9b1d-c176ba656158" containerName="kube-rbac-proxy" Oct 30 22:28:06.521535 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.521515 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.538362 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.538330 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"kube-root-ca.crt\"" Oct 30 22:28:06.538479 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.538396 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:28:06.538479 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.538396 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-logger-raw-d0eec-kube-rbac-proxy-sar-config\"" Oct 30 22:28:06.538479 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.538397 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"seaweedfs-s3-creds\"" Oct 30 22:28:06.549456 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.549433 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-logger-raw-d0eec-predictor-serving-cert\"" Oct 30 22:28:06.550958 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.550940 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp"] Oct 30 22:28:06.630149 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.630093 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4dj9\" (UniqueName: \"kubernetes.io/projected/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-api-access-z4dj9\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.630149 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.630125 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-cabundle-cert\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.630149 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.630144 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.630300 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.630198 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f995f8b-37d8-410d-b7d3-3421ec66974a-proxy-tls\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.630336 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.630303 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f995f8b-37d8-410d-b7d3-3421ec66974a-kserve-provision-location\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.730986 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.730961 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4dj9\" (UniqueName: \"kubernetes.io/projected/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-api-access-z4dj9\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.731078 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.730990 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-cabundle-cert\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.731078 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.731009 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.731078 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.731026 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f995f8b-37d8-410d-b7d3-3421ec66974a-proxy-tls\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.731190 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.731148 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f995f8b-37d8-410d-b7d3-3421ec66974a-kserve-provision-location\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.731503 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.731475 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f995f8b-37d8-410d-b7d3-3421ec66974a-kserve-provision-location\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.731743 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.731726 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.731799 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.731775 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-cabundle-cert\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.733582 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.733562 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f995f8b-37d8-410d-b7d3-3421ec66974a-proxy-tls\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.754109 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.754087 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4dj9\" (UniqueName: \"kubernetes.io/projected/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-api-access-z4dj9\") pod \"isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:06.839802 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:06.839771 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:07.161372 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:07.161350 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp"] Oct 30 22:28:07.163130 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:28:07.163104 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f995f8b_37d8_410d_b7d3_3421ec66974a.slice/crio-8349d110c27da8433adfac4262cb7f20c06d2d9e1f8e1e63938a057a5d930676 WatchSource:0}: Error finding container 8349d110c27da8433adfac4262cb7f20c06d2d9e1f8e1e63938a057a5d930676: Status 404 returned error can't find the container with id 8349d110c27da8433adfac4262cb7f20c06d2d9e1f8e1e63938a057a5d930676 Oct 30 22:28:07.451242 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:07.451151 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:08.028153 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:08.028116 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" event={"ID":"6f995f8b-37d8-410d-b7d3-3421ec66974a","Type":"ContainerStarted","Data":"74e9748ac97d01a03cb17015c97b56191676bbd4898775572235be4fc25250d8"} Oct 30 22:28:08.028329 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:08.028182 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" event={"ID":"6f995f8b-37d8-410d-b7d3-3421ec66974a","Type":"ContainerStarted","Data":"8349d110c27da8433adfac4262cb7f20c06d2d9e1f8e1e63938a057a5d930676"} Oct 30 22:28:11.047942 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:11.047907 4933 generic.go:356] "Generic (PLEG): container finished" podID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerID="74e9748ac97d01a03cb17015c97b56191676bbd4898775572235be4fc25250d8" exitCode=0 Oct 30 22:28:11.048269 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:11.047947 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" event={"ID":"6f995f8b-37d8-410d-b7d3-3421ec66974a","Type":"ContainerDied","Data":"74e9748ac97d01a03cb17015c97b56191676bbd4898775572235be4fc25250d8"} Oct 30 22:28:12.054942 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:12.054909 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" event={"ID":"6f995f8b-37d8-410d-b7d3-3421ec66974a","Type":"ContainerStarted","Data":"73fca0b2ad179925c048ab1040b1621e1d36015e9e1bf1c01f454eb5b9baa963"} Oct 30 22:28:12.055424 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:12.054974 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" event={"ID":"6f995f8b-37d8-410d-b7d3-3421ec66974a","Type":"ContainerStarted","Data":"5a0624775128b68695a3408e5b34cdabb7be38567ff906c2523b57b25beeb4d3"} Oct 30 22:28:12.055424 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:12.055006 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" event={"ID":"6f995f8b-37d8-410d-b7d3-3421ec66974a","Type":"ContainerStarted","Data":"f0116ea3d96bf36682ce90082c23d900dd48e8218d68d2b29effe3b8a69490d2"} Oct 30 22:28:12.055424 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:12.055300 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:12.055545 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:12.055476 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:12.056635 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:12.056589 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:28:12.124309 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:12.124265 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podStartSLOduration=2.481136186 podStartE2EDuration="6.124254184s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.643117998s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:28:12.111286058 +0000 UTC m=+1230.182184835" watchObservedRunningTime="2026-10-30 22:28:12.124254184 +0000 UTC m=+1230.195152959" Oct 30 22:28:13.059227 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:13.059180 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:28:13.059742 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:13.059297 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:13.060543 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:13.060514 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:28:14.063981 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:14.063938 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:28:14.064428 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:14.064284 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:28:16.476195 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:28:16.476154 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:28:19.067685 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:19.067657 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:28:19.068184 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:19.068157 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:28:19.068420 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:19.068395 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:28:24.775765 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:24.775724 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:24.918148 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:24.918108 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:29.068177 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:29.068135 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:28:29.068676 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:29.068460 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:28:34.724078 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:34.724033 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:39.068893 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:39.068851 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:28:39.069311 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:39.069286 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:28:40.934476 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:40.934445 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:41.060410 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:41.060371 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:46.475652 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:28:46.475592 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:28:48.606693 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:48.606658 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:48.728169 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:48.728138 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:49.068110 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:49.068061 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:28:49.068419 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:49.068383 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:28:53.649060 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:53.649027 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:28:59.068466 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:59.068424 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:28:59.068974 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:28:59.068920 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:29:02.399050 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:02.399012 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:02.675846 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:02.675772 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:07.964111 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:07.964080 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:09.068800 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:09.068756 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:29:09.069279 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:09.069254 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:29:16.475360 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:29:16.475322 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:29:19.068151 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:19.068107 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:29:19.068717 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:19.068382 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:29:25.075972 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:25.075871 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:29:25.076442 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:25.076422 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:29:32.451131 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:32.451100 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp"] Oct 30 22:29:32.451600 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:32.451437 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" containerID="cri-o://f0116ea3d96bf36682ce90082c23d900dd48e8218d68d2b29effe3b8a69490d2" gracePeriod=30 Oct 30 22:29:32.451600 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:32.451449 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kube-rbac-proxy" containerID="cri-o://5a0624775128b68695a3408e5b34cdabb7be38567ff906c2523b57b25beeb4d3" gracePeriod=30 Oct 30 22:29:32.451600 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:32.451486 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" containerID="cri-o://73fca0b2ad179925c048ab1040b1621e1d36015e9e1bf1c01f454eb5b9baa963" gracePeriod=30 Oct 30 22:29:32.521439 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:32.521402 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:32.664853 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:32.664826 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:33.403419 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:33.403386 4933 generic.go:356] "Generic (PLEG): container finished" podID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerID="5a0624775128b68695a3408e5b34cdabb7be38567ff906c2523b57b25beeb4d3" exitCode=0 Oct 30 22:29:33.403419 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:33.403424 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" event={"ID":"6f995f8b-37d8-410d-b7d3-3421ec66974a","Type":"ContainerDied","Data":"5a0624775128b68695a3408e5b34cdabb7be38567ff906c2523b57b25beeb4d3"} Oct 30 22:29:34.064083 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:34.064042 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused" Oct 30 22:29:34.865536 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:34.865502 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:29:35.075918 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:35.075875 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:29:35.076354 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:35.076206 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:29:37.422209 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:37.422174 4933 generic.go:356] "Generic (PLEG): container finished" podID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerID="f0116ea3d96bf36682ce90082c23d900dd48e8218d68d2b29effe3b8a69490d2" exitCode=0 Oct 30 22:29:37.422654 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:37.422278 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" event={"ID":"6f995f8b-37d8-410d-b7d3-3421ec66974a","Type":"ContainerDied","Data":"f0116ea3d96bf36682ce90082c23d900dd48e8218d68d2b29effe3b8a69490d2"} Oct 30 22:29:39.064491 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:39.064442 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused" Oct 30 22:29:44.064863 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:44.064815 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused" Oct 30 22:29:44.065371 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:44.064945 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:29:45.076265 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:45.076225 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:29:45.076705 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:45.076674 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:29:46.479363 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:29:46.479319 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:29:49.064590 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:49.064547 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused" Oct 30 22:29:54.064414 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:54.064369 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused" Oct 30 22:29:55.076386 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:55.076339 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Oct 30 22:29:55.076846 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:55.076511 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:29:55.076846 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:55.076657 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:29:55.076846 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:55.076756 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:29:59.064340 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:29:59.064288 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused" Oct 30 22:30:02.297121 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.297084 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:02.531501 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.531474 4933 generic.go:356] "Generic (PLEG): container finished" podID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerID="73fca0b2ad179925c048ab1040b1621e1d36015e9e1bf1c01f454eb5b9baa963" exitCode=137 Oct 30 22:30:02.531656 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.531517 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" event={"ID":"6f995f8b-37d8-410d-b7d3-3421ec66974a","Type":"ContainerDied","Data":"73fca0b2ad179925c048ab1040b1621e1d36015e9e1bf1c01f454eb5b9baa963"} Oct 30 22:30:02.591240 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.591214 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:30:02.661239 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.661213 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-rbac-proxy-sar-config\") pod \"6f995f8b-37d8-410d-b7d3-3421ec66974a\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " Oct 30 22:30:02.661369 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.661258 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f995f8b-37d8-410d-b7d3-3421ec66974a-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f995f8b-37d8-410d-b7d3-3421ec66974a-kserve-provision-location\") pod \"6f995f8b-37d8-410d-b7d3-3421ec66974a\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " Oct 30 22:30:02.661369 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.661304 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f995f8b-37d8-410d-b7d3-3421ec66974a-proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f995f8b-37d8-410d-b7d3-3421ec66974a-proxy-tls\") pod \"6f995f8b-37d8-410d-b7d3-3421ec66974a\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " Oct 30 22:30:02.661492 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.661367 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-cabundle-cert\") pod \"6f995f8b-37d8-410d-b7d3-3421ec66974a\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " Oct 30 22:30:02.661492 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.661421 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-api-access-z4dj9\" (UniqueName: \"kubernetes.io/projected/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-api-access-z4dj9\") pod \"6f995f8b-37d8-410d-b7d3-3421ec66974a\" (UID: \"6f995f8b-37d8-410d-b7d3-3421ec66974a\") " Oct 30 22:30:02.662153 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.661577 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-rbac-proxy-sar-config" pod "6f995f8b-37d8-410d-b7d3-3421ec66974a" (UID: "6f995f8b-37d8-410d-b7d3-3421ec66974a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:30:02.662153 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.661618 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f995f8b-37d8-410d-b7d3-3421ec66974a-kserve-provision-location" pod "6f995f8b-37d8-410d-b7d3-3421ec66974a" (UID: "6f995f8b-37d8-410d-b7d3-3421ec66974a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:30:02.662153 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.661985 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-cabundle-cert" pod "6f995f8b-37d8-410d-b7d3-3421ec66974a" (UID: "6f995f8b-37d8-410d-b7d3-3421ec66974a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:30:02.663626 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.663585 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f995f8b-37d8-410d-b7d3-3421ec66974a-proxy-tls" pod "6f995f8b-37d8-410d-b7d3-3421ec66974a" (UID: "6f995f8b-37d8-410d-b7d3-3421ec66974a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:30:02.664220 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.664191 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-api-access-z4dj9" pod "6f995f8b-37d8-410d-b7d3-3421ec66974a" (UID: "6f995f8b-37d8-410d-b7d3-3421ec66974a"). InnerVolumeSpecName "kube-api-access-z4dj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:30:02.762107 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.762078 4933 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4dj9\" (UniqueName: \"kubernetes.io/projected/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-api-access-z4dj9\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:30:02.762107 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.762105 4933 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:30:02.762228 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.762118 4933 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6f995f8b-37d8-410d-b7d3-3421ec66974a-kserve-provision-location\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:30:02.762228 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.762128 4933 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f995f8b-37d8-410d-b7d3-3421ec66974a-proxy-tls\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:30:02.762228 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:02.762138 4933 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6f995f8b-37d8-410d-b7d3-3421ec66974a-cabundle-cert\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:30:03.545358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:03.545324 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" Oct 30 22:30:03.545358 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:03.545326 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp" event={"ID":"6f995f8b-37d8-410d-b7d3-3421ec66974a","Type":"ContainerDied","Data":"8349d110c27da8433adfac4262cb7f20c06d2d9e1f8e1e63938a057a5d930676"} Oct 30 22:30:03.545962 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:03.545441 4933 scope.go:122] "RemoveContainer" containerID="73fca0b2ad179925c048ab1040b1621e1d36015e9e1bf1c01f454eb5b9baa963" Oct 30 22:30:03.555732 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:03.555688 4933 scope.go:122] "RemoveContainer" containerID="5a0624775128b68695a3408e5b34cdabb7be38567ff906c2523b57b25beeb4d3" Oct 30 22:30:03.564488 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:03.564467 4933 scope.go:122] "RemoveContainer" containerID="f0116ea3d96bf36682ce90082c23d900dd48e8218d68d2b29effe3b8a69490d2" Oct 30 22:30:03.572327 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:03.572307 4933 scope.go:122] "RemoveContainer" containerID="74e9748ac97d01a03cb17015c97b56191676bbd4898775572235be4fc25250d8" Oct 30 22:30:03.609583 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:03.609560 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp"] Oct 30 22:30:03.620750 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:03.620722 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2951e75f13/isvc-logger-raw-d0eec-predictor-588fffc9d6-kmrrp"] Oct 30 22:30:04.079908 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:04.079881 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" path="/var/lib/kubelet/pods/6f995f8b-37d8-410d-b7d3-3421ec66974a/volumes" Oct 30 22:30:04.444038 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:04.443940 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:04.650627 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:04.650537 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:16.478409 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:30:16.478367 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:30:33.306977 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:33.306944 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:34.988851 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:34.988815 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:44.829159 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:44.829130 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:44.964486 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:30:44.964435 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:30:46.476788 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:30:46.476748 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:31:16.477859 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:31:16.477822 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:31:36.438984 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:31:36.438937 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:31:46.481350 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:31:46.481304 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:32:06.481082 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:32:06.481036 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:15.777381 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:32:15.777343 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:16.479733 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:32:16.479693 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:32:23.112293 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:32:23.112259 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:23.241479 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:32:23.241448 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:23.378844 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:32:23.378772 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:23.498683 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:32:23.498632 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:35.197951 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:32:35.197896 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:32:42.198710 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:32:42.198682 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:32:42.214746 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:32:42.214719 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:32:46.474314 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:32:46.474278 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:32:56.046344 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:32:56.046274 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:01.374465 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:01.374409 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:01.507473 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:01.507442 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:09.134860 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:09.134823 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:14.069724 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:14.069681 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g"] Oct 30 22:33:14.070171 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:14.069880 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerName="model-chainer-raw-bdc73" containerID="cri-o://1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42" gracePeriod=30 Oct 30 22:33:14.081257 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:14.081228 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5"] Oct 30 22:33:14.081442 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:14.081407 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerName="model-chainer-raw-hpa-e619c" containerID="cri-o://95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417" gracePeriod=30 Oct 30 22:33:14.143220 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:14.143179 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:14.377803 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:14.377721 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerName="model-chainer-raw-bdc73" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:15.868566 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:15.868517 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerName="model-chainer-raw-hpa-e619c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:16.477235 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:33:16.477200 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:33:19.377689 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:19.377650 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerName="model-chainer-raw-bdc73" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:20.868830 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:20.868779 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerName="model-chainer-raw-hpa-e619c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:24.377511 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:24.377471 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerName="model-chainer-raw-bdc73" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:24.377938 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:24.377583 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:33:25.868669 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:25.868633 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerName="model-chainer-raw-hpa-e619c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:25.869056 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:25.868728 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:33:29.377328 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:29.377286 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerName="model-chainer-raw-bdc73" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:30.868627 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:30.868575 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerName="model-chainer-raw-hpa-e619c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:34.377557 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:34.377519 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerName="model-chainer-raw-bdc73" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:35.336459 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:35.336420 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:35.869118 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:35.869079 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerName="model-chainer-raw-hpa-e619c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:39.377082 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:39.377039 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerName="model-chainer-raw-bdc73" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:40.868461 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:40.868417 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerName="model-chainer-raw-hpa-e619c" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:33:44.230415 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.230385 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:33:44.270257 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.270118 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:33:44.304463 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.304439 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2bfe2445-1993-4d21-8c2e-875d41f02f84-proxy-tls\" (UniqueName: \"kubernetes.io/secret/2bfe2445-1993-4d21-8c2e-875d41f02f84-proxy-tls\") pod \"2bfe2445-1993-4d21-8c2e-875d41f02f84\" (UID: \"2bfe2445-1993-4d21-8c2e-875d41f02f84\") " Oct 30 22:33:44.304569 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.304481 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2bfe2445-1993-4d21-8c2e-875d41f02f84-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bfe2445-1993-4d21-8c2e-875d41f02f84-openshift-service-ca-bundle\") pod \"2bfe2445-1993-4d21-8c2e-875d41f02f84\" (UID: \"2bfe2445-1993-4d21-8c2e-875d41f02f84\") " Oct 30 22:33:44.304842 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.304816 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bfe2445-1993-4d21-8c2e-875d41f02f84-openshift-service-ca-bundle" pod "2bfe2445-1993-4d21-8c2e-875d41f02f84" (UID: "2bfe2445-1993-4d21-8c2e-875d41f02f84"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:33:44.306390 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.306368 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bfe2445-1993-4d21-8c2e-875d41f02f84-proxy-tls" pod "2bfe2445-1993-4d21-8c2e-875d41f02f84" (UID: "2bfe2445-1993-4d21-8c2e-875d41f02f84"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:33:44.405836 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.405781 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-proxy-tls\") pod \"ef7c0266-80dd-4b1e-b2d7-bc60317e655e\" (UID: \"ef7c0266-80dd-4b1e-b2d7-bc60317e655e\") " Oct 30 22:33:44.405836 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.405828 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-openshift-service-ca-bundle\") pod \"ef7c0266-80dd-4b1e-b2d7-bc60317e655e\" (UID: \"ef7c0266-80dd-4b1e-b2d7-bc60317e655e\") " Oct 30 22:33:44.406033 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.405995 4933 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2bfe2445-1993-4d21-8c2e-875d41f02f84-proxy-tls\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:33:44.406033 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.406006 4933 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bfe2445-1993-4d21-8c2e-875d41f02f84-openshift-service-ca-bundle\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:33:44.406211 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.406188 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-openshift-service-ca-bundle" pod "ef7c0266-80dd-4b1e-b2d7-bc60317e655e" (UID: "ef7c0266-80dd-4b1e-b2d7-bc60317e655e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:33:44.407764 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.407743 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-proxy-tls" pod "ef7c0266-80dd-4b1e-b2d7-bc60317e655e" (UID: "ef7c0266-80dd-4b1e-b2d7-bc60317e655e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:33:44.465064 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.465035 4933 generic.go:356] "Generic (PLEG): container finished" podID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerID="1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42" exitCode=0 Oct 30 22:33:44.465162 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.465079 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" Oct 30 22:33:44.465162 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.465095 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" event={"ID":"2bfe2445-1993-4d21-8c2e-875d41f02f84","Type":"ContainerDied","Data":"1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42"} Oct 30 22:33:44.465162 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.465145 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g" event={"ID":"2bfe2445-1993-4d21-8c2e-875d41f02f84","Type":"ContainerDied","Data":"5bb65e8b1538624f5ab211398a9dee9e67d6fcc84cc68bdae1b3ce7c41a3600b"} Oct 30 22:33:44.465282 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.465170 4933 scope.go:122] "RemoveContainer" containerID="1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42" Oct 30 22:33:44.466248 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.466231 4933 generic.go:356] "Generic (PLEG): container finished" podID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerID="95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417" exitCode=137 Oct 30 22:33:44.466307 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.466260 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" event={"ID":"ef7c0266-80dd-4b1e-b2d7-bc60317e655e","Type":"ContainerDied","Data":"95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417"} Oct 30 22:33:44.466307 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.466275 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" Oct 30 22:33:44.466307 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.466299 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5" event={"ID":"ef7c0266-80dd-4b1e-b2d7-bc60317e655e","Type":"ContainerDied","Data":"e01a2f437879ad923f8be2f223b9cf4b0099df0895598fbfe51811a934984e9b"} Oct 30 22:33:44.473241 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.473217 4933 scope.go:122] "RemoveContainer" containerID="1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42" Oct 30 22:33:44.473523 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:33:44.473495 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42\": container with ID starting with 1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42 not found: ID does not exist" containerID="1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42" Oct 30 22:33:44.473632 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.473531 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42"} err="failed to get container status \"1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42\": rpc error: code = NotFound desc = could not find container \"1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42\": container with ID starting with 1facae6353fcbad0d6d31237c742e449cd94b628044f90d0ca045d8eab971c42 not found: ID does not exist" Oct 30 22:33:44.473632 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.473552 4933 scope.go:122] "RemoveContainer" containerID="95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417" Oct 30 22:33:44.481081 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.481062 4933 scope.go:122] "RemoveContainer" containerID="95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417" Oct 30 22:33:44.481310 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:33:44.481292 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417\": container with ID starting with 95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417 not found: ID does not exist" containerID="95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417" Oct 30 22:33:44.481360 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.481316 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417"} err="failed to get container status \"95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417\": rpc error: code = NotFound desc = could not find container \"95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417\": container with ID starting with 95d0f8be2751c0d5354de1df82b48a1726594863240a5421be155de32af11417 not found: ID does not exist" Oct 30 22:33:44.507176 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.507158 4933 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-proxy-tls\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:33:44.507262 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.507180 4933 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef7c0266-80dd-4b1e-b2d7-bc60317e655e-openshift-service-ca-bundle\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:33:44.515737 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.515717 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g"] Oct 30 22:33:44.519985 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.519967 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-bdc73-8b6b84c8-6424g"] Oct 30 22:33:44.553999 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.553980 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5"] Oct 30 22:33:44.559281 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:44.559262 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2951e75f13/model-chainer-raw-hpa-e619c-7d6db47dc9-79ks5"] Oct 30 22:33:46.081424 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:46.081390 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" path="/var/lib/kubelet/pods/2bfe2445-1993-4d21-8c2e-875d41f02f84/volumes" Oct 30 22:33:46.081879 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:46.081775 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" path="/var/lib/kubelet/pods/ef7c0266-80dd-4b1e-b2d7-bc60317e655e/volumes" Oct 30 22:33:46.477046 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:33:46.476963 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:33:51.401562 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:51.401525 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:51.530636 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:51.530583 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:51.650361 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:51.650328 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:51.779577 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:51.779545 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:51.911024 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:51.910998 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:52.400841 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:52.400809 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:52.590179 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:52.590148 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:52.788492 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:52.788466 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:52.929700 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:52.929664 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:53.479575 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:53.479544 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:53.612068 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:53.612037 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:59.010066 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:59.010023 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:33:59.130087 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:33:59.130053 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:00.992592 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:34:00.992562 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:01.158692 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:34:01.158658 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:01.306853 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:34:01.306787 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:01.430655 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:34:01.430619 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:16.476182 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:34:16.476144 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:34:35.445476 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:34:35.445440 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:34:46.476899 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:34:46.476861 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:34:52.072133 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:34:52.072091 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:16.476560 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:35:16.476521 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:35:31.499904 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.499798 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:31.556554 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556521 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd"] Oct 30 22:35:31.556850 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556836 4933 cpu_manager.go:414] "containerMap: removing container" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kube-rbac-proxy" Oct 30 22:35:31.556898 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556851 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kube-rbac-proxy" Oct 30 22:35:31.556898 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556871 4933 cpu_manager.go:414] "containerMap: removing container" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" Oct 30 22:35:31.556898 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556876 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" Oct 30 22:35:31.556898 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556888 4933 cpu_manager.go:414] "containerMap: removing container" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerName="model-chainer-raw-bdc73" Oct 30 22:35:31.556898 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556893 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerName="model-chainer-raw-bdc73" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556906 4933 cpu_manager.go:414] "containerMap: removing container" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556910 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556917 4933 cpu_manager.go:414] "containerMap: removing container" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="storage-initializer" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556922 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="storage-initializer" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556933 4933 cpu_manager.go:414] "containerMap: removing container" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerName="model-chainer-raw-hpa-e619c" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.556940 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerName="model-chainer-raw-hpa-e619c" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.557004 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef7c0266-80dd-4b1e-b2d7-bc60317e655e" containerName="model-chainer-raw-hpa-e619c" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.557014 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kube-rbac-proxy" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.557023 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="kserve-container" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.557030 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="2bfe2445-1993-4d21-8c2e-875d41f02f84" containerName="model-chainer-raw-bdc73" Oct 30 22:35:31.557057 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.557036 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f995f8b-37d8-410d-b7d3-3421ec66974a" containerName="agent" Oct 30 22:35:31.560157 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.560136 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.576658 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.576630 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd"] Oct 30 22:35:31.586931 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.586908 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"seaweedfs-s3-creds\"" Oct 30 22:35:31.587020 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.586925 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"kube-root-ca.crt\"" Oct 30 22:35:31.589070 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.589050 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:35:31.589070 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.589058 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\"" Oct 30 22:35:31.589231 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.589115 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"openshift-service-ca.crt\"" Oct 30 22:35:31.589231 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.589156 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"default-dockercfg-7rhfl\"" Oct 30 22:35:31.589231 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.589191 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-promote-v2-predictor-serving-cert\"" Oct 30 22:35:31.634876 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.634854 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57rbz\" (UniqueName: \"kubernetes.io/projected/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-api-access-57rbz\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.634965 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.634882 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83bfef76-87b3-409b-8c34-f080e4fd891d-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.634965 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.634901 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.635049 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.634967 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.635095 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.635068 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83bfef76-87b3-409b-8c34-f080e4fd891d-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.735864 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.735839 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83bfef76-87b3-409b-8c34-f080e4fd891d-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.735982 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.735872 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.735982 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.735902 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.735982 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.735931 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83bfef76-87b3-409b-8c34-f080e4fd891d-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.736099 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.735996 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rbz\" (UniqueName: \"kubernetes.io/projected/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-api-access-57rbz\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.736293 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.736269 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83bfef76-87b3-409b-8c34-f080e4fd891d-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.736569 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.736542 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.736725 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.736618 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.738416 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.738396 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83bfef76-87b3-409b-8c34-f080e4fd891d-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.761862 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.761813 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57rbz\" (UniqueName: \"kubernetes.io/projected/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-api-access-57rbz\") pod \"isvc-canary-promote-v2-predictor-6845fc788-vmbbd\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:31.877086 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:31.877055 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:32.190486 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:32.190460 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd"] Oct 30 22:35:32.192114 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:35:32.192083 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bfef76_87b3_409b_8c34_f080e4fd891d.slice/crio-070b8407e187ffdc6ffd22f4545db92129f2dfa23354f532d6d8538df0aa006a WatchSource:0}: Error finding container 070b8407e187ffdc6ffd22f4545db92129f2dfa23354f532d6d8538df0aa006a: Status 404 returned error can't find the container with id 070b8407e187ffdc6ffd22f4545db92129f2dfa23354f532d6d8538df0aa006a Oct 30 22:35:32.920515 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:32.920480 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" event={"ID":"83bfef76-87b3-409b-8c34-f080e4fd891d","Type":"ContainerStarted","Data":"5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25"} Oct 30 22:35:32.920898 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:32.920537 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" event={"ID":"83bfef76-87b3-409b-8c34-f080e4fd891d","Type":"ContainerStarted","Data":"070b8407e187ffdc6ffd22f4545db92129f2dfa23354f532d6d8538df0aa006a"} Oct 30 22:35:35.575498 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:35.575467 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:35:35.940220 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:35.940182 4933 generic.go:356] "Generic (PLEG): container finished" podID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerID="5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25" exitCode=0 Oct 30 22:35:35.940336 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:35.940237 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" event={"ID":"83bfef76-87b3-409b-8c34-f080e4fd891d","Type":"ContainerDied","Data":"5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25"} Oct 30 22:35:36.946512 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:36.946479 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" event={"ID":"83bfef76-87b3-409b-8c34-f080e4fd891d","Type":"ContainerStarted","Data":"b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c"} Oct 30 22:35:36.946985 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:36.946539 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" event={"ID":"83bfef76-87b3-409b-8c34-f080e4fd891d","Type":"ContainerStarted","Data":"5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5"} Oct 30 22:35:36.946985 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:36.946757 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:37.006731 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:37.006684 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podStartSLOduration=2.382414341 podStartE2EDuration="6.006671084s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.624256743s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:35:37.005683257 +0000 UTC m=+1675.076582035" watchObservedRunningTime="2026-10-30 22:35:37.006671084 +0000 UTC m=+1675.077569859" Oct 30 22:35:37.951124 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:37.951092 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:37.952451 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:37.952424 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:35:38.955266 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:38.955222 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:35:43.960097 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:43.960066 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:35:43.960555 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:43.960529 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:35:46.475621 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:35:46.475568 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:35:53.961377 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:35:53.961339 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:36:03.960688 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:36:03.960647 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:36:13.960480 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:36:13.960435 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:36:16.476197 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:36:16.476154 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:36:23.961354 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:36:23.961317 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:36:33.961366 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:36:33.961319 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:36:35.767811 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:36:35.767773 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:43.961153 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:36:43.961111 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:36:44.331449 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:36:44.331407 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:36:46.475471 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:36:46.475438 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:36:53.961808 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:36:53.961736 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:37:02.041947 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:02.041906 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd"] Oct 30 22:37:02.042372 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:02.042152 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" containerID="cri-o://5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5" gracePeriod=30 Oct 30 22:37:02.042372 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:02.042199 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kube-rbac-proxy" containerID="cri-o://b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c" gracePeriod=30 Oct 30 22:37:02.120731 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:02.120695 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:02.299627 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:02.299544 4933 generic.go:356] "Generic (PLEG): container finished" podID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerID="b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c" exitCode=0 Oct 30 22:37:02.299627 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:02.299582 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" event={"ID":"83bfef76-87b3-409b-8c34-f080e4fd891d","Type":"ContainerDied","Data":"b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c"} Oct 30 22:37:03.955798 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:03.955757 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.37:8643/healthz\": dial tcp 10.132.0.37:8643: connect: connection refused" Oct 30 22:37:03.961088 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:03.961065 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused" Oct 30 22:37:06.279015 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.278991 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:37:06.305853 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.305830 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-cabundle-cert\") pod \"83bfef76-87b3-409b-8c34-f080e4fd891d\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " Oct 30 22:37:06.305964 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.305868 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/83bfef76-87b3-409b-8c34-f080e4fd891d-proxy-tls\" (UniqueName: \"kubernetes.io/secret/83bfef76-87b3-409b-8c34-f080e4fd891d-proxy-tls\") pod \"83bfef76-87b3-409b-8c34-f080e4fd891d\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " Oct 30 22:37:06.305964 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.305909 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-api-access-57rbz\" (UniqueName: \"kubernetes.io/projected/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-api-access-57rbz\") pod \"83bfef76-87b3-409b-8c34-f080e4fd891d\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " Oct 30 22:37:06.306082 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.306026 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-rbac-proxy-sar-config\") pod \"83bfef76-87b3-409b-8c34-f080e4fd891d\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " Oct 30 22:37:06.306192 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.306089 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83bfef76-87b3-409b-8c34-f080e4fd891d-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83bfef76-87b3-409b-8c34-f080e4fd891d-kserve-provision-location\") pod \"83bfef76-87b3-409b-8c34-f080e4fd891d\" (UID: \"83bfef76-87b3-409b-8c34-f080e4fd891d\") " Oct 30 22:37:06.306294 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.306271 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-cabundle-cert" pod "83bfef76-87b3-409b-8c34-f080e4fd891d" (UID: "83bfef76-87b3-409b-8c34-f080e4fd891d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:37:06.306378 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.306359 4933 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-cabundle-cert\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:37:06.306437 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.306393 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-rbac-proxy-sar-config" pod "83bfef76-87b3-409b-8c34-f080e4fd891d" (UID: "83bfef76-87b3-409b-8c34-f080e4fd891d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:37:06.306495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.306418 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83bfef76-87b3-409b-8c34-f080e4fd891d-kserve-provision-location" pod "83bfef76-87b3-409b-8c34-f080e4fd891d" (UID: "83bfef76-87b3-409b-8c34-f080e4fd891d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:37:06.308078 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.308058 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83bfef76-87b3-409b-8c34-f080e4fd891d-proxy-tls" pod "83bfef76-87b3-409b-8c34-f080e4fd891d" (UID: "83bfef76-87b3-409b-8c34-f080e4fd891d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:37:06.308078 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.308066 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-api-access-57rbz" pod "83bfef76-87b3-409b-8c34-f080e4fd891d" (UID: "83bfef76-87b3-409b-8c34-f080e4fd891d"). InnerVolumeSpecName "kube-api-access-57rbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:37:06.317447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.317426 4933 generic.go:356] "Generic (PLEG): container finished" podID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerID="5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5" exitCode=0 Oct 30 22:37:06.317558 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.317491 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" event={"ID":"83bfef76-87b3-409b-8c34-f080e4fd891d","Type":"ContainerDied","Data":"5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5"} Oct 30 22:37:06.317558 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.317493 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" Oct 30 22:37:06.317558 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.317536 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd" event={"ID":"83bfef76-87b3-409b-8c34-f080e4fd891d","Type":"ContainerDied","Data":"070b8407e187ffdc6ffd22f4545db92129f2dfa23354f532d6d8538df0aa006a"} Oct 30 22:37:06.317747 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.317562 4933 scope.go:122] "RemoveContainer" containerID="b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c" Oct 30 22:37:06.326633 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.326519 4933 scope.go:122] "RemoveContainer" containerID="5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5" Oct 30 22:37:06.333745 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.333729 4933 scope.go:122] "RemoveContainer" containerID="5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25" Oct 30 22:37:06.341305 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.341286 4933 scope.go:122] "RemoveContainer" containerID="b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c" Oct 30 22:37:06.341575 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:37:06.341556 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c\": container with ID starting with b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c not found: ID does not exist" containerID="b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c" Oct 30 22:37:06.341642 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.341583 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c"} err="failed to get container status \"b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c\": rpc error: code = NotFound desc = could not find container \"b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c\": container with ID starting with b50bc2da45174c533ecdd5a3c9c120ddc2d30007c12af139c84207b623e8e46c not found: ID does not exist" Oct 30 22:37:06.341642 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.341600 4933 scope.go:122] "RemoveContainer" containerID="5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5" Oct 30 22:37:06.341884 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:37:06.341863 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5\": container with ID starting with 5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5 not found: ID does not exist" containerID="5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5" Oct 30 22:37:06.341952 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.341890 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5"} err="failed to get container status \"5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5\": rpc error: code = NotFound desc = could not find container \"5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5\": container with ID starting with 5e74ac612f4443a0935dbd30d241b3e158109bb41b230c125fa4cb5fb52115d5 not found: ID does not exist" Oct 30 22:37:06.341952 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.341904 4933 scope.go:122] "RemoveContainer" containerID="5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25" Oct 30 22:37:06.342164 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:37:06.342142 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25\": container with ID starting with 5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25 not found: ID does not exist" containerID="5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25" Oct 30 22:37:06.342222 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.342170 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25"} err="failed to get container status \"5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25\": rpc error: code = NotFound desc = could not find container \"5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25\": container with ID starting with 5f6081978316da4242de10536ce9e3187f26b4c9cfb9d69c505f6bd437d8ef25 not found: ID does not exist" Oct 30 22:37:06.381082 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.381060 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd"] Oct 30 22:37:06.384487 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.384469 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-vmbbd"] Oct 30 22:37:06.407705 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.407686 4933 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83bfef76-87b3-409b-8c34-f080e4fd891d-kserve-provision-location\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:37:06.407705 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.407704 4933 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/83bfef76-87b3-409b-8c34-f080e4fd891d-proxy-tls\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:37:06.407822 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.407715 4933 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57rbz\" (UniqueName: \"kubernetes.io/projected/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-api-access-57rbz\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:37:06.407822 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:06.407723 4933 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/83bfef76-87b3-409b-8c34-f080e4fd891d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:37:08.080729 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:08.080687 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" path="/var/lib/kubelet/pods/83bfef76-87b3-409b-8c34-f080e4fd891d/volumes" Oct 30 22:37:09.042302 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:09.042265 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:16.476060 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:37:16.476009 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:37:16.641437 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:16.641406 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:16.826803 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:16.826769 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:18.962901 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:18.962864 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:19.151351 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:19.151320 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:20.340429 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:20.340391 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:20.629244 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:20.629161 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:35.817659 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:35.817600 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:40.381471 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.381438 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:40.542466 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.542435 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7"] Oct 30 22:37:40.542787 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.542773 4933 cpu_manager.go:414] "containerMap: removing container" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" Oct 30 22:37:40.542840 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.542788 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" Oct 30 22:37:40.542840 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.542814 4933 cpu_manager.go:414] "containerMap: removing container" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="storage-initializer" Oct 30 22:37:40.542840 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.542819 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="storage-initializer" Oct 30 22:37:40.542840 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.542833 4933 cpu_manager.go:414] "containerMap: removing container" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kube-rbac-proxy" Oct 30 22:37:40.542840 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.542838 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kube-rbac-proxy" Oct 30 22:37:40.542984 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.542892 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kube-rbac-proxy" Oct 30 22:37:40.542984 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.542900 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="83bfef76-87b3-409b-8c34-f080e4fd891d" containerName="kserve-container" Oct 30 22:37:40.546093 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.546074 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.560964 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.560939 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"seaweedfs-s3-creds\"" Oct 30 22:37:40.571882 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.571861 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"default-dockercfg-7dz8s\"" Oct 30 22:37:40.572092 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.572007 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"kube-root-ca.crt\"" Oct 30 22:37:40.572092 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.572026 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:37:40.572092 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.572059 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"isvc-logger-raw-cipn-kube-rbac-proxy-sar-config\"" Oct 30 22:37:40.572256 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.572097 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"openshift-service-ca.crt\"" Oct 30 22:37:40.572256 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.572099 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"isvc-logger-raw-cipn-predictor-serving-cert\"" Oct 30 22:37:40.573365 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.573338 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7"] Oct 30 22:37:40.632250 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.632187 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:37:40.649825 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.649801 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.649924 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.649847 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fb957b4-ebd7-4f66-83e1-17b96784de49-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.649924 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.649871 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fb957b4-ebd7-4f66-83e1-17b96784de49-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.649993 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.649947 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45wtr\" (UniqueName: \"kubernetes.io/projected/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-api-access-45wtr\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.649993 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.649989 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.751256 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.751232 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.751348 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.751274 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.751348 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.751307 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fb957b4-ebd7-4f66-83e1-17b96784de49-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.751348 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.751325 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fb957b4-ebd7-4f66-83e1-17b96784de49-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.751348 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.751345 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45wtr\" (UniqueName: \"kubernetes.io/projected/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-api-access-45wtr\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.751822 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.751802 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fb957b4-ebd7-4f66-83e1-17b96784de49-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.752104 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.752082 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.752179 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.752082 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.753846 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.753828 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fb957b4-ebd7-4f66-83e1-17b96784de49-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.774810 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.774791 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45wtr\" (UniqueName: \"kubernetes.io/projected/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-api-access-45wtr\") pod \"isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:40.865011 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:40.864990 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:41.189811 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:41.189785 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7"] Oct 30 22:37:41.191350 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:37:41.191320 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb957b4_ebd7_4f66_83e1_17b96784de49.slice/crio-996fe0d153bd8c1432e59b5df6cfac24c113d062093cd03c845fb8af7b545d6e WatchSource:0}: Error finding container 996fe0d153bd8c1432e59b5df6cfac24c113d062093cd03c845fb8af7b545d6e: Status 404 returned error can't find the container with id 996fe0d153bd8c1432e59b5df6cfac24c113d062093cd03c845fb8af7b545d6e Oct 30 22:37:41.462835 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:41.462759 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" event={"ID":"5fb957b4-ebd7-4f66-83e1-17b96784de49","Type":"ContainerStarted","Data":"0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d"} Oct 30 22:37:41.462835 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:41.462817 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" event={"ID":"5fb957b4-ebd7-4f66-83e1-17b96784de49","Type":"ContainerStarted","Data":"996fe0d153bd8c1432e59b5df6cfac24c113d062093cd03c845fb8af7b545d6e"} Oct 30 22:37:42.231291 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:42.231258 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:37:42.241742 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:42.241719 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:37:45.480550 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:45.480479 4933 generic.go:356] "Generic (PLEG): container finished" podID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerID="0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d" exitCode=0 Oct 30 22:37:45.480919 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:45.480551 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" event={"ID":"5fb957b4-ebd7-4f66-83e1-17b96784de49","Type":"ContainerDied","Data":"0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d"} Oct 30 22:37:46.476478 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:37:46.476442 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:37:46.486564 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:46.486536 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" event={"ID":"5fb957b4-ebd7-4f66-83e1-17b96784de49","Type":"ContainerStarted","Data":"d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21"} Oct 30 22:37:46.486930 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:46.486638 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" event={"ID":"5fb957b4-ebd7-4f66-83e1-17b96784de49","Type":"ContainerStarted","Data":"88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed"} Oct 30 22:37:46.486930 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:46.486680 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" event={"ID":"5fb957b4-ebd7-4f66-83e1-17b96784de49","Type":"ContainerStarted","Data":"9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4"} Oct 30 22:37:46.486930 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:46.486879 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:46.486930 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:46.486923 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:46.487130 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:46.486957 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:46.488293 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:46.488268 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:37:46.488966 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:46.488937 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:37:46.559373 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:46.559320 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podStartSLOduration=2.6492377830000002 podStartE2EDuration="6.55930343s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.910065647s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:37:46.54661549 +0000 UTC m=+1804.617514522" watchObservedRunningTime="2026-10-30 22:37:46.55930343 +0000 UTC m=+1804.630202207" Oct 30 22:37:47.491354 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:47.491313 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:37:47.491762 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:47.491662 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:37:52.494974 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:52.494942 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:37:52.495370 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:52.495346 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:37:52.495811 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:37:52.495787 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:38:02.495518 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:02.495478 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:38:02.495950 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:02.495709 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:38:12.495404 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:12.495362 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:38:12.495982 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:12.495950 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:38:16.476583 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:38:16.476544 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:38:22.496075 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:22.496034 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:38:22.496583 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:22.496504 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:38:32.495543 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:32.495406 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:38:32.495942 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:32.495811 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:38:36.006935 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:36.006896 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:38:42.496096 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:42.496059 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:38:42.496569 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:42.496538 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:38:46.475601 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:38:46.475563 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:38:52.495497 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:52.495448 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:38:52.495943 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:38:52.495815 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:39:02.496209 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:02.496178 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:39:02.496724 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:02.496427 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:39:16.476799 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:39:16.476762 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:39:16.586254 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:16.586224 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7"] Oct 30 22:39:16.586494 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:16.586466 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" containerID="cri-o://d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21" gracePeriod=30 Oct 30 22:39:16.586547 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:16.586463 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" containerID="cri-o://9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4" gracePeriod=30 Oct 30 22:39:16.586547 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:16.586496 4933 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kube-rbac-proxy" containerID="cri-o://88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed" gracePeriod=30 Oct 30 22:39:16.616905 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:16.616879 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:16.756243 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:16.756194 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:16.859115 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:16.859091 4933 generic.go:356] "Generic (PLEG): container finished" podID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerID="88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed" exitCode=0 Oct 30 22:39:16.859240 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:16.859160 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" event={"ID":"5fb957b4-ebd7-4f66-83e1-17b96784de49","Type":"ContainerDied","Data":"88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed"} Oct 30 22:39:17.491765 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:17.491730 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused" Oct 30 22:39:20.878263 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:20.878229 4933 generic.go:356] "Generic (PLEG): container finished" podID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerID="9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4" exitCode=0 Oct 30 22:39:20.878552 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:20.878301 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" event={"ID":"5fb957b4-ebd7-4f66-83e1-17b96784de49","Type":"ContainerDied","Data":"9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4"} Oct 30 22:39:22.492006 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:22.491970 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused" Oct 30 22:39:22.496375 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:22.496345 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:39:22.496680 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:22.496655 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:39:27.492138 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:27.492101 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused" Oct 30 22:39:27.492495 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:27.492250 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:39:32.492019 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:32.491978 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused" Oct 30 22:39:32.496282 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:32.496254 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:39:32.496763 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:32.496740 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:39:36.071241 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:36.071206 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:37.491821 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:37.491782 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused" Oct 30 22:39:42.491585 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:42.491541 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused" Oct 30 22:39:42.495840 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:42.495803 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused" Oct 30 22:39:42.495957 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:42.495930 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:39:42.496240 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:42.496217 4933 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 22:39:42.496310 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:42.496301 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:39:46.479859 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:39:46.479822 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:39:46.732015 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.731959 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:39:46.849809 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.849785 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5fb957b4-ebd7-4f66-83e1-17b96784de49-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fb957b4-ebd7-4f66-83e1-17b96784de49-kserve-provision-location\") pod \"5fb957b4-ebd7-4f66-83e1-17b96784de49\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " Oct 30 22:39:46.849955 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.849848 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5fb957b4-ebd7-4f66-83e1-17b96784de49-proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fb957b4-ebd7-4f66-83e1-17b96784de49-proxy-tls\") pod \"5fb957b4-ebd7-4f66-83e1-17b96784de49\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " Oct 30 22:39:46.849955 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.849892 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-api-access-45wtr\" (UniqueName: \"kubernetes.io/projected/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-api-access-45wtr\") pod \"5fb957b4-ebd7-4f66-83e1-17b96784de49\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " Oct 30 22:39:46.849955 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.849943 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-rbac-proxy-sar-config\") pod \"5fb957b4-ebd7-4f66-83e1-17b96784de49\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " Oct 30 22:39:46.850125 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.849992 4933 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-cabundle-cert\") pod \"5fb957b4-ebd7-4f66-83e1-17b96784de49\" (UID: \"5fb957b4-ebd7-4f66-83e1-17b96784de49\") " Oct 30 22:39:46.850207 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.850183 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fb957b4-ebd7-4f66-83e1-17b96784de49-kserve-provision-location" pod "5fb957b4-ebd7-4f66-83e1-17b96784de49" (UID: "5fb957b4-ebd7-4f66-83e1-17b96784de49"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:39:46.850268 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.850248 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-rbac-proxy-sar-config" pod "5fb957b4-ebd7-4f66-83e1-17b96784de49" (UID: "5fb957b4-ebd7-4f66-83e1-17b96784de49"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:39:46.850357 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.850335 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-cabundle-cert" pod "5fb957b4-ebd7-4f66-83e1-17b96784de49" (UID: "5fb957b4-ebd7-4f66-83e1-17b96784de49"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:39:46.851995 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.851973 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fb957b4-ebd7-4f66-83e1-17b96784de49-proxy-tls" pod "5fb957b4-ebd7-4f66-83e1-17b96784de49" (UID: "5fb957b4-ebd7-4f66-83e1-17b96784de49"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:39:46.852093 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.852074 4933 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-api-access-45wtr" pod "5fb957b4-ebd7-4f66-83e1-17b96784de49" (UID: "5fb957b4-ebd7-4f66-83e1-17b96784de49"). InnerVolumeSpecName "kube-api-access-45wtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:39:46.950510 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.950485 4933 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fb957b4-ebd7-4f66-83e1-17b96784de49-kserve-provision-location\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:39:46.950510 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.950508 4933 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fb957b4-ebd7-4f66-83e1-17b96784de49-proxy-tls\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:39:46.950671 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.950519 4933 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45wtr\" (UniqueName: \"kubernetes.io/projected/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-api-access-45wtr\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:39:46.950671 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.950528 4933 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:39:46.950671 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.950536 4933 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5fb957b4-ebd7-4f66-83e1-17b96784de49-cabundle-cert\") on node \"ip-10-0-137-160.ec2.internal\" DevicePath \"\"" Oct 30 22:39:46.992237 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.992207 4933 generic.go:356] "Generic (PLEG): container finished" podID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerID="d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21" exitCode=0 Oct 30 22:39:46.992327 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.992271 4933 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" Oct 30 22:39:46.992327 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.992292 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" event={"ID":"5fb957b4-ebd7-4f66-83e1-17b96784de49","Type":"ContainerDied","Data":"d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21"} Oct 30 22:39:46.992411 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.992394 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7" event={"ID":"5fb957b4-ebd7-4f66-83e1-17b96784de49","Type":"ContainerDied","Data":"996fe0d153bd8c1432e59b5df6cfac24c113d062093cd03c845fb8af7b545d6e"} Oct 30 22:39:46.992447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:46.992439 4933 scope.go:122] "RemoveContainer" containerID="d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21" Oct 30 22:39:47.000974 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.000956 4933 scope.go:122] "RemoveContainer" containerID="88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed" Oct 30 22:39:47.010731 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.010713 4933 scope.go:122] "RemoveContainer" containerID="9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4" Oct 30 22:39:47.017592 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.017577 4933 scope.go:122] "RemoveContainer" containerID="0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d" Oct 30 22:39:47.024598 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.024574 4933 scope.go:122] "RemoveContainer" containerID="d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21" Oct 30 22:39:47.024881 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:39:47.024860 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21\": container with ID starting with d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21 not found: ID does not exist" containerID="d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21" Oct 30 22:39:47.024960 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.024893 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21"} err="failed to get container status \"d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21\": rpc error: code = NotFound desc = could not find container \"d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21\": container with ID starting with d6e71292b467453519453fb8883c16c54d2c150b9c3016c7ce0fd12e38ffcb21 not found: ID does not exist" Oct 30 22:39:47.024960 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.024916 4933 scope.go:122] "RemoveContainer" containerID="88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed" Oct 30 22:39:47.025173 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:39:47.025155 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed\": container with ID starting with 88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed not found: ID does not exist" containerID="88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed" Oct 30 22:39:47.025212 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.025180 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed"} err="failed to get container status \"88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed\": rpc error: code = NotFound desc = could not find container \"88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed\": container with ID starting with 88b6e587dc21589c874b3d3ee9669e6b5d2ca0e24aa9540f4b863fe7034fc7ed not found: ID does not exist" Oct 30 22:39:47.025212 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.025196 4933 scope.go:122] "RemoveContainer" containerID="9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4" Oct 30 22:39:47.025424 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:39:47.025406 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4\": container with ID starting with 9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4 not found: ID does not exist" containerID="9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4" Oct 30 22:39:47.025485 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.025431 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4"} err="failed to get container status \"9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4\": rpc error: code = NotFound desc = could not find container \"9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4\": container with ID starting with 9550bb8e252ab87aa4275e53325fbd61bfd5b8a85da0ad25d54bf778aab9c3a4 not found: ID does not exist" Oct 30 22:39:47.025485 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.025446 4933 scope.go:122] "RemoveContainer" containerID="0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d" Oct 30 22:39:47.025690 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:39:47.025667 4933 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d\": container with ID starting with 0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d not found: ID does not exist" containerID="0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d" Oct 30 22:39:47.025782 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.025694 4933 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d"} err="failed to get container status \"0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d\": rpc error: code = NotFound desc = could not find container \"0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d\": container with ID starting with 0f488933d58dabc09e973c023027c81507f444b674314a89235a05aaa3189d5d not found: ID does not exist" Oct 30 22:39:47.044238 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.044214 4933 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7"] Oct 30 22:39:47.048777 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.048762 4933 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a93fba2bb7/isvc-logger-raw-cipn-predictor-789d4f5f55-cw9j7"] Oct 30 22:39:47.819447 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:47.819410 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:48.080406 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:48.080326 4933 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" path="/var/lib/kubelet/pods/5fb957b4-ebd7-4f66-83e1-17b96784de49/volumes" Oct 30 22:39:48.789449 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:48.789413 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:48.911221 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:48.911197 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:53.892975 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:53.892864 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:39:54.029224 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:39:54.029185 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:01.073994 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:01.073955 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:16.476043 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:40:16.476005 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:40:29.377813 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:29.377780 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:29.679262 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:29.679188 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:29.820025 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:29.819993 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:34.301300 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:34.301270 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r2hqv_960e184e-c2a7-4937-bf04-4c13a434883e/global-pull-secret-syncer/0.log" Oct 30 22:40:34.493707 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:34.493680 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-8xtlm_4c8ed0be-6573-4bf7-aa93-572c5c0e4bce/connection-checker/0.log" Oct 30 22:40:34.634113 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:34.634056 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-92wb6_43cebd0d-8293-4c7c-9469-4b211733bb79/connection-checker/0.log" Oct 30 22:40:34.763615 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:34.763592 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-t8fj7_a918696f-7dcd-4942-bbe2-1f59aaf991fe/connection-checker/0.log" Oct 30 22:40:34.909884 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:34.909829 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" Oct 30 22:40:35.259102 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:35.259075 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:35.342962 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:35.342934 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-160.ec2.internal_4bcd859681c6ed3bc37c2cdc12c8d68d/haproxy/0.log" Oct 30 22:40:35.387890 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:35.387823 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:36.171740 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:36.171708 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:41.047085 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:41.047055 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-xvqph_9d369819-d29c-48a6-b03b-41f2145bac41/cluster-monitoring-operator/0.log" Oct 30 22:40:41.830919 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:41.830886 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2jxzd_e3f223b2-d93e-423f-8c51-15393d8ee691/node-exporter/0.log" Oct 30 22:40:41.959565 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:41.959540 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2jxzd_e3f223b2-d93e-423f-8c51-15393d8ee691/kube-rbac-proxy/0.log" Oct 30 22:40:42.091079 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.091013 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2jxzd_e3f223b2-d93e-423f-8c51-15393d8ee691/init-textfile/0.log" Oct 30 22:40:42.792750 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.792717 4933 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72"] Oct 30 22:40:42.793058 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793045 4933 cpu_manager.go:414] "containerMap: removing container" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kube-rbac-proxy" Oct 30 22:40:42.793105 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793059 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kube-rbac-proxy" Oct 30 22:40:42.793105 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793071 4933 cpu_manager.go:414] "containerMap: removing container" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="storage-initializer" Oct 30 22:40:42.793105 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793076 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="storage-initializer" Oct 30 22:40:42.793105 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793094 4933 cpu_manager.go:414] "containerMap: removing container" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" Oct 30 22:40:42.793105 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793099 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" Oct 30 22:40:42.793261 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793113 4933 cpu_manager.go:414] "containerMap: removing container" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" Oct 30 22:40:42.793261 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793118 4933 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" Oct 30 22:40:42.793261 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793168 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kube-rbac-proxy" Oct 30 22:40:42.793261 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793178 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="kserve-container" Oct 30 22:40:42.793261 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.793186 4933 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fb957b4-ebd7-4f66-83e1-17b96784de49" containerName="agent" Oct 30 22:40:42.797247 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.797226 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.815125 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.815101 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72"] Oct 30 22:40:42.825476 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.825453 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mprzg\"/\"openshift-service-ca.crt\"" Oct 30 22:40:42.825569 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.825505 4933 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mprzg\"/\"kube-root-ca.crt\"" Oct 30 22:40:42.825569 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.825542 4933 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mprzg\"/\"default-dockercfg-gxfc7\"" Oct 30 22:40:42.826839 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.826821 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-proc\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.826897 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.826852 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4l2l\" (UniqueName: \"kubernetes.io/projected/b7079b02-8675-464d-889d-683128753a25-kube-api-access-g4l2l\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.826932 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.826892 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-lib-modules\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.827048 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.827027 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-sys\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.827105 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.827089 4933 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-podres\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.928202 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.928178 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-sys\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.928343 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.928230 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-podres\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.928343 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.928254 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-proc\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.928343 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.928283 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4l2l\" (UniqueName: \"kubernetes.io/projected/b7079b02-8675-464d-889d-683128753a25-kube-api-access-g4l2l\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.928343 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.928293 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-sys\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.928343 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.928304 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-podres\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.928565 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.928376 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-proc\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.928565 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.928448 4933 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-lib-modules\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.928565 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.928537 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7079b02-8675-464d-889d-683128753a25-lib-modules\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:42.951251 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:42.951229 4933 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4l2l\" (UniqueName: \"kubernetes.io/projected/b7079b02-8675-464d-889d-683128753a25-kube-api-access-g4l2l\") pod \"perf-node-gather-daemonset-5wr72\" (UID: \"b7079b02-8675-464d-889d-683128753a25\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:43.109862 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:43.109811 4933 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:43.406076 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:43.406045 4933 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72"] Oct 30 22:40:43.407108 ip-10-0-137-160 kubenswrapper[4933]: W1030 22:40:43.407078 4933 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb7079b02_8675_464d_889d_683128753a25.slice/crio-6f678aa031b4e8d1893a462b9bb26fcfce1ac81c7682139e2d4f6285850943e9 WatchSource:0}: Error finding container 6f678aa031b4e8d1893a462b9bb26fcfce1ac81c7682139e2d4f6285850943e9: Status 404 returned error can't find the container with id 6f678aa031b4e8d1893a462b9bb26fcfce1ac81c7682139e2d4f6285850943e9 Oct 30 22:40:44.232579 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:44.232544 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" event={"ID":"b7079b02-8675-464d-889d-683128753a25","Type":"ContainerStarted","Data":"437a4d6fc4bfe0051135cb960fad4e837afb1c6ff76f6613aabe217eaa7640c6"} Oct 30 22:40:44.233007 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:44.232593 4933 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" event={"ID":"b7079b02-8675-464d-889d-683128753a25","Type":"ContainerStarted","Data":"6f678aa031b4e8d1893a462b9bb26fcfce1ac81c7682139e2d4f6285850943e9"} Oct 30 22:40:44.233007 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:44.232674 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:44.272410 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:44.272361 4933 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" podStartSLOduration=2.272350701 podStartE2EDuration="2.272350701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:40:44.271724384 +0000 UTC m=+1982.342623138" watchObservedRunningTime="2026-10-30 22:40:44.272350701 +0000 UTC m=+1982.343249477" Oct 30 22:40:46.476326 ip-10-0-137-160 kubenswrapper[4933]: E1030 22:40:46.476292 4933 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-86mjd" containerName="extractor" Oct 30 22:40:47.099423 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:47.099395 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-mmh7p_d72a205f-a6c2-4510-989f-cfd6c8aa045d/networking-console-plugin/0.log" Oct 30 22:40:48.097145 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:48.097112 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/2.log" Oct 30 22:40:48.101027 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:48.101004 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8ddx2_ff224fb4-ef29-4599-aca1-38595e23d592/console-operator/3.log" Oct 30 22:40:50.179856 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:50.179831 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-dsswm_3f904583-6409-4a27-b9b8-cf8e1167a0b4/volume-data-source-validator/0.log" Oct 30 22:40:50.247100 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:50.247071 4933 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-5wr72" Oct 30 22:40:52.221876 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:52.221851 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vvjk_9cab6006-eafd-41a7-8035-22dfb992b4e6/dns/0.log" Oct 30 22:40:52.357018 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:52.356988 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vvjk_9cab6006-eafd-41a7-8035-22dfb992b4e6/kube-rbac-proxy/0.log" Oct 30 22:40:53.037475 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:53.037445 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fsplc_f9ef3359-4ffd-4a26-889a-8f516ef1970a/dns-node-resolver/0.log" Oct 30 22:40:54.775847 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:54.775820 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vvdnv_419fe0bc-c964-47f0-82fc-3c5d45969e63/node-ca/0.log" Oct 30 22:40:56.557038 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:56.557008 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5df9566755-smt7x_5212eb1f-ffaf-4fd0-b0a3-39a90fdb5c33/router/0.log" Oct 30 22:40:57.696346 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:57.696313 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qg8m6_2996b6af-d6da-494d-b7d9-219a40969a19/serve-healthcheck-canary/0.log" Oct 30 22:40:58.591159 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:58.591125 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-hdt8n_60d187ab-b86b-42f8-9bdb-2cdad6e6d518/insights-operator/0.log" Oct 30 22:40:58.591561 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:58.591547 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-hdt8n_60d187ab-b86b-42f8-9bdb-2cdad6e6d518/insights-operator/1.log" Oct 30 22:40:58.716464 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:58.716438 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-86mjd_f0f427f4-1c06-4556-8645-8932bcd7b653/kube-rbac-proxy/0.log" Oct 30 22:40:58.841221 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:58.841157 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-86mjd_f0f427f4-1c06-4556-8645-8932bcd7b653/exporter/0.log" Oct 30 22:40:58.966033 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:58.966009 4933 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-86mjd_f0f427f4-1c06-4556-8645-8932bcd7b653/extractor/0.log" Oct 30 22:40:59.789873 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:59.789837 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024 Oct 30 22:40:59.917785 ip-10-0-137-160 kubenswrapper[4933]: I1030 22:40:59.917754 4933 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bz4rw_8005cfc5-780e-4ea3-898e-6a54e0f93158/konnectivity-agent/0.log" limit=1024