Jul 15 10:47:58.899623 ip-10-0-131-232 systemd[1]: Starting Kubernetes Kubelet... Jul 15 10:47:59.424824 ip-10-0-131-232 systemd[1]: Started Kubernetes Kubelet. Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.350498 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357042 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357056 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357060 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357064 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357067 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357070 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357073 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:47:59.435623 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357075 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357078 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357081 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357084 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357087 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357090 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357092 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357095 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357098 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357100 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357103 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357106 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357109 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357111 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357113 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357116 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357119 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357122 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357124 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357127 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:47:59.458789 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357129 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357132 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357135 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357138 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357140 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357143 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357146 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357148 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357151 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357153 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357156 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357158 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357161 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357163 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357166 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357168 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357171 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357173 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357175 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357178 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:47:59.473812 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357180 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357183 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357186 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357190 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357192 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357196 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357200 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357203 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357206 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357209 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357212 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357214 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357217 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357220 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357222 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357225 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357228 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357230 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357233 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:47:59.488401 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357236 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357240 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357242 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357245 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357247 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357250 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357252 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357255 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357257 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357259 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357262 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357265 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357267 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357270 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357272 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357274 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357278 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357282 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357285 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357289 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:47:59.490557 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357291 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357295 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357297 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357300 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357303 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357305 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357308 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357311 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357313 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357316 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357319 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357321 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.357324 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358048 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358055 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358058 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358062 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358065 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358067 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:47:59.492261 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358070 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358073 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358075 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358079 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358082 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358084 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358087 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358090 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358093 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358095 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358098 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358101 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358104 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358106 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358109 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358112 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358115 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358117 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358120 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358123 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:47:59.494476 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358125 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358128 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358130 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358133 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358135 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358139 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358143 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358146 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358149 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358152 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358154 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358157 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358160 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358166 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358170 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358173 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358175 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358178 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358181 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:47:59.508484 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358184 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358186 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358189 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358191 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358194 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358197 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358200 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358203 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358205 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358208 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358211 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358213 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358218 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358221 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358224 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358228 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358231 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358234 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358236 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358239 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:47:59.673168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358243 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358246 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358249 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358252 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358254 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358257 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358259 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358262 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358264 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358267 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358269 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358272 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358274 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358277 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358279 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358282 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358284 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358287 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358291 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:47:59.674504 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358295 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358298 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358302 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358306 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358308 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358311 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358315 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358318 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358320 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358323 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358345 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358348 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358351 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358354 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358356 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358722 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358726 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358729 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358732 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358735 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:47:59.676908 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358737 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358740 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358743 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358745 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358748 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358750 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358753 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358755 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358760 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358763 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358767 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358772 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358775 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358778 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358784 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358787 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358790 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358793 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358797 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:47:59.688855 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358800 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358803 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358805 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358808 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358811 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358813 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358816 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358819 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358821 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358824 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358826 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358829 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358831 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358834 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358837 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358841 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358843 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358846 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358848 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358851 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:47:59.690033 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358853 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358856 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358859 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358861 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358863 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358867 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358869 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358874 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358876 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358879 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358881 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358886 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358889 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358891 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358894 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358896 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358899 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358901 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358904 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358906 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:47:59.692747 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358909 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358911 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358914 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358916 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358919 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358921 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358924 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358926 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358929 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358931 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358934 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358936 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358939 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358941 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358944 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358946 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358949 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358951 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358954 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:47:59.695137 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358958 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358960 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358963 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358965 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358971 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358974 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358976 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358978 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358981 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358984 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358987 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358989 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358992 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358995 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.358999 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359002 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359069 2553 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359076 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359081 2553 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359085 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359089 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 10:47:59.697138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359092 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359096 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359100 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359103 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359106 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359110 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359113 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359116 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359118 2553 flags.go:64] FLAG: --cgroup-root="" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359121 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359124 2553 flags.go:64] FLAG: --client-ca-file="" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359129 2553 flags.go:64] FLAG: --cloud-provider="external" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359132 2553 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359136 2553 flags.go:64] FLAG: --cluster-domain="" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359139 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359143 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359147 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359150 2553 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359154 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359157 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359160 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359163 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359165 2553 flags.go:64] FLAG: --contention-profiling="false" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359168 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 10:47:59.700179 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359171 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359174 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359177 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359181 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359184 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359187 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359190 2553 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359192 2553 flags.go:64] FLAG: --enable-server="true" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359195 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359199 2553 flags.go:64] FLAG: --event-burst="100" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359202 2553 flags.go:64] FLAG: --event-qps="50" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359204 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359208 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359210 2553 flags.go:64] FLAG: --eviction-hard="" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359214 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359217 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359219 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359222 2553 flags.go:64] FLAG: --eviction-soft="" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359225 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359229 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359232 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359235 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359238 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359242 2553 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359245 2553 flags.go:64] FLAG: --feature-gates="" Jul 15 10:47:59.701619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359249 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359252 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359255 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359267 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359271 2553 flags.go:64] FLAG: --healthz-port="10248" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359274 2553 flags.go:64] FLAG: --help="false" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359277 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359280 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359283 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359286 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359289 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359292 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359295 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359298 2553 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359301 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359304 2553 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359306 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359309 2553 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359312 2553 flags.go:64] FLAG: --kube-reserved="" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359315 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359318 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359321 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359324 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359344 2553 flags.go:64] FLAG: --lock-file="" Jul 15 10:47:59.702782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359347 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359350 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359355 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359361 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359370 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359374 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359377 2553 flags.go:64] FLAG: --logging-format="text" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359380 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359384 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359386 2553 flags.go:64] FLAG: --manifest-url="" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359389 2553 flags.go:64] FLAG: --manifest-url-header="" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359394 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359397 2553 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359400 2553 flags.go:64] FLAG: --max-pods="110" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359403 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359406 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359409 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359412 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359415 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359417 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359420 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359427 2553 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359430 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359433 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 10:47:59.706074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359435 2553 flags.go:64] FLAG: --pod-cidr="" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359438 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359445 2553 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359447 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359450 2553 flags.go:64] FLAG: --pods-per-core="0" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359453 2553 flags.go:64] FLAG: --port="10250" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359457 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359459 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02fd0c76e09403ebb" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359462 2553 flags.go:64] FLAG: --qos-reserved="" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359465 2553 flags.go:64] FLAG: --read-only-port="10255" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359468 2553 flags.go:64] FLAG: --register-node="true" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359473 2553 flags.go:64] FLAG: --register-with-taints="" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359476 2553 flags.go:64] FLAG: --registry-burst="10" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359480 2553 flags.go:64] FLAG: --registry-qps="5" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359484 2553 flags.go:64] FLAG: --reserved-cpus="" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359487 2553 flags.go:64] FLAG: --reserved-memory="" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359490 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359493 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359496 2553 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359499 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359502 2553 flags.go:64] FLAG: --runonce="false" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359504 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359507 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359510 2553 flags.go:64] FLAG: --seccomp-default="false" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359513 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 10:47:59.707143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359516 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359519 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359522 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359525 2553 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359527 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359530 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359533 2553 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359536 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359538 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359542 2553 flags.go:64] FLAG: --system-cgroups="" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359544 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359549 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359552 2553 flags.go:64] FLAG: --tls-cert-file="" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359555 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359559 2553 flags.go:64] FLAG: --tls-min-version="" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359562 2553 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359565 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359568 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359572 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359575 2553 flags.go:64] FLAG: --v="2" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359579 2553 flags.go:64] FLAG: --version="false" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359588 2553 flags.go:64] FLAG: --vmodule="" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359591 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.359595 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359699 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:47:59.712246 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359703 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359706 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359709 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359712 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359715 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359718 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359721 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359724 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359727 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359730 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359732 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359735 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359737 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359740 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359743 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359746 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359748 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359751 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359753 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359756 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:47:59.712960 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359758 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359761 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359763 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359768 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359771 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359775 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359777 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359780 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359784 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359790 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359793 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359796 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359798 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359801 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359803 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359806 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359809 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359812 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359814 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:47:59.713519 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359817 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359820 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359824 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359827 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359830 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359833 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359836 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359838 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359841 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359843 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359846 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359849 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359851 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359854 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359856 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359859 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359861 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359864 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359868 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:47:59.714088 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359871 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359873 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359877 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359880 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359883 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359885 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359888 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359890 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359893 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359896 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359898 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359901 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359904 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359906 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359909 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359911 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359914 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359916 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359919 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359921 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:47:59.714609 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359924 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359926 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359929 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359931 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359934 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359936 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359939 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359941 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359944 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359947 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359950 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359956 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359958 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359961 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359965 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359968 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359970 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359973 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359976 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:47:59.715187 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.359979 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.360656 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.367088 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.367102 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.368268 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.368277 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368355 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368362 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368366 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368371 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368375 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368380 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368384 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368389 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368393 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:47:59.715994 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368397 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368400 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368409 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368412 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368416 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368420 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368424 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368428 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368433 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368437 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368441 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368445 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368449 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368453 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368456 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368461 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368465 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368470 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368476 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:47:59.716854 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368482 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368487 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368491 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368496 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368500 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368504 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368508 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368513 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368517 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368521 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368525 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368530 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368535 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368539 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368543 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368547 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368552 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368556 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368560 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368564 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:47:59.717735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368568 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368571 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368575 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368579 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368583 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368586 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368590 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368594 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368598 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368602 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368606 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368609 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368615 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368618 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368624 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368628 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368631 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368635 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368639 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368643 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:47:59.718597 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368649 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368654 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368658 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368663 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368666 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368670 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368674 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368679 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368683 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368687 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368691 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368694 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368698 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368702 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368706 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368710 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368714 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368717 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368722 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368726 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:47:59.719460 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368730 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368733 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368737 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368741 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368746 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368751 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368755 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368760 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368762 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368765 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368770 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.368777 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368932 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368939 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 10:47:59.893083 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368944 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368948 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368952 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368957 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368961 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368965 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368971 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368975 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368979 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368982 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368985 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368988 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368993 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.368997 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369000 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369004 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369008 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369012 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369015 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 10:47:59.893896 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369019 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369025 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369030 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369036 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369041 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369045 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369049 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369054 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369057 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369061 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369065 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369069 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369073 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369077 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369080 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369084 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369087 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369091 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369095 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369100 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 10:47:59.894735 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369104 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369108 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369111 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369115 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369119 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369123 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369126 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369130 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369134 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369138 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369141 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369145 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369150 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369155 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369160 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369166 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369170 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369174 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369178 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 10:47:59.895596 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369182 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369187 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369191 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369195 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369197 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369201 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369205 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369208 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369212 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369216 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369220 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369223 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369229 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369233 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369237 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369241 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369244 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369248 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369253 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 10:47:59.896658 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369258 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369262 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369265 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369269 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369273 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369276 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369280 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369285 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369288 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369293 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369297 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369301 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369304 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369308 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369312 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369317 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369321 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369345 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369349 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 10:47:59.897529 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:47:59.369353 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.369360 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.369490 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.372009 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.373485 2553 server.go:1019] "Starting client certificate rotation" Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.373579 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.373617 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.376186 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.379271 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.386441 2553 log.go:25] "Validated CRI v1 runtime API" Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.388583 2553 log.go:25] "Validated CRI v1 image API" Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.389357 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 10:47:59.898603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.393625 2553 fs.go:135] Filesystem UUIDs: map[48b84d72-3c5d-48ac-994d-199431e0b370:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9ded1821-3c72-48a5-bd56-ccf9b1185db8:/dev/nvme0n1p3] Jul 15 10:47:59.899252 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.393638 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 10:47:59.899470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.399381 2553 manager.go:216] Machine: {Timestamp:2026-07-15 10:47:59.398054724 +0000 UTC m=+0.365372534 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3134113 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e4ee9897ef0335b71e9dcd92db79f SystemUUID:ec2e4ee9-897e-f033-5b71-e9dcd92db79f BootID:9c539bf4-d393-4b92-a9dd-9a966f8b422e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8e:b0:36:90:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8e:b0:36:90:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:5c:43:f4:96:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 10:47:59.899470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.399480 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 10:47:59.899470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.399545 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 10:47:59.899470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.405712 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 10:47:59.899470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.405739 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 10:47:59.899470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.407589 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 10:47:59.899470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.407601 2553 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.407613 2553 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.407621 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.408247 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.408966 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.411524 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.411639 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.411669 2553 kubelet.go:486] "Attempting to sync node with API server" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.411678 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.411693 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.411701 2553 kubelet.go:398] "Adding apiserver pod source" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.411710 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.412034 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.412050 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.413861 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.415740 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.415768 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416245 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416264 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416270 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416276 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416284 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416290 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416840 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416847 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416854 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416860 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416874 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.416882 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.417765 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.417779 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.420801 2553 server.go:1268] "Started kubelet" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.420873 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.420894 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.420993 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.424783 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.426661 2553 server.go:310] "Adding debug handlers to kubelet server" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.426759 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.426663 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 10:47:59.902236 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.427293 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.427285 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.429781 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-232.ec2.internal.18c270d8ef376bc5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-232.ec2.internal,UID:ip-10-0-131-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-232.ec2.internal,},FirstTimestamp:2026-07-15 10:47:59.420771269 +0000 UTC m=+0.388089062,LastTimestamp:2026-07-15 10:47:59.420771269 +0000 UTC m=+0.388089062,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-232.ec2.internal,}" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.434020 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.434042 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.434104 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.435915 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.435938 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.436056 2553 reconstruct.go:97] "Volume reconstruction finished" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.436063 2553 reconciler.go:29] "Reconciler: start to sync state" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.436275 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.436378 2553 factory.go:55] Registering systemd factory Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.436393 2553 factory.go:223] Registration of the systemd container factory successfully Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.436393 2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.436760 2553 factory.go:153] Registering CRI-O factory Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.436774 2553 factory.go:223] Registration of the crio container factory successfully Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.436818 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.436841 2553 factory.go:103] Registering Raw factory Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.436853 2553 manager.go:1196] Started watching for new ooms in manager Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.437355 2553 manager.go:349] Starting recovery of all containers Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.445715 2553 manager.go:354] Recovery completed Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.447518 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.451775 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.453693 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.453735 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.453745 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.453793 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fk85k" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.454165 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.454171 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.454175 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.454184 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 15 10:47:59.903969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.454793 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.454815 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.454824 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.455389 2553 policy_none.go:49] "None policy: Start" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.455402 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.455415 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.456468 2553 policy_none.go:47] "Start" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.460861 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fk85k" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.461444 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-232.ec2.internal.18c270d8f12e2c1e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-232.ec2.internal,UID:ip-10-0-131-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-232.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-232.ec2.internal,},FirstTimestamp:2026-07-15 10:47:59.453719582 +0000 UTC m=+0.421037374,LastTimestamp:2026-07-15 10:47:59.453719582 +0000 UTC m=+0.421037374,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-232.ec2.internal,}" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.466195 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-232.ec2.internal.18c270d8f12e7b18 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-232.ec2.internal,UID:ip-10-0-131-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-232.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-232.ec2.internal,},FirstTimestamp:2026-07-15 10:47:59.4537398 +0000 UTC m=+0.421057593,LastTimestamp:2026-07-15 10:47:59.4537398 +0000 UTC m=+0.421057593,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-232.ec2.internal,}" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.534429 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.550855 2553 manager.go:337] "Starting Device Plugin manager" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.550888 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.550898 2553 server.go:87] "Starting device plugin registration server" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.551103 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.551114 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.551223 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.551313 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.551322 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.551853 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.551900 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.557042 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.558317 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.558360 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.558376 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.558406 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.560519 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:47:59.911624 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.642224 2553 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-232.ec2.internal\" not found" node="ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.651303 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.652111 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.652136 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.652146 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.652166 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.659254 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal"] Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.659317 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.660675 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.660705 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.660716 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.662320 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.662404 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.662427 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.662719 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.662729 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-232.ec2.internal\": node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.662981 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.663008 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.663019 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.662982 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.663076 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.663086 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.664775 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.664797 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.665433 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.665462 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.665478 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.682507 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.683903 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-232.ec2.internal\" not found" node="ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.689038 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-232.ec2.internal\" not found" node="ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.912910 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.783461 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:47:59.914200 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.837884 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0c77009e9fb924b9ca7fe1c784feaaf-config\") pod \"kube-apiserver-proxy-ip-10-0-131-232.ec2.internal\" (UID: \"f0c77009e9fb924b9ca7fe1c784feaaf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.914200 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.837906 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd580c7f8d1332ff31c1ef6a4b2be26f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal\" (UID: \"bd580c7f8d1332ff31c1ef6a4b2be26f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.914200 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.837925 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd580c7f8d1332ff31c1ef6a4b2be26f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal\" (UID: \"bd580c7f8d1332ff31c1ef6a4b2be26f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" Jul 15 10:47:59.914200 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.884088 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.068711 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.938642 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0c77009e9fb924b9ca7fe1c784feaaf-config\") pod \"kube-apiserver-proxy-ip-10-0-131-232.ec2.internal\" (UID: \"f0c77009e9fb924b9ca7fe1c784feaaf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal" Jul 15 10:48:00.068711 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.938668 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd580c7f8d1332ff31c1ef6a4b2be26f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal\" (UID: \"bd580c7f8d1332ff31c1ef6a4b2be26f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" Jul 15 10:48:00.068711 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.938685 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd580c7f8d1332ff31c1ef6a4b2be26f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal\" (UID: \"bd580c7f8d1332ff31c1ef6a4b2be26f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" Jul 15 10:48:00.068711 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.938732 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd580c7f8d1332ff31c1ef6a4b2be26f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal\" (UID: \"bd580c7f8d1332ff31c1ef6a4b2be26f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" Jul 15 10:48:00.068711 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.938736 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0c77009e9fb924b9ca7fe1c784feaaf-config\") pod \"kube-apiserver-proxy-ip-10-0-131-232.ec2.internal\" (UID: \"f0c77009e9fb924b9ca7fe1c784feaaf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal" Jul 15 10:48:00.068711 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.938747 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd580c7f8d1332ff31c1ef6a4b2be26f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal\" (UID: \"bd580c7f8d1332ff31c1ef6a4b2be26f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" Jul 15 10:48:00.068711 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:47:59.984754 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.068711 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.985847 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal" Jul 15 10:48:00.068711 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:47:59.990924 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" Jul 15 10:48:00.247378 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:00.085560 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.247378 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:00.186118 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.247378 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.240734 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:48:00.353378 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:00.286852 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.554435 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.372457 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 10:48:00.554435 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.372570 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 10:48:00.554435 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.372570 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 10:48:00.554435 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:00.387715 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.554435 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.466500 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 10:43:00 +0000 UTC" deadline="2028-03-19 05:49:48.899849313 +0000 UTC" Jul 15 10:48:00.554435 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.466950 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14707h1m48.432901504s" Jul 15 10:48:00.554435 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:00.488147 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.776830 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:00.589244 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.776830 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.599090 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 10:48:00.776830 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.600140 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientMemory" Jul 15 10:48:00.776830 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.600175 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 10:48:00.776830 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.600192 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeHasSufficientPID" Jul 15 10:48:00.776830 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:00.651339 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd580c7f8d1332ff31c1ef6a4b2be26f.slice/crio-adb2570de9c4e5d7fef10aca87275bcbb1c25a9500dd2af04ff2bb5f78f9c0e9 WatchSource:0}: Error finding container adb2570de9c4e5d7fef10aca87275bcbb1c25a9500dd2af04ff2bb5f78f9c0e9: Status 404 returned error can't find the container with id adb2570de9c4e5d7fef10aca87275bcbb1c25a9500dd2af04ff2bb5f78f9c0e9 Jul 15 10:48:00.776830 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.661914 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 10:48:00.776830 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:00.665232 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c77009e9fb924b9ca7fe1c784feaaf.slice/crio-4c65c23d3a4fb915a7bb7c014a2ded03a97d5f1727d30f6cb6df44fb9de8f7b8 WatchSource:0}: Error finding container 4c65c23d3a4fb915a7bb7c014a2ded03a97d5f1727d30f6cb6df44fb9de8f7b8: Status 404 returned error can't find the container with id 4c65c23d3a4fb915a7bb7c014a2ded03a97d5f1727d30f6cb6df44fb9de8f7b8 Jul 15 10:48:00.776830 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:00.690186 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.976700 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:00.791450 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.976700 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:00.892619 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-232.ec2.internal\" not found" Jul 15 10:48:00.976700 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.895277 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:48:00.976700 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.935629 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal" Jul 15 10:48:00.976700 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.946886 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 10:48:00.976700 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.947823 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" Jul 15 10:48:00.976700 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:00.958838 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 10:48:01.195286 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.006331 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:48:01.334666 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.276127 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.411848 2553 apiserver.go:52] "Watching apiserver" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.419907 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.421264 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-n9zm5","kube-system/konnectivity-agent-h8wwv","kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6","openshift-dns/node-resolver-9glqk","openshift-multus/multus-v6k8q","openshift-multus/network-metrics-daemon-z4hz6","openshift-network-operator/iptables-alerter-dkgls","openshift-cluster-node-tuning-operator/tuned-pqqbt","openshift-image-registry/node-ca-8hbsr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal","openshift-multus/multus-additional-cni-plugins-zhrkq","openshift-network-diagnostics/network-check-target-dfkgs","openshift-ovn-kubernetes/ovnkube-node-z6m8d"] Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.424012 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.424100 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.426406 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.426487 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.428905 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.431540 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.435839 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.436773 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437031 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437190 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437296 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jzzx7\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437329 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437439 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437472 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437542 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437649 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vx2gp\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437662 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437765 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.437893 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.438014 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 10:48:01.440562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.438986 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.441707 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.440637 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8wpx2\"" Jul 15 10:48:01.441707 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.441076 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 10:48:01.441707 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.441577 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 10:48:01.441927 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.441808 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 10:48:01.442859 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.442038 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8sjjd\"" Jul 15 10:48:01.442859 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.442445 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 10:48:01.442859 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.442673 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 10:48:01.444226 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.443283 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 10:48:01.444226 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.443663 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 10:48:01.444226 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.443809 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s57fd\"" Jul 15 10:48:01.444226 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.444015 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 10:48:01.446778 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.444986 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:01.446778 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.445047 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:01.448091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.447852 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.450993 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8mmjn\"" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.451246 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.451489 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.452384 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.452599 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.453290 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.454768 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-cni-netd\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455249 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e72bb67f-c3f6-4428-8f95-f4550c74a728-env-overrides\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455522 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-sys-fs\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455554 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48db0132-07ec-45ae-a403-33dbef104301-cni-binary-copy\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455588 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-var-lib-cni-multus\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455624 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl8vj\" (UniqueName: \"kubernetes.io/projected/e72bb67f-c3f6-4428-8f95-f4550c74a728-kube-api-access-vl8vj\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455657 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-run-k8s-cni-cncf-io\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455688 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-run-multus-certs\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455717 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-socket-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455749 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-var-lib-cni-bin\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.535061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455780 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqjv\" (UniqueName: \"kubernetes.io/projected/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-kube-api-access-xgqjv\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455820 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-run-netns\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455850 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48db0132-07ec-45ae-a403-33dbef104301-multus-daemon-config\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455878 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-etc-kubernetes\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455918 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-tuned\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455955 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb78eef-9330-46a0-b932-5e69c17c5209-tmp-dir\") pod \"node-resolver-9glqk\" (UID: \"2bb78eef-9330-46a0-b932-5e69c17c5209\") " pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.455988 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bb78eef-9330-46a0-b932-5e69c17c5209-hosts-file\") pod \"node-resolver-9glqk\" (UID: \"2bb78eef-9330-46a0-b932-5e69c17c5209\") " pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456019 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-var-lib-openvswitch\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456052 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-kubernetes\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-systemd-units\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456110 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-run-systemd\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456144 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd6ls\" (UniqueName: \"kubernetes.io/projected/eacac30c-422c-49ce-a6a2-527ac638bb91-kube-api-access-sd6ls\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456177 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-run\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456207 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9080f2e2-9840-41ac-85ad-8301ae0be66f-tmp\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.536193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456233 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-run-ovn-kubernetes\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456266 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456299 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-var-lib-kubelet\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456334 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-multus-conf-dir\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456361 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-sysctl-conf\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456391 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-sys\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456443 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42gpw\" (UniqueName: \"kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw\") pod \"network-check-target-dfkgs\" (UID: \"fcd79b31-387f-42f5-b3d7-23d4d010bb01\") " pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456475 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-run-openvswitch\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456512 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e72bb67f-c3f6-4428-8f95-f4550c74a728-ovnkube-script-lib\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456538 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456571 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-sysconfig\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456605 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-device-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456637 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxrfz\" (UniqueName: \"kubernetes.io/projected/2bb78eef-9330-46a0-b932-5e69c17c5209-kube-api-access-nxrfz\") pod \"node-resolver-9glqk\" (UID: \"2bb78eef-9330-46a0-b932-5e69c17c5209\") " pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.537306 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456671 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-modprobe-d\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456702 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-sysctl-d\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456733 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e72bb67f-c3f6-4428-8f95-f4550c74a728-ovn-node-metrics-cert\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456761 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-lib-modules\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456797 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-log-socket\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456829 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-system-cni-dir\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456860 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-run-ovn\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456887 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-registration-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456918 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-systemd\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456949 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-etc-selinux\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.456981 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-cnibin\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458315 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-run-netns\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458411 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-os-release\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458437 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-etc-openvswitch\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.538209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458465 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-host\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458493 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmsz\" (UniqueName: \"kubernetes.io/projected/9080f2e2-9840-41ac-85ad-8301ae0be66f-kube-api-access-pkmsz\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458513 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e72bb67f-c3f6-4428-8f95-f4550c74a728-ovnkube-config\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458533 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-hostroot\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458553 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-kubelet\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458571 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-slash\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458589 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-multus-cni-dir\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458614 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-multus-socket-dir-parent\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458638 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-var-lib-kubelet\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458657 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458683 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-cni-bin\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458702 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h25sj\" (UniqueName: \"kubernetes.io/projected/48db0132-07ec-45ae-a403-33dbef104301-kube-api-access-h25sj\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.458726 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-node-log\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.459580 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.459598 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.459622 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.462221 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 10:48:01.539345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.462500 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k7777\"" Jul 15 10:48:01.540971 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.462670 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x82bq\"" Jul 15 10:48:01.540971 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.462993 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 10:48:01.540971 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.463237 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 10:48:01.540971 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.463276 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lbjp4\"" Jul 15 10:48:01.540971 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.463434 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 10:48:01.540971 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.463492 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 10:48:01.540971 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.463691 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 10:48:01.540971 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.475283 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rsrwk" Jul 15 10:48:01.540971 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.482155 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rsrwk" Jul 15 10:48:01.540971 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.537641 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563205 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-systemd\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563238 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-etc-selinux\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563262 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-cnibin\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563285 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-run-netns\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563312 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d4bd1d2-8706-4238-a438-5bbe25fb41ab-serviceca\") pod \"node-ca-8hbsr\" (UID: \"0d4bd1d2-8706-4238-a438-5bbe25fb41ab\") " pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563335 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cca9c267-e327-4934-912a-5e6183d3cd90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563363 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-systemd\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563373 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-os-release\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563409 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-etc-openvswitch\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563433 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-host\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563439 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-cnibin\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563452 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmsz\" (UniqueName: \"kubernetes.io/projected/9080f2e2-9840-41ac-85ad-8301ae0be66f-kube-api-access-pkmsz\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563473 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e72bb67f-c3f6-4428-8f95-f4550c74a728-ovnkube-config\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563493 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-hostroot\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.651647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563512 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-kubelet\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563533 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-slash\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563553 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-multus-cni-dir\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563577 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cca9c267-e327-4934-912a-5e6183d3cd90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563600 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-multus-socket-dir-parent\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563623 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-var-lib-kubelet\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563644 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563665 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-cni-bin\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563686 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h25sj\" (UniqueName: \"kubernetes.io/projected/48db0132-07ec-45ae-a403-33dbef104301-kube-api-access-h25sj\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563708 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563728 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-node-log\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563748 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-cni-netd\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563768 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e72bb67f-c3f6-4428-8f95-f4550c74a728-env-overrides\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563790 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-sys-fs\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.653925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563811 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48db0132-07ec-45ae-a403-33dbef104301-cni-binary-copy\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563831 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-var-lib-cni-multus\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563852 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97wq5\" (UniqueName: \"kubernetes.io/projected/0d4bd1d2-8706-4238-a438-5bbe25fb41ab-kube-api-access-97wq5\") pod \"node-ca-8hbsr\" (UID: \"0d4bd1d2-8706-4238-a438-5bbe25fb41ab\") " pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563856 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-etc-selinux\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563874 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-cnibin\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563895 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl8vj\" (UniqueName: \"kubernetes.io/projected/e72bb67f-c3f6-4428-8f95-f4550c74a728-kube-api-access-vl8vj\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563909 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-etc-openvswitch\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563916 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-run-k8s-cni-cncf-io\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563940 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-run-multus-certs\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563951 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-host\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563960 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-socket-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563982 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-var-lib-cni-bin\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564002 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/685c8f85-0e5d-468e-9211-242e068b1da2-iptables-alerter-script\") pod \"iptables-alerter-dkgls\" (UID: \"685c8f85-0e5d-468e-9211-242e068b1da2\") " pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564023 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/685c8f85-0e5d-468e-9211-242e068b1da2-host-slash\") pod \"iptables-alerter-dkgls\" (UID: \"685c8f85-0e5d-468e-9211-242e068b1da2\") " pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.654827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564026 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-run-netns\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564271 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-hostroot\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564309 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-node-log\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564336 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-kubelet\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564360 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-cni-netd\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564431 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-slash\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564708 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-multus-cni-dir\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564717 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e72bb67f-c3f6-4428-8f95-f4550c74a728-env-overrides\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564779 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-var-lib-cni-multus\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.564877 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-socket-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.565097 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-run-k8s-cni-cncf-io\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.565138 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-run-multus-certs\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.565159 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48db0132-07ec-45ae-a403-33dbef104301-cni-binary-copy\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.565205 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-multus-socket-dir-parent\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.565221 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.565247 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-var-lib-kubelet\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.656391 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.565285 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-cni-bin\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.563769 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-os-release\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.565344 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-var-lib-cni-bin\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.565399 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-sys-fs\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567489 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-system-cni-dir\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.567497 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs podName:e9700e2f-eb72-46e7-ba4d-667b3c5942fc nodeName:}" failed. No retries permitted until 2026-07-15 10:48:02.065266145 +0000 UTC m=+3.032583926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs") pod "network-metrics-daemon-z4hz6" (UID: "e9700e2f-eb72-46e7-ba4d-667b3c5942fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567544 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqjv\" (UniqueName: \"kubernetes.io/projected/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-kube-api-access-xgqjv\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567575 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-run-netns\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567600 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48db0132-07ec-45ae-a403-33dbef104301-multus-daemon-config\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567621 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-run-netns\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567625 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-etc-kubernetes\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567658 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-etc-kubernetes\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567661 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4937210a-24fb-45a5-b3b4-dd096d5eec3d-kubelet-config\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567693 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-tuned\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.657552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567822 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb78eef-9330-46a0-b932-5e69c17c5209-tmp-dir\") pod \"node-resolver-9glqk\" (UID: \"2bb78eef-9330-46a0-b932-5e69c17c5209\") " pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.567851 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bb78eef-9330-46a0-b932-5e69c17c5209-hosts-file\") pod \"node-resolver-9glqk\" (UID: \"2bb78eef-9330-46a0-b932-5e69c17c5209\") " pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568048 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2bb78eef-9330-46a0-b932-5e69c17c5209-hosts-file\") pod \"node-resolver-9glqk\" (UID: \"2bb78eef-9330-46a0-b932-5e69c17c5209\") " pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568090 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-var-lib-openvswitch\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568119 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-kubernetes\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568122 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb78eef-9330-46a0-b932-5e69c17c5209-tmp-dir\") pod \"node-resolver-9glqk\" (UID: \"2bb78eef-9330-46a0-b932-5e69c17c5209\") " pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568154 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48db0132-07ec-45ae-a403-33dbef104301-multus-daemon-config\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568177 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-var-lib-openvswitch\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568257 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-kubernetes\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568328 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-systemd-units\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568381 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-run-systemd\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568412 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd6ls\" (UniqueName: \"kubernetes.io/projected/eacac30c-422c-49ce-a6a2-527ac638bb91-kube-api-access-sd6ls\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568458 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6633f6d2-7af7-4b3f-9dad-f46935acdf23-konnectivity-ca\") pod \"konnectivity-agent-h8wwv\" (UID: \"6633f6d2-7af7-4b3f-9dad-f46935acdf23\") " pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568485 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d4bd1d2-8706-4238-a438-5bbe25fb41ab-host\") pod \"node-ca-8hbsr\" (UID: \"0d4bd1d2-8706-4238-a438-5bbe25fb41ab\") " pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568507 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-run\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.659311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568526 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9080f2e2-9840-41ac-85ad-8301ae0be66f-tmp\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568547 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-run-ovn-kubernetes\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568552 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-run-systemd\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568570 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568594 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-var-lib-kubelet\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568611 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-systemd-units\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568650 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-run-ovn-kubernetes\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568654 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-multus-conf-dir\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568682 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6633f6d2-7af7-4b3f-9dad-f46935acdf23-agent-certs\") pod \"konnectivity-agent-h8wwv\" (UID: \"6633f6d2-7af7-4b3f-9dad-f46935acdf23\") " pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568724 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-host-var-lib-kubelet\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568768 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-run\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568863 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-multus-conf-dir\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568683 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568907 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-sysctl-conf\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.660213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568943 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-sys\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568985 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gpw\" (UniqueName: \"kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw\") pod \"network-check-target-dfkgs\" (UID: \"fcd79b31-387f-42f5-b3d7-23d4d010bb01\") " pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569011 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-run-openvswitch\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569023 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-sysctl-conf\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569054 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e72bb67f-c3f6-4428-8f95-f4550c74a728-ovnkube-script-lib\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569066 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-run-openvswitch\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569111 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-sys\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569148 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4937210a-24fb-45a5-b3b4-dd096d5eec3d-dbus\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569579 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e72bb67f-c3f6-4428-8f95-f4550c74a728-ovnkube-script-lib\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569610 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-sysconfig\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569635 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-device-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569682 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxrfz\" (UniqueName: \"kubernetes.io/projected/2bb78eef-9330-46a0-b932-5e69c17c5209-kube-api-access-nxrfz\") pod \"node-resolver-9glqk\" (UID: \"2bb78eef-9330-46a0-b932-5e69c17c5209\") " pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569708 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzlxf\" (UniqueName: \"kubernetes.io/projected/cca9c267-e327-4934-912a-5e6183d3cd90-kube-api-access-nzlxf\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.661346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569730 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-modprobe-d\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569771 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-sysctl-d\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569793 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e72bb67f-c3f6-4428-8f95-f4550c74a728-ovn-node-metrics-cert\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569816 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsgbx\" (UniqueName: \"kubernetes.io/projected/685c8f85-0e5d-468e-9211-242e068b1da2-kube-api-access-nsgbx\") pod \"iptables-alerter-dkgls\" (UID: \"685c8f85-0e5d-468e-9211-242e068b1da2\") " pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569839 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569860 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-lib-modules\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569882 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-log-socket\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569903 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-system-cni-dir\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569973 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cca9c267-e327-4934-912a-5e6183d3cd90-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.569999 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-run-ovn\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.570021 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-registration-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.570056 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-os-release\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.570132 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48db0132-07ec-45ae-a403-33dbef104301-system-cni-dir\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.570235 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-modprobe-d\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.661973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.570270 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-device-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.570302 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.570335 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-sysconfig\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.570653 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-sysctl-d\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.568465 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.571657 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e72bb67f-c3f6-4428-8f95-f4550c74a728-ovnkube-config\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.571824 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-log-socket\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.571976 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9080f2e2-9840-41ac-85ad-8301ae0be66f-lib-modules\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.572426 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e72bb67f-c3f6-4428-8f95-f4550c74a728-run-ovn\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.572524 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eacac30c-422c-49ce-a6a2-527ac638bb91-registration-dir\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.576753 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e72bb67f-c3f6-4428-8f95-f4550c74a728-ovn-node-metrics-cert\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.577001 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl8vj\" (UniqueName: \"kubernetes.io/projected/e72bb67f-c3f6-4428-8f95-f4550c74a728-kube-api-access-vl8vj\") pod \"ovnkube-node-z6m8d\" (UID: \"e72bb67f-c3f6-4428-8f95-f4550c74a728\") " pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.577879 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal" event={"ID":"f0c77009e9fb924b9ca7fe1c784feaaf","Type":"ContainerStarted","Data":"4c65c23d3a4fb915a7bb7c014a2ded03a97d5f1727d30f6cb6df44fb9de8f7b8"} Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.578245 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9080f2e2-9840-41ac-85ad-8301ae0be66f-etc-tuned\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.578544 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9080f2e2-9840-41ac-85ad-8301ae0be66f-tmp\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.663091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.578964 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" event={"ID":"bd580c7f8d1332ff31c1ef6a4b2be26f","Type":"ContainerStarted","Data":"adb2570de9c4e5d7fef10aca87275bcbb1c25a9500dd2af04ff2bb5f78f9c0e9"} Jul 15 10:48:01.664902 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.579088 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmsz\" (UniqueName: \"kubernetes.io/projected/9080f2e2-9840-41ac-85ad-8301ae0be66f-kube-api-access-pkmsz\") pod \"tuned-pqqbt\" (UID: \"9080f2e2-9840-41ac-85ad-8301ae0be66f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.664902 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.581648 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxrfz\" (UniqueName: \"kubernetes.io/projected/2bb78eef-9330-46a0-b932-5e69c17c5209-kube-api-access-nxrfz\") pod \"node-resolver-9glqk\" (UID: \"2bb78eef-9330-46a0-b932-5e69c17c5209\") " pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.664902 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.581783 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:48:01.664902 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.581806 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:48:01.664902 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.581879 2553 projected.go:196] Error preparing data for projected volume kube-api-access-42gpw for pod openshift-network-diagnostics/network-check-target-dfkgs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:01.664902 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.581936 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw podName:fcd79b31-387f-42f5-b3d7-23d4d010bb01 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:02.081918115 +0000 UTC m=+3.049235910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-42gpw" (UniqueName: "kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw") pod "network-check-target-dfkgs" (UID: "fcd79b31-387f-42f5-b3d7-23d4d010bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:01.664902 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.582220 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h25sj\" (UniqueName: \"kubernetes.io/projected/48db0132-07ec-45ae-a403-33dbef104301-kube-api-access-h25sj\") pod \"multus-v6k8q\" (UID: \"48db0132-07ec-45ae-a403-33dbef104301\") " pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.664902 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.582722 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd6ls\" (UniqueName: \"kubernetes.io/projected/eacac30c-422c-49ce-a6a2-527ac638bb91-kube-api-access-sd6ls\") pod \"aws-ebs-csi-driver-node-k6fz6\" (UID: \"eacac30c-422c-49ce-a6a2-527ac638bb91\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.664902 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.583771 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqjv\" (UniqueName: \"kubernetes.io/projected/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-kube-api-access-xgqjv\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671393 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cca9c267-e327-4934-912a-5e6183d3cd90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671439 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671467 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97wq5\" (UniqueName: \"kubernetes.io/projected/0d4bd1d2-8706-4238-a438-5bbe25fb41ab-kube-api-access-97wq5\") pod \"node-ca-8hbsr\" (UID: \"0d4bd1d2-8706-4238-a438-5bbe25fb41ab\") " pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671510 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-cnibin\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671572 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/685c8f85-0e5d-468e-9211-242e068b1da2-iptables-alerter-script\") pod \"iptables-alerter-dkgls\" (UID: \"685c8f85-0e5d-468e-9211-242e068b1da2\") " pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671598 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/685c8f85-0e5d-468e-9211-242e068b1da2-host-slash\") pod \"iptables-alerter-dkgls\" (UID: \"685c8f85-0e5d-468e-9211-242e068b1da2\") " pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671624 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-system-cni-dir\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671649 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4937210a-24fb-45a5-b3b4-dd096d5eec3d-kubelet-config\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671669 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6633f6d2-7af7-4b3f-9dad-f46935acdf23-konnectivity-ca\") pod \"konnectivity-agent-h8wwv\" (UID: \"6633f6d2-7af7-4b3f-9dad-f46935acdf23\") " pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671684 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d4bd1d2-8706-4238-a438-5bbe25fb41ab-host\") pod \"node-ca-8hbsr\" (UID: \"0d4bd1d2-8706-4238-a438-5bbe25fb41ab\") " pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671711 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6633f6d2-7af7-4b3f-9dad-f46935acdf23-agent-certs\") pod \"konnectivity-agent-h8wwv\" (UID: \"6633f6d2-7af7-4b3f-9dad-f46935acdf23\") " pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671739 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4937210a-24fb-45a5-b3b4-dd096d5eec3d-dbus\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.671745 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:01.756275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671757 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzlxf\" (UniqueName: \"kubernetes.io/projected/cca9c267-e327-4934-912a-5e6183d3cd90-kube-api-access-nzlxf\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671778 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsgbx\" (UniqueName: \"kubernetes.io/projected/685c8f85-0e5d-468e-9211-242e068b1da2-kube-api-access-nsgbx\") pod \"iptables-alerter-dkgls\" (UID: \"685c8f85-0e5d-468e-9211-242e068b1da2\") " pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:01.671798 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret podName:4937210a-24fb-45a5-b3b4-dd096d5eec3d nodeName:}" failed. No retries permitted until 2026-07-15 10:48:02.171780702 +0000 UTC m=+3.139098483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret") pod "global-pull-secret-syncer-n9zm5" (UID: "4937210a-24fb-45a5-b3b4-dd096d5eec3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671829 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671863 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cca9c267-e327-4934-912a-5e6183d3cd90-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671893 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-os-release\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671918 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d4bd1d2-8706-4238-a438-5bbe25fb41ab-serviceca\") pod \"node-ca-8hbsr\" (UID: \"0d4bd1d2-8706-4238-a438-5bbe25fb41ab\") " pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671940 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cca9c267-e327-4934-912a-5e6183d3cd90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.671977 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-cnibin\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672049 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4937210a-24fb-45a5-b3b4-dd096d5eec3d-kubelet-config\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672120 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cca9c267-e327-4934-912a-5e6183d3cd90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672343 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672508 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6633f6d2-7af7-4b3f-9dad-f46935acdf23-konnectivity-ca\") pod \"konnectivity-agent-h8wwv\" (UID: \"6633f6d2-7af7-4b3f-9dad-f46935acdf23\") " pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:01.758358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672511 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-os-release\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672547 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/685c8f85-0e5d-468e-9211-242e068b1da2-host-slash\") pod \"iptables-alerter-dkgls\" (UID: \"685c8f85-0e5d-468e-9211-242e068b1da2\") " pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672590 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca9c267-e327-4934-912a-5e6183d3cd90-system-cni-dir\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672824 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cca9c267-e327-4934-912a-5e6183d3cd90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672902 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4937210a-24fb-45a5-b3b4-dd096d5eec3d-dbus\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672958 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/685c8f85-0e5d-468e-9211-242e068b1da2-iptables-alerter-script\") pod \"iptables-alerter-dkgls\" (UID: \"685c8f85-0e5d-468e-9211-242e068b1da2\") " pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672969 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cca9c267-e327-4934-912a-5e6183d3cd90-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.672993 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d4bd1d2-8706-4238-a438-5bbe25fb41ab-serviceca\") pod \"node-ca-8hbsr\" (UID: \"0d4bd1d2-8706-4238-a438-5bbe25fb41ab\") " pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.673002 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d4bd1d2-8706-4238-a438-5bbe25fb41ab-host\") pod \"node-ca-8hbsr\" (UID: \"0d4bd1d2-8706-4238-a438-5bbe25fb41ab\") " pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.675314 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6633f6d2-7af7-4b3f-9dad-f46935acdf23-agent-certs\") pod \"konnectivity-agent-h8wwv\" (UID: \"6633f6d2-7af7-4b3f-9dad-f46935acdf23\") " pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.683308 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97wq5\" (UniqueName: \"kubernetes.io/projected/0d4bd1d2-8706-4238-a438-5bbe25fb41ab-kube-api-access-97wq5\") pod \"node-ca-8hbsr\" (UID: \"0d4bd1d2-8706-4238-a438-5bbe25fb41ab\") " pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.684515 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzlxf\" (UniqueName: \"kubernetes.io/projected/cca9c267-e327-4934-912a-5e6183d3cd90-kube-api-access-nzlxf\") pod \"multus-additional-cni-plugins-zhrkq\" (UID: \"cca9c267-e327-4934-912a-5e6183d3cd90\") " pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.684868 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsgbx\" (UniqueName: \"kubernetes.io/projected/685c8f85-0e5d-468e-9211-242e068b1da2-kube-api-access-nsgbx\") pod \"iptables-alerter-dkgls\" (UID: \"685c8f85-0e5d-468e-9211-242e068b1da2\") " pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.759301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.758280 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:01.772136 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.769728 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:01.775748 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode72bb67f_c3f6_4428_8f95_f4550c74a728.slice/crio-ab79c0c3506b5145cc16c0c7fef4f4d3e7e38b2b4533054f309f466f309ed709 WatchSource:0}: Error finding container ab79c0c3506b5145cc16c0c7fef4f4d3e7e38b2b4533054f309f466f309ed709: Status 404 returned error can't find the container with id ab79c0c3506b5145cc16c0c7fef4f4d3e7e38b2b4533054f309f466f309ed709 Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.779223 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9glqk" Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:01.783232 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeacac30c_422c_49ce_a6a2_527ac638bb91.slice/crio-cfe0094a50c9797324ebe233d24ad974dd33dd32b9aff1a50c6175fb4fed1127 WatchSource:0}: Error finding container cfe0094a50c9797324ebe233d24ad974dd33dd32b9aff1a50c6175fb4fed1127: Status 404 returned error can't find the container with id cfe0094a50c9797324ebe233d24ad974dd33dd32b9aff1a50c6175fb4fed1127 Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.788130 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v6k8q" Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:01.789939 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb78eef_9330_46a0_b932_5e69c17c5209.slice/crio-c627382a5bc123c6385a839728af8737ef8eee8ef6e9adae59dba2016ff8a0c3 WatchSource:0}: Error finding container c627382a5bc123c6385a839728af8737ef8eee8ef6e9adae59dba2016ff8a0c3: Status 404 returned error can't find the container with id c627382a5bc123c6385a839728af8737ef8eee8ef6e9adae59dba2016ff8a0c3 Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.796155 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:01.800899 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48db0132_07ec_45ae_a403_33dbef104301.slice/crio-789d406dff0a1de6d40b2026552d0e3b5defec352a34334e93aedc3166f9ace7 WatchSource:0}: Error finding container 789d406dff0a1de6d40b2026552d0e3b5defec352a34334e93aedc3166f9ace7: Status 404 returned error can't find the container with id 789d406dff0a1de6d40b2026552d0e3b5defec352a34334e93aedc3166f9ace7 Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.805219 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:01.807230 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9080f2e2_9840_41ac_85ad_8301ae0be66f.slice/crio-fc1f30d4c1ac279f969f4459ec967f6130bd569472b237eafd2f48afe317b37b WatchSource:0}: Error finding container fc1f30d4c1ac279f969f4459ec967f6130bd569472b237eafd2f48afe317b37b: Status 404 returned error can't find the container with id fc1f30d4c1ac279f969f4459ec967f6130bd569472b237eafd2f48afe317b37b Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.814819 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8hbsr" Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:01.816000 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6633f6d2_7af7_4b3f_9dad_f46935acdf23.slice/crio-297f4ee80d0590d19a41b1c48feb7b05352cfd11869abe2133b0ebe7498b28e5 WatchSource:0}: Error finding container 297f4ee80d0590d19a41b1c48feb7b05352cfd11869abe2133b0ebe7498b28e5: Status 404 returned error can't find the container with id 297f4ee80d0590d19a41b1c48feb7b05352cfd11869abe2133b0ebe7498b28e5 Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.824675 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dkgls" Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:01.824844 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4bd1d2_8706_4238_a438_5bbe25fb41ab.slice/crio-83eb8a5d2a144b93897bd4d9cf4128cf3c7373963e99cd098690cd4549b56c84 WatchSource:0}: Error finding container 83eb8a5d2a144b93897bd4d9cf4128cf3c7373963e99cd098690cd4549b56c84: Status 404 returned error can't find the container with id 83eb8a5d2a144b93897bd4d9cf4128cf3c7373963e99cd098690cd4549b56c84 Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:01.837041 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" Jul 15 10:48:01.919175 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:01.839956 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685c8f85_0e5d_468e_9211_242e068b1da2.slice/crio-94745885553c3560be985de6e22fafa51035973574716c2276604950bf9622db WatchSource:0}: Error finding container 94745885553c3560be985de6e22fafa51035973574716c2276604950bf9622db: Status 404 returned error can't find the container with id 94745885553c3560be985de6e22fafa51035973574716c2276604950bf9622db Jul 15 10:48:02.124910 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.075123 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:02.124910 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:02.075270 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:02.124910 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:02.075334 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs podName:e9700e2f-eb72-46e7-ba4d-667b3c5942fc nodeName:}" failed. No retries permitted until 2026-07-15 10:48:03.075317961 +0000 UTC m=+4.042635745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs") pod "network-metrics-daemon-z4hz6" (UID: "e9700e2f-eb72-46e7-ba4d-667b3c5942fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:02.176218 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.176147 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:02.176218 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.176204 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gpw\" (UniqueName: \"kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw\") pod \"network-check-target-dfkgs\" (UID: \"fcd79b31-387f-42f5-b3d7-23d4d010bb01\") " pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:02.176423 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:02.176266 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:02.176423 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:02.176336 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:48:02.176423 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:02.176356 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret podName:4937210a-24fb-45a5-b3b4-dd096d5eec3d nodeName:}" failed. No retries permitted until 2026-07-15 10:48:03.176318313 +0000 UTC m=+4.143636096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret") pod "global-pull-secret-syncer-n9zm5" (UID: "4937210a-24fb-45a5-b3b4-dd096d5eec3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:02.176423 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:02.176370 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:48:02.176423 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:02.176385 2553 projected.go:196] Error preparing data for projected volume kube-api-access-42gpw for pod openshift-network-diagnostics/network-check-target-dfkgs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:02.176715 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:02.176436 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw podName:fcd79b31-387f-42f5-b3d7-23d4d010bb01 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:03.176420734 +0000 UTC m=+4.143738518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-42gpw" (UniqueName: "kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw") pod "network-check-target-dfkgs" (UID: "fcd79b31-387f-42f5-b3d7-23d4d010bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:02.241557 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.241533 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 10:48:02.485558 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.485466 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 10:43:02 +0000 UTC" deadline="2027-12-10 03:25:01.831759128 +0000 UTC" Jul 15 10:48:02.485558 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.485506 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12304h36m59.346258295s" Jul 15 10:48:02.559006 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.558976 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:02.559167 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:02.559102 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:02.581430 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.581397 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9glqk" event={"ID":"2bb78eef-9330-46a0-b932-5e69c17c5209","Type":"ContainerStarted","Data":"c627382a5bc123c6385a839728af8737ef8eee8ef6e9adae59dba2016ff8a0c3"} Jul 15 10:48:02.582735 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.582710 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" event={"ID":"e72bb67f-c3f6-4428-8f95-f4550c74a728","Type":"ContainerStarted","Data":"ab79c0c3506b5145cc16c0c7fef4f4d3e7e38b2b4533054f309f466f309ed709"} Jul 15 10:48:02.583964 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.583934 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dkgls" event={"ID":"685c8f85-0e5d-468e-9211-242e068b1da2","Type":"ContainerStarted","Data":"94745885553c3560be985de6e22fafa51035973574716c2276604950bf9622db"} Jul 15 10:48:02.585068 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.585045 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8hbsr" event={"ID":"0d4bd1d2-8706-4238-a438-5bbe25fb41ab","Type":"ContainerStarted","Data":"83eb8a5d2a144b93897bd4d9cf4128cf3c7373963e99cd098690cd4549b56c84"} Jul 15 10:48:02.586185 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.586165 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v6k8q" event={"ID":"48db0132-07ec-45ae-a403-33dbef104301","Type":"ContainerStarted","Data":"789d406dff0a1de6d40b2026552d0e3b5defec352a34334e93aedc3166f9ace7"} Jul 15 10:48:02.587269 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.587248 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" event={"ID":"eacac30c-422c-49ce-a6a2-527ac638bb91","Type":"ContainerStarted","Data":"cfe0094a50c9797324ebe233d24ad974dd33dd32b9aff1a50c6175fb4fed1127"} Jul 15 10:48:02.588305 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.588285 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h8wwv" event={"ID":"6633f6d2-7af7-4b3f-9dad-f46935acdf23","Type":"ContainerStarted","Data":"297f4ee80d0590d19a41b1c48feb7b05352cfd11869abe2133b0ebe7498b28e5"} Jul 15 10:48:02.589388 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:02.589363 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" event={"ID":"9080f2e2-9840-41ac-85ad-8301ae0be66f","Type":"ContainerStarted","Data":"fc1f30d4c1ac279f969f4459ec967f6130bd569472b237eafd2f48afe317b37b"} Jul 15 10:48:03.084227 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:03.084184 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:03.084937 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:03.084345 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:03.084937 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:03.084434 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs podName:e9700e2f-eb72-46e7-ba4d-667b3c5942fc nodeName:}" failed. No retries permitted until 2026-07-15 10:48:05.08441435 +0000 UTC m=+6.051732132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs") pod "network-metrics-daemon-z4hz6" (UID: "e9700e2f-eb72-46e7-ba4d-667b3c5942fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:03.185694 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:03.185284 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:03.185694 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:03.185378 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gpw\" (UniqueName: \"kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw\") pod \"network-check-target-dfkgs\" (UID: \"fcd79b31-387f-42f5-b3d7-23d4d010bb01\") " pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:03.185694 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:03.185512 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:03.185694 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:03.185567 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:48:03.185694 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:03.185579 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret podName:4937210a-24fb-45a5-b3b4-dd096d5eec3d nodeName:}" failed. No retries permitted until 2026-07-15 10:48:05.18555803 +0000 UTC m=+6.152875824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret") pod "global-pull-secret-syncer-n9zm5" (UID: "4937210a-24fb-45a5-b3b4-dd096d5eec3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:03.185694 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:03.185588 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:48:03.185694 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:03.185602 2553 projected.go:196] Error preparing data for projected volume kube-api-access-42gpw for pod openshift-network-diagnostics/network-check-target-dfkgs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:03.185694 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:03.185640 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw podName:fcd79b31-387f-42f5-b3d7-23d4d010bb01 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:05.185628836 +0000 UTC m=+6.152946618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-42gpw" (UniqueName: "kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw") pod "network-check-target-dfkgs" (UID: "fcd79b31-387f-42f5-b3d7-23d4d010bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:03.485782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:03.485676 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 10:43:02 +0000 UTC" deadline="2028-03-30 00:42:57.925841388 +0000 UTC" Jul 15 10:48:03.485782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:03.485736 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14965h54m54.440109925s" Jul 15 10:48:03.561214 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:03.560712 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:03.561214 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:03.560851 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:03.561671 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:03.561541 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:03.561671 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:03.561649 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:03.594828 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:03.594796 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" event={"ID":"cca9c267-e327-4934-912a-5e6183d3cd90","Type":"ContainerStarted","Data":"2f46416b5f82a522c25ead7ac81c50b2a2e90852cc70c0513b33babeb949fa2f"} Jul 15 10:48:03.597539 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:03.597510 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal" event={"ID":"f0c77009e9fb924b9ca7fe1c784feaaf","Type":"ContainerStarted","Data":"4879ab63baa26eea62a8160366c828fbdebacb36f2bb530aee79f1c7f6e18166"} Jul 15 10:48:04.559167 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:04.559121 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:04.559768 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:04.559254 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:04.619582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:04.618333 2553 generic.go:356] "Generic (PLEG): container finished" podID="bd580c7f8d1332ff31c1ef6a4b2be26f" containerID="d01a14259eb011d54a1d426d2d8ec0613ccc9a61f1a5d8a4a4a4b17f250be425" exitCode=0 Jul 15 10:48:04.619582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:04.619332 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" event={"ID":"bd580c7f8d1332ff31c1ef6a4b2be26f","Type":"ContainerDied","Data":"d01a14259eb011d54a1d426d2d8ec0613ccc9a61f1a5d8a4a4a4b17f250be425"} Jul 15 10:48:04.637081 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:04.636627 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-232.ec2.internal" podStartSLOduration=3.636605717 podStartE2EDuration="3.636605717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:03.614860726 +0000 UTC m=+4.582178532" watchObservedRunningTime="2026-07-15 10:48:04.636605717 +0000 UTC m=+5.603923522" Jul 15 10:48:05.100810 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:05.100774 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:05.101019 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:05.100935 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:05.101019 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:05.101001 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs podName:e9700e2f-eb72-46e7-ba4d-667b3c5942fc nodeName:}" failed. No retries permitted until 2026-07-15 10:48:09.100980484 +0000 UTC m=+10.068298270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs") pod "network-metrics-daemon-z4hz6" (UID: "e9700e2f-eb72-46e7-ba4d-667b3c5942fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:05.202077 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:05.202040 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gpw\" (UniqueName: \"kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw\") pod \"network-check-target-dfkgs\" (UID: \"fcd79b31-387f-42f5-b3d7-23d4d010bb01\") " pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:05.202243 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:05.202131 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:05.202302 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:05.202280 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:05.202386 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:05.202346 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret podName:4937210a-24fb-45a5-b3b4-dd096d5eec3d nodeName:}" failed. No retries permitted until 2026-07-15 10:48:09.202326622 +0000 UTC m=+10.169644405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret") pod "global-pull-secret-syncer-n9zm5" (UID: "4937210a-24fb-45a5-b3b4-dd096d5eec3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:05.202488 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:05.202396 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:48:05.202488 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:05.202423 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:48:05.202488 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:05.202440 2553 projected.go:196] Error preparing data for projected volume kube-api-access-42gpw for pod openshift-network-diagnostics/network-check-target-dfkgs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:05.202651 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:05.202492 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw podName:fcd79b31-387f-42f5-b3d7-23d4d010bb01 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:09.202475586 +0000 UTC m=+10.169793372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-42gpw" (UniqueName: "kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw") pod "network-check-target-dfkgs" (UID: "fcd79b31-387f-42f5-b3d7-23d4d010bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:05.562045 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:05.561951 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:05.562541 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:05.562158 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:05.562671 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:05.562652 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:05.562771 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:05.562751 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:06.559313 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:06.559280 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:06.559491 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:06.559466 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:07.559940 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:07.559500 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:07.559940 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:07.559621 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:07.559940 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:07.559708 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:07.559940 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:07.559826 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:08.559198 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:08.559170 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:08.559360 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:08.559303 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:09.132270 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:09.132220 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:09.132741 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:09.132396 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:09.132741 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:09.132477 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs podName:e9700e2f-eb72-46e7-ba4d-667b3c5942fc nodeName:}" failed. No retries permitted until 2026-07-15 10:48:17.13245368 +0000 UTC m=+18.099771472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs") pod "network-metrics-daemon-z4hz6" (UID: "e9700e2f-eb72-46e7-ba4d-667b3c5942fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:09.234008 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:09.233574 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:09.234008 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:09.233632 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gpw\" (UniqueName: \"kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw\") pod \"network-check-target-dfkgs\" (UID: \"fcd79b31-387f-42f5-b3d7-23d4d010bb01\") " pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:09.234008 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:09.233738 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:09.234008 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:09.233751 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:48:09.234008 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:09.233767 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:48:09.234008 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:09.233779 2553 projected.go:196] Error preparing data for projected volume kube-api-access-42gpw for pod openshift-network-diagnostics/network-check-target-dfkgs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:09.234008 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:09.233802 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret podName:4937210a-24fb-45a5-b3b4-dd096d5eec3d nodeName:}" failed. No retries permitted until 2026-07-15 10:48:17.23378519 +0000 UTC m=+18.201102975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret") pod "global-pull-secret-syncer-n9zm5" (UID: "4937210a-24fb-45a5-b3b4-dd096d5eec3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:09.234008 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:09.233817 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw podName:fcd79b31-387f-42f5-b3d7-23d4d010bb01 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:17.233809552 +0000 UTC m=+18.201127332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-42gpw" (UniqueName: "kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw") pod "network-check-target-dfkgs" (UID: "fcd79b31-387f-42f5-b3d7-23d4d010bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:09.565031 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:09.564534 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:09.565031 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:09.564638 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:09.565470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:09.565298 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:09.565470 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:09.565432 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:10.559805 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:10.559538 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:10.559805 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:10.559671 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:11.559914 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:11.559528 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:11.559914 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:11.559643 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:11.559914 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:11.559528 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:11.559914 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:11.559789 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:12.559315 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:12.559282 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:12.559473 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:12.559432 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:13.559233 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:13.559196 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:13.559618 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:13.559321 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:13.559618 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:13.559351 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:13.559618 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:13.559434 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:14.559154 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:14.559120 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:14.559315 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:14.559236 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:15.559584 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:15.559550 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:15.559584 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:15.559595 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:15.560078 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:15.559689 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:15.560078 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:15.559815 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:16.559339 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:16.559297 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:16.559556 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:16.559424 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:17.196317 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:17.196287 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:17.196783 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:17.196425 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:17.196783 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:17.196482 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs podName:e9700e2f-eb72-46e7-ba4d-667b3c5942fc nodeName:}" failed. No retries permitted until 2026-07-15 10:48:33.196462699 +0000 UTC m=+34.163780496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs") pod "network-metrics-daemon-z4hz6" (UID: "e9700e2f-eb72-46e7-ba4d-667b3c5942fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:17.297198 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:17.297174 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:17.297310 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:17.297229 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gpw\" (UniqueName: \"kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw\") pod \"network-check-target-dfkgs\" (UID: \"fcd79b31-387f-42f5-b3d7-23d4d010bb01\") " pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:17.297394 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:17.297325 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:17.297394 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:17.297350 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:48:17.297394 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:17.297370 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:48:17.297394 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:17.297385 2553 projected.go:196] Error preparing data for projected volume kube-api-access-42gpw for pod openshift-network-diagnostics/network-check-target-dfkgs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:17.297609 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:17.297408 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret podName:4937210a-24fb-45a5-b3b4-dd096d5eec3d nodeName:}" failed. No retries permitted until 2026-07-15 10:48:33.29738857 +0000 UTC m=+34.264706350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret") pod "global-pull-secret-syncer-n9zm5" (UID: "4937210a-24fb-45a5-b3b4-dd096d5eec3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:17.297609 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:17.297432 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw podName:fcd79b31-387f-42f5-b3d7-23d4d010bb01 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:33.297416347 +0000 UTC m=+34.264734149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-42gpw" (UniqueName: "kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw") pod "network-check-target-dfkgs" (UID: "fcd79b31-387f-42f5-b3d7-23d4d010bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:17.558697 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:17.558625 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:17.558849 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:17.558759 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:17.558849 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:17.558792 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:17.558958 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:17.558889 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:18.558964 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:18.558924 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:18.559377 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:18.559062 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:19.560204 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:19.560171 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:19.560647 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:19.560265 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:19.560647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:19.560371 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:19.560647 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:19.560468 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:20.558775 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:20.558748 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:20.558950 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:20.558867 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:21.559339 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:21.559296 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:21.559687 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:21.559448 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:21.559687 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:21.559484 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:21.559687 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:21.559555 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:22.558670 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.558517 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:22.558811 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:22.558762 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:22.651512 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.651439 2553 generic.go:356] "Generic (PLEG): container finished" podID="cca9c267-e327-4934-912a-5e6183d3cd90" containerID="013b48dec0a1871a79142ebdf442a37f200dcd930bfca684a68d3281e4272b3f" exitCode=0 Jul 15 10:48:22.651512 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.651489 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" event={"ID":"cca9c267-e327-4934-912a-5e6183d3cd90","Type":"ContainerDied","Data":"013b48dec0a1871a79142ebdf442a37f200dcd930bfca684a68d3281e4272b3f"} Jul 15 10:48:22.654288 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.654181 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" event={"ID":"bd580c7f8d1332ff31c1ef6a4b2be26f","Type":"ContainerStarted","Data":"367a93c7b380df15a30262b585ed56a9ad6f23a922b72736a6d77f3bda625a68"} Jul 15 10:48:22.655813 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.655787 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8hbsr" event={"ID":"0d4bd1d2-8706-4238-a438-5bbe25fb41ab","Type":"ContainerStarted","Data":"26fbfadd6e44f0e82fd1a79cf60c2537e61084644ac6dc25f0b59b1f1a8c5721"} Jul 15 10:48:22.660501 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.660480 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v6k8q" event={"ID":"48db0132-07ec-45ae-a403-33dbef104301","Type":"ContainerStarted","Data":"3978fb51900bcfadd25d93a708faab09954e21ad6e9ee72660f093864764016a"} Jul 15 10:48:22.662123 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.662066 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" event={"ID":"eacac30c-422c-49ce-a6a2-527ac638bb91","Type":"ContainerStarted","Data":"5c3dfd8d2be70642c7861b64233a4c6ed04c9ddaf4646de6c66a4782978ac069"} Jul 15 10:48:22.663740 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.663715 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h8wwv" event={"ID":"6633f6d2-7af7-4b3f-9dad-f46935acdf23","Type":"ContainerStarted","Data":"00e0a89e3d6c354bf1e73cab60f536c196107cfa27e6513e7850e2853ee89860"} Jul 15 10:48:22.665289 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.665267 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" event={"ID":"9080f2e2-9840-41ac-85ad-8301ae0be66f","Type":"ContainerStarted","Data":"601798caa8f1530515333833ec21b058fd746aa2b6c37c056a7ea25fd2361683"} Jul 15 10:48:22.666937 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.666841 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9glqk" event={"ID":"2bb78eef-9330-46a0-b932-5e69c17c5209","Type":"ContainerStarted","Data":"8e5607874e3cad3544ef821b697e9a413ed81313e89216d3f191c6b305e1fa11"} Jul 15 10:48:22.669785 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.669768 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 10:48:22.670168 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.670141 2553 generic.go:356] "Generic (PLEG): container finished" podID="e72bb67f-c3f6-4428-8f95-f4550c74a728" containerID="50b30c0b081b25b1780af787b7441f4c9850de1a256a9bd202443c89ce7c0f60" exitCode=1 Jul 15 10:48:22.670307 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.670177 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" event={"ID":"e72bb67f-c3f6-4428-8f95-f4550c74a728","Type":"ContainerStarted","Data":"eb73682488004d2401296f3fd77823299272e88b9118d16e6c7458073a2eb1f6"} Jul 15 10:48:22.670307 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.670235 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" event={"ID":"e72bb67f-c3f6-4428-8f95-f4550c74a728","Type":"ContainerStarted","Data":"33d2c363ceda45b11e8e06c32c470a0ec8fc1b13f6cfee81a47c1dc7078c9b40"} Jul 15 10:48:22.670307 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.670280 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" event={"ID":"e72bb67f-c3f6-4428-8f95-f4550c74a728","Type":"ContainerStarted","Data":"570a9dbf80d16ef09ce6d8e549823e877c08f798b418bea0c57a01d69816bb9a"} Jul 15 10:48:22.670463 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.670342 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" event={"ID":"e72bb67f-c3f6-4428-8f95-f4550c74a728","Type":"ContainerStarted","Data":"e2e6613ca6a75a40f590d90661d7a524c437c75c44e70ca5b6b89409970e0649"} Jul 15 10:48:22.670463 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.670390 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" event={"ID":"e72bb67f-c3f6-4428-8f95-f4550c74a728","Type":"ContainerDied","Data":"50b30c0b081b25b1780af787b7441f4c9850de1a256a9bd202443c89ce7c0f60"} Jul 15 10:48:22.670463 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.670445 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" event={"ID":"e72bb67f-c3f6-4428-8f95-f4550c74a728","Type":"ContainerStarted","Data":"290995ad572b495edc33bf8dee5a2caf20ba152e9f888a11db6e2bbd29a8b50d"} Jul 15 10:48:22.691110 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.691067 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pqqbt" podStartSLOduration=2.7136171989999998 podStartE2EDuration="22.691050985s" totalImagesPullingTime="19.977433786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:22.690404638 +0000 UTC m=+23.657722460" watchObservedRunningTime="2026-07-15 10:48:22.691050985 +0000 UTC m=+23.658368786" Jul 15 10:48:22.703142 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.703101 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h8wwv" podStartSLOduration=2.731208797 podStartE2EDuration="22.703088403s" totalImagesPullingTime="19.971879606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:22.702356168 +0000 UTC m=+23.669673993" watchObservedRunningTime="2026-07-15 10:48:22.703088403 +0000 UTC m=+23.670406203" Jul 15 10:48:22.722662 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.722627 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8hbsr" podStartSLOduration=2.783694275 podStartE2EDuration="22.72261567s" totalImagesPullingTime="19.938921395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:22.721976835 +0000 UTC m=+23.689294635" watchObservedRunningTime="2026-07-15 10:48:22.72261567 +0000 UTC m=+23.689933494" Jul 15 10:48:22.740091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.740051 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-232.ec2.internal" podStartSLOduration=21.740038961 podStartE2EDuration="21.740038961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:22.739548609 +0000 UTC m=+23.706866410" watchObservedRunningTime="2026-07-15 10:48:22.740038961 +0000 UTC m=+23.707356763" Jul 15 10:48:22.753669 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.753634 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9glqk" podStartSLOduration=2.802888653 podStartE2EDuration="22.753623874s" totalImagesPullingTime="19.950735221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:22.753369957 +0000 UTC m=+23.720687787" watchObservedRunningTime="2026-07-15 10:48:22.753623874 +0000 UTC m=+23.720941674" Jul 15 10:48:22.772732 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:22.772698 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v6k8q" podStartSLOduration=2.719969689 podStartE2EDuration="22.772688057s" totalImagesPullingTime="20.052718368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:22.772273787 +0000 UTC m=+23.739591588" watchObservedRunningTime="2026-07-15 10:48:22.772688057 +0000 UTC m=+23.740005857" Jul 15 10:48:23.415953 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:23.415928 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 10:48:23.559121 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:23.559063 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:23.559295 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:23.559063 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:23.559295 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:23.559176 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:23.559295 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:23.559279 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:23.563116 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:23.563048 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T10:48:23.415948902Z","UUID":"36b1f6e2-501e-4111-a44e-b8869e7ae524","Handler":null,"Name":"","Endpoint":""} Jul 15 10:48:23.564698 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:23.564679 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 10:48:23.564796 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:23.564719 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 10:48:23.673596 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:23.673567 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dkgls" event={"ID":"685c8f85-0e5d-468e-9211-242e068b1da2","Type":"ContainerStarted","Data":"4be314d438e92a51d10d66dc8889301518aeb6f9d82a436f19a9920cc6b491cb"} Jul 15 10:48:23.675725 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:23.675695 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" event={"ID":"eacac30c-422c-49ce-a6a2-527ac638bb91","Type":"ContainerStarted","Data":"578981426b6350e1d7ca9b242d89c90852b5357b576d9356b9f10ff3556b8a95"} Jul 15 10:48:23.688211 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:23.688152 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dkgls" podStartSLOduration=3.744572508 podStartE2EDuration="23.688139242s" totalImagesPullingTime="19.943566734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:23.687686481 +0000 UTC m=+24.655004303" watchObservedRunningTime="2026-07-15 10:48:23.688139242 +0000 UTC m=+24.655457042" Jul 15 10:48:24.559117 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:24.559088 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:24.559284 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:24.559211 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:25.559170 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:25.558992 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:25.559662 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:25.559050 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:25.559662 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:25.559258 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:25.559662 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:25.559343 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:25.682919 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:25.682891 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 10:48:25.683364 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:25.683321 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" event={"ID":"e72bb67f-c3f6-4428-8f95-f4550c74a728","Type":"ContainerStarted","Data":"7908ec97b7dc4ffa86cbcbec3106f7f3bbd65bdf4678aa2593653d1ad28116ae"} Jul 15 10:48:25.685643 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:25.685618 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" event={"ID":"eacac30c-422c-49ce-a6a2-527ac638bb91","Type":"ContainerStarted","Data":"867e44ae40b5f65fd260ecb81704c9794e5b71d8b69bb851ce59db03febbbbe6"} Jul 15 10:48:25.702705 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:25.702664 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k6fz6" podStartSLOduration=3.207739961 podStartE2EDuration="25.702648907s" totalImagesPullingTime="22.494908946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:25.702567593 +0000 UTC m=+26.669885394" watchObservedRunningTime="2026-07-15 10:48:25.702648907 +0000 UTC m=+26.669966710" Jul 15 10:48:26.559562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:26.559528 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:26.560071 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:26.559659 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:27.225665 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.225631 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:27.226235 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.226210 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:27.559577 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.559494 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:27.560196 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:27.559612 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:27.560196 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.559662 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:27.560196 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:27.559744 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:27.692583 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.692558 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 10:48:27.692925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.692895 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" event={"ID":"e72bb67f-c3f6-4428-8f95-f4550c74a728","Type":"ContainerStarted","Data":"88c85264cf61aeaaa65613699adf57b4d114fcf2a112d1080c987e0e6df58a89"} Jul 15 10:48:27.693163 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.693132 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:27.693300 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.693284 2553 scope.go:117] "RemoveContainer" containerID="50b30c0b081b25b1780af787b7441f4c9850de1a256a9bd202443c89ce7c0f60" Jul 15 10:48:27.694774 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.694754 2553 generic.go:356] "Generic (PLEG): container finished" podID="cca9c267-e327-4934-912a-5e6183d3cd90" containerID="ed965a6565d63d7a34589de52364ce5db9a88dbf24dd187f6956d47ec55bdc28" exitCode=0 Jul 15 10:48:27.694862 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.694841 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" event={"ID":"cca9c267-e327-4934-912a-5e6183d3cd90","Type":"ContainerDied","Data":"ed965a6565d63d7a34589de52364ce5db9a88dbf24dd187f6956d47ec55bdc28"} Jul 15 10:48:27.695079 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.695058 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:27.695598 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.695486 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h8wwv" Jul 15 10:48:27.709385 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:27.709366 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:28.559252 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.559217 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:28.559474 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:28.559363 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:28.701845 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.701821 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 10:48:28.702369 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.702224 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" event={"ID":"e72bb67f-c3f6-4428-8f95-f4550c74a728","Type":"ContainerStarted","Data":"dd98f5866f9938eb66c64a81f4d2a8fb8174fc83f15a8a73aab4b42b8c93b820"} Jul 15 10:48:28.702606 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.702584 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:28.702750 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.702731 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:28.719185 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.719165 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:48:28.729043 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.729005 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" podStartSLOduration=8.645936741 podStartE2EDuration="28.728992972s" totalImagesPullingTime="20.083056231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:28.727287274 +0000 UTC m=+29.694605129" watchObservedRunningTime="2026-07-15 10:48:28.728992972 +0000 UTC m=+29.696310774" Jul 15 10:48:28.963137 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.963110 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dfkgs"] Jul 15 10:48:28.963261 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.963227 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:28.963378 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:28.963350 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:28.966482 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.966458 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z4hz6"] Jul 15 10:48:28.966583 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.966561 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:28.966665 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:28.966648 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:28.967037 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.967015 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n9zm5"] Jul 15 10:48:28.967121 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:28.967102 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:28.967190 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:28.967170 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:29.705385 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:29.705357 2553 generic.go:356] "Generic (PLEG): container finished" podID="cca9c267-e327-4934-912a-5e6183d3cd90" containerID="54ff1bb39b645797b16a574546ae4c1b64f23ab40a678d7562f087586a5134e9" exitCode=0 Jul 15 10:48:29.705784 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:29.705427 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" event={"ID":"cca9c267-e327-4934-912a-5e6183d3cd90","Type":"ContainerDied","Data":"54ff1bb39b645797b16a574546ae4c1b64f23ab40a678d7562f087586a5134e9"} Jul 15 10:48:30.559522 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:30.559491 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:30.559522 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:30.559508 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:30.559730 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:30.559529 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:30.559730 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:30.559595 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:30.559730 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:30.559638 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:30.559854 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:30.559737 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:31.712217 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:31.712042 2553 generic.go:356] "Generic (PLEG): container finished" podID="cca9c267-e327-4934-912a-5e6183d3cd90" containerID="854fbb668a873f4cfbc926ed78f49da83cfd176d3fd601ebcf238a88b29399b4" exitCode=0 Jul 15 10:48:31.712217 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:31.712115 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" event={"ID":"cca9c267-e327-4934-912a-5e6183d3cd90","Type":"ContainerDied","Data":"854fbb668a873f4cfbc926ed78f49da83cfd176d3fd601ebcf238a88b29399b4"} Jul 15 10:48:32.559037 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:32.558996 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:32.559206 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:32.559057 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:32.559206 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:32.559061 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:32.559206 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:32.559125 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:32.559392 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:32.559239 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:32.559392 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:32.559317 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:33.217389 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:33.217356 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:33.217961 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:33.217509 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:33.217961 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:33.217568 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs podName:e9700e2f-eb72-46e7-ba4d-667b3c5942fc nodeName:}" failed. No retries permitted until 2026-07-15 10:49:05.217550642 +0000 UTC m=+66.184868421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs") pod "network-metrics-daemon-z4hz6" (UID: "e9700e2f-eb72-46e7-ba4d-667b3c5942fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 10:48:33.318341 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:33.318310 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:33.318498 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:33.318379 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gpw\" (UniqueName: \"kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw\") pod \"network-check-target-dfkgs\" (UID: \"fcd79b31-387f-42f5-b3d7-23d4d010bb01\") " pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:33.318498 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:33.318474 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:33.318620 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:33.318542 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret podName:4937210a-24fb-45a5-b3b4-dd096d5eec3d nodeName:}" failed. No retries permitted until 2026-07-15 10:49:05.318523251 +0000 UTC m=+66.285841047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret") pod "global-pull-secret-syncer-n9zm5" (UID: "4937210a-24fb-45a5-b3b4-dd096d5eec3d") : object "kube-system"/"original-pull-secret" not registered Jul 15 10:48:33.318620 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:33.318555 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 10:48:33.318620 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:33.318581 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 10:48:33.318620 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:33.318593 2553 projected.go:196] Error preparing data for projected volume kube-api-access-42gpw for pod openshift-network-diagnostics/network-check-target-dfkgs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:33.318805 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:33.318648 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw podName:fcd79b31-387f-42f5-b3d7-23d4d010bb01 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:05.318630979 +0000 UTC m=+66.285948761 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-42gpw" (UniqueName: "kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw") pod "network-check-target-dfkgs" (UID: "fcd79b31-387f-42f5-b3d7-23d4d010bb01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 10:48:34.558559 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:34.558521 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:34.558559 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:34.558549 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:34.559117 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:34.558527 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:34.559117 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:34.558678 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n9zm5" podUID="4937210a-24fb-45a5-b3b4-dd096d5eec3d" Jul 15 10:48:34.559117 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:34.558726 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfkgs" podUID="fcd79b31-387f-42f5-b3d7-23d4d010bb01" Jul 15 10:48:34.559117 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:34.558807 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z4hz6" podUID="e9700e2f-eb72-46e7-ba4d-667b3c5942fc" Jul 15 10:48:35.823314 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.823284 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-232.ec2.internal" event="NodeReady" Jul 15 10:48:35.823684 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.823438 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 10:48:35.861153 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.861123 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9"] Jul 15 10:48:35.864256 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.864186 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k"] Jul 15 10:48:35.864393 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.864368 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:35.866485 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.866464 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 10:48:35.866660 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.866618 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 10:48:35.866904 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.866809 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 10:48:35.866904 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.866871 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 10:48:35.867173 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.867154 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz"] Jul 15 10:48:35.867254 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.867241 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xqfrq\"" Jul 15 10:48:35.867307 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.867252 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k" Jul 15 10:48:35.869124 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.869109 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rhfv2\"" Jul 15 10:48:35.869315 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.869301 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 10:48:35.869512 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.869499 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 10:48:35.869678 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.869664 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79bdf6d5f4-d9nmz"] Jul 15 10:48:35.869786 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.869772 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:35.871842 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.871824 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 10:48:35.871912 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.871844 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 10:48:35.871912 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.871899 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 10:48:35.871979 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.871916 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hgn8k\"" Jul 15 10:48:35.872317 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.872305 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd"] Jul 15 10:48:35.872410 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.872397 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:35.874783 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.874763 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-jzskx"] Jul 15 10:48:35.874895 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.874876 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:35.874969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.874907 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 10:48:35.875040 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.875024 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lqsk4\"" Jul 15 10:48:35.875117 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.875101 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 10:48:35.875173 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.875026 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 10:48:35.877715 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.877640 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 10:48:35.877715 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.877690 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xrlxq\"" Jul 15 10:48:35.877956 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.877924 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 10:48:35.878146 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.878123 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 10:48:35.878620 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.878536 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 10:48:35.880988 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.880586 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k"] Jul 15 10:48:35.880988 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.880624 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz"] Jul 15 10:48:35.880988 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.880708 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:35.881186 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.881127 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 10:48:35.881495 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.881452 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9"] Jul 15 10:48:35.881740 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.881723 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-jzskx"] Jul 15 10:48:35.882981 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.882818 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 10:48:35.884003 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.883982 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w8vqp"] Jul 15 10:48:35.884665 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.884485 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 10:48:35.884665 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.884526 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 10:48:35.884665 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.884582 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2bzhd\"" Jul 15 10:48:35.886268 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.886243 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 10:48:35.890752 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.890673 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs"] Jul 15 10:48:35.890857 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.890842 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:35.892640 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.892618 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 10:48:35.892899 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.892882 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 10:48:35.893307 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.893293 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 10:48:35.893401 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.893386 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gq7lc\"" Jul 15 10:48:35.894233 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.894219 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79bdf6d5f4-d9nmz"] Jul 15 10:48:35.894277 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.894245 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d4jkb"] Jul 15 10:48:35.894322 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.894309 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs" Jul 15 10:48:35.897723 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.896810 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 10:48:35.897723 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.897258 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gnntd\"" Jul 15 10:48:35.897723 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.897604 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 10:48:35.897723 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.897628 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd"] Jul 15 10:48:35.897723 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.897709 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d4jkb" Jul 15 10:48:35.899419 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.899402 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs"] Jul 15 10:48:35.899782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.899762 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w8vqp"] Jul 15 10:48:35.900361 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.899972 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 10:48:35.900545 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.900526 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ggwdm\"" Jul 15 10:48:35.900617 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.900020 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 10:48:35.900671 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.900496 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d4jkb"] Jul 15 10:48:35.900671 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.900025 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 10:48:35.937134 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937109 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-installation-pull-secrets\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:35.937203 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937151 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:35.937242 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937222 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:35.937286 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937241 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-trusted-ca\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:35.937286 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937268 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rjqq\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-kube-api-access-6rjqq\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:35.937379 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937287 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82gh7\" (UniqueName: \"kubernetes.io/projected/ac978a33-68b9-4eca-b19c-7c694c50a4ee-kube-api-access-82gh7\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:35.937379 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937305 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-image-registry-private-configuration\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:35.937379 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937353 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6mjg\" (UniqueName: \"kubernetes.io/projected/f0b9d3a6-00bd-4355-b515-fa0d3c97bd42-kube-api-access-c6mjg\") pod \"service-ca-operator-7695fc6c8c-fh2r9\" (UID: \"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:35.937481 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937386 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq84z\" (UniqueName: \"kubernetes.io/projected/b2a5dfe8-7042-4808-9598-50daf570cba7-kube-api-access-kq84z\") pod \"kube-storage-version-migrator-operator-799cb7f958-jwkzd\" (UID: \"b2a5dfe8-7042-4808-9598-50daf570cba7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:35.937481 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937416 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5kcd\" (UniqueName: \"kubernetes.io/projected/a7401eb5-89e1-4f00-b397-65770902a27d-kube-api-access-j5kcd\") pod \"volume-data-source-validator-78495597f6-cd69k\" (UID: \"a7401eb5-89e1-4f00-b397-65770902a27d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k" Jul 15 10:48:35.937481 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937445 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b9d3a6-00bd-4355-b515-fa0d3c97bd42-serving-cert\") pod \"service-ca-operator-7695fc6c8c-fh2r9\" (UID: \"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:35.937481 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937468 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0b9d3a6-00bd-4355-b515-fa0d3c97bd42-config\") pod \"service-ca-operator-7695fc6c8c-fh2r9\" (UID: \"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:35.937609 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937493 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-bound-sa-token\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:35.937609 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937518 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a5dfe8-7042-4808-9598-50daf570cba7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-jwkzd\" (UID: \"b2a5dfe8-7042-4808-9598-50daf570cba7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:35.937609 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937591 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/604d9ac0-123f-439a-aaa1-126a4ee7183c-ca-trust-extracted\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:35.937708 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937622 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-certificates\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:35.937708 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:35.937647 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2a5dfe8-7042-4808-9598-50daf570cba7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-jwkzd\" (UID: \"b2a5dfe8-7042-4808-9598-50daf570cba7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:36.028853 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.028826 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:36.038787 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.038766 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2a5dfe8-7042-4808-9598-50daf570cba7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-jwkzd\" (UID: \"b2a5dfe8-7042-4808-9598-50daf570cba7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:36.038838 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.038796 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjd2w\" (UniqueName: \"kubernetes.io/projected/16501ed3-6671-462f-8b7e-df5fd5ebddbb-kube-api-access-bjd2w\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.038838 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.038816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-installation-pull-secrets\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.038903 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.038840 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/742e4915-dbfa-4d56-9d88-9cac05b2d551-config-volume\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.038903 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.038868 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-trusted-ca\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.038903 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.038895 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16501ed3-6671-462f-8b7e-df5fd5ebddbb-config\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.039007 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.038917 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g9bt\" (UniqueName: \"kubernetes.io/projected/63fd9a9d-dda9-4c64-94e6-e8c2c0dfe3a5-kube-api-access-5g9bt\") pod \"network-check-source-869dcfcdcd-gnzzs\" (UID: \"63fd9a9d-dda9-4c64-94e6-e8c2c0dfe3a5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs" Jul 15 10:48:36.039007 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.038944 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.039007 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.038970 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82gh7\" (UniqueName: \"kubernetes.io/projected/ac978a33-68b9-4eca-b19c-7c694c50a4ee-kube-api-access-82gh7\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:36.039007 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.038997 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5kcd\" (UniqueName: \"kubernetes.io/projected/a7401eb5-89e1-4f00-b397-65770902a27d-kube-api-access-j5kcd\") pod \"volume-data-source-validator-78495597f6-cd69k\" (UID: \"a7401eb5-89e1-4f00-b397-65770902a27d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k" Jul 15 10:48:36.039168 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.039019 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:48:36.039168 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.039038 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bdf6d5f4-d9nmz: secret "image-registry-tls" not found Jul 15 10:48:36.039168 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.039091 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls podName:604d9ac0-123f-439a-aaa1-126a4ee7183c nodeName:}" failed. No retries permitted until 2026-07-15 10:48:36.539072198 +0000 UTC m=+37.506389978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls") pod "image-registry-79bdf6d5f4-d9nmz" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c") : secret "image-registry-tls" not found Jul 15 10:48:36.039168 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039035 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b9d3a6-00bd-4355-b515-fa0d3c97bd42-serving-cert\") pod \"service-ca-operator-7695fc6c8c-fh2r9\" (UID: \"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:36.039407 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039162 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0b9d3a6-00bd-4355-b515-fa0d3c97bd42-config\") pod \"service-ca-operator-7695fc6c8c-fh2r9\" (UID: \"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:36.039470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039436 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-bound-sa-token\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.039528 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039469 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/742e4915-dbfa-4d56-9d88-9cac05b2d551-tmp-dir\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.039528 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039499 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/604d9ac0-123f-439a-aaa1-126a4ee7183c-ca-trust-extracted\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.039626 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039527 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-certificates\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.039626 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039558 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.039626 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039583 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fww9k\" (UniqueName: \"kubernetes.io/projected/cb750dcc-239b-4aec-9ea1-10d74ae15425-kube-api-access-fww9k\") pod \"ingress-canary-d4jkb\" (UID: \"cb750dcc-239b-4aec-9ea1-10d74ae15425\") " pod="openshift-ingress-canary/ingress-canary-d4jkb" Jul 15 10:48:36.039626 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039613 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:36.039808 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039641 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvq49\" (UniqueName: \"kubernetes.io/projected/742e4915-dbfa-4d56-9d88-9cac05b2d551-kube-api-access-kvq49\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.039808 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039673 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rjqq\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-kube-api-access-6rjqq\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.039808 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039714 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16501ed3-6671-462f-8b7e-df5fd5ebddbb-trusted-ca\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.039808 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039742 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0b9d3a6-00bd-4355-b515-fa0d3c97bd42-config\") pod \"service-ca-operator-7695fc6c8c-fh2r9\" (UID: \"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:36.039808 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039743 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16501ed3-6671-462f-8b7e-df5fd5ebddbb-serving-cert\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.039808 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039792 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-image-registry-private-configuration\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.040092 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039820 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6mjg\" (UniqueName: \"kubernetes.io/projected/f0b9d3a6-00bd-4355-b515-fa0d3c97bd42-kube-api-access-c6mjg\") pod \"service-ca-operator-7695fc6c8c-fh2r9\" (UID: \"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:36.040092 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039845 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq84z\" (UniqueName: \"kubernetes.io/projected/b2a5dfe8-7042-4808-9598-50daf570cba7-kube-api-access-kq84z\") pod \"kube-storage-version-migrator-operator-799cb7f958-jwkzd\" (UID: \"b2a5dfe8-7042-4808-9598-50daf570cba7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:36.040092 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039868 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb750dcc-239b-4aec-9ea1-10d74ae15425-cert\") pod \"ingress-canary-d4jkb\" (UID: \"cb750dcc-239b-4aec-9ea1-10d74ae15425\") " pod="openshift-ingress-canary/ingress-canary-d4jkb" Jul 15 10:48:36.040092 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.039900 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a5dfe8-7042-4808-9598-50daf570cba7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-jwkzd\" (UID: \"b2a5dfe8-7042-4808-9598-50daf570cba7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:36.040092 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.040002 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 10:48:36.040092 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.040059 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls podName:ac978a33-68b9-4eca-b19c-7c694c50a4ee nodeName:}" failed. No retries permitted until 2026-07-15 10:48:36.540041723 +0000 UTC m=+37.507359510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9q6pz" (UID: "ac978a33-68b9-4eca-b19c-7c694c50a4ee") : secret "samples-operator-tls" not found Jul 15 10:48:36.040398 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.040138 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-trusted-ca\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.040398 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.040172 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-certificates\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.040505 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.040402 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/604d9ac0-123f-439a-aaa1-126a4ee7183c-ca-trust-extracted\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.040505 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.040480 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a5dfe8-7042-4808-9598-50daf570cba7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-jwkzd\" (UID: \"b2a5dfe8-7042-4808-9598-50daf570cba7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:36.043145 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.043120 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2a5dfe8-7042-4808-9598-50daf570cba7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-jwkzd\" (UID: \"b2a5dfe8-7042-4808-9598-50daf570cba7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:36.043230 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.043125 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-image-registry-private-configuration\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.043286 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.043259 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-installation-pull-secrets\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.043587 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.043573 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0b9d3a6-00bd-4355-b515-fa0d3c97bd42-serving-cert\") pod \"service-ca-operator-7695fc6c8c-fh2r9\" (UID: \"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:36.047732 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.047690 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-bound-sa-token\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.047828 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.047740 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5kcd\" (UniqueName: \"kubernetes.io/projected/a7401eb5-89e1-4f00-b397-65770902a27d-kube-api-access-j5kcd\") pod \"volume-data-source-validator-78495597f6-cd69k\" (UID: \"a7401eb5-89e1-4f00-b397-65770902a27d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k" Jul 15 10:48:36.047884 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.047844 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82gh7\" (UniqueName: \"kubernetes.io/projected/ac978a33-68b9-4eca-b19c-7c694c50a4ee-kube-api-access-82gh7\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:36.048081 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.048064 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6mjg\" (UniqueName: \"kubernetes.io/projected/f0b9d3a6-00bd-4355-b515-fa0d3c97bd42-kube-api-access-c6mjg\") pod \"service-ca-operator-7695fc6c8c-fh2r9\" (UID: \"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:36.048167 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.048145 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rjqq\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-kube-api-access-6rjqq\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.048218 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.048147 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq84z\" (UniqueName: \"kubernetes.io/projected/b2a5dfe8-7042-4808-9598-50daf570cba7-kube-api-access-kq84z\") pod \"kube-storage-version-migrator-operator-799cb7f958-jwkzd\" (UID: \"b2a5dfe8-7042-4808-9598-50daf570cba7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:36.125604 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.125577 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:36.140525 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.140505 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16501ed3-6671-462f-8b7e-df5fd5ebddbb-config\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.140585 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.140530 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g9bt\" (UniqueName: \"kubernetes.io/projected/63fd9a9d-dda9-4c64-94e6-e8c2c0dfe3a5-kube-api-access-5g9bt\") pod \"network-check-source-869dcfcdcd-gnzzs\" (UID: \"63fd9a9d-dda9-4c64-94e6-e8c2c0dfe3a5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs" Jul 15 10:48:36.140585 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.140560 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/742e4915-dbfa-4d56-9d88-9cac05b2d551-tmp-dir\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.140585 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.140579 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.140680 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.140602 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww9k\" (UniqueName: \"kubernetes.io/projected/cb750dcc-239b-4aec-9ea1-10d74ae15425-kube-api-access-fww9k\") pod \"ingress-canary-d4jkb\" (UID: \"cb750dcc-239b-4aec-9ea1-10d74ae15425\") " pod="openshift-ingress-canary/ingress-canary-d4jkb" Jul 15 10:48:36.140680 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.140643 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvq49\" (UniqueName: \"kubernetes.io/projected/742e4915-dbfa-4d56-9d88-9cac05b2d551-kube-api-access-kvq49\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.140784 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.140678 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:48:36.140784 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.140730 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls podName:742e4915-dbfa-4d56-9d88-9cac05b2d551 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:36.640713035 +0000 UTC m=+37.608030819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls") pod "dns-default-w8vqp" (UID: "742e4915-dbfa-4d56-9d88-9cac05b2d551") : secret "dns-default-metrics-tls" not found Jul 15 10:48:36.140784 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.140683 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16501ed3-6671-462f-8b7e-df5fd5ebddbb-trusted-ca\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.140998 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.140811 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16501ed3-6671-462f-8b7e-df5fd5ebddbb-serving-cert\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.140998 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.140843 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb750dcc-239b-4aec-9ea1-10d74ae15425-cert\") pod \"ingress-canary-d4jkb\" (UID: \"cb750dcc-239b-4aec-9ea1-10d74ae15425\") " pod="openshift-ingress-canary/ingress-canary-d4jkb" Jul 15 10:48:36.141102 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.140910 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjd2w\" (UniqueName: \"kubernetes.io/projected/16501ed3-6671-462f-8b7e-df5fd5ebddbb-kube-api-access-bjd2w\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.141518 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.141282 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/742e4915-dbfa-4d56-9d88-9cac05b2d551-config-volume\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.144890 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.141322 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/742e4915-dbfa-4d56-9d88-9cac05b2d551-tmp-dir\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.144890 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.141779 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16501ed3-6671-462f-8b7e-df5fd5ebddbb-trusted-ca\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.144890 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.141906 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/742e4915-dbfa-4d56-9d88-9cac05b2d551-config-volume\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.144890 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.141944 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/16501ed3-6671-462f-8b7e-df5fd5ebddbb-config\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.144890 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.143868 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb750dcc-239b-4aec-9ea1-10d74ae15425-cert\") pod \"ingress-canary-d4jkb\" (UID: \"cb750dcc-239b-4aec-9ea1-10d74ae15425\") " pod="openshift-ingress-canary/ingress-canary-d4jkb" Jul 15 10:48:36.145433 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.145418 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16501ed3-6671-462f-8b7e-df5fd5ebddbb-serving-cert\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.149287 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.149252 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g9bt\" (UniqueName: \"kubernetes.io/projected/63fd9a9d-dda9-4c64-94e6-e8c2c0dfe3a5-kube-api-access-5g9bt\") pod \"network-check-source-869dcfcdcd-gnzzs\" (UID: \"63fd9a9d-dda9-4c64-94e6-e8c2c0dfe3a5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs" Jul 15 10:48:36.149425 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.149361 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvq49\" (UniqueName: \"kubernetes.io/projected/742e4915-dbfa-4d56-9d88-9cac05b2d551-kube-api-access-kvq49\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.150074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.150033 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fww9k\" (UniqueName: \"kubernetes.io/projected/cb750dcc-239b-4aec-9ea1-10d74ae15425-kube-api-access-fww9k\") pod \"ingress-canary-d4jkb\" (UID: \"cb750dcc-239b-4aec-9ea1-10d74ae15425\") " pod="openshift-ingress-canary/ingress-canary-d4jkb" Jul 15 10:48:36.150764 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.150748 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjd2w\" (UniqueName: \"kubernetes.io/projected/16501ed3-6671-462f-8b7e-df5fd5ebddbb-kube-api-access-bjd2w\") pod \"console-operator-7866497494-jzskx\" (UID: \"16501ed3-6671-462f-8b7e-df5fd5ebddbb\") " pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.196246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.196190 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" Jul 15 10:48:36.203904 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.203888 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k" Jul 15 10:48:36.221040 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.221021 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" Jul 15 10:48:36.226861 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.226839 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:36.238012 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.237980 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs" Jul 15 10:48:36.243509 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.242995 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d4jkb" Jul 15 10:48:36.397100 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.397025 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:36.411787 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.411760 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k"] Jul 15 10:48:36.415348 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.415007 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9"] Jul 15 10:48:36.418868 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:36.418831 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7401eb5_89e1_4f00_b397_65770902a27d.slice/crio-f75639c474ec9343d5203396e6a815b211558e6a2fededd0e78e63943c4cfcd2 WatchSource:0}: Error finding container f75639c474ec9343d5203396e6a815b211558e6a2fededd0e78e63943c4cfcd2: Status 404 returned error can't find the container with id f75639c474ec9343d5203396e6a815b211558e6a2fededd0e78e63943c4cfcd2 Jul 15 10:48:36.421026 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:36.421010 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b9d3a6_00bd_4355_b515_fa0d3c97bd42.slice/crio-a78e5fdc4572a59fb0bbcc2b3c51957c8e86ecf8cdf4714e4b678ced10863259 WatchSource:0}: Error finding container a78e5fdc4572a59fb0bbcc2b3c51957c8e86ecf8cdf4714e4b678ced10863259: Status 404 returned error can't find the container with id a78e5fdc4572a59fb0bbcc2b3c51957c8e86ecf8cdf4714e4b678ced10863259 Jul 15 10:48:36.440967 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.440944 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d4jkb"] Jul 15 10:48:36.444112 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:36.444085 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb750dcc_239b_4aec_9ea1_10d74ae15425.slice/crio-df55694b475b1508ca86bc8ac29f32f6bfb90fccc9c669d0281631bbd5c2eb60 WatchSource:0}: Error finding container df55694b475b1508ca86bc8ac29f32f6bfb90fccc9c669d0281631bbd5c2eb60: Status 404 returned error can't find the container with id df55694b475b1508ca86bc8ac29f32f6bfb90fccc9c669d0281631bbd5c2eb60 Jul 15 10:48:36.444216 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.444199 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-jzskx"] Jul 15 10:48:36.447280 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:36.447170 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16501ed3_6671_462f_8b7e_df5fd5ebddbb.slice/crio-5e72dec46df802e32ee90f24fb8f72453c5ae0dfee5df034558971e2e72cf897 WatchSource:0}: Error finding container 5e72dec46df802e32ee90f24fb8f72453c5ae0dfee5df034558971e2e72cf897: Status 404 returned error can't find the container with id 5e72dec46df802e32ee90f24fb8f72453c5ae0dfee5df034558971e2e72cf897 Jul 15 10:48:36.447886 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.447866 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd"] Jul 15 10:48:36.450210 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:36.450187 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a5dfe8_7042_4808_9598_50daf570cba7.slice/crio-d508abd91164259af40a582a458187047a5e25d0d1ab38c0b36bc7d96e2c575f WatchSource:0}: Error finding container d508abd91164259af40a582a458187047a5e25d0d1ab38c0b36bc7d96e2c575f: Status 404 returned error can't find the container with id d508abd91164259af40a582a458187047a5e25d0d1ab38c0b36bc7d96e2c575f Jul 15 10:48:36.457493 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.457473 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs"] Jul 15 10:48:36.460512 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:36.460490 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fd9a9d_dda9_4c64_94e6_e8c2c0dfe3a5.slice/crio-64faaab6450f83f6aad03e7c800b471eb233a57586f319f81911d6aa571a8b66 WatchSource:0}: Error finding container 64faaab6450f83f6aad03e7c800b471eb233a57586f319f81911d6aa571a8b66: Status 404 returned error can't find the container with id 64faaab6450f83f6aad03e7c800b471eb233a57586f319f81911d6aa571a8b66 Jul 15 10:48:36.461004 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.460983 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:36.546912 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.546882 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:36.547002 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.546963 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:36.547052 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.547036 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 10:48:36.547110 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.547101 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls podName:ac978a33-68b9-4eca-b19c-7c694c50a4ee nodeName:}" failed. No retries permitted until 2026-07-15 10:48:37.547086691 +0000 UTC m=+38.514404473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9q6pz" (UID: "ac978a33-68b9-4eca-b19c-7c694c50a4ee") : secret "samples-operator-tls" not found Jul 15 10:48:36.547147 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.547044 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:48:36.547147 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.547120 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bdf6d5f4-d9nmz: secret "image-registry-tls" not found Jul 15 10:48:36.547217 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.547149 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls podName:604d9ac0-123f-439a-aaa1-126a4ee7183c nodeName:}" failed. No retries permitted until 2026-07-15 10:48:37.547141377 +0000 UTC m=+38.514459157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls") pod "image-registry-79bdf6d5f4-d9nmz" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c") : secret "image-registry-tls" not found Jul 15 10:48:36.558841 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.558816 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:48:36.558841 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.558829 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:48:36.558967 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.558827 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:48:36.561172 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.561154 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kvp4d\"" Jul 15 10:48:36.561252 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.561186 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 10:48:36.561416 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.561403 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 10:48:36.562043 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.562019 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2zzjw\"" Jul 15 10:48:36.647235 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.647217 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:36.647400 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.647382 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:48:36.647465 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:36.647454 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls podName:742e4915-dbfa-4d56-9d88-9cac05b2d551 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:37.647437733 +0000 UTC m=+38.614755529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls") pod "dns-default-w8vqp" (UID: "742e4915-dbfa-4d56-9d88-9cac05b2d551") : secret "dns-default-metrics-tls" not found Jul 15 10:48:36.724664 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.724613 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs" event={"ID":"63fd9a9d-dda9-4c64-94e6-e8c2c0dfe3a5","Type":"ContainerStarted","Data":"64faaab6450f83f6aad03e7c800b471eb233a57586f319f81911d6aa571a8b66"} Jul 15 10:48:36.725752 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.725730 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-jzskx" event={"ID":"16501ed3-6671-462f-8b7e-df5fd5ebddbb","Type":"ContainerStarted","Data":"5e72dec46df802e32ee90f24fb8f72453c5ae0dfee5df034558971e2e72cf897"} Jul 15 10:48:36.728341 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.728309 2553 generic.go:356] "Generic (PLEG): container finished" podID="cca9c267-e327-4934-912a-5e6183d3cd90" containerID="0310cc203487f3c202be93fe3f1d495a82841816e66b8adcfb1412b3a6d52bd6" exitCode=0 Jul 15 10:48:36.728423 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.728351 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" event={"ID":"cca9c267-e327-4934-912a-5e6183d3cd90","Type":"ContainerDied","Data":"0310cc203487f3c202be93fe3f1d495a82841816e66b8adcfb1412b3a6d52bd6"} Jul 15 10:48:36.729508 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.729487 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d4jkb" event={"ID":"cb750dcc-239b-4aec-9ea1-10d74ae15425","Type":"ContainerStarted","Data":"df55694b475b1508ca86bc8ac29f32f6bfb90fccc9c669d0281631bbd5c2eb60"} Jul 15 10:48:36.730571 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.730549 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k" event={"ID":"a7401eb5-89e1-4f00-b397-65770902a27d","Type":"ContainerStarted","Data":"f75639c474ec9343d5203396e6a815b211558e6a2fededd0e78e63943c4cfcd2"} Jul 15 10:48:36.731655 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.731635 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" event={"ID":"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42","Type":"ContainerStarted","Data":"a78e5fdc4572a59fb0bbcc2b3c51957c8e86ecf8cdf4714e4b678ced10863259"} Jul 15 10:48:36.732698 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:36.732681 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" event={"ID":"b2a5dfe8-7042-4808-9598-50daf570cba7","Type":"ContainerStarted","Data":"d508abd91164259af40a582a458187047a5e25d0d1ab38c0b36bc7d96e2c575f"} Jul 15 10:48:37.201385 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:37.201297 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:37.262376 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:37.262313 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:37.556610 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:37.556348 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:37.556750 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:37.556511 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 10:48:37.556750 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:37.556683 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:37.556750 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:37.556715 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls podName:ac978a33-68b9-4eca-b19c-7c694c50a4ee nodeName:}" failed. No retries permitted until 2026-07-15 10:48:39.55669246 +0000 UTC m=+40.524010244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9q6pz" (UID: "ac978a33-68b9-4eca-b19c-7c694c50a4ee") : secret "samples-operator-tls" not found Jul 15 10:48:37.556919 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:37.556773 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:48:37.556919 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:37.556790 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bdf6d5f4-d9nmz: secret "image-registry-tls" not found Jul 15 10:48:37.556919 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:37.556839 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls podName:604d9ac0-123f-439a-aaa1-126a4ee7183c nodeName:}" failed. No retries permitted until 2026-07-15 10:48:39.55682398 +0000 UTC m=+40.524141760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls") pod "image-registry-79bdf6d5f4-d9nmz" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c") : secret "image-registry-tls" not found Jul 15 10:48:37.605573 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:37.605540 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:37.657483 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:37.657454 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:37.657628 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:37.657601 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:48:37.657700 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:37.657658 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls podName:742e4915-dbfa-4d56-9d88-9cac05b2d551 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:39.657639228 +0000 UTC m=+40.624957014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls") pod "dns-default-w8vqp" (UID: "742e4915-dbfa-4d56-9d88-9cac05b2d551") : secret "dns-default-metrics-tls" not found Jul 15 10:48:37.662973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:37.662949 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:37.745780 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:37.745747 2553 generic.go:356] "Generic (PLEG): container finished" podID="cca9c267-e327-4934-912a-5e6183d3cd90" containerID="eb589bb49ff9b009148029c392606ae5ab8d4d169c557da9d8fe41f8425a0c77" exitCode=0 Jul 15 10:48:37.745914 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:37.745800 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" event={"ID":"cca9c267-e327-4934-912a-5e6183d3cd90","Type":"ContainerDied","Data":"eb589bb49ff9b009148029c392606ae5ab8d4d169c557da9d8fe41f8425a0c77"} Jul 15 10:48:38.757181 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:38.756472 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" event={"ID":"cca9c267-e327-4934-912a-5e6183d3cd90","Type":"ContainerStarted","Data":"0a3ba70ee0491351e72f3845e179c8867e2eca12d7c8106f3608f5fc7bd41c25"} Jul 15 10:48:38.758859 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:38.758817 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k" event={"ID":"a7401eb5-89e1-4f00-b397-65770902a27d","Type":"ContainerStarted","Data":"56a695746c5b0a76515a9fe405ac6652d1fed5e120ef9ec46e29e4c2bbd8ea85"} Jul 15 10:48:38.792476 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:38.792384 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zhrkq" podStartSLOduration=8.977473964 podStartE2EDuration="38.792363935s" totalImagesPullingTime="29.814889971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:38.77773797 +0000 UTC m=+39.745055800" watchObservedRunningTime="2026-07-15 10:48:38.792363935 +0000 UTC m=+39.759681737" Jul 15 10:48:38.899582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:38.899541 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:38.990658 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:38.990624 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:39.577213 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:39.577173 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:39.577422 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:39.577300 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:39.577422 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:39.577313 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 10:48:39.577422 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:39.577411 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls podName:ac978a33-68b9-4eca-b19c-7c694c50a4ee nodeName:}" failed. No retries permitted until 2026-07-15 10:48:43.577389295 +0000 UTC m=+44.544707081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9q6pz" (UID: "ac978a33-68b9-4eca-b19c-7c694c50a4ee") : secret "samples-operator-tls" not found Jul 15 10:48:39.577602 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:39.577442 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:48:39.577602 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:39.577461 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bdf6d5f4-d9nmz: secret "image-registry-tls" not found Jul 15 10:48:39.577602 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:39.577517 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls podName:604d9ac0-123f-439a-aaa1-126a4ee7183c nodeName:}" failed. No retries permitted until 2026-07-15 10:48:43.577497163 +0000 UTC m=+44.544814945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls") pod "image-registry-79bdf6d5f4-d9nmz" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c") : secret "image-registry-tls" not found Jul 15 10:48:39.678274 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:39.678234 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:39.678474 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:39.678433 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:48:39.678549 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:39.678503 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls podName:742e4915-dbfa-4d56-9d88-9cac05b2d551 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:43.678484919 +0000 UTC m=+44.645802712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls") pod "dns-default-w8vqp" (UID: "742e4915-dbfa-4d56-9d88-9cac05b2d551") : secret "dns-default-metrics-tls" not found Jul 15 10:48:39.960024 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:39.959912 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:40.056046 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:40.056007 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:43.357594 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.357498 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:43.411848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.411776 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:43.615786 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.615708 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:43.615786 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.615766 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:43.616009 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:43.615881 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 10:48:43.616009 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:43.615888 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:48:43.616009 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:43.615906 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bdf6d5f4-d9nmz: secret "image-registry-tls" not found Jul 15 10:48:43.616009 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:43.615945 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls podName:ac978a33-68b9-4eca-b19c-7c694c50a4ee nodeName:}" failed. No retries permitted until 2026-07-15 10:48:51.615928149 +0000 UTC m=+52.583245929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9q6pz" (UID: "ac978a33-68b9-4eca-b19c-7c694c50a4ee") : secret "samples-operator-tls" not found Jul 15 10:48:43.616009 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:43.615962 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls podName:604d9ac0-123f-439a-aaa1-126a4ee7183c nodeName:}" failed. No retries permitted until 2026-07-15 10:48:51.615953548 +0000 UTC m=+52.583271342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls") pod "image-registry-79bdf6d5f4-d9nmz" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c") : secret "image-registry-tls" not found Jul 15 10:48:43.716751 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.716723 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:43.716884 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:43.716865 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:48:43.716935 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:43.716927 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls podName:742e4915-dbfa-4d56-9d88-9cac05b2d551 nodeName:}" failed. No retries permitted until 2026-07-15 10:48:51.716910339 +0000 UTC m=+52.684228125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls") pod "dns-default-w8vqp" (UID: "742e4915-dbfa-4d56-9d88-9cac05b2d551") : secret "dns-default-metrics-tls" not found Jul 15 10:48:43.773857 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.773832 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" event={"ID":"b2a5dfe8-7042-4808-9598-50daf570cba7","Type":"ContainerStarted","Data":"ee6b722dea2ce909a7048916b1abeb760c11e6b8fb2b46c5e7dda3385219d237"} Jul 15 10:48:43.775613 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.775591 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs" event={"ID":"63fd9a9d-dda9-4c64-94e6-e8c2c0dfe3a5","Type":"ContainerStarted","Data":"284bc8ae4d972afb011c866dbb36ac7175810a9cb0f1ccab854630e11cf70cd1"} Jul 15 10:48:43.777364 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.777346 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/0.log" Jul 15 10:48:43.777455 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.777381 2553 generic.go:356] "Generic (PLEG): container finished" podID="16501ed3-6671-462f-8b7e-df5fd5ebddbb" containerID="efba2e3137ec21a677037fc9222ef4788b7e671e3242966a25c878bc8b5ec325" exitCode=255 Jul 15 10:48:43.777513 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.777466 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-jzskx" event={"ID":"16501ed3-6671-462f-8b7e-df5fd5ebddbb","Type":"ContainerDied","Data":"efba2e3137ec21a677037fc9222ef4788b7e671e3242966a25c878bc8b5ec325"} Jul 15 10:48:43.777631 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.777612 2553 scope.go:117] "RemoveContainer" containerID="efba2e3137ec21a677037fc9222ef4788b7e671e3242966a25c878bc8b5ec325" Jul 15 10:48:43.779023 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.778997 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d4jkb" event={"ID":"cb750dcc-239b-4aec-9ea1-10d74ae15425","Type":"ContainerStarted","Data":"4133081511b4c0860f9b9d1abda80d36f798a9c06098b0f4ca57cbb0911e708f"} Jul 15 10:48:43.780587 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.780560 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" event={"ID":"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42","Type":"ContainerStarted","Data":"7fb67f0875db3ddf68d1456e37152cbef34b13648bfdb2af923751dc4208bbc0"} Jul 15 10:48:43.794841 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.791325 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cd69k" podStartSLOduration=33.197043464 podStartE2EDuration="34.79130654s" totalImagesPullingTime="1.594263076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:38.792199955 +0000 UTC m=+39.759517783" watchObservedRunningTime="2026-07-15 10:48:43.79130654 +0000 UTC m=+44.758624342" Jul 15 10:48:43.812248 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.812200 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" podStartSLOduration=28.187382961 podStartE2EDuration="34.812183887s" totalImagesPullingTime="6.624800926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:43.792170565 +0000 UTC m=+44.759488392" watchObservedRunningTime="2026-07-15 10:48:43.812183887 +0000 UTC m=+44.779501691" Jul 15 10:48:43.828446 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.828401 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gnzzs" podStartSLOduration=13.202956114 podStartE2EDuration="19.828384696s" totalImagesPullingTime="6.625428582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:43.827388438 +0000 UTC m=+44.794706262" watchObservedRunningTime="2026-07-15 10:48:43.828384696 +0000 UTC m=+44.795702498" Jul 15 10:48:43.841789 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:43.841746 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" podStartSLOduration=28.189202237 podStartE2EDuration="34.841731171s" totalImagesPullingTime="6.652528934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:43.841277692 +0000 UTC m=+44.808595497" watchObservedRunningTime="2026-07-15 10:48:43.841731171 +0000 UTC m=+44.809048974" Jul 15 10:48:44.252681 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.252644 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:44.352708 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.352682 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:44.461070 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.461010 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d4jkb" podStartSLOduration=2.830761547 podStartE2EDuration="9.460989672s" totalImagesPullingTime="6.630228125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:43.856983987 +0000 UTC m=+44.824301788" watchObservedRunningTime="2026-07-15 10:48:44.460989672 +0000 UTC m=+45.428307473" Jul 15 10:48:44.462171 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.462144 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4"] Jul 15 10:48:44.462542 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.462519 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:44.482757 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.482739 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4"] Jul 15 10:48:44.482850 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.482823 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4" Jul 15 10:48:44.485131 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.485109 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rj9t9\"" Jul 15 10:48:44.485402 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.485384 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 15 10:48:44.486131 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.486111 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 15 10:48:44.553291 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.553257 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:44.626262 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.626239 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q725p\" (UniqueName: \"kubernetes.io/projected/82a4d1da-6468-486d-aa8e-03879587cd76-kube-api-access-q725p\") pod \"migrator-7f59b54f6c-f6ps4\" (UID: \"82a4d1da-6468-486d-aa8e-03879587cd76\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4" Jul 15 10:48:44.654228 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.654185 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:44.726656 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.726601 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q725p\" (UniqueName: \"kubernetes.io/projected/82a4d1da-6468-486d-aa8e-03879587cd76-kube-api-access-q725p\") pod \"migrator-7f59b54f6c-f6ps4\" (UID: \"82a4d1da-6468-486d-aa8e-03879587cd76\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4" Jul 15 10:48:44.735380 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.735361 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q725p\" (UniqueName: \"kubernetes.io/projected/82a4d1da-6468-486d-aa8e-03879587cd76-kube-api-access-q725p\") pod \"migrator-7f59b54f6c-f6ps4\" (UID: \"82a4d1da-6468-486d-aa8e-03879587cd76\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4" Jul 15 10:48:44.753489 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.753462 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:44.785257 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.785239 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 10:48:44.785651 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.785637 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/0.log" Jul 15 10:48:44.785732 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.785672 2553 generic.go:356] "Generic (PLEG): container finished" podID="16501ed3-6671-462f-8b7e-df5fd5ebddbb" containerID="b429acc04e2730e3a06db882e140947362e8dba6e80705330e64fdf54112f083" exitCode=255 Jul 15 10:48:44.785732 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.785700 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-jzskx" event={"ID":"16501ed3-6671-462f-8b7e-df5fd5ebddbb","Type":"ContainerDied","Data":"b429acc04e2730e3a06db882e140947362e8dba6e80705330e64fdf54112f083"} Jul 15 10:48:44.785831 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.785770 2553 scope.go:117] "RemoveContainer" containerID="efba2e3137ec21a677037fc9222ef4788b7e671e3242966a25c878bc8b5ec325" Jul 15 10:48:44.786007 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.785993 2553 scope.go:117] "RemoveContainer" containerID="b429acc04e2730e3a06db882e140947362e8dba6e80705330e64fdf54112f083" Jul 15 10:48:44.786208 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:44.786152 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-jzskx_openshift-console-operator(16501ed3-6671-462f-8b7e-df5fd5ebddbb)\"" pod="openshift-console-operator/console-operator-7866497494-jzskx" podUID="16501ed3-6671-462f-8b7e-df5fd5ebddbb" Jul 15 10:48:44.792386 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.792371 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4" Jul 15 10:48:44.952530 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.952500 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4"] Jul 15 10:48:44.955220 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:44.955186 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a4d1da_6468_486d_aa8e_03879587cd76.slice/crio-ba150a266cf39c812679beb072870bcb7c0bc0695c6b2410b3c1b0b177416ca3 WatchSource:0}: Error finding container ba150a266cf39c812679beb072870bcb7c0bc0695c6b2410b3c1b0b177416ca3: Status 404 returned error can't find the container with id ba150a266cf39c812679beb072870bcb7c0bc0695c6b2410b3c1b0b177416ca3 Jul 15 10:48:44.960134 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:44.960105 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:45.023428 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:45.023321 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:45.795396 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:45.795361 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4" event={"ID":"82a4d1da-6468-486d-aa8e-03879587cd76","Type":"ContainerStarted","Data":"ba150a266cf39c812679beb072870bcb7c0bc0695c6b2410b3c1b0b177416ca3"} Jul 15 10:48:45.796895 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:45.796875 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 10:48:45.797191 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:45.797175 2553 scope.go:117] "RemoveContainer" containerID="b429acc04e2730e3a06db882e140947362e8dba6e80705330e64fdf54112f083" Jul 15 10:48:45.797323 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:45.797306 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-jzskx_openshift-console-operator(16501ed3-6671-462f-8b7e-df5fd5ebddbb)\"" pod="openshift-console-operator/console-operator-7866497494-jzskx" podUID="16501ed3-6671-462f-8b7e-df5fd5ebddbb" Jul 15 10:48:46.227807 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.227777 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:46.227948 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.227829 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:48:46.561676 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.561604 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-q77tw"] Jul 15 10:48:46.581454 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.581429 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-q77tw"] Jul 15 10:48:46.581595 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.581524 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.583985 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.583963 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 10:48:46.584123 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.584078 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n4xtb\"" Jul 15 10:48:46.584123 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.584083 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 10:48:46.585070 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.585052 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 10:48:46.585130 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.585062 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 10:48:46.596827 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.596804 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:46.646610 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.646570 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:46.745235 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.745209 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qk7m\" (UniqueName: \"kubernetes.io/projected/445b7a6d-5768-4b4e-9d3e-74796c778ce3-kube-api-access-2qk7m\") pod \"service-ca-79f68b9f4f-q77tw\" (UID: \"445b7a6d-5768-4b4e-9d3e-74796c778ce3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.745383 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.745259 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/445b7a6d-5768-4b4e-9d3e-74796c778ce3-signing-cabundle\") pod \"service-ca-79f68b9f4f-q77tw\" (UID: \"445b7a6d-5768-4b4e-9d3e-74796c778ce3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.745456 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.745436 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/445b7a6d-5768-4b4e-9d3e-74796c778ce3-signing-key\") pod \"service-ca-79f68b9f4f-q77tw\" (UID: \"445b7a6d-5768-4b4e-9d3e-74796c778ce3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.799737 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.799720 2553 scope.go:117] "RemoveContainer" containerID="b429acc04e2730e3a06db882e140947362e8dba6e80705330e64fdf54112f083" Jul 15 10:48:46.800024 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:46.799847 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-jzskx_openshift-console-operator(16501ed3-6671-462f-8b7e-df5fd5ebddbb)\"" pod="openshift-console-operator/console-operator-7866497494-jzskx" podUID="16501ed3-6671-462f-8b7e-df5fd5ebddbb" Jul 15 10:48:46.845752 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.845703 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/445b7a6d-5768-4b4e-9d3e-74796c778ce3-signing-key\") pod \"service-ca-79f68b9f4f-q77tw\" (UID: \"445b7a6d-5768-4b4e-9d3e-74796c778ce3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.845752 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.845738 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qk7m\" (UniqueName: \"kubernetes.io/projected/445b7a6d-5768-4b4e-9d3e-74796c778ce3-kube-api-access-2qk7m\") pod \"service-ca-79f68b9f4f-q77tw\" (UID: \"445b7a6d-5768-4b4e-9d3e-74796c778ce3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.845899 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.845761 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/445b7a6d-5768-4b4e-9d3e-74796c778ce3-signing-cabundle\") pod \"service-ca-79f68b9f4f-q77tw\" (UID: \"445b7a6d-5768-4b4e-9d3e-74796c778ce3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.846466 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.846448 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/445b7a6d-5768-4b4e-9d3e-74796c778ce3-signing-cabundle\") pod \"service-ca-79f68b9f4f-q77tw\" (UID: \"445b7a6d-5768-4b4e-9d3e-74796c778ce3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.848038 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.848017 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/445b7a6d-5768-4b4e-9d3e-74796c778ce3-signing-key\") pod \"service-ca-79f68b9f4f-q77tw\" (UID: \"445b7a6d-5768-4b4e-9d3e-74796c778ce3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.853378 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.853352 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qk7m\" (UniqueName: \"kubernetes.io/projected/445b7a6d-5768-4b4e-9d3e-74796c778ce3-kube-api-access-2qk7m\") pod \"service-ca-79f68b9f4f-q77tw\" (UID: \"445b7a6d-5768-4b4e-9d3e-74796c778ce3\") " pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.890381 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.890358 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" Jul 15 10:48:46.891529 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.891509 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc"] Jul 15 10:48:46.912837 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.912811 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc"] Jul 15 10:48:46.912931 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.912859 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" Jul 15 10:48:46.914714 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.914695 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q"] Jul 15 10:48:46.915064 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.915044 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 10:48:46.915148 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.915070 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 15 10:48:46.916012 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.915997 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 10:48:46.916093 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.916023 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4vjnj\"" Jul 15 10:48:46.916093 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.916023 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 10:48:46.928778 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.928755 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq"] Jul 15 10:48:46.928891 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.928874 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:46.931688 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.931662 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 15 10:48:46.955101 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.955079 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q"] Jul 15 10:48:46.955203 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.955113 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq"] Jul 15 10:48:46.955252 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.955226 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:46.957609 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.957588 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 15 10:48:46.957741 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.957721 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 15 10:48:46.957741 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.957738 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 15 10:48:46.957891 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:46.957592 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 15 10:48:47.047363 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.047315 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z54vr\" (UniqueName: \"kubernetes.io/projected/509b32bc-3105-4c91-ba14-67c0f4572c63-kube-api-access-z54vr\") pod \"klusterlet-addon-workmgr-dc5cf6f66-px75q\" (UID: \"509b32bc-3105-4c91-ba14-67c0f4572c63\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:47.047454 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.047384 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sxv9\" (UniqueName: \"kubernetes.io/projected/22cef08e-822e-40fc-a734-e82ef45f9768-kube-api-access-6sxv9\") pod \"managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc\" (UID: \"22cef08e-822e-40fc-a734-e82ef45f9768\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" Jul 15 10:48:47.047454 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.047418 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/509b32bc-3105-4c91-ba14-67c0f4572c63-tmp\") pod \"klusterlet-addon-workmgr-dc5cf6f66-px75q\" (UID: \"509b32bc-3105-4c91-ba14-67c0f4572c63\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:47.047544 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.047522 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22cef08e-822e-40fc-a734-e82ef45f9768-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc\" (UID: \"22cef08e-822e-40fc-a734-e82ef45f9768\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" Jul 15 10:48:47.047591 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.047550 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/509b32bc-3105-4c91-ba14-67c0f4572c63-klusterlet-config\") pod \"klusterlet-addon-workmgr-dc5cf6f66-px75q\" (UID: \"509b32bc-3105-4c91-ba14-67c0f4572c63\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:47.050490 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.050467 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-q77tw"] Jul 15 10:48:47.054049 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:47.054025 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445b7a6d_5768_4b4e_9d3e_74796c778ce3.slice/crio-6ae2bb20d7d0941a8662c8d261e95ecabb5ee7c9913f45cc91d5315f7341155e WatchSource:0}: Error finding container 6ae2bb20d7d0941a8662c8d261e95ecabb5ee7c9913f45cc91d5315f7341155e: Status 404 returned error can't find the container with id 6ae2bb20d7d0941a8662c8d261e95ecabb5ee7c9913f45cc91d5315f7341155e Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.148832 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z54vr\" (UniqueName: \"kubernetes.io/projected/509b32bc-3105-4c91-ba14-67c0f4572c63-kube-api-access-z54vr\") pod \"klusterlet-addon-workmgr-dc5cf6f66-px75q\" (UID: \"509b32bc-3105-4c91-ba14-67c0f4572c63\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.148885 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-hub\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.149659 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sxv9\" (UniqueName: \"kubernetes.io/projected/22cef08e-822e-40fc-a734-e82ef45f9768-kube-api-access-6sxv9\") pod \"managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc\" (UID: \"22cef08e-822e-40fc-a734-e82ef45f9768\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.149718 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.149763 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/509b32bc-3105-4c91-ba14-67c0f4572c63-tmp\") pod \"klusterlet-addon-workmgr-dc5cf6f66-px75q\" (UID: \"509b32bc-3105-4c91-ba14-67c0f4572c63\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.149830 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/391b6617-0f45-4c4b-be87-8cb4cec30d8a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.149887 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.150040 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-ca\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.150081 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22cef08e-822e-40fc-a734-e82ef45f9768-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc\" (UID: \"22cef08e-822e-40fc-a734-e82ef45f9768\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.150183 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/509b32bc-3105-4c91-ba14-67c0f4572c63-klusterlet-config\") pod \"klusterlet-addon-workmgr-dc5cf6f66-px75q\" (UID: \"509b32bc-3105-4c91-ba14-67c0f4572c63\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.150242 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th5x4\" (UniqueName: \"kubernetes.io/projected/391b6617-0f45-4c4b-be87-8cb4cec30d8a-kube-api-access-th5x4\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.151731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.150707 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/509b32bc-3105-4c91-ba14-67c0f4572c63-tmp\") pod \"klusterlet-addon-workmgr-dc5cf6f66-px75q\" (UID: \"509b32bc-3105-4c91-ba14-67c0f4572c63\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:47.155351 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.153906 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22cef08e-822e-40fc-a734-e82ef45f9768-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc\" (UID: \"22cef08e-822e-40fc-a734-e82ef45f9768\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" Jul 15 10:48:47.155351 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.153931 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/509b32bc-3105-4c91-ba14-67c0f4572c63-klusterlet-config\") pod \"klusterlet-addon-workmgr-dc5cf6f66-px75q\" (UID: \"509b32bc-3105-4c91-ba14-67c0f4572c63\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:47.161877 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.161851 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z54vr\" (UniqueName: \"kubernetes.io/projected/509b32bc-3105-4c91-ba14-67c0f4572c63-kube-api-access-z54vr\") pod \"klusterlet-addon-workmgr-dc5cf6f66-px75q\" (UID: \"509b32bc-3105-4c91-ba14-67c0f4572c63\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:47.161960 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.161939 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sxv9\" (UniqueName: \"kubernetes.io/projected/22cef08e-822e-40fc-a734-e82ef45f9768-kube-api-access-6sxv9\") pod \"managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc\" (UID: \"22cef08e-822e-40fc-a734-e82ef45f9768\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" Jul 15 10:48:47.235346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.235305 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" Jul 15 10:48:47.249465 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.249439 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:47.250703 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.250674 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th5x4\" (UniqueName: \"kubernetes.io/projected/391b6617-0f45-4c4b-be87-8cb4cec30d8a-kube-api-access-th5x4\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.250768 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.250717 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-hub\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.250768 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.250757 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.250851 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.250810 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/391b6617-0f45-4c4b-be87-8cb4cec30d8a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.250851 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.250841 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.250951 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.250929 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-ca\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.251579 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.251553 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/391b6617-0f45-4c4b-be87-8cb4cec30d8a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.253286 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.253266 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-hub\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.253512 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.253485 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.253841 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.253823 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.253841 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.253832 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/391b6617-0f45-4c4b-be87-8cb4cec30d8a-ca\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.258311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.258284 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th5x4\" (UniqueName: \"kubernetes.io/projected/391b6617-0f45-4c4b-be87-8cb4cec30d8a-kube-api-access-th5x4\") pod \"cluster-proxy-proxy-agent-7d47f49d87-ckgdq\" (UID: \"391b6617-0f45-4c4b-be87-8cb4cec30d8a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.265006 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.264988 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:48:47.394119 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.394058 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc"] Jul 15 10:48:47.396043 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:47.396002 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22cef08e_822e_40fc_a734_e82ef45f9768.slice/crio-54a9e5343e8df45e82d57bd5d979fb8bd0ffdc7716f3f1d97530437b0604c87e WatchSource:0}: Error finding container 54a9e5343e8df45e82d57bd5d979fb8bd0ffdc7716f3f1d97530437b0604c87e: Status 404 returned error can't find the container with id 54a9e5343e8df45e82d57bd5d979fb8bd0ffdc7716f3f1d97530437b0604c87e Jul 15 10:48:47.435178 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.435152 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q"] Jul 15 10:48:47.439650 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:47.439623 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509b32bc_3105_4c91_ba14_67c0f4572c63.slice/crio-9a75142d3981bbba77353bc0d7f02260b082d4a0359e767fe90ebbc9811d05b1 WatchSource:0}: Error finding container 9a75142d3981bbba77353bc0d7f02260b082d4a0359e767fe90ebbc9811d05b1: Status 404 returned error can't find the container with id 9a75142d3981bbba77353bc0d7f02260b082d4a0359e767fe90ebbc9811d05b1 Jul 15 10:48:47.468948 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.468868 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq"] Jul 15 10:48:47.471065 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:48:47.471046 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod391b6617_0f45_4c4b_be87_8cb4cec30d8a.slice/crio-b7ce8908f3f34a75bfc31a1d23deba7f33915e21780fcd608a987a3bfa33d278 WatchSource:0}: Error finding container b7ce8908f3f34a75bfc31a1d23deba7f33915e21780fcd608a987a3bfa33d278: Status 404 returned error can't find the container with id b7ce8908f3f34a75bfc31a1d23deba7f33915e21780fcd608a987a3bfa33d278 Jul 15 10:48:47.540128 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.540104 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:47.804923 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.804894 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" event={"ID":"22cef08e-822e-40fc-a734-e82ef45f9768","Type":"ContainerStarted","Data":"54a9e5343e8df45e82d57bd5d979fb8bd0ffdc7716f3f1d97530437b0604c87e"} Jul 15 10:48:47.806265 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.806243 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" event={"ID":"391b6617-0f45-4c4b-be87-8cb4cec30d8a","Type":"ContainerStarted","Data":"b7ce8908f3f34a75bfc31a1d23deba7f33915e21780fcd608a987a3bfa33d278"} Jul 15 10:48:47.808134 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.808104 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4" event={"ID":"82a4d1da-6468-486d-aa8e-03879587cd76","Type":"ContainerStarted","Data":"a2540010dfbf18a3959e725e00e5e1e1ea358e7d1e70ae97fe935c1d82b0b8b2"} Jul 15 10:48:47.808243 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.808152 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4" event={"ID":"82a4d1da-6468-486d-aa8e-03879587cd76","Type":"ContainerStarted","Data":"f1bb5afcc7339d0b7468094886da3084a4848b257117148ac37b43acbb563dcf"} Jul 15 10:48:47.809451 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.809427 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" event={"ID":"509b32bc-3105-4c91-ba14-67c0f4572c63","Type":"ContainerStarted","Data":"9a75142d3981bbba77353bc0d7f02260b082d4a0359e767fe90ebbc9811d05b1"} Jul 15 10:48:47.810901 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.810879 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" event={"ID":"445b7a6d-5768-4b4e-9d3e-74796c778ce3","Type":"ContainerStarted","Data":"a752eab3cc4e579af6847884ce2ed2fedd09feb1beb46ed00607222874628d8a"} Jul 15 10:48:47.811017 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.810919 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" event={"ID":"445b7a6d-5768-4b4e-9d3e-74796c778ce3","Type":"ContainerStarted","Data":"6ae2bb20d7d0941a8662c8d261e95ecabb5ee7c9913f45cc91d5315f7341155e"} Jul 15 10:48:47.825784 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.825748 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-f6ps4" podStartSLOduration=1.85380239 podStartE2EDuration="3.825734616s" totalImagesPullingTime="1.971932226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:47.824834491 +0000 UTC m=+48.792152291" watchObservedRunningTime="2026-07-15 10:48:47.825734616 +0000 UTC m=+48.793052418" Jul 15 10:48:47.842173 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:47.842136 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-q77tw" podStartSLOduration=1.842123801 podStartE2EDuration="1.842123801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:47.841562565 +0000 UTC m=+48.808880366" watchObservedRunningTime="2026-07-15 10:48:47.842123801 +0000 UTC m=+48.809441636" Jul 15 10:48:48.539952 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:48.539861 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:48.733789 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:48.733739 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:48.828900 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:48.828738 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:48.934508 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:48.929512 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:49.030297 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:49.030254 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:49.231210 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:49.231179 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:50.037534 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:50.037502 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:50.249965 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:50.249926 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:50.444286 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:50.444200 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:50.851565 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:50.851310 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:51.244146 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:51.244084 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:51.457084 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:51.457029 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:51.701345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:51.701260 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:48:51.701482 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:51.701343 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:51.701482 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:51.701435 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 10:48:51.701482 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:51.701450 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bdf6d5f4-d9nmz: secret "image-registry-tls" not found Jul 15 10:48:51.701579 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:51.701502 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls podName:604d9ac0-123f-439a-aaa1-126a4ee7183c nodeName:}" failed. No retries permitted until 2026-07-15 10:49:07.701484685 +0000 UTC m=+68.668802467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls") pod "image-registry-79bdf6d5f4-d9nmz" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c") : secret "image-registry-tls" not found Jul 15 10:48:51.703624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:51.703593 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac978a33-68b9-4eca-b19c-7c694c50a4ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9q6pz\" (UID: \"ac978a33-68b9-4eca-b19c-7c694c50a4ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:51.802340 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:51.802296 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:48:51.802492 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:51.802458 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 10:48:51.802553 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:48:51.802521 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls podName:742e4915-dbfa-4d56-9d88-9cac05b2d551 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:07.802506459 +0000 UTC m=+68.769824238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls") pod "dns-default-w8vqp" (UID: "742e4915-dbfa-4d56-9d88-9cac05b2d551") : secret "dns-default-metrics-tls" not found Jul 15 10:48:51.810245 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:51.810221 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" Jul 15 10:48:51.837511 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:51.837485 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:52.238548 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:52.238513 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:52.428033 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:52.427966 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:52.843526 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:52.843398 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:52.942639 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:52.942609 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:53.042562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:53.042529 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:53.117021 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:53.116948 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:53.434770 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:53.434676 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:53.484015 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:53.483983 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:54.078684 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.078617 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:54.432558 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.432478 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:54.464133 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.463613 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz"] Jul 15 10:48:54.628414 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.628324 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:54.857695 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.857666 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" event={"ID":"391b6617-0f45-4c4b-be87-8cb4cec30d8a","Type":"ContainerStarted","Data":"8b11e9bfba847601f520043a7d06012e73fc7b4126294f0a1094c2ef1ae009b1"} Jul 15 10:48:54.857841 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.857711 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" event={"ID":"391b6617-0f45-4c4b-be87-8cb4cec30d8a","Type":"ContainerStarted","Data":"4f19b603dcb0658dd62df6579583fb3abbc15f1aa33fac29689efa687778e799"} Jul 15 10:48:54.857841 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.857731 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" event={"ID":"391b6617-0f45-4c4b-be87-8cb4cec30d8a","Type":"ContainerStarted","Data":"162c4d8750412559f8fb8ba3558b73387a865da1613f6e39f36e21ef0dd59b3e"} Jul 15 10:48:54.858812 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.858785 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" event={"ID":"ac978a33-68b9-4eca-b19c-7c694c50a4ee","Type":"ContainerStarted","Data":"254c3d5abaa2ac188fb384ed88513ad82b09215812a2192480e60857b711c4d4"} Jul 15 10:48:54.860285 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.860252 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" event={"ID":"509b32bc-3105-4c91-ba14-67c0f4572c63","Type":"ContainerStarted","Data":"da29b7eee0f9568bad4de148dd397849d8caf5e90ae3d744e1de1fa62d8fe521"} Jul 15 10:48:54.860524 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.860472 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:54.861916 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.861894 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" Jul 15 10:48:54.862014 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.861929 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" event={"ID":"22cef08e-822e-40fc-a734-e82ef45f9768","Type":"ContainerStarted","Data":"1ed65a4273f878aea225d4bbaf23b49e163adfad81d419caca9d46633a99f400"} Jul 15 10:48:54.874653 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.874611 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" podStartSLOduration=2.010829779 podStartE2EDuration="8.874599786s" totalImagesPullingTime="6.863770007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:54.873876432 +0000 UTC m=+55.841194229" watchObservedRunningTime="2026-07-15 10:48:54.874599786 +0000 UTC m=+55.841917581" Jul 15 10:48:54.887523 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.887454 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc5cf6f66-px75q" podStartSLOduration=1.9862017239999998 podStartE2EDuration="8.887440202s" totalImagesPullingTime="6.901238478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:54.887085027 +0000 UTC m=+55.854402827" watchObservedRunningTime="2026-07-15 10:48:54.887440202 +0000 UTC m=+55.854758003" Jul 15 10:48:54.899822 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:54.899788 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69ddb7bf78-qkhcc" podStartSLOduration=1.980615126 podStartE2EDuration="8.899777215s" totalImagesPullingTime="6.919162089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:54.899482108 +0000 UTC m=+55.866799908" watchObservedRunningTime="2026-07-15 10:48:54.899777215 +0000 UTC m=+55.867095016" Jul 15 10:48:55.026504 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:55.026476 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:55.226924 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:55.226898 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:55.632166 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:55.632086 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:56.030765 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:56.030703 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:56.300965 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:56.300882 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:56.625905 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:56.625821 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:56.870241 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:56.870213 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" event={"ID":"ac978a33-68b9-4eca-b19c-7c694c50a4ee","Type":"ContainerStarted","Data":"9b2787350c10e7ea97c68bc120bdac7758b391fa224a35aa0bad24dc2f25e0aa"} Jul 15 10:48:56.870665 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:56.870258 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" event={"ID":"ac978a33-68b9-4eca-b19c-7c694c50a4ee","Type":"ContainerStarted","Data":"67a7cecb348a1e74aa455a3056f47787267a893942e0b167d38347b379fba1e7"} Jul 15 10:48:56.885818 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:56.885740 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9q6pz" podStartSLOduration=46.346451386 podStartE2EDuration="47.885724678s" totalImagesPullingTime="1.539273292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:56.884763405 +0000 UTC m=+57.852081229" watchObservedRunningTime="2026-07-15 10:48:56.885724678 +0000 UTC m=+57.853042479" Jul 15 10:48:57.229425 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:57.229397 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:57.267504 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:57.267475 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" podUID="391b6617-0f45-4c4b-be87-8cb4cec30d8a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 15 10:48:57.676619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:57.676558 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:58.044086 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:58.044056 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:58.224773 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:58.224739 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:58.628009 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:58.627974 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:48:58.835073 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:48:58.835044 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:00.559137 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:00.559108 2553 scope.go:117] "RemoveContainer" containerID="b429acc04e2730e3a06db882e140947362e8dba6e80705330e64fdf54112f083" Jul 15 10:49:00.726617 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:00.726586 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z6m8d" Jul 15 10:49:00.886363 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:00.886277 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 10:49:00.886507 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:00.886365 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-jzskx" event={"ID":"16501ed3-6671-462f-8b7e-df5fd5ebddbb","Type":"ContainerStarted","Data":"1480757a04c5db9cbba71acf91e1f3a5e16015278c7add6d40c4c3b7cda0e4f5"} Jul 15 10:49:00.886664 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:00.886644 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:49:00.903375 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:00.903322 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-jzskx" podStartSLOduration=45.276051748 podStartE2EDuration="51.903309457s" totalImagesPullingTime="6.627257709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:00.902113766 +0000 UTC m=+61.869431609" watchObservedRunningTime="2026-07-15 10:49:00.903309457 +0000 UTC m=+61.870627303" Jul 15 10:49:01.594017 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:01.593991 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-jzskx" Jul 15 10:49:01.775591 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:01.775548 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:01.876468 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:01.876397 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:02.059739 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:02.059700 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:02.113907 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:02.113873 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:02.273432 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:02.273403 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:02.327633 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:02.327601 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:02.443794 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:02.443765 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:02.651040 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:02.650958 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:02.751443 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:02.751414 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:02.973049 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:02.973006 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:03.456755 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:03.456680 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:03.665269 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:03.665240 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:03.765849 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:03.765817 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:03.877755 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:03.877725 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:05.314095 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.311085 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:49:05.314599 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.314579 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 10:49:05.323477 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.323448 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9700e2f-eb72-46e7-ba4d-667b3c5942fc-metrics-certs\") pod \"network-metrics-daemon-z4hz6\" (UID: \"e9700e2f-eb72-46e7-ba4d-667b3c5942fc\") " pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:49:05.376311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.376286 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2zzjw\"" Jul 15 10:49:05.385146 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.385124 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z4hz6" Jul 15 10:49:05.412078 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.412054 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gpw\" (UniqueName: \"kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw\") pod \"network-check-target-dfkgs\" (UID: \"fcd79b31-387f-42f5-b3d7-23d4d010bb01\") " pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:49:05.412195 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.412092 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:49:05.414385 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.414359 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 10:49:05.414546 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.414528 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42gpw\" (UniqueName: \"kubernetes.io/projected/fcd79b31-387f-42f5-b3d7-23d4d010bb01-kube-api-access-42gpw\") pod \"network-check-target-dfkgs\" (UID: \"fcd79b31-387f-42f5-b3d7-23d4d010bb01\") " pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:49:05.425180 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.425158 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4937210a-24fb-45a5-b3b4-dd096d5eec3d-original-pull-secret\") pod \"global-pull-secret-syncer-n9zm5\" (UID: \"4937210a-24fb-45a5-b3b4-dd096d5eec3d\") " pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:49:05.507206 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.507179 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z4hz6"] Jul 15 10:49:05.510239 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:05.510208 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9700e2f_eb72_46e7_ba4d_667b3c5942fc.slice/crio-14eeb61a25f5f055b662794cc35cb2b282903c3a8acb9b96c3d9a1396c9aae00 WatchSource:0}: Error finding container 14eeb61a25f5f055b662794cc35cb2b282903c3a8acb9b96c3d9a1396c9aae00: Status 404 returned error can't find the container with id 14eeb61a25f5f055b662794cc35cb2b282903c3a8acb9b96c3d9a1396c9aae00 Jul 15 10:49:05.670893 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.670827 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kvp4d\"" Jul 15 10:49:05.678868 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.678847 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:49:05.678967 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.678853 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n9zm5" Jul 15 10:49:05.824199 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.824173 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n9zm5"] Jul 15 10:49:05.826936 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:05.826915 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4937210a_24fb_45a5_b3b4_dd096d5eec3d.slice/crio-7ad8cf75d988ee19e3293470312465b772fd73b70a99666f5e992ea9bae625e5 WatchSource:0}: Error finding container 7ad8cf75d988ee19e3293470312465b772fd73b70a99666f5e992ea9bae625e5: Status 404 returned error can't find the container with id 7ad8cf75d988ee19e3293470312465b772fd73b70a99666f5e992ea9bae625e5 Jul 15 10:49:05.840046 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.840021 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dfkgs"] Jul 15 10:49:05.842865 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:05.842844 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd79b31_387f_42f5_b3d7_23d4d010bb01.slice/crio-0a6889a3676821e7ed723f56b81c91ed94fa9892400844db725212b20840346c WatchSource:0}: Error finding container 0a6889a3676821e7ed723f56b81c91ed94fa9892400844db725212b20840346c: Status 404 returned error can't find the container with id 0a6889a3676821e7ed723f56b81c91ed94fa9892400844db725212b20840346c Jul 15 10:49:05.903255 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.903224 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n9zm5" event={"ID":"4937210a-24fb-45a5-b3b4-dd096d5eec3d","Type":"ContainerStarted","Data":"7ad8cf75d988ee19e3293470312465b772fd73b70a99666f5e992ea9bae625e5"} Jul 15 10:49:05.904311 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.904288 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z4hz6" event={"ID":"e9700e2f-eb72-46e7-ba4d-667b3c5942fc","Type":"ContainerStarted","Data":"14eeb61a25f5f055b662794cc35cb2b282903c3a8acb9b96c3d9a1396c9aae00"} Jul 15 10:49:05.905752 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.905731 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dfkgs" event={"ID":"fcd79b31-387f-42f5-b3d7-23d4d010bb01","Type":"ContainerStarted","Data":"caba6e4097089cbed11b516a8562cca8474ea5c2fd2193f3a1ce7755701cd3b2"} Jul 15 10:49:05.905835 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.905773 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dfkgs" event={"ID":"fcd79b31-387f-42f5-b3d7-23d4d010bb01","Type":"ContainerStarted","Data":"0a6889a3676821e7ed723f56b81c91ed94fa9892400844db725212b20840346c"} Jul 15 10:49:05.905873 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.905838 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:49:05.920838 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:05.920792 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dfkgs" podStartSLOduration=65.920779303 podStartE2EDuration="1m5.920779303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:05.919899042 +0000 UTC m=+66.887216846" watchObservedRunningTime="2026-07-15 10:49:05.920779303 +0000 UTC m=+66.888097134" Jul 15 10:49:06.912601 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:06.912558 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z4hz6" event={"ID":"e9700e2f-eb72-46e7-ba4d-667b3c5942fc","Type":"ContainerStarted","Data":"f4b3026ae5db1bf185d77815c7766238ffb4d14d0874a24d2c0bd4abc9ca1a61"} Jul 15 10:49:07.267384 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:07.267344 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" podUID="391b6617-0f45-4c4b-be87-8cb4cec30d8a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 15 10:49:07.732051 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:07.732020 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:49:07.734617 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:07.734591 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") pod \"image-registry-79bdf6d5f4-d9nmz\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:49:07.832688 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:07.832652 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:49:07.835209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:07.835186 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/742e4915-dbfa-4d56-9d88-9cac05b2d551-metrics-tls\") pod \"dns-default-w8vqp\" (UID: \"742e4915-dbfa-4d56-9d88-9cac05b2d551\") " pod="openshift-dns/dns-default-w8vqp" Jul 15 10:49:07.918298 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:07.918259 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z4hz6" event={"ID":"e9700e2f-eb72-46e7-ba4d-667b3c5942fc","Type":"ContainerStarted","Data":"77005fa79515534d18c51732a08d58fbe093a59c85fa4dc53e36f9eab342e217"} Jul 15 10:49:07.934091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:07.934035 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z4hz6" podStartSLOduration=66.810388573 podStartE2EDuration="1m7.934015274s" totalImagesPullingTime="1.123626701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:07.933306565 +0000 UTC m=+68.900624438" watchObservedRunningTime="2026-07-15 10:49:07.934015274 +0000 UTC m=+68.901333079" Jul 15 10:49:08.018029 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:08.017956 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lqsk4\"" Jul 15 10:49:08.026238 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:08.026214 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:49:08.034877 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:08.034817 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gq7lc\"" Jul 15 10:49:08.043137 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:08.043112 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w8vqp" Jul 15 10:49:08.192135 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:08.192112 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79bdf6d5f4-d9nmz"] Jul 15 10:49:08.195065 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:08.195031 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604d9ac0_123f_439a_aaa1_126a4ee7183c.slice/crio-110dbda1e6c5391e6448d42fd77a0d48c5c7c1084e5207985211b75bbc27865e WatchSource:0}: Error finding container 110dbda1e6c5391e6448d42fd77a0d48c5c7c1084e5207985211b75bbc27865e: Status 404 returned error can't find the container with id 110dbda1e6c5391e6448d42fd77a0d48c5c7c1084e5207985211b75bbc27865e Jul 15 10:49:08.214710 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:08.214660 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w8vqp"] Jul 15 10:49:08.219833 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:08.219805 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742e4915_dbfa_4d56_9d88_9cac05b2d551.slice/crio-e17ab1487a1088028e29c42531ca036272544837492d69d44ad5aa959928a7e8 WatchSource:0}: Error finding container e17ab1487a1088028e29c42531ca036272544837492d69d44ad5aa959928a7e8: Status 404 returned error can't find the container with id e17ab1487a1088028e29c42531ca036272544837492d69d44ad5aa959928a7e8 Jul 15 10:49:08.923373 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:08.923338 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w8vqp" event={"ID":"742e4915-dbfa-4d56-9d88-9cac05b2d551","Type":"ContainerStarted","Data":"e17ab1487a1088028e29c42531ca036272544837492d69d44ad5aa959928a7e8"} Jul 15 10:49:08.925085 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:08.925058 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" event={"ID":"604d9ac0-123f-439a-aaa1-126a4ee7183c","Type":"ContainerStarted","Data":"7e9b9633b05f186ff097cb815d2d707463c5663fc95252df6ebb957e24e538da"} Jul 15 10:49:08.925233 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:08.925104 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" event={"ID":"604d9ac0-123f-439a-aaa1-126a4ee7183c","Type":"ContainerStarted","Data":"110dbda1e6c5391e6448d42fd77a0d48c5c7c1084e5207985211b75bbc27865e"} Jul 15 10:49:08.925322 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:08.925299 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:49:10.892381 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.892313 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" podStartSLOduration=70.89229672 podStartE2EDuration="1m10.89229672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:08.95382847 +0000 UTC m=+69.921146294" watchObservedRunningTime="2026-07-15 10:49:10.89229672 +0000 UTC m=+71.859614522" Jul 15 10:49:10.892864 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.892837 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-4lwd5"] Jul 15 10:49:10.907259 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.907234 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-jhfrt"] Jul 15 10:49:10.907420 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.907406 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:10.909852 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.909829 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 10:49:10.910005 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.909984 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 10:49:10.910005 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.909999 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 10:49:10.910723 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.910706 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-48z2x\"" Jul 15 10:49:10.910815 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.910746 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 10:49:10.915948 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.915923 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 10:49:10.921372 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.921351 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-4lwd5"] Jul 15 10:49:10.921488 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.921391 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-jhfrt"] Jul 15 10:49:10.921488 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.921409 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" Jul 15 10:49:10.923745 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.923729 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 10:49:10.924420 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.924240 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 10:49:10.924420 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.924339 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-49jkw\"" Jul 15 10:49:10.934462 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.934437 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n9zm5" event={"ID":"4937210a-24fb-45a5-b3b4-dd096d5eec3d","Type":"ContainerStarted","Data":"b0725a35d91a73bb92e6e054af95ef2ca84f53a9eb12899b22c1aa02782f1906"} Jul 15 10:49:10.968475 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.968446 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:10.978612 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.978568 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n9zm5" podStartSLOduration=66.66062833 podStartE2EDuration="1m10.978553597s" totalImagesPullingTime="4.317925267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:10.976493794 +0000 UTC m=+71.943811596" watchObservedRunningTime="2026-07-15 10:49:10.978553597 +0000 UTC m=+71.945871375" Jul 15 10:49:10.996144 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:10.996107 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws"] Jul 15 10:49:11.011857 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.011819 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-6lkhx"] Jul 15 10:49:11.012020 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.011957 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.015469 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.015136 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 10:49:11.015469 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.015266 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-v8zvz\"" Jul 15 10:49:11.016465 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.016444 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 10:49:11.016585 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.016504 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 10:49:11.016763 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.016746 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 10:49:11.027817 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.027796 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws"] Jul 15 10:49:11.027926 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.027827 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-6lkhx"] Jul 15 10:49:11.027926 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.027903 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-6lkhx" Jul 15 10:49:11.032732 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.032712 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 10:49:11.033246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.033220 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9h5jg\"" Jul 15 10:49:11.035113 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.035072 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 10:49:11.039740 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.039717 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75b95db498-7ftm6"] Jul 15 10:49:11.055999 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.055977 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.061891 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.061865 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9703a2d9-e2b3-453f-9dd5-795d429a21a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jhfrt\" (UID: \"9703a2d9-e2b3-453f-9dd5-795d429a21a5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" Jul 15 10:49:11.062066 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.061913 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a77fdc9-59c2-4ebf-879b-cfe375881b24-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.062066 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.061942 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a77fdc9-59c2-4ebf-879b-cfe375881b24-serving-cert\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.062352 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062090 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a77fdc9-59c2-4ebf-879b-cfe375881b24-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.062352 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062130 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a77fdc9-59c2-4ebf-879b-cfe375881b24-tmp\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.062352 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062171 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0a77fdc9-59c2-4ebf-879b-cfe375881b24-snapshots\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.062352 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062198 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhwb9\" (UniqueName: \"kubernetes.io/projected/0a77fdc9-59c2-4ebf-879b-cfe375881b24-kube-api-access-nhwb9\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.062352 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062232 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 10:49:11.062648 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062520 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 10:49:11.062648 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062235 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9703a2d9-e2b3-453f-9dd5-795d429a21a5-nginx-conf\") pod \"networking-console-plugin-6cf856758c-jhfrt\" (UID: \"9703a2d9-e2b3-453f-9dd5-795d429a21a5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" Jul 15 10:49:11.062648 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062641 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 10:49:11.062772 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062721 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 10:49:11.062862 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062722 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 10:49:11.062862 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062815 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 10:49:11.062862 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.062766 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nv4cd\"" Jul 15 10:49:11.084180 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.084147 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75b95db498-7ftm6"] Jul 15 10:49:11.102089 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.102062 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:11.163710 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163632 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a77fdc9-59c2-4ebf-879b-cfe375881b24-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.163710 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163682 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a77fdc9-59c2-4ebf-879b-cfe375881b24-serving-cert\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.163922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163722 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a77fdc9-59c2-4ebf-879b-cfe375881b24-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.163922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163748 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a77fdc9-59c2-4ebf-879b-cfe375881b24-tmp\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.163922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163790 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/641ced34-704d-4252-ad95-9400b513397e-stats-auth\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.163922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163817 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0a77fdc9-59c2-4ebf-879b-cfe375881b24-snapshots\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.163922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163844 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhwb9\" (UniqueName: \"kubernetes.io/projected/0a77fdc9-59c2-4ebf-879b-cfe375881b24-kube-api-access-nhwb9\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.163922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163870 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/641ced34-704d-4252-ad95-9400b513397e-default-certificate\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.163922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163892 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9703a2d9-e2b3-453f-9dd5-795d429a21a5-nginx-conf\") pod \"networking-console-plugin-6cf856758c-jhfrt\" (UID: \"9703a2d9-e2b3-453f-9dd5-795d429a21a5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" Jul 15 10:49:11.163922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163909 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfq8d\" (UniqueName: \"kubernetes.io/projected/641ced34-704d-4252-ad95-9400b513397e-kube-api-access-hfq8d\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.164284 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163948 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqnxc\" (UniqueName: \"kubernetes.io/projected/ec52f8cc-5de4-4328-9b9d-a2eb26e599a1-kube-api-access-xqnxc\") pod \"cluster-monitoring-operator-5f7f494dd4-4zbws\" (UID: \"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.164284 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163980 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec52f8cc-5de4-4328-9b9d-a2eb26e599a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4zbws\" (UID: \"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.164284 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.163998 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/641ced34-704d-4252-ad95-9400b513397e-metrics-certs\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.164284 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.164018 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/641ced34-704d-4252-ad95-9400b513397e-service-ca-bundle\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.164284 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.164048 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zng7d\" (UniqueName: \"kubernetes.io/projected/faee1bc3-08a2-4cac-a984-dfa5a8737f16-kube-api-access-zng7d\") pod \"downloads-68c9cbb497-6lkhx\" (UID: \"faee1bc3-08a2-4cac-a984-dfa5a8737f16\") " pod="openshift-console/downloads-68c9cbb497-6lkhx" Jul 15 10:49:11.164284 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.164069 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ec52f8cc-5de4-4328-9b9d-a2eb26e599a1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4zbws\" (UID: \"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.164284 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.164096 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9703a2d9-e2b3-453f-9dd5-795d429a21a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jhfrt\" (UID: \"9703a2d9-e2b3-453f-9dd5-795d429a21a5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" Jul 15 10:49:11.164647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.164517 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a77fdc9-59c2-4ebf-879b-cfe375881b24-tmp\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.164647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.164557 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a77fdc9-59c2-4ebf-879b-cfe375881b24-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.164647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.164592 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a77fdc9-59c2-4ebf-879b-cfe375881b24-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.165063 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.165027 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0a77fdc9-59c2-4ebf-879b-cfe375881b24-snapshots\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.165193 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.165112 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9703a2d9-e2b3-453f-9dd5-795d429a21a5-nginx-conf\") pod \"networking-console-plugin-6cf856758c-jhfrt\" (UID: \"9703a2d9-e2b3-453f-9dd5-795d429a21a5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" Jul 15 10:49:11.167267 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.167241 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9703a2d9-e2b3-453f-9dd5-795d429a21a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jhfrt\" (UID: \"9703a2d9-e2b3-453f-9dd5-795d429a21a5\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" Jul 15 10:49:11.167390 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.167267 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0a77fdc9-59c2-4ebf-879b-cfe375881b24-serving-cert\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.172398 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.172371 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhwb9\" (UniqueName: \"kubernetes.io/projected/0a77fdc9-59c2-4ebf-879b-cfe375881b24-kube-api-access-nhwb9\") pod \"insights-operator-68d9dd94cf-4lwd5\" (UID: \"0a77fdc9-59c2-4ebf-879b-cfe375881b24\") " pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.186342 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.186306 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:11.220297 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.220267 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" Jul 15 10:49:11.231529 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.231503 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" Jul 15 10:49:11.264902 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.264873 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/641ced34-704d-4252-ad95-9400b513397e-stats-auth\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.265062 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.264921 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/641ced34-704d-4252-ad95-9400b513397e-default-certificate\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.265062 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.264947 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfq8d\" (UniqueName: \"kubernetes.io/projected/641ced34-704d-4252-ad95-9400b513397e-kube-api-access-hfq8d\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.265296 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.265268 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqnxc\" (UniqueName: \"kubernetes.io/projected/ec52f8cc-5de4-4328-9b9d-a2eb26e599a1-kube-api-access-xqnxc\") pod \"cluster-monitoring-operator-5f7f494dd4-4zbws\" (UID: \"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.265453 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.265322 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec52f8cc-5de4-4328-9b9d-a2eb26e599a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4zbws\" (UID: \"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.265453 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.265381 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/641ced34-704d-4252-ad95-9400b513397e-metrics-certs\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.265453 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.265412 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/641ced34-704d-4252-ad95-9400b513397e-service-ca-bundle\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.265619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.265465 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zng7d\" (UniqueName: \"kubernetes.io/projected/faee1bc3-08a2-4cac-a984-dfa5a8737f16-kube-api-access-zng7d\") pod \"downloads-68c9cbb497-6lkhx\" (UID: \"faee1bc3-08a2-4cac-a984-dfa5a8737f16\") " pod="openshift-console/downloads-68c9cbb497-6lkhx" Jul 15 10:49:11.265619 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.265496 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ec52f8cc-5de4-4328-9b9d-a2eb26e599a1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4zbws\" (UID: \"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.266416 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.266378 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/641ced34-704d-4252-ad95-9400b513397e-service-ca-bundle\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.266589 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.266543 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ec52f8cc-5de4-4328-9b9d-a2eb26e599a1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4zbws\" (UID: \"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.268034 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.267966 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/641ced34-704d-4252-ad95-9400b513397e-default-certificate\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.268401 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.268365 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/641ced34-704d-4252-ad95-9400b513397e-stats-auth\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.268624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.268606 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec52f8cc-5de4-4328-9b9d-a2eb26e599a1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4zbws\" (UID: \"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.268692 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.268641 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/641ced34-704d-4252-ad95-9400b513397e-metrics-certs\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.274775 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.274724 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqnxc\" (UniqueName: \"kubernetes.io/projected/ec52f8cc-5de4-4328-9b9d-a2eb26e599a1-kube-api-access-xqnxc\") pod \"cluster-monitoring-operator-5f7f494dd4-4zbws\" (UID: \"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.275150 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.275132 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfq8d\" (UniqueName: \"kubernetes.io/projected/641ced34-704d-4252-ad95-9400b513397e-kube-api-access-hfq8d\") pod \"router-default-75b95db498-7ftm6\" (UID: \"641ced34-704d-4252-ad95-9400b513397e\") " pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.277826 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.277793 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zng7d\" (UniqueName: \"kubernetes.io/projected/faee1bc3-08a2-4cac-a984-dfa5a8737f16-kube-api-access-zng7d\") pod \"downloads-68c9cbb497-6lkhx\" (UID: \"faee1bc3-08a2-4cac-a984-dfa5a8737f16\") " pod="openshift-console/downloads-68c9cbb497-6lkhx" Jul 15 10:49:11.324648 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.324618 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" Jul 15 10:49:11.337267 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.337233 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-6lkhx" Jul 15 10:49:11.366625 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.366595 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:11.583746 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.583669 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:11.657860 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.657831 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75b95db498-7ftm6"] Jul 15 10:49:11.661678 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:11.661648 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641ced34_704d_4252_ad95_9400b513397e.slice/crio-3e8dc24233f3994664639d5065c0b4dfc6db2b4d2751100c9ea3db25a3d7565a WatchSource:0}: Error finding container 3e8dc24233f3994664639d5065c0b4dfc6db2b4d2751100c9ea3db25a3d7565a: Status 404 returned error can't find the container with id 3e8dc24233f3994664639d5065c0b4dfc6db2b4d2751100c9ea3db25a3d7565a Jul 15 10:49:11.662176 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.662149 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:11.709167 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.709143 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws"] Jul 15 10:49:11.857114 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:11.857032 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec52f8cc_5de4_4328_9b9d_a2eb26e599a1.slice/crio-e961ffbdf1db832756f68c0705031c4d6ff19b798c39bf4123d27e985d11be43 WatchSource:0}: Error finding container e961ffbdf1db832756f68c0705031c4d6ff19b798c39bf4123d27e985d11be43: Status 404 returned error can't find the container with id e961ffbdf1db832756f68c0705031c4d6ff19b798c39bf4123d27e985d11be43 Jul 15 10:49:11.872734 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.872616 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-jhfrt"] Jul 15 10:49:11.874538 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:11.874513 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9703a2d9_e2b3_453f_9dd5_795d429a21a5.slice/crio-c0cefb240f4cf4268c4721aa33e40f7d3ed829d5948f0b16881205d499a29460 WatchSource:0}: Error finding container c0cefb240f4cf4268c4721aa33e40f7d3ed829d5948f0b16881205d499a29460: Status 404 returned error can't find the container with id c0cefb240f4cf4268c4721aa33e40f7d3ed829d5948f0b16881205d499a29460 Jul 15 10:49:11.878645 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.878397 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-4lwd5"] Jul 15 10:49:11.879693 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.879600 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-6lkhx"] Jul 15 10:49:11.881775 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:11.881750 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaee1bc3_08a2_4cac_a984_dfa5a8737f16.slice/crio-b23e42d02bf8173d164067c9943bc356b1895499f1af0ffa3df7c19d5f6d0810 WatchSource:0}: Error finding container b23e42d02bf8173d164067c9943bc356b1895499f1af0ffa3df7c19d5f6d0810: Status 404 returned error can't find the container with id b23e42d02bf8173d164067c9943bc356b1895499f1af0ffa3df7c19d5f6d0810 Jul 15 10:49:11.882505 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:11.882393 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a77fdc9_59c2_4ebf_879b_cfe375881b24.slice/crio-72d118b1a45ac51e27410517e148620934858816dafcd41258e6dcf987a682df WatchSource:0}: Error finding container 72d118b1a45ac51e27410517e148620934858816dafcd41258e6dcf987a682df: Status 404 returned error can't find the container with id 72d118b1a45ac51e27410517e148620934858816dafcd41258e6dcf987a682df Jul 15 10:49:11.940906 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.940878 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" event={"ID":"0a77fdc9-59c2-4ebf-879b-cfe375881b24","Type":"ContainerStarted","Data":"72d118b1a45ac51e27410517e148620934858816dafcd41258e6dcf987a682df"} Jul 15 10:49:11.942242 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.942218 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" event={"ID":"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1","Type":"ContainerStarted","Data":"e961ffbdf1db832756f68c0705031c4d6ff19b798c39bf4123d27e985d11be43"} Jul 15 10:49:11.943370 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.943352 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75b95db498-7ftm6" event={"ID":"641ced34-704d-4252-ad95-9400b513397e","Type":"ContainerStarted","Data":"3e8dc24233f3994664639d5065c0b4dfc6db2b4d2751100c9ea3db25a3d7565a"} Jul 15 10:49:11.944651 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.944632 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" event={"ID":"9703a2d9-e2b3-453f-9dd5-795d429a21a5","Type":"ContainerStarted","Data":"c0cefb240f4cf4268c4721aa33e40f7d3ed829d5948f0b16881205d499a29460"} Jul 15 10:49:11.945714 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:11.945695 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-6lkhx" event={"ID":"faee1bc3-08a2-4cac-a984-dfa5a8737f16","Type":"ContainerStarted","Data":"b23e42d02bf8173d164067c9943bc356b1895499f1af0ffa3df7c19d5f6d0810"} Jul 15 10:49:12.953776 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:12.953222 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w8vqp" event={"ID":"742e4915-dbfa-4d56-9d88-9cac05b2d551","Type":"ContainerStarted","Data":"71ae24a5e988bcdf5c9da6b00c0c599613b121080788c13e89d495bbc08015e6"} Jul 15 10:49:12.953776 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:12.953287 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w8vqp" event={"ID":"742e4915-dbfa-4d56-9d88-9cac05b2d551","Type":"ContainerStarted","Data":"413148f060044bbfabcc12cef4cc9c315b6242591f9cb0c0eeab07a472e4acd2"} Jul 15 10:49:12.953776 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:12.953566 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w8vqp" Jul 15 10:49:12.964230 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:12.963206 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75b95db498-7ftm6" event={"ID":"641ced34-704d-4252-ad95-9400b513397e","Type":"ContainerStarted","Data":"3ffb420d0ac18607be0bb19eaaa887ea4a90b513c9f9fe1340e47308369d4c88"} Jul 15 10:49:12.978715 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:12.978664 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w8vqp" podStartSLOduration=34.315441562 podStartE2EDuration="37.97864765s" totalImagesPullingTime="3.663206088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:12.975775861 +0000 UTC m=+73.943093690" watchObservedRunningTime="2026-07-15 10:49:12.97864765 +0000 UTC m=+73.945965451" Jul 15 10:49:12.993124 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:12.993055 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75b95db498-7ftm6" podStartSLOduration=2.993026661 podStartE2EDuration="2.993026661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:12.99277213 +0000 UTC m=+73.960089963" watchObservedRunningTime="2026-07-15 10:49:12.993026661 +0000 UTC m=+73.960344468" Jul 15 10:49:13.143387 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:13.143281 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:13.204591 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:13.204435 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:13.354654 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:13.354585 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:13.367584 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:13.367495 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:13.370835 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:13.370629 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:13.414735 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:13.414651 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:13.969550 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:13.969487 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:13.970100 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:13.970081 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75b95db498-7ftm6" Jul 15 10:49:14.685960 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.685921 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:14.753823 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.753757 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:14.884159 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.884117 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54c44868b-tknzv"] Jul 15 10:49:14.886624 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.886600 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:14.890315 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.889986 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 10:49:14.890315 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.889993 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wsphm\"" Jul 15 10:49:14.890315 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.890064 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 10:49:14.890315 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.890081 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 10:49:14.890315 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.889993 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 10:49:14.890315 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.890224 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 10:49:14.897969 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:14.897943 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c44868b-tknzv"] Jul 15 10:49:15.003145 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.003089 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-config\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.003145 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.003147 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-service-ca\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.003701 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.003173 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkz5p\" (UniqueName: \"kubernetes.io/projected/58f817a9-604f-4938-a5a4-d57bf8d485c5-kube-api-access-rkz5p\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.003701 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.003209 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-oauth-serving-cert\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.003701 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.003249 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-serving-cert\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.003701 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.003273 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-oauth-config\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.104410 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.104374 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-config\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.104582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.104458 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-service-ca\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.104582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.104486 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkz5p\" (UniqueName: \"kubernetes.io/projected/58f817a9-604f-4938-a5a4-d57bf8d485c5-kube-api-access-rkz5p\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.104582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.104522 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-oauth-serving-cert\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.104751 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.104615 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-serving-cert\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.104751 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.104681 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-oauth-config\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.105271 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.105244 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-config\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.105459 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.105436 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-oauth-serving-cert\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.105565 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.105532 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-service-ca\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.107612 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.107587 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-oauth-config\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.107721 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.107670 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-serving-cert\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.113997 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.113967 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkz5p\" (UniqueName: \"kubernetes.io/projected/58f817a9-604f-4938-a5a4-d57bf8d485c5-kube-api-access-rkz5p\") pod \"console-54c44868b-tknzv\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.200379 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.200352 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:15.379775 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.379733 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c44868b-tknzv"] Jul 15 10:49:15.384751 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:15.384710 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f817a9_604f_4938_a5a4_d57bf8d485c5.slice/crio-9377c3d898a239ba975d3c07747b986ff3fb57b9e26b7c44b001b1105cf8af05 WatchSource:0}: Error finding container 9377c3d898a239ba975d3c07747b986ff3fb57b9e26b7c44b001b1105cf8af05: Status 404 returned error can't find the container with id 9377c3d898a239ba975d3c07747b986ff3fb57b9e26b7c44b001b1105cf8af05 Jul 15 10:49:15.503119 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.503067 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:15.672471 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.672375 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:15.676239 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.676211 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2"] Jul 15 10:49:15.679395 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.679363 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2" Jul 15 10:49:15.681996 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.681963 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 15 10:49:15.682121 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.682066 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xkh5l\"" Jul 15 10:49:15.691837 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.691806 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2"] Jul 15 10:49:15.794045 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.793995 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:15.811347 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.811294 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6745c10e-ed37-402d-8bcc-4e281da981fa-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-94lr2\" (UID: \"6745c10e-ed37-402d-8bcc-4e281da981fa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2" Jul 15 10:49:15.912468 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.912372 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6745c10e-ed37-402d-8bcc-4e281da981fa-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-94lr2\" (UID: \"6745c10e-ed37-402d-8bcc-4e281da981fa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2" Jul 15 10:49:15.915318 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.915288 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6745c10e-ed37-402d-8bcc-4e281da981fa-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-94lr2\" (UID: \"6745c10e-ed37-402d-8bcc-4e281da981fa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2" Jul 15 10:49:15.980758 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.980720 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" event={"ID":"0a77fdc9-59c2-4ebf-879b-cfe375881b24","Type":"ContainerStarted","Data":"8e7dcc1d3096b58b26c4413ddf1714c7b8316a9b3edf52bed9257a1bfaeb182a"} Jul 15 10:49:15.984780 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.984220 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" event={"ID":"ec52f8cc-5de4-4328-9b9d-a2eb26e599a1","Type":"ContainerStarted","Data":"515478815fd9358fbfc0e201c0e6629d7103a43fbed9b1837f6b15ced9d440f8"} Jul 15 10:49:15.987792 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.987745 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c44868b-tknzv" event={"ID":"58f817a9-604f-4938-a5a4-d57bf8d485c5","Type":"ContainerStarted","Data":"9377c3d898a239ba975d3c07747b986ff3fb57b9e26b7c44b001b1105cf8af05"} Jul 15 10:49:15.990078 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.990046 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" event={"ID":"9703a2d9-e2b3-453f-9dd5-795d429a21a5","Type":"ContainerStarted","Data":"fd9c2a582578d2c65193ce1e6f2a94e8de7ae044dab2939f55eee2e72921a036"} Jul 15 10:49:15.992376 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:15.992358 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2" Jul 15 10:49:16.001878 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.001826 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-4lwd5" podStartSLOduration=2.768415664 podStartE2EDuration="6.001804594s" totalImagesPullingTime="3.23338893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:15.999908745 +0000 UTC m=+76.967226549" watchObservedRunningTime="2026-07-15 10:49:16.001804594 +0000 UTC m=+76.969122396" Jul 15 10:49:16.019094 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.018601 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-jhfrt" podStartSLOduration=2.788553518 podStartE2EDuration="6.018577946s" totalImagesPullingTime="3.230024428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:16.016712519 +0000 UTC m=+76.984030344" watchObservedRunningTime="2026-07-15 10:49:16.018577946 +0000 UTC m=+76.985895747" Jul 15 10:49:16.047707 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.046396 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4zbws" podStartSLOduration=2.807325702 podStartE2EDuration="6.04637666s" totalImagesPullingTime="3.239050958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:16.04578059 +0000 UTC m=+77.013098392" watchObservedRunningTime="2026-07-15 10:49:16.04637666 +0000 UTC m=+77.013694465" Jul 15 10:49:16.165697 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.165129 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2"] Jul 15 10:49:16.168186 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:16.168147 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6745c10e_ed37_402d_8bcc_4e281da981fa.slice/crio-af21611f84cfe13708dc726a9fd8929b67543493cba1d42ca77bde7a78e46d90 WatchSource:0}: Error finding container af21611f84cfe13708dc726a9fd8929b67543493cba1d42ca77bde7a78e46d90: Status 404 returned error can't find the container with id af21611f84cfe13708dc726a9fd8929b67543493cba1d42ca77bde7a78e46d90 Jul 15 10:49:16.210085 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.209951 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:16.278001 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.277866 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:16.389029 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.388898 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:16.410579 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.409929 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7q8sl"] Jul 15 10:49:16.414079 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.412825 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.416072 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.415855 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 10:49:16.416800 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.416607 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 10:49:16.418010 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.417996 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sk44r\"" Jul 15 10:49:16.424353 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.423975 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7q8sl"] Jul 15 10:49:16.481725 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.481690 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:16.519011 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.518978 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-crio-socket\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.519011 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.519023 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-data-volume\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.519247 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.519060 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbc8q\" (UniqueName: \"kubernetes.io/projected/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-api-access-kbc8q\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.519247 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.519128 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.519247 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.519162 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.619786 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.619690 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.619786 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.619742 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.619961 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.619804 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-crio-socket\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.619961 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.619828 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-data-volume\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.619961 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.619859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbc8q\" (UniqueName: \"kubernetes.io/projected/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-api-access-kbc8q\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.620539 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:16.620264 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 10:49:16.620539 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:16.620363 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 10:49:16.620539 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.620374 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-crio-socket\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.620539 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:16.620374 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls podName:df7755ca-33a0-48dc-884c-0b57ccdb3ca7 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:17.120319556 +0000 UTC m=+78.087637352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7q8sl" (UID: "df7755ca-33a0-48dc-884c-0b57ccdb3ca7") : secret "insights-runtime-extractor-tls" not found Jul 15 10:49:16.620539 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:16.620450 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm podName:df7755ca-33a0-48dc-884c-0b57ccdb3ca7 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:17.12042952 +0000 UTC m=+78.087747300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7q8sl" (UID: "df7755ca-33a0-48dc-884c-0b57ccdb3ca7") : configmap "kube-rbac-proxy" not found Jul 15 10:49:16.620869 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.620548 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-data-volume\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.639780 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.639746 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbc8q\" (UniqueName: \"kubernetes.io/projected/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-api-access-kbc8q\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:16.720457 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.720417 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:16.824600 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.824505 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:16.877006 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.876810 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:16.997143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:16.997108 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2" event={"ID":"6745c10e-ed37-402d-8bcc-4e281da981fa","Type":"ContainerStarted","Data":"af21611f84cfe13708dc726a9fd8929b67543493cba1d42ca77bde7a78e46d90"} Jul 15 10:49:17.124016 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:17.123975 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:17.124485 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:17.124024 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:17.124751 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:17.124726 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 10:49:17.124857 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:17.124799 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls podName:df7755ca-33a0-48dc-884c-0b57ccdb3ca7 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:18.124779543 +0000 UTC m=+79.092097328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7q8sl" (UID: "df7755ca-33a0-48dc-884c-0b57ccdb3ca7") : secret "insights-runtime-extractor-tls" not found Jul 15 10:49:17.124967 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:17.124726 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 10:49:17.125582 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:17.125194 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm podName:df7755ca-33a0-48dc-884c-0b57ccdb3ca7 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:18.125176364 +0000 UTC m=+79.092494146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7q8sl" (UID: "df7755ca-33a0-48dc-884c-0b57ccdb3ca7") : configmap "kube-rbac-proxy" not found Jul 15 10:49:17.266680 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:17.266644 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" podUID="391b6617-0f45-4c4b-be87-8cb4cec30d8a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 15 10:49:17.266848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:17.266718 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" Jul 15 10:49:17.267611 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:17.267360 2553 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"8b11e9bfba847601f520043a7d06012e73fc7b4126294f0a1094c2ef1ae009b1"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 15 10:49:17.267611 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:17.267424 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" podUID="391b6617-0f45-4c4b-be87-8cb4cec30d8a" containerName="service-proxy" containerID="cri-o://8b11e9bfba847601f520043a7d06012e73fc7b4126294f0a1094c2ef1ae009b1" gracePeriod=30 Jul 15 10:49:18.006009 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.005973 2553 generic.go:356] "Generic (PLEG): container finished" podID="391b6617-0f45-4c4b-be87-8cb4cec30d8a" containerID="8b11e9bfba847601f520043a7d06012e73fc7b4126294f0a1094c2ef1ae009b1" exitCode=2 Jul 15 10:49:18.006157 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.006034 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" event={"ID":"391b6617-0f45-4c4b-be87-8cb4cec30d8a","Type":"ContainerDied","Data":"8b11e9bfba847601f520043a7d06012e73fc7b4126294f0a1094c2ef1ae009b1"} Jul 15 10:49:18.006157 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.006082 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d47f49d87-ckgdq" event={"ID":"391b6617-0f45-4c4b-be87-8cb4cec30d8a","Type":"ContainerStarted","Data":"0cb2dbada464b06a88fca8482035a8786d1ee21069acdc947569d50fb122d550"} Jul 15 10:49:18.008015 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.007982 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2" event={"ID":"6745c10e-ed37-402d-8bcc-4e281da981fa","Type":"ContainerStarted","Data":"bef0ebf035aa16f353788da928552f718d33a3753817aa908c0ce1add09caf0a"} Jul 15 10:49:18.008585 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.008528 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2" Jul 15 10:49:18.014626 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.014603 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2" Jul 15 10:49:18.043908 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.043810 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-94lr2" podStartSLOduration=1.860956279 podStartE2EDuration="3.043791641s" totalImagesPullingTime="1.182835362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:18.04349534 +0000 UTC m=+79.010813142" watchObservedRunningTime="2026-07-15 10:49:18.043791641 +0000 UTC m=+79.011109445" Jul 15 10:49:18.135675 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.134807 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:18.135675 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.134878 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:18.135675 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:18.135229 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 10:49:18.135675 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:18.135264 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 10:49:18.135675 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:18.135287 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls podName:df7755ca-33a0-48dc-884c-0b57ccdb3ca7 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:20.135268022 +0000 UTC m=+81.102585801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7q8sl" (UID: "df7755ca-33a0-48dc-884c-0b57ccdb3ca7") : secret "insights-runtime-extractor-tls" not found Jul 15 10:49:18.135675 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:18.135305 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm podName:df7755ca-33a0-48dc-884c-0b57ccdb3ca7 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:20.135295657 +0000 UTC m=+81.102613443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7q8sl" (UID: "df7755ca-33a0-48dc-884c-0b57ccdb3ca7") : configmap "kube-rbac-proxy" not found Jul 15 10:49:18.201673 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.201641 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-jhfrt_9703a2d9-e2b3-453f-9dd5-795d429a21a5/networking-console-plugin/0.log" Jul 15 10:49:18.400872 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.400797 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 10:49:18.604682 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.604646 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/2.log" Jul 15 10:49:18.701011 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.700914 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:18.781273 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:18.781090 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:19.201087 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:19.201046 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w8vqp_742e4915-dbfa-4d56-9d88-9cac05b2d551/dns/0.log" Jul 15 10:49:19.401361 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:19.401259 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w8vqp_742e4915-dbfa-4d56-9d88-9cac05b2d551/kube-rbac-proxy/0.log" Jul 15 10:49:19.438366 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:19.438261 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:19.599779 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:19.599749 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9glqk_2bb78eef-9330-46a0-b932-5e69c17c5209/dns-node-resolver/0.log" Jul 15 10:49:20.023800 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:20.023766 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c44868b-tknzv" event={"ID":"58f817a9-604f-4938-a5a4-d57bf8d485c5","Type":"ContainerStarted","Data":"85879dd8a99134fffa319b663cddaee8ea6724b161e6853291a3c39e8d86260d"} Jul 15 10:49:20.040993 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:20.040936 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54c44868b-tknzv" podStartSLOduration=2.415290179 podStartE2EDuration="6.040916266s" totalImagesPullingTime="3.625626087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:20.039391636 +0000 UTC m=+81.006709455" watchObservedRunningTime="2026-07-15 10:49:20.040916266 +0000 UTC m=+81.008234068" Jul 15 10:49:20.153460 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:20.153421 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:20.153625 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:20.153475 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:20.153973 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:20.153949 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 10:49:20.154091 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:20.154019 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls podName:df7755ca-33a0-48dc-884c-0b57ccdb3ca7 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:24.154000916 +0000 UTC m=+85.121318695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7q8sl" (UID: "df7755ca-33a0-48dc-884c-0b57ccdb3ca7") : secret "insights-runtime-extractor-tls" not found Jul 15 10:49:20.154091 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:20.153949 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 10:49:20.154202 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:49:20.154136 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm podName:df7755ca-33a0-48dc-884c-0b57ccdb3ca7 nodeName:}" failed. No retries permitted until 2026-07-15 10:49:24.154113058 +0000 UTC m=+85.121430853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7q8sl" (UID: "df7755ca-33a0-48dc-884c-0b57ccdb3ca7") : configmap "kube-rbac-proxy" not found Jul 15 10:49:20.401269 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:20.401195 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79bdf6d5f4-d9nmz_604d9ac0-123f-439a-aaa1-126a4ee7183c/registry/0.log" Jul 15 10:49:20.799829 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:20.799798 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8hbsr_0d4bd1d2-8706-4238-a438-5bbe25fb41ab/node-ca/0.log" Jul 15 10:49:21.201272 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:21.201181 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75b95db498-7ftm6_641ced34-704d-4252-ad95-9400b513397e/router/0.log" Jul 15 10:49:21.481476 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:21.481398 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:21.533611 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:21.533501 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:21.600160 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:21.600127 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4jkb_cb750dcc-239b-4aec-9ea1-10d74ae15425/serve-healthcheck-canary/0.log" Jul 15 10:49:21.957082 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:21.956962 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:22.165784 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:22.165642 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:22.971509 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:22.971474 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w8vqp" Jul 15 10:49:24.191505 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:24.191472 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:24.191505 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:24.191511 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:24.192066 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:24.192048 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:24.194008 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:24.193981 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7755ca-33a0-48dc-884c-0b57ccdb3ca7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7q8sl\" (UID: \"df7755ca-33a0-48dc-884c-0b57ccdb3ca7\") " pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:24.228216 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:24.228188 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7q8sl" Jul 15 10:49:24.347119 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:24.347081 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:25.201560 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:25.201521 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:25.202025 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:25.201596 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:25.208655 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:25.208631 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:26.056093 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:26.056064 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:26.178403 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:26.178363 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:26.567050 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:26.567014 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:26.666848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:26.666806 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:26.880004 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:26.879887 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:27.055135 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.055065 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:27.122802 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.122136 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k9fdc"] Jul 15 10:49:27.154787 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.154705 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:27.160741 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.160149 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.163482 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.162843 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 10:49:27.163482 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.163098 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hdxmv\"" Jul 15 10:49:27.163482 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.163251 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 10:49:27.163482 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.163435 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 10:49:27.163745 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.163599 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 10:49:27.210779 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.210748 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c44868b-tknzv"] Jul 15 10:49:27.219625 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.219600 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.219817 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.219799 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-textfile\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.219998 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.219973 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4725afd7-21b0-4583-9a5b-baf54881e9ba-root\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.220235 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.220213 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-tls\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.220386 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.220371 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-wtmp\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.220572 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.220547 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.220730 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.220597 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4725afd7-21b0-4583-9a5b-baf54881e9ba-metrics-client-ca\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.220730 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.220637 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4725afd7-21b0-4583-9a5b-baf54881e9ba-sys\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.220730 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.220661 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdqgp\" (UniqueName: \"kubernetes.io/projected/4725afd7-21b0-4583-9a5b-baf54881e9ba-kube-api-access-wdqgp\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.241456 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.241424 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:27.302974 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.302938 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:27.321794 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.321766 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.321911 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.321816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4725afd7-21b0-4583-9a5b-baf54881e9ba-metrics-client-ca\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.321911 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.321854 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4725afd7-21b0-4583-9a5b-baf54881e9ba-sys\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.321911 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.321873 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdqgp\" (UniqueName: \"kubernetes.io/projected/4725afd7-21b0-4583-9a5b-baf54881e9ba-kube-api-access-wdqgp\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.321911 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.321906 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.322122 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.321937 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-textfile\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.322122 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.321960 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4725afd7-21b0-4583-9a5b-baf54881e9ba-sys\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.322122 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.321974 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4725afd7-21b0-4583-9a5b-baf54881e9ba-root\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.322122 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.322002 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4725afd7-21b0-4583-9a5b-baf54881e9ba-root\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.322122 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.322028 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-tls\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.322122 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.322063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-wtmp\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.322357 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.322225 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-wtmp\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.322466 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.322443 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.322896 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.322838 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4725afd7-21b0-4583-9a5b-baf54881e9ba-metrics-client-ca\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.322896 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.322838 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-textfile\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.325124 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.325086 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-tls\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.325124 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.325117 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4725afd7-21b0-4583-9a5b-baf54881e9ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.329887 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.329868 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdqgp\" (UniqueName: \"kubernetes.io/projected/4725afd7-21b0-4583-9a5b-baf54881e9ba-kube-api-access-wdqgp\") pod \"node-exporter-k9fdc\" (UID: \"4725afd7-21b0-4583-9a5b-baf54881e9ba\") " pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.402589 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.402559 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:27.475730 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.475696 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9fdc" Jul 15 10:49:27.503778 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.503751 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:27.642091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.642034 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:27.802939 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:27.802837 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:28.031823 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:28.031785 2553 patch_prober.go:28] interesting pod/image-registry-79bdf6d5f4-d9nmz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 10:49:28.031992 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:28.031848 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" podUID="604d9ac0-123f-439a-aaa1-126a4ee7183c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 10:49:28.078978 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:28.078883 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:28.200549 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:28.200453 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:28.300586 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:28.300485 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:28.400750 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:28.400662 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:28.458649 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:28.458550 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:29.386073 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:29.386040 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4725afd7_21b0_4583_9a5b_baf54881e9ba.slice/crio-a83d6538a70906e657c6cee905b53e724da5d55fd001d28bffa6618a71d75a2d WatchSource:0}: Error finding container a83d6538a70906e657c6cee905b53e724da5d55fd001d28bffa6618a71d75a2d: Status 404 returned error can't find the container with id a83d6538a70906e657c6cee905b53e724da5d55fd001d28bffa6618a71d75a2d Jul 15 10:49:29.501594 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:29.501566 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7q8sl"] Jul 15 10:49:29.503753 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:29.503728 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf7755ca_33a0_48dc_884c_0b57ccdb3ca7.slice/crio-fb3481768674bde8641cdde89b7354b8fdafc81e393c61a3952d6e637e0e3001 WatchSource:0}: Error finding container fb3481768674bde8641cdde89b7354b8fdafc81e393c61a3952d6e637e0e3001: Status 404 returned error can't find the container with id fb3481768674bde8641cdde89b7354b8fdafc81e393c61a3952d6e637e0e3001 Jul 15 10:49:29.579761 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:29.579721 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:29.934631 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:29.934606 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:49:30.025346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:30.025245 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:30.087345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:30.082157 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7q8sl" event={"ID":"df7755ca-33a0-48dc-884c-0b57ccdb3ca7","Type":"ContainerStarted","Data":"fb3481768674bde8641cdde89b7354b8fdafc81e393c61a3952d6e637e0e3001"} Jul 15 10:49:30.087345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:30.084864 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9fdc" event={"ID":"4725afd7-21b0-4583-9a5b-baf54881e9ba","Type":"ContainerStarted","Data":"a83d6538a70906e657c6cee905b53e724da5d55fd001d28bffa6618a71d75a2d"} Jul 15 10:49:30.350605 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:30.350471 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:30.417556 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:30.417490 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:30.616029 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:30.615939 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:31.097676 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.097640 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-6lkhx" event={"ID":"faee1bc3-08a2-4cac-a984-dfa5a8737f16","Type":"ContainerStarted","Data":"5c0729bddf0a0f10cbc295d341ab29c79c8fbc22609f40fc73adc236cd01687a"} Jul 15 10:49:31.098154 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.098135 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-6lkhx" Jul 15 10:49:31.103609 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.103560 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-6lkhx" Jul 15 10:49:31.137051 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.136742 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-6lkhx" podStartSLOduration=3.007760122 podStartE2EDuration="21.136725069s" totalImagesPullingTime="18.128964947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:31.118952624 +0000 UTC m=+92.086270512" watchObservedRunningTime="2026-07-15 10:49:31.136725069 +0000 UTC m=+92.104042927" Jul 15 10:49:31.176727 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.176671 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:31.278106 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.278073 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:31.377781 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.377645 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:31.527369 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.527314 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:31.610972 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.610936 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:31.875177 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.874870 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:31.970988 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:31.970615 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:32.107784 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:32.107098 2553 generic.go:356] "Generic (PLEG): container finished" podID="4725afd7-21b0-4583-9a5b-baf54881e9ba" containerID="7671500baf6908460140407905ae742984ac0f3e0f31ac1593d65aca4bd97a5c" exitCode=0 Jul 15 10:49:32.107784 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:32.107230 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9fdc" event={"ID":"4725afd7-21b0-4583-9a5b-baf54881e9ba","Type":"ContainerDied","Data":"7671500baf6908460140407905ae742984ac0f3e0f31ac1593d65aca4bd97a5c"} Jul 15 10:49:32.377928 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:32.377843 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:33.118310 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.118271 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9fdc" event={"ID":"4725afd7-21b0-4583-9a5b-baf54881e9ba","Type":"ContainerStarted","Data":"5f88c7406431234819fd3e02e53f5f270d4ae485006f81727f3bbf6e5fbfd52a"} Jul 15 10:49:33.119027 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.118357 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9fdc" event={"ID":"4725afd7-21b0-4583-9a5b-baf54881e9ba","Type":"ContainerStarted","Data":"e4595bfce770b729bb0320dd1bc3c99210bea4bed22c00654bd094d601657ec0"} Jul 15 10:49:33.136643 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.136544 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k9fdc" podStartSLOduration=3.678794855 podStartE2EDuration="6.136526341s" totalImagesPullingTime="2.358978505s" totalInitContainerRuntime="98.752981ms" isStatefulPod=true podCreationTimestamp="2026-07-15 10:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:33.13550315 +0000 UTC m=+94.102820953" watchObservedRunningTime="2026-07-15 10:49:33.136526341 +0000 UTC m=+94.103844145" Jul 15 10:49:33.328962 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.328921 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:33.699264 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.699227 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65784d59bf-z6h77"] Jul 15 10:49:33.800609 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.800530 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65784d59bf-z6h77"] Jul 15 10:49:33.800609 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.800564 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.827479 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.827452 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 10:49:33.886848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.886538 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-config\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.886848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.886589 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qb9g\" (UniqueName: \"kubernetes.io/projected/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-kube-api-access-4qb9g\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.886848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.886649 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-serving-cert\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.886848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.886672 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-oauth-serving-cert\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.886848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.886718 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-trusted-ca-bundle\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.886848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.886753 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-oauth-config\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.886848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.886769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-service-ca\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.913545 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.913361 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:33.988042 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.987999 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-config\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.988235 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.988061 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qb9g\" (UniqueName: \"kubernetes.io/projected/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-kube-api-access-4qb9g\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.988235 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.988132 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-serving-cert\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.988235 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.988158 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-oauth-serving-cert\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.988235 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.988207 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-trusted-ca-bundle\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.988486 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.988246 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-oauth-config\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.988486 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.988269 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-service-ca\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.989029 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.989002 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-service-ca\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.989682 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.989658 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-config\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.991219 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.990891 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-oauth-serving-cert\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.991356 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.991231 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-trusted-ca-bundle\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.993844 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.993816 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-oauth-config\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.993985 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.993958 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-serving-cert\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:33.998756 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:33.998733 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qb9g\" (UniqueName: \"kubernetes.io/projected/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-kube-api-access-4qb9g\") pod \"console-65784d59bf-z6h77\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:34.124027 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:34.123007 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:35.108410 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:35.108362 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:35.166470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:35.166436 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:36.540064 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:36.540037 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65784d59bf-z6h77"] Jul 15 10:49:36.542630 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:49:36.542603 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9a8b94_2c29_4b25_bbcb_08b26b5f12fc.slice/crio-e283d11723f30928b5c369c5b9523a28c277fe5b228ed0799d36ed7d930ebf7e WatchSource:0}: Error finding container e283d11723f30928b5c369c5b9523a28c277fe5b228ed0799d36ed7d930ebf7e: Status 404 returned error can't find the container with id e283d11723f30928b5c369c5b9523a28c277fe5b228ed0799d36ed7d930ebf7e Jul 15 10:49:36.915796 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:36.915743 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dfkgs" Jul 15 10:49:37.149211 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:37.149174 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7q8sl" event={"ID":"df7755ca-33a0-48dc-884c-0b57ccdb3ca7","Type":"ContainerStarted","Data":"3d57136a3658ef8cdfa1b679a2d527e88de0f6141411c5c60ff19fe1c349f4b4"} Jul 15 10:49:37.151046 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:37.151020 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65784d59bf-z6h77" event={"ID":"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc","Type":"ContainerStarted","Data":"c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327"} Jul 15 10:49:37.151186 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:37.151065 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65784d59bf-z6h77" event={"ID":"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc","Type":"ContainerStarted","Data":"e283d11723f30928b5c369c5b9523a28c277fe5b228ed0799d36ed7d930ebf7e"} Jul 15 10:49:37.167377 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:37.167247 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65784d59bf-z6h77" podStartSLOduration=4.167228914 podStartE2EDuration="4.167228914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:49:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:37.166580419 +0000 UTC m=+98.133898246" watchObservedRunningTime="2026-07-15 10:49:37.167228914 +0000 UTC m=+98.134546716" Jul 15 10:49:37.180369 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:37.180342 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:37.259364 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:37.255948 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:37.327719 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:37.327679 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:39.076269 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:39.075529 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79bdf6d5f4-d9nmz"] Jul 15 10:49:39.161572 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:39.161417 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:39.254738 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:39.254700 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:39.397753 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:39.397620 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:39.450519 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:39.450484 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:41.090044 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:41.090012 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:41.140654 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:41.140621 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:42.177401 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:42.177314 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7q8sl" event={"ID":"df7755ca-33a0-48dc-884c-0b57ccdb3ca7","Type":"ContainerStarted","Data":"1e4798517e98d4cd279fef1ff4a59ab1e9df8e53afc5e1b8395c946a798e84b1"} Jul 15 10:49:42.354605 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:42.354577 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:42.458277 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:42.458246 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:43.398045 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:43.397997 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:43.495196 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:43.495158 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:44.123499 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:44.123469 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:44.123690 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:44.123551 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:44.128900 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:44.128879 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:44.192660 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:44.192635 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:49:44.353745 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:44.353705 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:44.476835 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:44.476799 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:44.576596 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:44.576543 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:47.210400 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:47.210362 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7q8sl" event={"ID":"df7755ca-33a0-48dc-884c-0b57ccdb3ca7","Type":"ContainerStarted","Data":"e514c7ad7d8919b4b8f7afb406bf5b42c9eb3e60cf5463cabd6960d94e3149e5"} Jul 15 10:49:47.228764 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:47.228718 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7q8sl" podStartSLOduration=14.864108595 podStartE2EDuration="31.228702079s" totalImagesPullingTime="16.364593484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:49:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:49:47.22765383 +0000 UTC m=+108.194971644" watchObservedRunningTime="2026-07-15 10:49:47.228702079 +0000 UTC m=+108.196019881" Jul 15 10:49:48.480099 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:48.480061 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:48.580987 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:48.580934 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:53.089190 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.089148 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54c44868b-tknzv" podUID="58f817a9-604f-4938-a5a4-d57bf8d485c5" containerName="console" containerID="cri-o://85879dd8a99134fffa319b663cddaee8ea6724b161e6853291a3c39e8d86260d" gracePeriod=15 Jul 15 10:49:53.236976 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.236940 2553 generic.go:356] "Generic (PLEG): container finished" podID="58f817a9-604f-4938-a5a4-d57bf8d485c5" containerID="85879dd8a99134fffa319b663cddaee8ea6724b161e6853291a3c39e8d86260d" exitCode=0 Jul 15 10:49:53.237081 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.237012 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c44868b-tknzv" event={"ID":"58f817a9-604f-4938-a5a4-d57bf8d485c5","Type":"ContainerDied","Data":"85879dd8a99134fffa319b663cddaee8ea6724b161e6853291a3c39e8d86260d"} Jul 15 10:49:53.356054 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.356001 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:53.453815 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.453790 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-oauth-config\") pod \"58f817a9-604f-4938-a5a4-d57bf8d485c5\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " Jul 15 10:49:53.453950 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.453822 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkz5p\" (UniqueName: \"kubernetes.io/projected/58f817a9-604f-4938-a5a4-d57bf8d485c5-kube-api-access-rkz5p\") pod \"58f817a9-604f-4938-a5a4-d57bf8d485c5\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " Jul 15 10:49:53.453950 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.453854 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-service-ca\") pod \"58f817a9-604f-4938-a5a4-d57bf8d485c5\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " Jul 15 10:49:53.453950 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.453875 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-oauth-serving-cert\") pod \"58f817a9-604f-4938-a5a4-d57bf8d485c5\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " Jul 15 10:49:53.453950 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.453921 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-serving-cert\") pod \"58f817a9-604f-4938-a5a4-d57bf8d485c5\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " Jul 15 10:49:53.454161 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.453957 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-config\") pod \"58f817a9-604f-4938-a5a4-d57bf8d485c5\" (UID: \"58f817a9-604f-4938-a5a4-d57bf8d485c5\") " Jul 15 10:49:53.454292 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.454262 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "58f817a9-604f-4938-a5a4-d57bf8d485c5" (UID: "58f817a9-604f-4938-a5a4-d57bf8d485c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:49:53.454414 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.454312 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "58f817a9-604f-4938-a5a4-d57bf8d485c5" (UID: "58f817a9-604f-4938-a5a4-d57bf8d485c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:49:53.454459 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.454421 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-config" (OuterVolumeSpecName: "console-config") pod "58f817a9-604f-4938-a5a4-d57bf8d485c5" (UID: "58f817a9-604f-4938-a5a4-d57bf8d485c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:49:53.456089 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.456068 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "58f817a9-604f-4938-a5a4-d57bf8d485c5" (UID: "58f817a9-604f-4938-a5a4-d57bf8d485c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:49:53.456184 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.456098 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f817a9-604f-4938-a5a4-d57bf8d485c5-kube-api-access-rkz5p" (OuterVolumeSpecName: "kube-api-access-rkz5p") pod "58f817a9-604f-4938-a5a4-d57bf8d485c5" (UID: "58f817a9-604f-4938-a5a4-d57bf8d485c5"). InnerVolumeSpecName "kube-api-access-rkz5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:49:53.456184 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.456122 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "58f817a9-604f-4938-a5a4-d57bf8d485c5" (UID: "58f817a9-604f-4938-a5a4-d57bf8d485c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:49:53.555510 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.555488 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkz5p\" (UniqueName: \"kubernetes.io/projected/58f817a9-604f-4938-a5a4-d57bf8d485c5-kube-api-access-rkz5p\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:49:53.555510 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.555510 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-service-ca\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:49:53.555637 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.555519 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-oauth-serving-cert\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:49:53.555637 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.555528 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-serving-cert\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:49:53.555637 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.555537 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-config\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:49:53.555637 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:53.555545 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58f817a9-604f-4938-a5a4-d57bf8d485c5-console-oauth-config\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:49:54.243498 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:54.243479 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c44868b-tknzv" Jul 15 10:49:54.243963 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:54.243525 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c44868b-tknzv" event={"ID":"58f817a9-604f-4938-a5a4-d57bf8d485c5","Type":"ContainerDied","Data":"9377c3d898a239ba975d3c07747b986ff3fb57b9e26b7c44b001b1105cf8af05"} Jul 15 10:49:54.243963 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:54.243588 2553 scope.go:117] "RemoveContainer" containerID="85879dd8a99134fffa319b663cddaee8ea6724b161e6853291a3c39e8d86260d" Jul 15 10:49:54.245426 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:54.245391 2553 generic.go:356] "Generic (PLEG): container finished" podID="f0b9d3a6-00bd-4355-b515-fa0d3c97bd42" containerID="7fb67f0875db3ddf68d1456e37152cbef34b13648bfdb2af923751dc4208bbc0" exitCode=0 Jul 15 10:49:54.245584 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:54.245443 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" event={"ID":"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42","Type":"ContainerDied","Data":"7fb67f0875db3ddf68d1456e37152cbef34b13648bfdb2af923751dc4208bbc0"} Jul 15 10:49:54.245921 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:54.245756 2553 scope.go:117] "RemoveContainer" containerID="7fb67f0875db3ddf68d1456e37152cbef34b13648bfdb2af923751dc4208bbc0" Jul 15 10:49:54.289341 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:54.288525 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c44868b-tknzv"] Jul 15 10:49:54.289341 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:54.288571 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54c44868b-tknzv"] Jul 15 10:49:55.252980 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:55.252947 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-fh2r9" event={"ID":"f0b9d3a6-00bd-4355-b515-fa0d3c97bd42","Type":"ContainerStarted","Data":"776894d1ff7204f7751ec01d6a161d72a5398194297a8d592b4aa68015e70520"} Jul 15 10:49:55.564614 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:55.564541 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58f817a9-604f-4938-a5a4-d57bf8d485c5" path="/var/lib/kubelet/pods/58f817a9-604f-4938-a5a4-d57bf8d485c5/volumes" Jul 15 10:49:58.354721 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:58.354680 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:49:58.407681 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:49:58.407649 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:04.106684 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.106635 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" podUID="604d9ac0-123f-439a-aaa1-126a4ee7183c" containerName="registry" containerID="cri-o://7e9b9633b05f186ff097cb815d2d707463c5663fc95252df6ebb957e24e538da" gracePeriod=30 Jul 15 10:50:04.294069 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.294039 2553 generic.go:356] "Generic (PLEG): container finished" podID="b2a5dfe8-7042-4808-9598-50daf570cba7" containerID="ee6b722dea2ce909a7048916b1abeb760c11e6b8fb2b46c5e7dda3385219d237" exitCode=0 Jul 15 10:50:04.294201 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.294121 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" event={"ID":"b2a5dfe8-7042-4808-9598-50daf570cba7","Type":"ContainerDied","Data":"ee6b722dea2ce909a7048916b1abeb760c11e6b8fb2b46c5e7dda3385219d237"} Jul 15 10:50:04.294640 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.294591 2553 scope.go:117] "RemoveContainer" containerID="ee6b722dea2ce909a7048916b1abeb760c11e6b8fb2b46c5e7dda3385219d237" Jul 15 10:50:04.296042 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.296019 2553 generic.go:356] "Generic (PLEG): container finished" podID="604d9ac0-123f-439a-aaa1-126a4ee7183c" containerID="7e9b9633b05f186ff097cb815d2d707463c5663fc95252df6ebb957e24e538da" exitCode=0 Jul 15 10:50:04.296137 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.296075 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" event={"ID":"604d9ac0-123f-439a-aaa1-126a4ee7183c","Type":"ContainerDied","Data":"7e9b9633b05f186ff097cb815d2d707463c5663fc95252df6ebb957e24e538da"} Jul 15 10:50:04.401795 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.401776 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:50:04.541892 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.541821 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-image-registry-private-configuration\") pod \"604d9ac0-123f-439a-aaa1-126a4ee7183c\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " Jul 15 10:50:04.541892 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.541861 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-certificates\") pod \"604d9ac0-123f-439a-aaa1-126a4ee7183c\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " Jul 15 10:50:04.541892 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.541885 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-bound-sa-token\") pod \"604d9ac0-123f-439a-aaa1-126a4ee7183c\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " Jul 15 10:50:04.542138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.541964 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rjqq\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-kube-api-access-6rjqq\") pod \"604d9ac0-123f-439a-aaa1-126a4ee7183c\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " Jul 15 10:50:04.542138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.541989 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-trusted-ca\") pod \"604d9ac0-123f-439a-aaa1-126a4ee7183c\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " Jul 15 10:50:04.542138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.542027 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") pod \"604d9ac0-123f-439a-aaa1-126a4ee7183c\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " Jul 15 10:50:04.542138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.542051 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/604d9ac0-123f-439a-aaa1-126a4ee7183c-ca-trust-extracted\") pod \"604d9ac0-123f-439a-aaa1-126a4ee7183c\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " Jul 15 10:50:04.542138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.542077 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-installation-pull-secrets\") pod \"604d9ac0-123f-439a-aaa1-126a4ee7183c\" (UID: \"604d9ac0-123f-439a-aaa1-126a4ee7183c\") " Jul 15 10:50:04.542594 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.542544 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "604d9ac0-123f-439a-aaa1-126a4ee7183c" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:50:04.542832 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.542778 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "604d9ac0-123f-439a-aaa1-126a4ee7183c" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:50:04.544810 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.544783 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "604d9ac0-123f-439a-aaa1-126a4ee7183c" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:50:04.545089 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.545061 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "604d9ac0-123f-439a-aaa1-126a4ee7183c" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:50:04.545208 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.545126 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-kube-api-access-6rjqq" (OuterVolumeSpecName: "kube-api-access-6rjqq") pod "604d9ac0-123f-439a-aaa1-126a4ee7183c" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c"). InnerVolumeSpecName "kube-api-access-6rjqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:50:04.545272 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.545229 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "604d9ac0-123f-439a-aaa1-126a4ee7183c" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:50:04.545323 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.545287 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "604d9ac0-123f-439a-aaa1-126a4ee7183c" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:50:04.554484 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.554453 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604d9ac0-123f-439a-aaa1-126a4ee7183c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "604d9ac0-123f-439a-aaa1-126a4ee7183c" (UID: "604d9ac0-123f-439a-aaa1-126a4ee7183c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:50:04.643386 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.643357 2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-image-registry-private-configuration\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:50:04.643386 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.643385 2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-certificates\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:50:04.643551 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.643400 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-bound-sa-token\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:50:04.643551 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.643414 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rjqq\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-kube-api-access-6rjqq\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:50:04.643551 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.643429 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/604d9ac0-123f-439a-aaa1-126a4ee7183c-trusted-ca\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:50:04.643551 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.643441 2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/604d9ac0-123f-439a-aaa1-126a4ee7183c-registry-tls\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:50:04.643551 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.643452 2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/604d9ac0-123f-439a-aaa1-126a4ee7183c-ca-trust-extracted\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:50:04.643551 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:04.643464 2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/604d9ac0-123f-439a-aaa1-126a4ee7183c-installation-pull-secrets\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:50:05.302192 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:05.302152 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jwkzd" event={"ID":"b2a5dfe8-7042-4808-9598-50daf570cba7","Type":"ContainerStarted","Data":"9b21439ae45fcff9e78d5eb8d3e0eb2a591f1f56847f558da5def6aff5792630"} Jul 15 10:50:05.303411 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:05.303386 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" event={"ID":"604d9ac0-123f-439a-aaa1-126a4ee7183c","Type":"ContainerDied","Data":"110dbda1e6c5391e6448d42fd77a0d48c5c7c1084e5207985211b75bbc27865e"} Jul 15 10:50:05.303411 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:05.303404 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bdf6d5f4-d9nmz" Jul 15 10:50:05.303570 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:05.303432 2553 scope.go:117] "RemoveContainer" containerID="7e9b9633b05f186ff097cb815d2d707463c5663fc95252df6ebb957e24e538da" Jul 15 10:50:05.332694 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:05.332671 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79bdf6d5f4-d9nmz"] Jul 15 10:50:05.338412 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:05.338391 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79bdf6d5f4-d9nmz"] Jul 15 10:50:05.564119 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:05.564048 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="604d9ac0-123f-439a-aaa1-126a4ee7183c" path="/var/lib/kubelet/pods/604d9ac0-123f-439a-aaa1-126a4ee7183c/volumes" Jul 15 10:50:10.461977 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:10.461940 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:10.514903 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:10.514859 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:15.709196 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:15.709155 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:16.164745 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:16.164656 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:25.216534 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:25.216493 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:25.264622 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:25.264590 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:30.999390 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:30.999359 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:31.069453 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:31.069426 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:36.516717 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:36.516682 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65784d59bf-z6h77"] Jul 15 10:50:36.969990 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:36.969946 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:37.027516 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:37.027477 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:37.605750 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:37.605712 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:37.705512 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:37.705478 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:42.851779 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:42.851744 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:42.916273 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:42.916239 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:46.004748 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:46.004713 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:46.691518 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:46.691483 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:46.750653 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:46.750621 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:47.687815 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:47.687780 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:47.789285 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:47.789249 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:47.861556 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:47.861531 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:58.358464 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:58.358376 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:50:58.459207 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:50:58.459170 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:51:01.540432 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.540391 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65784d59bf-z6h77" podUID="0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" containerName="console" containerID="cri-o://c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327" gracePeriod=15 Jul 15 10:51:01.778111 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.778087 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:51:01.854113 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854056 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-oauth-config\") pod \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " Jul 15 10:51:01.854113 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854110 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-serving-cert\") pod \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " Jul 15 10:51:01.854259 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854135 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-oauth-serving-cert\") pod \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " Jul 15 10:51:01.854259 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854196 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-config\") pod \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " Jul 15 10:51:01.854259 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854225 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qb9g\" (UniqueName: \"kubernetes.io/projected/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-kube-api-access-4qb9g\") pod \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " Jul 15 10:51:01.854259 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854248 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-trusted-ca-bundle\") pod \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " Jul 15 10:51:01.854479 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854278 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-service-ca\") pod \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\" (UID: \"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc\") " Jul 15 10:51:01.854654 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854535 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" (UID: "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:51:01.854774 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854655 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-config" (OuterVolumeSpecName: "console-config") pod "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" (UID: "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:51:01.854774 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854724 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" (UID: "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:51:01.854774 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.854734 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" (UID: "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:51:01.856153 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.856134 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" (UID: "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:51:01.856720 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.856686 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-kube-api-access-4qb9g" (OuterVolumeSpecName: "kube-api-access-4qb9g") pod "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" (UID: "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc"). InnerVolumeSpecName "kube-api-access-4qb9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:51:01.856788 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.856728 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" (UID: "0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:51:01.955712 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.955684 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-serving-cert\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:51:01.955712 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.955708 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-oauth-serving-cert\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:51:01.955898 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.955718 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-config\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:51:01.955898 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.955727 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qb9g\" (UniqueName: \"kubernetes.io/projected/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-kube-api-access-4qb9g\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:51:01.955898 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.955736 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-trusted-ca-bundle\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:51:01.955898 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.955745 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-service-ca\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:51:01.955898 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:01.955753 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc-console-oauth-config\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:51:02.545917 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:02.545885 2553 generic.go:356] "Generic (PLEG): container finished" podID="0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" containerID="c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327" exitCode=0 Jul 15 10:51:02.546357 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:02.545930 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65784d59bf-z6h77" Jul 15 10:51:02.546357 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:02.545962 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65784d59bf-z6h77" event={"ID":"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc","Type":"ContainerDied","Data":"c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327"} Jul 15 10:51:02.546357 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:02.545999 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65784d59bf-z6h77" event={"ID":"0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc","Type":"ContainerDied","Data":"e283d11723f30928b5c369c5b9523a28c277fe5b228ed0799d36ed7d930ebf7e"} Jul 15 10:51:02.546357 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:02.546019 2553 scope.go:117] "RemoveContainer" containerID="c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327" Jul 15 10:51:02.555059 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:02.555039 2553 scope.go:117] "RemoveContainer" containerID="c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327" Jul 15 10:51:02.555310 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:51:02.555290 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327\": container with ID starting with c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327 not found: ID does not exist" containerID="c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327" Jul 15 10:51:02.555392 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:02.555322 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327"} err="failed to get container status \"c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327\": rpc error: code = NotFound desc = could not find container \"c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327\": container with ID starting with c73195441f2605851032fe9776c70a6c06288793e632bd446959fbc9a1d47327 not found: ID does not exist" Jul 15 10:51:02.566111 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:02.566088 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65784d59bf-z6h77"] Jul 15 10:51:02.568118 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:02.568095 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65784d59bf-z6h77"] Jul 15 10:51:03.563959 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:03.563924 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" path="/var/lib/kubelet/pods/0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc/volumes" Jul 15 10:51:35.845694 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:35.845650 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:51:35.944737 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:35.944702 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:51:38.100136 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:38.100095 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:51:57.393298 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:57.393245 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:51:58.225204 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:51:58.225167 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:00.996597 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:00.996555 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:01.096992 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:01.096960 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:02.298825 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:02.298784 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:02.388895 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:02.388864 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:03.091939 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:03.091903 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:03.183067 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:03.183041 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:05.463439 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:05.463403 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:05.730913 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:05.730837 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:07.795820 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:07.795782 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:07.847884 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:07.847845 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:13.066070 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:13.066031 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:18.997250 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:18.997218 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:19.097511 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:19.097475 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:24.684628 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:24.684536 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:24.784788 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:24.784752 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:26.640226 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:26.640191 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:27.683628 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:27.683568 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:27.784482 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:27.784451 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:42.899699 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:42.899658 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:42.987848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:42.987816 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:43.607064 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:43.607027 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:43.707239 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:43.707206 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:44.224242 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.224210 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:44.397119 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.397084 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:44.509656 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.509582 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:44.532079 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.532053 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb"] Jul 15 10:52:44.532379 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.532368 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f817a9-604f-4938-a5a4-d57bf8d485c5" containerName="console" Jul 15 10:52:44.532432 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.532382 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f817a9-604f-4938-a5a4-d57bf8d485c5" containerName="console" Jul 15 10:52:44.532432 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.532393 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" containerName="console" Jul 15 10:52:44.532432 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.532398 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" containerName="console" Jul 15 10:52:44.532432 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.532406 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="604d9ac0-123f-439a-aaa1-126a4ee7183c" containerName="registry" Jul 15 10:52:44.532432 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.532412 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="604d9ac0-123f-439a-aaa1-126a4ee7183c" containerName="registry" Jul 15 10:52:44.532582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.532468 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="58f817a9-604f-4938-a5a4-d57bf8d485c5" containerName="console" Jul 15 10:52:44.532582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.532476 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c9a8b94-2c29-4b25-bbcb-08b26b5f12fc" containerName="console" Jul 15 10:52:44.532582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.532484 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="604d9ac0-123f-439a-aaa1-126a4ee7183c" containerName="registry" Jul 15 10:52:44.535441 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.535424 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.537811 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.537788 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 10:52:44.537811 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.537794 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 10:52:44.537973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.537889 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 10:52:44.537973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.537930 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8d86c\"" Jul 15 10:52:44.543315 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.543296 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 10:52:44.547061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.547040 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb"] Jul 15 10:52:44.586405 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.586380 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/564dbd70-3401-4628-95d7-7bb059627148-tmp\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.586514 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.586408 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/564dbd70-3401-4628-95d7-7bb059627148-webhook-cert\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.586514 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.586435 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/564dbd70-3401-4628-95d7-7bb059627148-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.586514 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.586469 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/564dbd70-3401-4628-95d7-7bb059627148-manifests\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.586664 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.586549 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x28j4\" (UniqueName: \"kubernetes.io/projected/564dbd70-3401-4628-95d7-7bb059627148-kube-api-access-x28j4\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.608177 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.608153 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:44.687512 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.687484 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x28j4\" (UniqueName: \"kubernetes.io/projected/564dbd70-3401-4628-95d7-7bb059627148-kube-api-access-x28j4\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.687616 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.687524 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/564dbd70-3401-4628-95d7-7bb059627148-tmp\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.687616 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.687552 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/564dbd70-3401-4628-95d7-7bb059627148-webhook-cert\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.687616 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.687593 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/564dbd70-3401-4628-95d7-7bb059627148-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.687770 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.687624 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/564dbd70-3401-4628-95d7-7bb059627148-manifests\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.687965 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.687946 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/564dbd70-3401-4628-95d7-7bb059627148-manifests\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.689641 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.689616 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/564dbd70-3401-4628-95d7-7bb059627148-tmp\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.690022 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.690001 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/564dbd70-3401-4628-95d7-7bb059627148-webhook-cert\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.690066 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.690044 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/564dbd70-3401-4628-95d7-7bb059627148-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.701705 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.701677 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x28j4\" (UniqueName: \"kubernetes.io/projected/564dbd70-3401-4628-95d7-7bb059627148-kube-api-access-x28j4\") pod \"opendatahub-operator-controller-manager-85886567-2dqdb\" (UID: \"564dbd70-3401-4628-95d7-7bb059627148\") " pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.723922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.723893 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:44.828967 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.828873 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:44.845820 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.845798 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:44.927859 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.927826 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:44.980160 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:44.980139 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb"] Jul 15 10:52:44.982480 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:52:44.982457 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564dbd70_3401_4628_95d7_7bb059627148.slice/crio-0994c7c6b45167562b6a54d15e17b9b5e0c411ab9c0f6d6133df822a99739266 WatchSource:0}: Error finding container 0994c7c6b45167562b6a54d15e17b9b5e0c411ab9c0f6d6133df822a99739266: Status 404 returned error can't find the container with id 0994c7c6b45167562b6a54d15e17b9b5e0c411ab9c0f6d6133df822a99739266 Jul 15 10:52:45.020320 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:45.020282 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:45.095020 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:45.094952 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:45.956626 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:45.956589 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" event={"ID":"564dbd70-3401-4628-95d7-7bb059627148","Type":"ContainerStarted","Data":"0994c7c6b45167562b6a54d15e17b9b5e0c411ab9c0f6d6133df822a99739266"} Jul 15 10:52:48.973089 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:48.973055 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" event={"ID":"564dbd70-3401-4628-95d7-7bb059627148","Type":"ContainerStarted","Data":"14cae460baf95cc30922f3d7e236c8572470201f78e89c31af51b7bfe74888f5"} Jul 15 10:52:49.978647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:49.978617 2553 generic.go:356] "Generic (PLEG): container finished" podID="564dbd70-3401-4628-95d7-7bb059627148" containerID="14cae460baf95cc30922f3d7e236c8572470201f78e89c31af51b7bfe74888f5" exitCode=0 Jul 15 10:52:49.979081 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:49.978669 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" event={"ID":"564dbd70-3401-4628-95d7-7bb059627148","Type":"ContainerDied","Data":"14cae460baf95cc30922f3d7e236c8572470201f78e89c31af51b7bfe74888f5"} Jul 15 10:52:50.984622 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:50.984583 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" event={"ID":"564dbd70-3401-4628-95d7-7bb059627148","Type":"ContainerStarted","Data":"d8e3ab2ace47c84e49c6acb576ef00a18dcd434740eb9c08acffaabcf9639ee9"} Jul 15 10:52:50.985098 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:50.984761 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:52:51.005942 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:51.005895 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" podStartSLOduration=2.498602406 podStartE2EDuration="7.005882783s" totalImagesPullingTime="3.468075698s" totalInitContainerRuntime="1.039204679s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:52:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:52:51.003622788 +0000 UTC m=+291.970940612" watchObservedRunningTime="2026-07-15 10:52:51.005882783 +0000 UTC m=+291.973200583" Jul 15 10:52:56.378652 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:56.378619 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:56.478522 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:56.478493 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:57.463894 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:57.463856 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:57.573841 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:57.573806 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:57.893998 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:57.893917 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:58.001346 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:57.998607 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:52:59.443796 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:59.443767 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 10:52:59.452605 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:59.452577 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 10:52:59.454905 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:59.454880 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 10:52:59.456415 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:59.456394 2553 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 10:52:59.462948 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:52:59.462932 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 10:53:01.991990 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:01.991961 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85886567-2dqdb" Jul 15 10:53:04.335241 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:04.335201 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:05.645353 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:05.645293 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:10.007362 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.007308 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:10.138921 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.138887 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7db8857594-w4rtz"] Jul 15 10:53:10.141188 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.141168 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.143571 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.143548 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 10:53:10.143737 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.143714 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9tptq\"" Jul 15 10:53:10.143979 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.143958 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 10:53:10.151256 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.151233 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7db8857594-w4rtz"] Jul 15 10:53:10.240536 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.240505 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:10.274273 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.274208 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsfrc\" (UniqueName: \"kubernetes.io/projected/3b279303-f0b6-4c80-8dda-7f3009cdebe0-kube-api-access-rsfrc\") pod \"kube-auth-proxy-7db8857594-w4rtz\" (UID: \"3b279303-f0b6-4c80-8dda-7f3009cdebe0\") " pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.274273 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.274252 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b279303-f0b6-4c80-8dda-7f3009cdebe0-tmp\") pod \"kube-auth-proxy-7db8857594-w4rtz\" (UID: \"3b279303-f0b6-4c80-8dda-7f3009cdebe0\") " pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.274449 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.274290 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b279303-f0b6-4c80-8dda-7f3009cdebe0-tls-certs\") pod \"kube-auth-proxy-7db8857594-w4rtz\" (UID: \"3b279303-f0b6-4c80-8dda-7f3009cdebe0\") " pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.329744 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.329716 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:10.375463 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.375434 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b279303-f0b6-4c80-8dda-7f3009cdebe0-tls-certs\") pod \"kube-auth-proxy-7db8857594-w4rtz\" (UID: \"3b279303-f0b6-4c80-8dda-7f3009cdebe0\") " pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.375582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.375490 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsfrc\" (UniqueName: \"kubernetes.io/projected/3b279303-f0b6-4c80-8dda-7f3009cdebe0-kube-api-access-rsfrc\") pod \"kube-auth-proxy-7db8857594-w4rtz\" (UID: \"3b279303-f0b6-4c80-8dda-7f3009cdebe0\") " pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.375582 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.375540 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b279303-f0b6-4c80-8dda-7f3009cdebe0-tmp\") pod \"kube-auth-proxy-7db8857594-w4rtz\" (UID: \"3b279303-f0b6-4c80-8dda-7f3009cdebe0\") " pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.377785 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.377754 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b279303-f0b6-4c80-8dda-7f3009cdebe0-tmp\") pod \"kube-auth-proxy-7db8857594-w4rtz\" (UID: \"3b279303-f0b6-4c80-8dda-7f3009cdebe0\") " pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.378002 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.377983 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b279303-f0b6-4c80-8dda-7f3009cdebe0-tls-certs\") pod \"kube-auth-proxy-7db8857594-w4rtz\" (UID: \"3b279303-f0b6-4c80-8dda-7f3009cdebe0\") " pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.385593 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.385566 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsfrc\" (UniqueName: \"kubernetes.io/projected/3b279303-f0b6-4c80-8dda-7f3009cdebe0-kube-api-access-rsfrc\") pod \"kube-auth-proxy-7db8857594-w4rtz\" (UID: \"3b279303-f0b6-4c80-8dda-7f3009cdebe0\") " pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.428396 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.428365 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:10.452093 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.452073 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" Jul 15 10:53:10.588384 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.588343 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7db8857594-w4rtz"] Jul 15 10:53:10.591172 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:53:10.591132 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b279303_f0b6_4c80_8dda_7f3009cdebe0.slice/crio-7c81b33210711bc1f4ce83cada8061cf7a42b35bfdf9b723e709ef5c4a31d8f0 WatchSource:0}: Error finding container 7c81b33210711bc1f4ce83cada8061cf7a42b35bfdf9b723e709ef5c4a31d8f0: Status 404 returned error can't find the container with id 7c81b33210711bc1f4ce83cada8061cf7a42b35bfdf9b723e709ef5c4a31d8f0 Jul 15 10:53:10.593545 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.593530 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 10:53:10.780455 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.780421 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:10.852043 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.851959 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w5tgs"] Jul 15 10:53:10.855626 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.855604 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" Jul 15 10:53:10.858053 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.858032 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-v79rh\"" Jul 15 10:53:10.858053 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.858044 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 15 10:53:10.867502 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.867442 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w5tgs"] Jul 15 10:53:10.911344 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.911305 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:10.980452 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.980425 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbx8n\" (UniqueName: \"kubernetes.io/projected/ca9acaca-e6e0-40ae-a719-41beb2371044-kube-api-access-hbx8n\") pod \"model-serving-api-54d89bd5fc-w5tgs\" (UID: \"ca9acaca-e6e0-40ae-a719-41beb2371044\") " pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" Jul 15 10:53:10.980600 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:10.980465 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9acaca-e6e0-40ae-a719-41beb2371044-tls-certs\") pod \"model-serving-api-54d89bd5fc-w5tgs\" (UID: \"ca9acaca-e6e0-40ae-a719-41beb2371044\") " pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" Jul 15 10:53:11.070389 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.070358 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" event={"ID":"3b279303-f0b6-4c80-8dda-7f3009cdebe0","Type":"ContainerStarted","Data":"7c81b33210711bc1f4ce83cada8061cf7a42b35bfdf9b723e709ef5c4a31d8f0"} Jul 15 10:53:11.081371 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.081313 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbx8n\" (UniqueName: \"kubernetes.io/projected/ca9acaca-e6e0-40ae-a719-41beb2371044-kube-api-access-hbx8n\") pod \"model-serving-api-54d89bd5fc-w5tgs\" (UID: \"ca9acaca-e6e0-40ae-a719-41beb2371044\") " pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" Jul 15 10:53:11.081505 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.081400 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9acaca-e6e0-40ae-a719-41beb2371044-tls-certs\") pod \"model-serving-api-54d89bd5fc-w5tgs\" (UID: \"ca9acaca-e6e0-40ae-a719-41beb2371044\") " pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" Jul 15 10:53:11.083805 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.083780 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9acaca-e6e0-40ae-a719-41beb2371044-tls-certs\") pod \"model-serving-api-54d89bd5fc-w5tgs\" (UID: \"ca9acaca-e6e0-40ae-a719-41beb2371044\") " pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" Jul 15 10:53:11.092048 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.092027 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbx8n\" (UniqueName: \"kubernetes.io/projected/ca9acaca-e6e0-40ae-a719-41beb2371044-kube-api-access-hbx8n\") pod \"model-serving-api-54d89bd5fc-w5tgs\" (UID: \"ca9acaca-e6e0-40ae-a719-41beb2371044\") " pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" Jul 15 10:53:11.123249 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.123150 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:11.172122 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.172091 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" Jul 15 10:53:11.253791 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.253755 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt"] Jul 15 10:53:11.255662 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.255632 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:11.256876 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.256848 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.259361 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.259320 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 10:53:11.259478 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.259415 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 10:53:11.259752 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.259736 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8pt4s\"" Jul 15 10:53:11.259825 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.259741 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 10:53:11.260433 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.260209 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 10:53:11.273323 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.273281 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt"] Jul 15 10:53:11.323250 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.323221 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:11.324614 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.324592 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w5tgs"] Jul 15 10:53:11.327344 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:53:11.327298 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9acaca_e6e0_40ae_a719_41beb2371044.slice/crio-167be60dc663ef19d86022932604ef67e5517844a98fdc4a6895b2922bacb442 WatchSource:0}: Error finding container 167be60dc663ef19d86022932604ef67e5517844a98fdc4a6895b2922bacb442: Status 404 returned error can't find the container with id 167be60dc663ef19d86022932604ef67e5517844a98fdc4a6895b2922bacb442 Jul 15 10:53:11.383721 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.383648 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-token\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.383721 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.383688 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dfe42d3-e785-41a5-8e28-802d7afa7c06-local-certs\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.383721 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.383716 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.383936 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.383790 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.383936 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.383908 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-cacerts\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.384056 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.383933 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbfgp\" (UniqueName: \"kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-kube-api-access-jbfgp\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.384056 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.383975 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.484557 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.484527 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-token\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.484714 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.484574 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dfe42d3-e785-41a5-8e28-802d7afa7c06-local-certs\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.484714 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.484603 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.484714 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.484628 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.484871 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.484721 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-cacerts\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.484871 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.484744 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfgp\" (UniqueName: \"kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-kube-api-access-jbfgp\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.484871 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.484783 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.485490 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.485462 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.487729 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.487703 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dfe42d3-e785-41a5-8e28-802d7afa7c06-local-certs\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.487985 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.487960 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.488187 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.488170 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.488694 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.488671 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-cacerts\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.492471 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.492430 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-token\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.492833 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.492812 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbfgp\" (UniqueName: \"kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-kube-api-access-jbfgp\") pod \"istiod-openshift-gateway-7574459656-2b8zt\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.570894 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.570860 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:11.740588 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:11.740469 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt"] Jul 15 10:53:11.743204 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:53:11.743182 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dfe42d3_e785_41a5_8e28_802d7afa7c06.slice/crio-42a2b74d31b4f5260852887cd3e3b1cbea675550140710f3b1c9ec17e62e2bd1 WatchSource:0}: Error finding container 42a2b74d31b4f5260852887cd3e3b1cbea675550140710f3b1c9ec17e62e2bd1: Status 404 returned error can't find the container with id 42a2b74d31b4f5260852887cd3e3b1cbea675550140710f3b1c9ec17e62e2bd1 Jul 15 10:53:12.077411 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:12.077371 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" event={"ID":"9dfe42d3-e785-41a5-8e28-802d7afa7c06","Type":"ContainerStarted","Data":"42a2b74d31b4f5260852887cd3e3b1cbea675550140710f3b1c9ec17e62e2bd1"} Jul 15 10:53:12.078804 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:12.078775 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" event={"ID":"ca9acaca-e6e0-40ae-a719-41beb2371044","Type":"ContainerStarted","Data":"167be60dc663ef19d86022932604ef67e5517844a98fdc4a6895b2922bacb442"} Jul 15 10:53:12.219173 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:12.219132 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:14.090524 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:14.090483 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" event={"ID":"3b279303-f0b6-4c80-8dda-7f3009cdebe0","Type":"ContainerStarted","Data":"c0b09feae19ef12df20fd65d861ce0c7c582f12223a3152423fd969e8feafa7e"} Jul 15 10:53:14.092250 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:14.092226 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" event={"ID":"ca9acaca-e6e0-40ae-a719-41beb2371044","Type":"ContainerStarted","Data":"1497184827cb7f9bf85272d6cf582bb2a31c23acad1cc7763b48ce80591a5252"} Jul 15 10:53:14.092395 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:14.092301 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" Jul 15 10:53:14.106289 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:14.106247 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7db8857594-w4rtz" podStartSLOduration=1.124330054 podStartE2EDuration="4.106232762s" totalImagesPullingTime="2.981902708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:53:14.104585531 +0000 UTC m=+315.071903349" watchObservedRunningTime="2026-07-15 10:53:14.106232762 +0000 UTC m=+315.073550565" Jul 15 10:53:14.119974 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:14.119673 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" podStartSLOduration=1.876441797 podStartE2EDuration="4.11965518s" totalImagesPullingTime="2.243213383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:53:14.118071604 +0000 UTC m=+315.085389433" watchObservedRunningTime="2026-07-15 10:53:14.11965518 +0000 UTC m=+315.086972982" Jul 15 10:53:15.073731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:15.073690 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 10:53:15.073802 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:15.073762 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 10:53:15.685547 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:15.685494 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:15.816138 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:15.816102 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:15.977115 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:15.977043 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:16.067098 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:16.067060 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:16.104234 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:16.104198 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" event={"ID":"9dfe42d3-e785-41a5-8e28-802d7afa7c06","Type":"ContainerStarted","Data":"519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576"} Jul 15 10:53:16.104393 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:16.104356 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:16.105989 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:16.105966 2553 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-2b8zt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 10:53:16.106089 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:16.106011 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" podUID="9dfe42d3-e785-41a5-8e28-802d7afa7c06" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 10:53:16.123751 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:16.123705 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" podStartSLOduration=1.795533171 podStartE2EDuration="5.123692025s" totalImagesPullingTime="3.328158854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:53:16.122526826 +0000 UTC m=+317.089844627" watchObservedRunningTime="2026-07-15 10:53:16.123692025 +0000 UTC m=+317.091009825" Jul 15 10:53:16.307603 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:16.307521 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:17.110680 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:17.110652 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:20.296340 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:20.296282 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:20.384848 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:20.384816 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:21.417756 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.417721 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:21.467520 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.467493 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb"] Jul 15 10:53:21.471922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.471901 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:53:21.474309 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.474287 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 15 10:53:21.474309 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.474293 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-txxqb\"" Jul 15 10:53:21.482113 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.482089 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb"] Jul 15 10:53:21.513578 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.513514 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:21.572569 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.572535 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/282c1c11-0da1-4533-89f8-276810df505e-cert\") pod \"kserve-controller-manager-d6f4b65b8-4zvlb\" (UID: \"282c1c11-0da1-4533-89f8-276810df505e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:53:21.572754 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.572689 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9psfs\" (UniqueName: \"kubernetes.io/projected/282c1c11-0da1-4533-89f8-276810df505e-kube-api-access-9psfs\") pod \"kserve-controller-manager-d6f4b65b8-4zvlb\" (UID: \"282c1c11-0da1-4533-89f8-276810df505e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:53:21.673926 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.673851 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9psfs\" (UniqueName: \"kubernetes.io/projected/282c1c11-0da1-4533-89f8-276810df505e-kube-api-access-9psfs\") pod \"kserve-controller-manager-d6f4b65b8-4zvlb\" (UID: \"282c1c11-0da1-4533-89f8-276810df505e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:53:21.673926 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.673903 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/282c1c11-0da1-4533-89f8-276810df505e-cert\") pod \"kserve-controller-manager-d6f4b65b8-4zvlb\" (UID: \"282c1c11-0da1-4533-89f8-276810df505e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:53:21.674123 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:53:21.673994 2553 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 15 10:53:21.674123 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:53:21.674046 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/282c1c11-0da1-4533-89f8-276810df505e-cert podName:282c1c11-0da1-4533-89f8-276810df505e nodeName:}" failed. No retries permitted until 2026-07-15 10:53:22.174029904 +0000 UTC m=+323.141347683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/282c1c11-0da1-4533-89f8-276810df505e-cert") pod "kserve-controller-manager-d6f4b65b8-4zvlb" (UID: "282c1c11-0da1-4533-89f8-276810df505e") : secret "kserve-webhook-server-cert" not found Jul 15 10:53:21.686247 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.686223 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9psfs\" (UniqueName: \"kubernetes.io/projected/282c1c11-0da1-4533-89f8-276810df505e-kube-api-access-9psfs\") pod \"kserve-controller-manager-d6f4b65b8-4zvlb\" (UID: \"282c1c11-0da1-4533-89f8-276810df505e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:53:21.801174 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:21.801146 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:22.178977 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:22.178949 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/282c1c11-0da1-4533-89f8-276810df505e-cert\") pod \"kserve-controller-manager-d6f4b65b8-4zvlb\" (UID: \"282c1c11-0da1-4533-89f8-276810df505e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:53:22.181214 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:22.181189 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/282c1c11-0da1-4533-89f8-276810df505e-cert\") pod \"kserve-controller-manager-d6f4b65b8-4zvlb\" (UID: \"282c1c11-0da1-4533-89f8-276810df505e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:53:22.273949 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:22.273920 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:22.384703 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:22.384679 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:53:22.442239 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:22.442126 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:22.541288 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:22.541155 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb"] Jul 15 10:53:22.542856 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:22.542825 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:22.543892 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:53:22.543868 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282c1c11_0da1_4533_89f8_276810df505e.slice/crio-c0a7e66e13594524ebb75e8cd8ec130831c46165ea34edce21bfbe2de0fb3e6c WatchSource:0}: Error finding container c0a7e66e13594524ebb75e8cd8ec130831c46165ea34edce21bfbe2de0fb3e6c: Status 404 returned error can't find the container with id c0a7e66e13594524ebb75e8cd8ec130831c46165ea34edce21bfbe2de0fb3e6c Jul 15 10:53:22.759945 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:22.759899 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:22.856009 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:22.855982 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:23.136504 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:23.136429 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" event={"ID":"282c1c11-0da1-4533-89f8-276810df505e","Type":"ContainerStarted","Data":"c0a7e66e13594524ebb75e8cd8ec130831c46165ea34edce21bfbe2de0fb3e6c"} Jul 15 10:53:24.314407 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.314374 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt"] Jul 15 10:53:24.314842 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.314691 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" podUID="9dfe42d3-e785-41a5-8e28-802d7afa7c06" containerName="discovery" containerID="cri-o://519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576" gracePeriod=30 Jul 15 10:53:24.604498 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.604477 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:24.698989 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.698960 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-token\") pod \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " Jul 15 10:53:24.699144 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.699005 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dfe42d3-e785-41a5-8e28-802d7afa7c06-local-certs\") pod \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " Jul 15 10:53:24.699144 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.699041 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-ca-configmap\") pod \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " Jul 15 10:53:24.699144 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.699089 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-dns-cert\") pod \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " Jul 15 10:53:24.699312 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.699153 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-cacerts\") pod \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " Jul 15 10:53:24.699312 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.699176 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbfgp\" (UniqueName: \"kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-kube-api-access-jbfgp\") pod \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " Jul 15 10:53:24.699312 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.699217 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-kubeconfig\") pod \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\" (UID: \"9dfe42d3-e785-41a5-8e28-802d7afa7c06\") " Jul 15 10:53:24.700090 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.700048 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "9dfe42d3-e785-41a5-8e28-802d7afa7c06" (UID: "9dfe42d3-e785-41a5-8e28-802d7afa7c06"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:53:24.702409 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.702377 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-cacerts" (OuterVolumeSpecName: "cacerts") pod "9dfe42d3-e785-41a5-8e28-802d7afa7c06" (UID: "9dfe42d3-e785-41a5-8e28-802d7afa7c06"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:53:24.702409 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.702393 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-token" (OuterVolumeSpecName: "istio-token") pod "9dfe42d3-e785-41a5-8e28-802d7afa7c06" (UID: "9dfe42d3-e785-41a5-8e28-802d7afa7c06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:53:24.702552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.702393 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dfe42d3-e785-41a5-8e28-802d7afa7c06-local-certs" (OuterVolumeSpecName: "local-certs") pod "9dfe42d3-e785-41a5-8e28-802d7afa7c06" (UID: "9dfe42d3-e785-41a5-8e28-802d7afa7c06"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:53:24.702552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.702444 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-kube-api-access-jbfgp" (OuterVolumeSpecName: "kube-api-access-jbfgp") pod "9dfe42d3-e785-41a5-8e28-802d7afa7c06" (UID: "9dfe42d3-e785-41a5-8e28-802d7afa7c06"). InnerVolumeSpecName "kube-api-access-jbfgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:53:24.702647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.702562 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "9dfe42d3-e785-41a5-8e28-802d7afa7c06" (UID: "9dfe42d3-e785-41a5-8e28-802d7afa7c06"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:53:24.702705 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.702670 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "9dfe42d3-e785-41a5-8e28-802d7afa7c06" (UID: "9dfe42d3-e785-41a5-8e28-802d7afa7c06"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:53:24.799987 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.799957 2553 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-kubeconfig\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:53:24.799987 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.799980 2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-token\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:53:24.800167 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.799993 2553 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dfe42d3-e785-41a5-8e28-802d7afa7c06-local-certs\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:53:24.800167 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.800006 2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-ca-configmap\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:53:24.800167 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.800016 2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-istio-csr-dns-cert\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:53:24.800167 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.800025 2553 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9dfe42d3-e785-41a5-8e28-802d7afa7c06-cacerts\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:53:24.800167 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:24.800034 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbfgp\" (UniqueName: \"kubernetes.io/projected/9dfe42d3-e785-41a5-8e28-802d7afa7c06-kube-api-access-jbfgp\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:53:25.101667 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.101633 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-w5tgs" Jul 15 10:53:25.150061 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.150028 2553 generic.go:356] "Generic (PLEG): container finished" podID="9dfe42d3-e785-41a5-8e28-802d7afa7c06" containerID="519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576" exitCode=0 Jul 15 10:53:25.150227 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.150065 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" event={"ID":"9dfe42d3-e785-41a5-8e28-802d7afa7c06","Type":"ContainerDied","Data":"519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576"} Jul 15 10:53:25.150227 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.150089 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" Jul 15 10:53:25.150227 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.150127 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt" event={"ID":"9dfe42d3-e785-41a5-8e28-802d7afa7c06","Type":"ContainerDied","Data":"42a2b74d31b4f5260852887cd3e3b1cbea675550140710f3b1c9ec17e62e2bd1"} Jul 15 10:53:25.150227 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.150154 2553 scope.go:117] "RemoveContainer" containerID="519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576" Jul 15 10:53:25.187799 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.187771 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt"] Jul 15 10:53:25.197571 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.197541 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2b8zt"] Jul 15 10:53:25.318751 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.318585 2553 scope.go:117] "RemoveContainer" containerID="519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576" Jul 15 10:53:25.318974 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:53:25.318899 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576\": container with ID starting with 519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576 not found: ID does not exist" containerID="519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576" Jul 15 10:53:25.318974 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.318924 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576"} err="failed to get container status \"519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576\": rpc error: code = NotFound desc = could not find container \"519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576\": container with ID starting with 519559087e3527e28fe39a11347b86b8a169e736d0d893efc52865e0b98a3576 not found: ID does not exist" Jul 15 10:53:25.565521 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:25.565495 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dfe42d3-e785-41a5-8e28-802d7afa7c06" path="/var/lib/kubelet/pods/9dfe42d3-e785-41a5-8e28-802d7afa7c06/volumes" Jul 15 10:53:26.156626 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:26.156591 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" event={"ID":"282c1c11-0da1-4533-89f8-276810df505e","Type":"ContainerStarted","Data":"8a9bb6f2de308211369255eb2cfcfcbff77dc603aa1de9b86477e8885261bd80"} Jul 15 10:53:26.156825 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:26.156650 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:53:26.175485 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:26.175436 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" podStartSLOduration=2.352609535 podStartE2EDuration="5.175421475s" totalImagesPullingTime="2.82281194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:53:26.173904435 +0000 UTC m=+327.141222237" watchObservedRunningTime="2026-07-15 10:53:26.175421475 +0000 UTC m=+327.142739277" Jul 15 10:53:43.359008 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:43.358964 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:43.410295 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:43.410242 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:53:57.169228 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:53:57.169151 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4zvlb" Jul 15 10:54:05.893236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:05.893186 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:05.994262 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:05.994221 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:06.039074 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.039047 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qh8ql"] Jul 15 10:54:06.039400 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.039386 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dfe42d3-e785-41a5-8e28-802d7afa7c06" containerName="discovery" Jul 15 10:54:06.039462 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.039402 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dfe42d3-e785-41a5-8e28-802d7afa7c06" containerName="discovery" Jul 15 10:54:06.039498 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.039492 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dfe42d3-e785-41a5-8e28-802d7afa7c06" containerName="discovery" Jul 15 10:54:06.043738 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.043714 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" Jul 15 10:54:06.046075 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.046053 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fvwls\"" Jul 15 10:54:06.046197 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.046120 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 10:54:06.046269 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.046200 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 10:54:06.052176 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.052153 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qh8ql"] Jul 15 10:54:06.080937 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.080916 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ltqk\" (UniqueName: \"kubernetes.io/projected/9f6102d0-d67b-446f-b9b6-39ef14afd30a-kube-api-access-9ltqk\") pod \"kuadrant-operator-catalog-qh8ql\" (UID: \"9f6102d0-d67b-446f-b9b6-39ef14afd30a\") " pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" Jul 15 10:54:06.098740 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.098715 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:06.181584 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.181534 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ltqk\" (UniqueName: \"kubernetes.io/projected/9f6102d0-d67b-446f-b9b6-39ef14afd30a-kube-api-access-9ltqk\") pod \"kuadrant-operator-catalog-qh8ql\" (UID: \"9f6102d0-d67b-446f-b9b6-39ef14afd30a\") " pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" Jul 15 10:54:06.188639 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.188618 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ltqk\" (UniqueName: \"kubernetes.io/projected/9f6102d0-d67b-446f-b9b6-39ef14afd30a-kube-api-access-9ltqk\") pod \"kuadrant-operator-catalog-qh8ql\" (UID: \"9f6102d0-d67b-446f-b9b6-39ef14afd30a\") " pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" Jul 15 10:54:06.355815 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.355792 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" Jul 15 10:54:06.411423 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.411397 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qh8ql"] Jul 15 10:54:06.480209 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.480186 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qh8ql"] Jul 15 10:54:06.482846 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:54:06.482820 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f6102d0_d67b_446f_b9b6_39ef14afd30a.slice/crio-4b031f6fdba69bdba669d39bb25cfb79a182173e44314f7adafc2b8fe4c0ebb8 WatchSource:0}: Error finding container 4b031f6fdba69bdba669d39bb25cfb79a182173e44314f7adafc2b8fe4c0ebb8: Status 404 returned error can't find the container with id 4b031f6fdba69bdba669d39bb25cfb79a182173e44314f7adafc2b8fe4c0ebb8 Jul 15 10:54:06.614250 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.614218 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jpplh"] Jul 15 10:54:06.618527 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.618508 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jpplh" Jul 15 10:54:06.623853 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.623831 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jpplh"] Jul 15 10:54:06.685536 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.685513 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjjj7\" (UniqueName: \"kubernetes.io/projected/7c9e3177-2e49-4972-9c54-ce94c85a0d72-kube-api-access-tjjj7\") pod \"kuadrant-operator-catalog-jpplh\" (UID: \"7c9e3177-2e49-4972-9c54-ce94c85a0d72\") " pod="kuadrant-system/kuadrant-operator-catalog-jpplh" Jul 15 10:54:06.786044 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.786016 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjjj7\" (UniqueName: \"kubernetes.io/projected/7c9e3177-2e49-4972-9c54-ce94c85a0d72-kube-api-access-tjjj7\") pod \"kuadrant-operator-catalog-jpplh\" (UID: \"7c9e3177-2e49-4972-9c54-ce94c85a0d72\") " pod="kuadrant-system/kuadrant-operator-catalog-jpplh" Jul 15 10:54:06.793216 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.793193 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjjj7\" (UniqueName: \"kubernetes.io/projected/7c9e3177-2e49-4972-9c54-ce94c85a0d72-kube-api-access-tjjj7\") pod \"kuadrant-operator-catalog-jpplh\" (UID: \"7c9e3177-2e49-4972-9c54-ce94c85a0d72\") " pod="kuadrant-system/kuadrant-operator-catalog-jpplh" Jul 15 10:54:06.928916 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:06.928888 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jpplh" Jul 15 10:54:07.053820 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:07.053755 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jpplh"] Jul 15 10:54:07.057022 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:54:07.056993 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9e3177_2e49_4972_9c54_ce94c85a0d72.slice/crio-a41a606b74e4a1776623f18848a6cd4049dd3acfa637e7a9dacfababb1a87abf WatchSource:0}: Error finding container a41a606b74e4a1776623f18848a6cd4049dd3acfa637e7a9dacfababb1a87abf: Status 404 returned error can't find the container with id a41a606b74e4a1776623f18848a6cd4049dd3acfa637e7a9dacfababb1a87abf Jul 15 10:54:07.340908 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:07.340833 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jpplh" event={"ID":"7c9e3177-2e49-4972-9c54-ce94c85a0d72","Type":"ContainerStarted","Data":"a41a606b74e4a1776623f18848a6cd4049dd3acfa637e7a9dacfababb1a87abf"} Jul 15 10:54:07.341871 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:07.341838 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" event={"ID":"9f6102d0-d67b-446f-b9b6-39ef14afd30a","Type":"ContainerStarted","Data":"4b031f6fdba69bdba669d39bb25cfb79a182173e44314f7adafc2b8fe4c0ebb8"} Jul 15 10:54:09.355289 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:09.355244 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" event={"ID":"9f6102d0-d67b-446f-b9b6-39ef14afd30a","Type":"ContainerStarted","Data":"44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c"} Jul 15 10:54:09.355776 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:09.355304 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" podUID="9f6102d0-d67b-446f-b9b6-39ef14afd30a" containerName="registry-server" containerID="cri-o://44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c" gracePeriod=2 Jul 15 10:54:09.357111 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:09.357078 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jpplh" event={"ID":"7c9e3177-2e49-4972-9c54-ce94c85a0d72","Type":"ContainerStarted","Data":"f27d21d8cf194e53d12067b817fa7cf3b8df3dc42f515c82d2c3fac1c60a4fb5"} Jul 15 10:54:09.371186 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:09.371136 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" podStartSLOduration=0.638097662 podStartE2EDuration="3.371116583s" totalImagesPullingTime="2.733018921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:54:09.368837222 +0000 UTC m=+370.336155022" watchObservedRunningTime="2026-07-15 10:54:09.371116583 +0000 UTC m=+370.338434587" Jul 15 10:54:09.382440 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:09.382400 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jpplh" podStartSLOduration=1.220380573 podStartE2EDuration="3.38239036s" totalImagesPullingTime="2.162009787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:54:09.381860596 +0000 UTC m=+370.349178423" watchObservedRunningTime="2026-07-15 10:54:09.38239036 +0000 UTC m=+370.349708162" Jul 15 10:54:09.602516 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:09.602489 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" Jul 15 10:54:09.711039 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:09.711013 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ltqk\" (UniqueName: \"kubernetes.io/projected/9f6102d0-d67b-446f-b9b6-39ef14afd30a-kube-api-access-9ltqk\") pod \"9f6102d0-d67b-446f-b9b6-39ef14afd30a\" (UID: \"9f6102d0-d67b-446f-b9b6-39ef14afd30a\") " Jul 15 10:54:09.713078 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:09.713053 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f6102d0-d67b-446f-b9b6-39ef14afd30a-kube-api-access-9ltqk" (OuterVolumeSpecName: "kube-api-access-9ltqk") pod "9f6102d0-d67b-446f-b9b6-39ef14afd30a" (UID: "9f6102d0-d67b-446f-b9b6-39ef14afd30a"). InnerVolumeSpecName "kube-api-access-9ltqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:54:09.811731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:09.811676 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ltqk\" (UniqueName: \"kubernetes.io/projected/9f6102d0-d67b-446f-b9b6-39ef14afd30a-kube-api-access-9ltqk\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:54:10.362771 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:10.362741 2553 generic.go:356] "Generic (PLEG): container finished" podID="9f6102d0-d67b-446f-b9b6-39ef14afd30a" containerID="44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c" exitCode=0 Jul 15 10:54:10.363154 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:10.362785 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" Jul 15 10:54:10.363154 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:10.362824 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" event={"ID":"9f6102d0-d67b-446f-b9b6-39ef14afd30a","Type":"ContainerDied","Data":"44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c"} Jul 15 10:54:10.363154 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:10.362875 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qh8ql" event={"ID":"9f6102d0-d67b-446f-b9b6-39ef14afd30a","Type":"ContainerDied","Data":"4b031f6fdba69bdba669d39bb25cfb79a182173e44314f7adafc2b8fe4c0ebb8"} Jul 15 10:54:10.363154 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:10.362897 2553 scope.go:117] "RemoveContainer" containerID="44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c" Jul 15 10:54:10.372459 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:10.372444 2553 scope.go:117] "RemoveContainer" containerID="44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c" Jul 15 10:54:10.372691 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:54:10.372673 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c\": container with ID starting with 44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c not found: ID does not exist" containerID="44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c" Jul 15 10:54:10.372739 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:10.372699 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c"} err="failed to get container status \"44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c\": rpc error: code = NotFound desc = could not find container \"44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c\": container with ID starting with 44bc886e23de87d4fe736301412824acd28571a3ec42ae27df6864b165cd394c not found: ID does not exist" Jul 15 10:54:10.383543 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:10.383523 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qh8ql"] Jul 15 10:54:10.387672 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:10.387652 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qh8ql"] Jul 15 10:54:11.564246 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:11.564214 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f6102d0-d67b-446f-b9b6-39ef14afd30a" path="/var/lib/kubelet/pods/9f6102d0-d67b-446f-b9b6-39ef14afd30a/volumes" Jul 15 10:54:16.930005 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:16.929974 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jpplh" Jul 15 10:54:16.930473 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:16.930067 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jpplh" Jul 15 10:54:16.953038 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:16.953011 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jpplh" Jul 15 10:54:17.416581 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:17.416558 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jpplh" Jul 15 10:54:34.302116 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:34.302073 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:35.130258 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:35.130225 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:38.570439 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.570410 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9"] Jul 15 10:54:38.570762 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.570749 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6102d0-d67b-446f-b9b6-39ef14afd30a" containerName="registry-server" Jul 15 10:54:38.570762 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.570763 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6102d0-d67b-446f-b9b6-39ef14afd30a" containerName="registry-server" Jul 15 10:54:38.570834 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.570827 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f6102d0-d67b-446f-b9b6-39ef14afd30a" containerName="registry-server" Jul 15 10:54:38.573877 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.573857 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9" Jul 15 10:54:38.576237 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.576218 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4tmwv\"" Jul 15 10:54:38.584265 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.584245 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9"] Jul 15 10:54:38.623469 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.623445 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvm5d\" (UniqueName: \"kubernetes.io/projected/f0d28e56-04e1-4e28-b654-adc70e32c9bc-kube-api-access-dvm5d\") pod \"authorino-operator-75cc8d5cb7-mgpl9\" (UID: \"f0d28e56-04e1-4e28-b654-adc70e32c9bc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9" Jul 15 10:54:38.724502 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.724478 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvm5d\" (UniqueName: \"kubernetes.io/projected/f0d28e56-04e1-4e28-b654-adc70e32c9bc-kube-api-access-dvm5d\") pod \"authorino-operator-75cc8d5cb7-mgpl9\" (UID: \"f0d28e56-04e1-4e28-b654-adc70e32c9bc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9" Jul 15 10:54:38.732180 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.732158 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvm5d\" (UniqueName: \"kubernetes.io/projected/f0d28e56-04e1-4e28-b654-adc70e32c9bc-kube-api-access-dvm5d\") pod \"authorino-operator-75cc8d5cb7-mgpl9\" (UID: \"f0d28e56-04e1-4e28-b654-adc70e32c9bc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9" Jul 15 10:54:38.884541 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:38.884472 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9" Jul 15 10:54:39.014700 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:39.013498 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9"] Jul 15 10:54:39.494723 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:39.494692 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9" event={"ID":"f0d28e56-04e1-4e28-b654-adc70e32c9bc","Type":"ContainerStarted","Data":"869872bdea8725caae0bc638a08f04ec1e88a430508e1bc617532fac0b75f8fa"} Jul 15 10:54:39.728637 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:39.728598 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:41.506156 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.506128 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9" event={"ID":"f0d28e56-04e1-4e28-b654-adc70e32c9bc","Type":"ContainerStarted","Data":"d2ffc38ec2c277f762bba7b09de9a702f28615e8b0115985a2ea3159000c28a3"} Jul 15 10:54:41.506501 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.506200 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9" Jul 15 10:54:41.525712 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.525665 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9" podStartSLOduration=1.150676396 podStartE2EDuration="3.525650561s" totalImagesPullingTime="2.374974165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:54:41.524179579 +0000 UTC m=+402.491497380" watchObservedRunningTime="2026-07-15 10:54:41.525650561 +0000 UTC m=+402.492968362" Jul 15 10:54:41.594180 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.594150 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9"] Jul 15 10:54:41.597433 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.597413 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:54:41.599805 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.599787 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-j79t7\"" Jul 15 10:54:41.608605 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.608586 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9"] Jul 15 10:54:41.751656 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.751632 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k78vc\" (UniqueName: \"kubernetes.io/projected/c5237a05-1cc7-419f-8079-06a1cf3d8073-kube-api-access-k78vc\") pod \"limitador-operator-controller-manager-859d7b78bd-m66w9\" (UID: \"c5237a05-1cc7-419f-8079-06a1cf3d8073\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:54:41.778879 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.778828 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:41.851980 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.851951 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k78vc\" (UniqueName: \"kubernetes.io/projected/c5237a05-1cc7-419f-8079-06a1cf3d8073-kube-api-access-k78vc\") pod \"limitador-operator-controller-manager-859d7b78bd-m66w9\" (UID: \"c5237a05-1cc7-419f-8079-06a1cf3d8073\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:54:41.865457 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.865431 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k78vc\" (UniqueName: \"kubernetes.io/projected/c5237a05-1cc7-419f-8079-06a1cf3d8073-kube-api-access-k78vc\") pod \"limitador-operator-controller-manager-859d7b78bd-m66w9\" (UID: \"c5237a05-1cc7-419f-8079-06a1cf3d8073\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:54:41.883126 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.883100 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:41.907225 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:41.907203 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:54:42.035772 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:42.035749 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9"] Jul 15 10:54:42.037684 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:54:42.037658 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5237a05_1cc7_419f_8079_06a1cf3d8073.slice/crio-1a8e307442f3c5921a2dec74c5505af440eb0cb618f871bbb755f4dfdf6626dd WatchSource:0}: Error finding container 1a8e307442f3c5921a2dec74c5505af440eb0cb618f871bbb755f4dfdf6626dd: Status 404 returned error can't find the container with id 1a8e307442f3c5921a2dec74c5505af440eb0cb618f871bbb755f4dfdf6626dd Jul 15 10:54:42.513017 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:42.512985 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" event={"ID":"c5237a05-1cc7-419f-8079-06a1cf3d8073","Type":"ContainerStarted","Data":"1a8e307442f3c5921a2dec74c5505af440eb0cb618f871bbb755f4dfdf6626dd"} Jul 15 10:54:42.970395 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:42.970354 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:43.748916 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:43.748881 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:44.524586 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:44.524550 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" event={"ID":"c5237a05-1cc7-419f-8079-06a1cf3d8073","Type":"ContainerStarted","Data":"a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573"} Jul 15 10:54:44.524758 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:44.524644 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:54:44.541470 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:44.541422 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" podStartSLOduration=1.800013096 podStartE2EDuration="3.541409344s" totalImagesPullingTime="1.741396248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:54:44.539708367 +0000 UTC m=+405.507026183" watchObservedRunningTime="2026-07-15 10:54:44.541409344 +0000 UTC m=+405.508727145" Jul 15 10:54:44.985908 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:44.985879 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c"] Jul 15 10:54:44.989249 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:44.989232 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c" Jul 15 10:54:44.991820 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:44.991797 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 10:54:44.991820 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:44.991814 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7ckwr\"" Jul 15 10:54:44.999956 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:44.999936 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c"] Jul 15 10:54:45.079363 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:45.079324 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td4wv\" (UniqueName: \"kubernetes.io/projected/b69b2028-0b1d-40af-a39b-08d5341c6383-kube-api-access-td4wv\") pod \"dns-operator-controller-manager-864dd78c4c-zlz7c\" (UID: \"b69b2028-0b1d-40af-a39b-08d5341c6383\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c" Jul 15 10:54:45.180282 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:45.180259 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td4wv\" (UniqueName: \"kubernetes.io/projected/b69b2028-0b1d-40af-a39b-08d5341c6383-kube-api-access-td4wv\") pod \"dns-operator-controller-manager-864dd78c4c-zlz7c\" (UID: \"b69b2028-0b1d-40af-a39b-08d5341c6383\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c" Jul 15 10:54:45.187825 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:45.187796 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td4wv\" (UniqueName: \"kubernetes.io/projected/b69b2028-0b1d-40af-a39b-08d5341c6383-kube-api-access-td4wv\") pod \"dns-operator-controller-manager-864dd78c4c-zlz7c\" (UID: \"b69b2028-0b1d-40af-a39b-08d5341c6383\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c" Jul 15 10:54:45.300067 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:45.300013 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c" Jul 15 10:54:45.431270 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:45.431245 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c"] Jul 15 10:54:45.434073 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:54:45.434053 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69b2028_0b1d_40af_a39b_08d5341c6383.slice/crio-b4c054fc4a180ed31bbd753a4bbaf85d78290a415e295d553b4a0b865769a812 WatchSource:0}: Error finding container b4c054fc4a180ed31bbd753a4bbaf85d78290a415e295d553b4a0b865769a812: Status 404 returned error can't find the container with id b4c054fc4a180ed31bbd753a4bbaf85d78290a415e295d553b4a0b865769a812 Jul 15 10:54:45.530398 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:45.530371 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c" event={"ID":"b69b2028-0b1d-40af-a39b-08d5341c6383","Type":"ContainerStarted","Data":"b4c054fc4a180ed31bbd753a4bbaf85d78290a415e295d553b4a0b865769a812"} Jul 15 10:54:45.743042 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:45.743004 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:46.171032 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:46.170951 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:48.549195 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:48.549164 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c" event={"ID":"b69b2028-0b1d-40af-a39b-08d5341c6383","Type":"ContainerStarted","Data":"8a0dfa8cc25a6a6356b066d8128e38e4aabb7a8756c6f31b2320a6ff47f6a0f6"} Jul 15 10:54:48.549585 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:48.549265 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c" Jul 15 10:54:48.565496 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:48.565452 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c" podStartSLOduration=1.916720598 podStartE2EDuration="4.565439403s" totalImagesPullingTime="2.648718805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:54:48.564669111 +0000 UTC m=+409.531986913" watchObservedRunningTime="2026-07-15 10:54:48.565439403 +0000 UTC m=+409.532757203" Jul 15 10:54:49.363618 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:49.363584 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:50.036746 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.036706 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm"] Jul 15 10:54:50.040423 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.040400 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:54:50.046063 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.046035 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xvngj\"" Jul 15 10:54:50.052612 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.052589 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm"] Jul 15 10:54:50.120706 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.120683 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvwlm\" (UniqueName: \"kubernetes.io/projected/d6ee96ef-eeca-43ef-84fe-912607c9c004-kube-api-access-xvwlm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" (UID: \"d6ee96ef-eeca-43ef-84fe-912607c9c004\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:54:50.120793 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.120724 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6ee96ef-eeca-43ef-84fe-912607c9c004-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" (UID: \"d6ee96ef-eeca-43ef-84fe-912607c9c004\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:54:50.221682 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.221658 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvwlm\" (UniqueName: \"kubernetes.io/projected/d6ee96ef-eeca-43ef-84fe-912607c9c004-kube-api-access-xvwlm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" (UID: \"d6ee96ef-eeca-43ef-84fe-912607c9c004\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:54:50.221766 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.221687 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6ee96ef-eeca-43ef-84fe-912607c9c004-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" (UID: \"d6ee96ef-eeca-43ef-84fe-912607c9c004\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:54:50.222014 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.221998 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6ee96ef-eeca-43ef-84fe-912607c9c004-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" (UID: \"d6ee96ef-eeca-43ef-84fe-912607c9c004\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:54:50.231662 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.231643 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvwlm\" (UniqueName: \"kubernetes.io/projected/d6ee96ef-eeca-43ef-84fe-912607c9c004-kube-api-access-xvwlm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" (UID: \"d6ee96ef-eeca-43ef-84fe-912607c9c004\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:54:50.350366 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.350298 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:54:50.478935 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.478909 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm"] Jul 15 10:54:50.481221 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:54:50.481192 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ee96ef_eeca_43ef_84fe_912607c9c004.slice/crio-f61765f5297cbcf38b3788c57def6eca571ebdeac8d81bfa519cef7bb7e62303 WatchSource:0}: Error finding container f61765f5297cbcf38b3788c57def6eca571ebdeac8d81bfa519cef7bb7e62303: Status 404 returned error can't find the container with id f61765f5297cbcf38b3788c57def6eca571ebdeac8d81bfa519cef7bb7e62303 Jul 15 10:54:50.559527 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:50.559497 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" event={"ID":"d6ee96ef-eeca-43ef-84fe-912607c9c004","Type":"ContainerStarted","Data":"f61765f5297cbcf38b3788c57def6eca571ebdeac8d81bfa519cef7bb7e62303"} Jul 15 10:54:51.324059 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:51.324019 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:51.417868 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:51.417838 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:51.787264 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:51.787196 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:51.886771 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:51.886742 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:52.515039 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:52.515008 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgpl9" Jul 15 10:54:55.113605 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:55.113537 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:55.215170 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:55.215111 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:55.533834 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:55.533805 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:54:56.590428 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:56.590398 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" event={"ID":"d6ee96ef-eeca-43ef-84fe-912607c9c004","Type":"ContainerStarted","Data":"e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45"} Jul 15 10:54:56.590846 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:56.590579 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:54:56.609395 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:56.609350 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" podStartSLOduration=1.196544193 podStartE2EDuration="6.609319079s" totalImagesPullingTime="5.412774886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:54:56.607661153 +0000 UTC m=+417.574978973" watchObservedRunningTime="2026-07-15 10:54:56.609319079 +0000 UTC m=+417.576636880" Jul 15 10:54:57.899268 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:57.899234 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:58.002375 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:58.002322 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:58.467372 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:58.467341 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:58.562277 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:58.562232 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:58.662918 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:58.662888 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:59.423845 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:59.423813 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:54:59.556265 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:54:59.556245 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zlz7c" Jul 15 10:55:00.435665 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:00.435624 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:01.770031 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:01.769998 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:01.871731 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:01.871699 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:02.460860 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:02.460829 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:02.561208 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:02.561174 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:07.597082 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:07.597051 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:55:08.510402 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.510371 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b"] Jul 15 10:55:08.515215 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.515198 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:08.523498 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.523474 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b"] Jul 15 10:55:08.663271 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.663232 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnflm\" (UniqueName: \"kubernetes.io/projected/4f49975c-89ed-48a0-ba26-6d1409c1622e-kube-api-access-nnflm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zjq6b\" (UID: \"4f49975c-89ed-48a0-ba26-6d1409c1622e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:08.663754 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.663417 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f49975c-89ed-48a0-ba26-6d1409c1622e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zjq6b\" (UID: \"4f49975c-89ed-48a0-ba26-6d1409c1622e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:08.763922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.763850 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f49975c-89ed-48a0-ba26-6d1409c1622e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zjq6b\" (UID: \"4f49975c-89ed-48a0-ba26-6d1409c1622e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:08.763922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.763905 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnflm\" (UniqueName: \"kubernetes.io/projected/4f49975c-89ed-48a0-ba26-6d1409c1622e-kube-api-access-nnflm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zjq6b\" (UID: \"4f49975c-89ed-48a0-ba26-6d1409c1622e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:08.764202 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.764183 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f49975c-89ed-48a0-ba26-6d1409c1622e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zjq6b\" (UID: \"4f49975c-89ed-48a0-ba26-6d1409c1622e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:08.773354 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.773317 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnflm\" (UniqueName: \"kubernetes.io/projected/4f49975c-89ed-48a0-ba26-6d1409c1622e-kube-api-access-nnflm\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zjq6b\" (UID: \"4f49975c-89ed-48a0-ba26-6d1409c1622e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:08.828023 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.828002 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:08.965426 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:08.965402 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b"] Jul 15 10:55:08.968035 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:55:08.968010 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f49975c_89ed_48a0_ba26_6d1409c1622e.slice/crio-56d0dc0229d40528d462c9f2c8790bdfcadefc3bd4460bba5374ac8f72fafdcb WatchSource:0}: Error finding container 56d0dc0229d40528d462c9f2c8790bdfcadefc3bd4460bba5374ac8f72fafdcb: Status 404 returned error can't find the container with id 56d0dc0229d40528d462c9f2c8790bdfcadefc3bd4460bba5374ac8f72fafdcb Jul 15 10:55:09.296058 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.295986 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b"] Jul 15 10:55:09.299897 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.299868 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b"] Jul 15 10:55:09.309101 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.309073 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm"] Jul 15 10:55:09.309290 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.309266 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" podUID="d6ee96ef-eeca-43ef-84fe-912607c9c004" containerName="manager" containerID="cri-o://e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45" gracePeriod=2 Jul 15 10:55:09.325030 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.323287 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr"] Jul 15 10:55:09.325030 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.324056 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f49975c-89ed-48a0-ba26-6d1409c1622e" containerName="manager" Jul 15 10:55:09.325030 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.324077 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f49975c-89ed-48a0-ba26-6d1409c1622e" containerName="manager" Jul 15 10:55:09.325030 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.324238 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f49975c-89ed-48a0-ba26-6d1409c1622e" containerName="manager" Jul 15 10:55:09.327857 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.327812 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm"] Jul 15 10:55:09.328104 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.327953 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:09.330969 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.330938 2553 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d6ee96ef-eeca-43ef-84fe-912607c9c004\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\": pods \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:55:09.332761 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.332733 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" is forbidden: User \"system:node:ip-10-0-131-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-232.ec2.internal' and this object" podUID="d6ee96ef-eeca-43ef-84fe-912607c9c004" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:55:09.338661 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.338640 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc"] Jul 15 10:55:09.339013 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.338997 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6ee96ef-eeca-43ef-84fe-912607c9c004" containerName="manager" Jul 15 10:55:09.339087 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.339015 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6ee96ef-eeca-43ef-84fe-912607c9c004" containerName="manager" Jul 15 10:55:09.339146 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.339108 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6ee96ef-eeca-43ef-84fe-912607c9c004" containerName="manager" Jul 15 10:55:09.342273 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.342253 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9"] Jul 15 10:55:09.342504 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.342484 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:09.342504 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.342491 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" podUID="c5237a05-1cc7-419f-8079-06a1cf3d8073" containerName="manager" containerID="cri-o://a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573" gracePeriod=2 Jul 15 10:55:09.343065 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.343047 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr"] Jul 15 10:55:09.348785 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.348758 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9"] Jul 15 10:55:09.356065 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.356041 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc"] Jul 15 10:55:09.358599 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.358561 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m66w9\" is forbidden: User \"system:node:ip-10-0-131-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-232.ec2.internal' and this object" podUID="c5237a05-1cc7-419f-8079-06a1cf3d8073" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:55:09.360427 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.360401 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" is forbidden: User \"system:node:ip-10-0-131-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-232.ec2.internal' and this object" podUID="d6ee96ef-eeca-43ef-84fe-912607c9c004" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:55:09.363073 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.363053 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz"] Jul 15 10:55:09.363560 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.363545 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5237a05-1cc7-419f-8079-06a1cf3d8073" containerName="manager" Jul 15 10:55:09.363607 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.363564 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5237a05-1cc7-419f-8079-06a1cf3d8073" containerName="manager" Jul 15 10:55:09.363666 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.363656 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5237a05-1cc7-419f-8079-06a1cf3d8073" containerName="manager" Jul 15 10:55:09.366790 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.366773 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz" Jul 15 10:55:09.368653 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.368628 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22fq9\" (UniqueName: \"kubernetes.io/projected/70df92f7-77c3-411b-8ab7-ed7be9f28e68-kube-api-access-22fq9\") pod \"limitador-operator-controller-manager-859d7b78bd-8l4vz\" (UID: \"70df92f7-77c3-411b-8ab7-ed7be9f28e68\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz" Jul 15 10:55:09.377471 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.377449 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz"] Jul 15 10:55:09.384429 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.384404 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m66w9\" is forbidden: User \"system:node:ip-10-0-131-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-232.ec2.internal' and this object" podUID="c5237a05-1cc7-419f-8079-06a1cf3d8073" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:55:09.386477 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.386455 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" is forbidden: User \"system:node:ip-10-0-131-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-232.ec2.internal' and this object" podUID="d6ee96ef-eeca-43ef-84fe-912607c9c004" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:55:09.469872 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.469843 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/873a08f9-2503-48ab-98fb-3125c637df0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6lbcc\" (UID: \"873a08f9-2503-48ab-98fb-3125c637df0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:09.469979 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.469886 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncz24\" (UniqueName: \"kubernetes.io/projected/1670c8a0-c01c-43da-bf56-ebccf8341384-kube-api-access-ncz24\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xzfzr\" (UID: \"1670c8a0-c01c-43da-bf56-ebccf8341384\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:09.469979 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.469917 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1670c8a0-c01c-43da-bf56-ebccf8341384-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xzfzr\" (UID: \"1670c8a0-c01c-43da-bf56-ebccf8341384\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:09.469979 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.469964 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22fq9\" (UniqueName: \"kubernetes.io/projected/70df92f7-77c3-411b-8ab7-ed7be9f28e68-kube-api-access-22fq9\") pod \"limitador-operator-controller-manager-859d7b78bd-8l4vz\" (UID: \"70df92f7-77c3-411b-8ab7-ed7be9f28e68\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz" Jul 15 10:55:09.470125 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.470012 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwc5j\" (UniqueName: \"kubernetes.io/projected/873a08f9-2503-48ab-98fb-3125c637df0d-kube-api-access-lwc5j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6lbcc\" (UID: \"873a08f9-2503-48ab-98fb-3125c637df0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:09.478077 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.478055 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22fq9\" (UniqueName: \"kubernetes.io/projected/70df92f7-77c3-411b-8ab7-ed7be9f28e68-kube-api-access-22fq9\") pod \"limitador-operator-controller-manager-859d7b78bd-8l4vz\" (UID: \"70df92f7-77c3-411b-8ab7-ed7be9f28e68\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz" Jul 15 10:55:09.568954 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.568603 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m66w9\" is forbidden: User \"system:node:ip-10-0-131-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-232.ec2.internal' and this object" podUID="c5237a05-1cc7-419f-8079-06a1cf3d8073" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:55:09.570610 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.570566 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pbtjm\" is forbidden: User \"system:node:ip-10-0-131-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-232.ec2.internal' and this object" podUID="d6ee96ef-eeca-43ef-84fe-912607c9c004" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:55:09.570748 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.570718 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwc5j\" (UniqueName: \"kubernetes.io/projected/873a08f9-2503-48ab-98fb-3125c637df0d-kube-api-access-lwc5j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6lbcc\" (UID: \"873a08f9-2503-48ab-98fb-3125c637df0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:09.570824 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.570807 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/873a08f9-2503-48ab-98fb-3125c637df0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6lbcc\" (UID: \"873a08f9-2503-48ab-98fb-3125c637df0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:09.570884 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.570843 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncz24\" (UniqueName: \"kubernetes.io/projected/1670c8a0-c01c-43da-bf56-ebccf8341384-kube-api-access-ncz24\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xzfzr\" (UID: \"1670c8a0-c01c-43da-bf56-ebccf8341384\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:09.570934 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.570887 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1670c8a0-c01c-43da-bf56-ebccf8341384-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xzfzr\" (UID: \"1670c8a0-c01c-43da-bf56-ebccf8341384\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:09.571418 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.571397 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/873a08f9-2503-48ab-98fb-3125c637df0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6lbcc\" (UID: \"873a08f9-2503-48ab-98fb-3125c637df0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:09.571748 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.571398 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1670c8a0-c01c-43da-bf56-ebccf8341384-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xzfzr\" (UID: \"1670c8a0-c01c-43da-bf56-ebccf8341384\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:09.582091 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.582073 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:55:09.582884 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.582862 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwc5j\" (UniqueName: \"kubernetes.io/projected/873a08f9-2503-48ab-98fb-3125c637df0d-kube-api-access-lwc5j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6lbcc\" (UID: \"873a08f9-2503-48ab-98fb-3125c637df0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:09.583323 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.583304 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncz24\" (UniqueName: \"kubernetes.io/projected/1670c8a0-c01c-43da-bf56-ebccf8341384-kube-api-access-ncz24\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xzfzr\" (UID: \"1670c8a0-c01c-43da-bf56-ebccf8341384\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:09.584766 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.584749 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:55:09.649351 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.649310 2553 generic.go:356] "Generic (PLEG): container finished" podID="d6ee96ef-eeca-43ef-84fe-912607c9c004" containerID="e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45" exitCode=0 Jul 15 10:55:09.649475 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.649354 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbtjm" Jul 15 10:55:09.649475 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.649418 2553 scope.go:117] "RemoveContainer" containerID="e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45" Jul 15 10:55:09.650760 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.650737 2553 generic.go:356] "Generic (PLEG): container finished" podID="c5237a05-1cc7-419f-8079-06a1cf3d8073" containerID="a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573" exitCode=0 Jul 15 10:55:09.650859 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.650774 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m66w9" Jul 15 10:55:09.652644 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.652628 2553 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" container="manager" Jul 15 10:55:09.660514 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.660497 2553 scope.go:117] "RemoveContainer" containerID="e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45" Jul 15 10:55:09.660907 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.660760 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45\": container with ID starting with e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45 not found: ID does not exist" containerID="e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45" Jul 15 10:55:09.660907 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.660791 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45"} err="failed to get container status \"e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45\": rpc error: code = NotFound desc = could not find container \"e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45\": container with ID starting with e9a17a33f9d18ab1595e051ff500158bbf65df4a09c87997512e68f198064e45 not found: ID does not exist" Jul 15 10:55:09.660907 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.660815 2553 scope.go:117] "RemoveContainer" containerID="a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573" Jul 15 10:55:09.669839 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.669824 2553 scope.go:117] "RemoveContainer" containerID="a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573" Jul 15 10:55:09.670124 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:09.670056 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573\": container with ID starting with a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573 not found: ID does not exist" containerID="a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573" Jul 15 10:55:09.670124 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.670077 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573"} err="failed to get container status \"a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573\": rpc error: code = NotFound desc = could not find container \"a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573\": container with ID starting with a0392a81f4da5a7a02a3f46288c695f54890f73a7106cbce1609ce621b694573 not found: ID does not exist" Jul 15 10:55:09.671651 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.671628 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6ee96ef-eeca-43ef-84fe-912607c9c004-extensions-socket-volume\") pod \"d6ee96ef-eeca-43ef-84fe-912607c9c004\" (UID: \"d6ee96ef-eeca-43ef-84fe-912607c9c004\") " Jul 15 10:55:09.671745 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.671678 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k78vc\" (UniqueName: \"kubernetes.io/projected/c5237a05-1cc7-419f-8079-06a1cf3d8073-kube-api-access-k78vc\") pod \"c5237a05-1cc7-419f-8079-06a1cf3d8073\" (UID: \"c5237a05-1cc7-419f-8079-06a1cf3d8073\") " Jul 15 10:55:09.671805 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.671744 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvwlm\" (UniqueName: \"kubernetes.io/projected/d6ee96ef-eeca-43ef-84fe-912607c9c004-kube-api-access-xvwlm\") pod \"d6ee96ef-eeca-43ef-84fe-912607c9c004\" (UID: \"d6ee96ef-eeca-43ef-84fe-912607c9c004\") " Jul 15 10:55:09.672035 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.672010 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6ee96ef-eeca-43ef-84fe-912607c9c004-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d6ee96ef-eeca-43ef-84fe-912607c9c004" (UID: "d6ee96ef-eeca-43ef-84fe-912607c9c004"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:55:09.672169 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.672152 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6ee96ef-eeca-43ef-84fe-912607c9c004-extensions-socket-volume\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:55:09.673892 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.673871 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5237a05-1cc7-419f-8079-06a1cf3d8073-kube-api-access-k78vc" (OuterVolumeSpecName: "kube-api-access-k78vc") pod "c5237a05-1cc7-419f-8079-06a1cf3d8073" (UID: "c5237a05-1cc7-419f-8079-06a1cf3d8073"). InnerVolumeSpecName "kube-api-access-k78vc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:55:09.674080 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.674062 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6ee96ef-eeca-43ef-84fe-912607c9c004-kube-api-access-xvwlm" (OuterVolumeSpecName: "kube-api-access-xvwlm") pod "d6ee96ef-eeca-43ef-84fe-912607c9c004" (UID: "d6ee96ef-eeca-43ef-84fe-912607c9c004"). InnerVolumeSpecName "kube-api-access-xvwlm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:55:09.733212 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.733186 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:09.740737 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.740720 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:09.746589 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.746571 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz" Jul 15 10:55:09.773743 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.773711 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k78vc\" (UniqueName: \"kubernetes.io/projected/c5237a05-1cc7-419f-8079-06a1cf3d8073-kube-api-access-k78vc\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:55:09.773743 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.773745 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvwlm\" (UniqueName: \"kubernetes.io/projected/d6ee96ef-eeca-43ef-84fe-912607c9c004-kube-api-access-xvwlm\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:55:09.887715 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:09.887678 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr"] Jul 15 10:55:09.890393 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:55:09.890364 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1670c8a0_c01c_43da_bf56_ebccf8341384.slice/crio-a11128a7117f1809ae690e71d6ab319ed2989fbf8cec511aa677acbf2bd58c57 WatchSource:0}: Error finding container a11128a7117f1809ae690e71d6ab319ed2989fbf8cec511aa677acbf2bd58c57: Status 404 returned error can't find the container with id a11128a7117f1809ae690e71d6ab319ed2989fbf8cec511aa677acbf2bd58c57 Jul 15 10:55:10.123181 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.123070 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc"] Jul 15 10:55:10.124972 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.124937 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz"] Jul 15 10:55:10.125783 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:55:10.125757 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873a08f9_2503_48ab_98fb_3125c637df0d.slice/crio-766774f702d81cef58aef1f071a6d8df3b92e63fbedcbcb6961e9c501c8c255a WatchSource:0}: Error finding container 766774f702d81cef58aef1f071a6d8df3b92e63fbedcbcb6961e9c501c8c255a: Status 404 returned error can't find the container with id 766774f702d81cef58aef1f071a6d8df3b92e63fbedcbcb6961e9c501c8c255a Jul 15 10:55:10.126599 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:55:10.126573 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70df92f7_77c3_411b_8ab7_ed7be9f28e68.slice/crio-5bbb9238792a010078dfcf18f798ee7c413637427f9736044a3d1a3ec05f5436 WatchSource:0}: Error finding container 5bbb9238792a010078dfcf18f798ee7c413637427f9736044a3d1a3ec05f5436: Status 404 returned error can't find the container with id 5bbb9238792a010078dfcf18f798ee7c413637427f9736044a3d1a3ec05f5436 Jul 15 10:55:10.658103 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.658070 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz" event={"ID":"70df92f7-77c3-411b-8ab7-ed7be9f28e68","Type":"ContainerStarted","Data":"7485bd5e298b46be5a900afc11d0bc860305a0b5fe6bfe939e91b3218fdd3b6a"} Jul 15 10:55:10.658297 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.658122 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz" event={"ID":"70df92f7-77c3-411b-8ab7-ed7be9f28e68","Type":"ContainerStarted","Data":"5bbb9238792a010078dfcf18f798ee7c413637427f9736044a3d1a3ec05f5436"} Jul 15 10:55:10.658297 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.658255 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz" Jul 15 10:55:10.659743 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.659721 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" event={"ID":"873a08f9-2503-48ab-98fb-3125c637df0d","Type":"ContainerStarted","Data":"2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d"} Jul 15 10:55:10.659820 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.659758 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" event={"ID":"873a08f9-2503-48ab-98fb-3125c637df0d","Type":"ContainerStarted","Data":"766774f702d81cef58aef1f071a6d8df3b92e63fbedcbcb6961e9c501c8c255a"} Jul 15 10:55:10.659820 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.659799 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:10.662152 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.662129 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" event={"ID":"1670c8a0-c01c-43da-bf56-ebccf8341384","Type":"ContainerStarted","Data":"2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b"} Jul 15 10:55:10.662274 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.662171 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" event={"ID":"1670c8a0-c01c-43da-bf56-ebccf8341384","Type":"ContainerStarted","Data":"a11128a7117f1809ae690e71d6ab319ed2989fbf8cec511aa677acbf2bd58c57"} Jul 15 10:55:10.662274 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.662198 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:10.664548 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.664517 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" podUID="4f49975c-89ed-48a0-ba26-6d1409c1622e" containerName="manager" containerID="cri-o://5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b" gracePeriod=2 Jul 15 10:55:10.674610 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.674562 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz" podStartSLOduration=1.674546072 podStartE2EDuration="1.674546072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:55:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:55:10.674298238 +0000 UTC m=+431.641616051" watchObservedRunningTime="2026-07-15 10:55:10.674546072 +0000 UTC m=+431.641863874" Jul 15 10:55:10.676492 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:10.676464 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zjq6b\" is forbidden: User \"system:node:ip-10-0-131-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-232.ec2.internal' and this object" podUID="4f49975c-89ed-48a0-ba26-6d1409c1622e" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:10.695671 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.695633 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" podStartSLOduration=1.695620882 podStartE2EDuration="1.695620882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:55:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:55:10.694568381 +0000 UTC m=+431.661886207" watchObservedRunningTime="2026-07-15 10:55:10.695620882 +0000 UTC m=+431.662938682" Jul 15 10:55:10.719133 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.719090 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" podStartSLOduration=1.719078951 podStartE2EDuration="1.719078951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:55:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:55:10.718302622 +0000 UTC m=+431.685620428" watchObservedRunningTime="2026-07-15 10:55:10.719078951 +0000 UTC m=+431.686396825" Jul 15 10:55:10.914924 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.914866 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:10.918453 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:10.918428 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zjq6b\" is forbidden: User \"system:node:ip-10-0-131-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-232.ec2.internal' and this object" podUID="4f49975c-89ed-48a0-ba26-6d1409c1622e" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:10.983626 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.983598 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnflm\" (UniqueName: \"kubernetes.io/projected/4f49975c-89ed-48a0-ba26-6d1409c1622e-kube-api-access-nnflm\") pod \"4f49975c-89ed-48a0-ba26-6d1409c1622e\" (UID: \"4f49975c-89ed-48a0-ba26-6d1409c1622e\") " Jul 15 10:55:10.983743 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.983688 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f49975c-89ed-48a0-ba26-6d1409c1622e-extensions-socket-volume\") pod \"4f49975c-89ed-48a0-ba26-6d1409c1622e\" (UID: \"4f49975c-89ed-48a0-ba26-6d1409c1622e\") " Jul 15 10:55:10.984029 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.983996 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f49975c-89ed-48a0-ba26-6d1409c1622e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4f49975c-89ed-48a0-ba26-6d1409c1622e" (UID: "4f49975c-89ed-48a0-ba26-6d1409c1622e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:55:10.985591 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:10.985561 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f49975c-89ed-48a0-ba26-6d1409c1622e-kube-api-access-nnflm" (OuterVolumeSpecName: "kube-api-access-nnflm") pod "4f49975c-89ed-48a0-ba26-6d1409c1622e" (UID: "4f49975c-89ed-48a0-ba26-6d1409c1622e"). InnerVolumeSpecName "kube-api-access-nnflm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:55:11.084677 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.084655 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnflm\" (UniqueName: \"kubernetes.io/projected/4f49975c-89ed-48a0-ba26-6d1409c1622e-kube-api-access-nnflm\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:55:11.084677 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.084678 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f49975c-89ed-48a0-ba26-6d1409c1622e-extensions-socket-volume\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:55:11.149402 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.149377 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:11.250184 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.250156 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:11.564749 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.564688 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f49975c-89ed-48a0-ba26-6d1409c1622e" path="/var/lib/kubelet/pods/4f49975c-89ed-48a0-ba26-6d1409c1622e/volumes" Jul 15 10:55:11.565021 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.565008 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5237a05-1cc7-419f-8079-06a1cf3d8073" path="/var/lib/kubelet/pods/c5237a05-1cc7-419f-8079-06a1cf3d8073/volumes" Jul 15 10:55:11.565315 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.565304 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6ee96ef-eeca-43ef-84fe-912607c9c004" path="/var/lib/kubelet/pods/d6ee96ef-eeca-43ef-84fe-912607c9c004/volumes" Jul 15 10:55:11.670566 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.670536 2553 generic.go:356] "Generic (PLEG): container finished" podID="4f49975c-89ed-48a0-ba26-6d1409c1622e" containerID="5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b" exitCode=0 Jul 15 10:55:11.670672 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.670577 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:11.670672 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.670634 2553 scope.go:117] "RemoveContainer" containerID="5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b" Jul 15 10:55:11.674960 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:11.674929 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zjq6b\" is forbidden: User \"system:node:ip-10-0-131-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-232.ec2.internal' and this object" podUID="4f49975c-89ed-48a0-ba26-6d1409c1622e" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zjq6b" Jul 15 10:55:11.679184 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.679169 2553 scope.go:117] "RemoveContainer" containerID="5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b" Jul 15 10:55:11.679433 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:11.679412 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b\": container with ID starting with 5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b not found: ID does not exist" containerID="5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b" Jul 15 10:55:11.679500 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:11.679440 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b"} err="failed to get container status \"5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b\": rpc error: code = NotFound desc = could not find container \"5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b\": container with ID starting with 5afbd79faf0e1cc7fe057d59a018a97f693a0eec5e73b4de1bbb2fd266aea62b not found: ID does not exist" Jul 15 10:55:14.545751 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:14.545709 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:14.644791 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:14.644757 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:16.733983 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:16.733946 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:16.834124 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:16.834094 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:21.311599 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:21.311566 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:21.411545 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:21.411515 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:21.672922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:21.672846 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:21.672922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:21.672916 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:21.673143 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:21.673053 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8l4vz" Jul 15 10:55:21.747787 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:21.747752 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc"] Jul 15 10:55:21.747948 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:21.747926 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" podUID="873a08f9-2503-48ab-98fb-3125c637df0d" containerName="manager" containerID="cri-o://2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d" gracePeriod=10 Jul 15 10:55:22.002030 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.002009 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:22.067398 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.067343 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/873a08f9-2503-48ab-98fb-3125c637df0d-extensions-socket-volume\") pod \"873a08f9-2503-48ab-98fb-3125c637df0d\" (UID: \"873a08f9-2503-48ab-98fb-3125c637df0d\") " Jul 15 10:55:22.067507 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.067416 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwc5j\" (UniqueName: \"kubernetes.io/projected/873a08f9-2503-48ab-98fb-3125c637df0d-kube-api-access-lwc5j\") pod \"873a08f9-2503-48ab-98fb-3125c637df0d\" (UID: \"873a08f9-2503-48ab-98fb-3125c637df0d\") " Jul 15 10:55:22.067769 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.067741 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/873a08f9-2503-48ab-98fb-3125c637df0d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "873a08f9-2503-48ab-98fb-3125c637df0d" (UID: "873a08f9-2503-48ab-98fb-3125c637df0d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:55:22.069587 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.069562 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/873a08f9-2503-48ab-98fb-3125c637df0d-kube-api-access-lwc5j" (OuterVolumeSpecName: "kube-api-access-lwc5j") pod "873a08f9-2503-48ab-98fb-3125c637df0d" (UID: "873a08f9-2503-48ab-98fb-3125c637df0d"). InnerVolumeSpecName "kube-api-access-lwc5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:55:22.152961 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.152927 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm"] Jul 15 10:55:22.153345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.153318 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="873a08f9-2503-48ab-98fb-3125c637df0d" containerName="manager" Jul 15 10:55:22.153419 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.153348 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="873a08f9-2503-48ab-98fb-3125c637df0d" containerName="manager" Jul 15 10:55:22.153491 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.153479 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="873a08f9-2503-48ab-98fb-3125c637df0d" containerName="manager" Jul 15 10:55:22.156653 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.156635 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 10:55:22.173323 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.169495 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/873a08f9-2503-48ab-98fb-3125c637df0d-extensions-socket-volume\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:55:22.173323 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.169524 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwc5j\" (UniqueName: \"kubernetes.io/projected/873a08f9-2503-48ab-98fb-3125c637df0d-kube-api-access-lwc5j\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:55:22.178020 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.177999 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm"] Jul 15 10:55:22.270399 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.270349 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6141d40-ed87-4f99-85d9-08d02a00b79e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r4lbm\" (UID: \"b6141d40-ed87-4f99-85d9-08d02a00b79e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 10:55:22.270399 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.270391 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx78j\" (UniqueName: \"kubernetes.io/projected/b6141d40-ed87-4f99-85d9-08d02a00b79e-kube-api-access-bx78j\") pod \"kuadrant-operator-controller-manager-86878c769f-r4lbm\" (UID: \"b6141d40-ed87-4f99-85d9-08d02a00b79e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 10:55:22.371080 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.371050 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6141d40-ed87-4f99-85d9-08d02a00b79e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r4lbm\" (UID: \"b6141d40-ed87-4f99-85d9-08d02a00b79e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 10:55:22.371427 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.371093 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx78j\" (UniqueName: \"kubernetes.io/projected/b6141d40-ed87-4f99-85d9-08d02a00b79e-kube-api-access-bx78j\") pod \"kuadrant-operator-controller-manager-86878c769f-r4lbm\" (UID: \"b6141d40-ed87-4f99-85d9-08d02a00b79e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 10:55:22.371469 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.371425 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6141d40-ed87-4f99-85d9-08d02a00b79e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r4lbm\" (UID: \"b6141d40-ed87-4f99-85d9-08d02a00b79e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 10:55:22.380024 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.380000 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx78j\" (UniqueName: \"kubernetes.io/projected/b6141d40-ed87-4f99-85d9-08d02a00b79e-kube-api-access-bx78j\") pod \"kuadrant-operator-controller-manager-86878c769f-r4lbm\" (UID: \"b6141d40-ed87-4f99-85d9-08d02a00b79e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 10:55:22.466578 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.466558 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 10:55:22.621876 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.621850 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm"] Jul 15 10:55:22.624102 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:55:22.624075 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6141d40_ed87_4f99_85d9_08d02a00b79e.slice/crio-5efac7d9dde2d3dcfac90189b55d4561cd9f31d3534739f997ef5b772f518a39 WatchSource:0}: Error finding container 5efac7d9dde2d3dcfac90189b55d4561cd9f31d3534739f997ef5b772f518a39: Status 404 returned error can't find the container with id 5efac7d9dde2d3dcfac90189b55d4561cd9f31d3534739f997ef5b772f518a39 Jul 15 10:55:22.730253 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.730220 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" event={"ID":"b6141d40-ed87-4f99-85d9-08d02a00b79e","Type":"ContainerStarted","Data":"137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b"} Jul 15 10:55:22.730388 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.730368 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 10:55:22.730454 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.730428 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" event={"ID":"b6141d40-ed87-4f99-85d9-08d02a00b79e","Type":"ContainerStarted","Data":"5efac7d9dde2d3dcfac90189b55d4561cd9f31d3534739f997ef5b772f518a39"} Jul 15 10:55:22.731640 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.731615 2553 generic.go:356] "Generic (PLEG): container finished" podID="873a08f9-2503-48ab-98fb-3125c637df0d" containerID="2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d" exitCode=0 Jul 15 10:55:22.731831 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.731669 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" Jul 15 10:55:22.731831 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.731672 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" event={"ID":"873a08f9-2503-48ab-98fb-3125c637df0d","Type":"ContainerDied","Data":"2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d"} Jul 15 10:55:22.731831 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.731786 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc" event={"ID":"873a08f9-2503-48ab-98fb-3125c637df0d","Type":"ContainerDied","Data":"766774f702d81cef58aef1f071a6d8df3b92e63fbedcbcb6961e9c501c8c255a"} Jul 15 10:55:22.731831 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.731809 2553 scope.go:117] "RemoveContainer" containerID="2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d" Jul 15 10:55:22.740744 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.740730 2553 scope.go:117] "RemoveContainer" containerID="2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d" Jul 15 10:55:22.741010 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:22.740993 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d\": container with ID starting with 2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d not found: ID does not exist" containerID="2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d" Jul 15 10:55:22.741053 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.741017 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d"} err="failed to get container status \"2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d\": rpc error: code = NotFound desc = could not find container \"2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d\": container with ID starting with 2957e2fd8a753a6eb6d221d53d3699f5d23a757f63510c74d6eeba162c5f2d0d not found: ID does not exist" Jul 15 10:55:22.748517 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.748477 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" podStartSLOduration=0.748466214 podStartE2EDuration="748.466214ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:55:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:55:22.747039623 +0000 UTC m=+443.714357445" watchObservedRunningTime="2026-07-15 10:55:22.748466214 +0000 UTC m=+443.715784082" Jul 15 10:55:22.763840 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.763813 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc"] Jul 15 10:55:22.767804 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:22.767782 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6lbcc"] Jul 15 10:55:23.565236 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:23.565200 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="873a08f9-2503-48ab-98fb-3125c637df0d" path="/var/lib/kubelet/pods/873a08f9-2503-48ab-98fb-3125c637df0d/volumes" Jul 15 10:55:33.739820 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:33.739791 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 10:55:33.787638 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:33.787602 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr"] Jul 15 10:55:33.787896 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:33.787839 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" podUID="1670c8a0-c01c-43da-bf56-ebccf8341384" containerName="manager" containerID="cri-o://2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b" gracePeriod=10 Jul 15 10:55:33.943322 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:33.943287 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:34.042118 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.042094 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:34.046989 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.046959 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:34.162662 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.162622 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncz24\" (UniqueName: \"kubernetes.io/projected/1670c8a0-c01c-43da-bf56-ebccf8341384-kube-api-access-ncz24\") pod \"1670c8a0-c01c-43da-bf56-ebccf8341384\" (UID: \"1670c8a0-c01c-43da-bf56-ebccf8341384\") " Jul 15 10:55:34.162863 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.162711 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1670c8a0-c01c-43da-bf56-ebccf8341384-extensions-socket-volume\") pod \"1670c8a0-c01c-43da-bf56-ebccf8341384\" (UID: \"1670c8a0-c01c-43da-bf56-ebccf8341384\") " Jul 15 10:55:34.163101 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.163077 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1670c8a0-c01c-43da-bf56-ebccf8341384-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1670c8a0-c01c-43da-bf56-ebccf8341384" (UID: "1670c8a0-c01c-43da-bf56-ebccf8341384"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 10:55:34.164733 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.164712 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1670c8a0-c01c-43da-bf56-ebccf8341384-kube-api-access-ncz24" (OuterVolumeSpecName: "kube-api-access-ncz24") pod "1670c8a0-c01c-43da-bf56-ebccf8341384" (UID: "1670c8a0-c01c-43da-bf56-ebccf8341384"). InnerVolumeSpecName "kube-api-access-ncz24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:55:34.263612 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.263575 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncz24\" (UniqueName: \"kubernetes.io/projected/1670c8a0-c01c-43da-bf56-ebccf8341384-kube-api-access-ncz24\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:55:34.263612 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.263609 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1670c8a0-c01c-43da-bf56-ebccf8341384-extensions-socket-volume\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:55:34.796660 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.796619 2553 generic.go:356] "Generic (PLEG): container finished" podID="1670c8a0-c01c-43da-bf56-ebccf8341384" containerID="2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b" exitCode=0 Jul 15 10:55:34.796660 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.796665 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" Jul 15 10:55:34.797147 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.796706 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" event={"ID":"1670c8a0-c01c-43da-bf56-ebccf8341384","Type":"ContainerDied","Data":"2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b"} Jul 15 10:55:34.797147 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.796778 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr" event={"ID":"1670c8a0-c01c-43da-bf56-ebccf8341384","Type":"ContainerDied","Data":"a11128a7117f1809ae690e71d6ab319ed2989fbf8cec511aa677acbf2bd58c57"} Jul 15 10:55:34.797147 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.796814 2553 scope.go:117] "RemoveContainer" containerID="2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b" Jul 15 10:55:34.806037 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.806018 2553 scope.go:117] "RemoveContainer" containerID="2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b" Jul 15 10:55:34.806363 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:55:34.806323 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b\": container with ID starting with 2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b not found: ID does not exist" containerID="2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b" Jul 15 10:55:34.806428 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.806370 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b"} err="failed to get container status \"2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b\": rpc error: code = NotFound desc = could not find container \"2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b\": container with ID starting with 2746377b592ff43186d6e4065c0c25ab9bddaf63317d27869bea13f7f7eab52b not found: ID does not exist" Jul 15 10:55:34.830164 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.830128 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr"] Jul 15 10:55:34.852297 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:34.852263 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xzfzr"] Jul 15 10:55:35.565058 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:35.565019 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1670c8a0-c01c-43da-bf56-ebccf8341384" path="/var/lib/kubelet/pods/1670c8a0-c01c-43da-bf56-ebccf8341384/volumes" Jul 15 10:55:38.395424 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:38.395383 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:38.495264 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:38.495226 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:45.143500 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:45.143460 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:45.195313 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:45.195272 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:52.277541 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.277475 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:52.288149 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.288117 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-94fgn"] Jul 15 10:55:52.288500 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.288486 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1670c8a0-c01c-43da-bf56-ebccf8341384" containerName="manager" Jul 15 10:55:52.288500 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.288500 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1670c8a0-c01c-43da-bf56-ebccf8341384" containerName="manager" Jul 15 10:55:52.288588 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.288562 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1670c8a0-c01c-43da-bf56-ebccf8341384" containerName="manager" Jul 15 10:55:52.293017 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.293001 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:55:52.295257 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.295227 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 10:55:52.295540 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.295515 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pjzsl\"" Jul 15 10:55:52.298139 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.298118 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-94fgn"] Jul 15 10:55:52.392443 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.392411 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-94fgn"] Jul 15 10:55:52.400607 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.400570 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:52.425828 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.425805 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce6db04e-71a1-407b-98f2-b7abf6a0f722-config-file\") pod \"limitador-limitador-64c94fd64f-94fgn\" (UID: \"ce6db04e-71a1-407b-98f2-b7abf6a0f722\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:55:52.425928 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.425839 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbz6\" (UniqueName: \"kubernetes.io/projected/ce6db04e-71a1-407b-98f2-b7abf6a0f722-kube-api-access-pnbz6\") pod \"limitador-limitador-64c94fd64f-94fgn\" (UID: \"ce6db04e-71a1-407b-98f2-b7abf6a0f722\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:55:52.455562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.455537 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:52.526844 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.526816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce6db04e-71a1-407b-98f2-b7abf6a0f722-config-file\") pod \"limitador-limitador-64c94fd64f-94fgn\" (UID: \"ce6db04e-71a1-407b-98f2-b7abf6a0f722\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:55:52.526962 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.526867 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbz6\" (UniqueName: \"kubernetes.io/projected/ce6db04e-71a1-407b-98f2-b7abf6a0f722-kube-api-access-pnbz6\") pod \"limitador-limitador-64c94fd64f-94fgn\" (UID: \"ce6db04e-71a1-407b-98f2-b7abf6a0f722\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:55:52.527494 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.527473 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce6db04e-71a1-407b-98f2-b7abf6a0f722-config-file\") pod \"limitador-limitador-64c94fd64f-94fgn\" (UID: \"ce6db04e-71a1-407b-98f2-b7abf6a0f722\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:55:52.534471 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.534421 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbz6\" (UniqueName: \"kubernetes.io/projected/ce6db04e-71a1-407b-98f2-b7abf6a0f722-kube-api-access-pnbz6\") pod \"limitador-limitador-64c94fd64f-94fgn\" (UID: \"ce6db04e-71a1-407b-98f2-b7abf6a0f722\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:55:52.604755 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.604731 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:55:52.742421 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.742398 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-94fgn"] Jul 15 10:55:52.744898 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:55:52.744871 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6db04e_71a1_407b_98f2_b7abf6a0f722.slice/crio-b691d3a4927ad5eafee03ce412cd04329bc9f32f9c3635cfdf4ab716a2ee15dd WatchSource:0}: Error finding container b691d3a4927ad5eafee03ce412cd04329bc9f32f9c3635cfdf4ab716a2ee15dd: Status 404 returned error can't find the container with id b691d3a4927ad5eafee03ce412cd04329bc9f32f9c3635cfdf4ab716a2ee15dd Jul 15 10:55:52.886989 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:52.886932 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" event={"ID":"ce6db04e-71a1-407b-98f2-b7abf6a0f722","Type":"ContainerStarted","Data":"b691d3a4927ad5eafee03ce412cd04329bc9f32f9c3635cfdf4ab716a2ee15dd"} Jul 15 10:55:53.094251 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.094220 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zldnp"] Jul 15 10:55:53.104257 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.104231 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zldnp"] Jul 15 10:55:53.104404 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.104322 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zldnp" Jul 15 10:55:53.106783 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.106752 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8rhd4\"" Jul 15 10:55:53.136575 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.136545 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:53.197773 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.197717 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:55:53.233304 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.233275 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjcq5\" (UniqueName: \"kubernetes.io/projected/1a3872d9-356b-4738-86c1-5bed9f410a6e-kube-api-access-rjcq5\") pod \"authorino-58cd955675-zldnp\" (UID: \"1a3872d9-356b-4738-86c1-5bed9f410a6e\") " pod="kuadrant-system/authorino-58cd955675-zldnp" Jul 15 10:55:53.334623 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.334600 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjcq5\" (UniqueName: \"kubernetes.io/projected/1a3872d9-356b-4738-86c1-5bed9f410a6e-kube-api-access-rjcq5\") pod \"authorino-58cd955675-zldnp\" (UID: \"1a3872d9-356b-4738-86c1-5bed9f410a6e\") " pod="kuadrant-system/authorino-58cd955675-zldnp" Jul 15 10:55:53.341883 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.341860 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjcq5\" (UniqueName: \"kubernetes.io/projected/1a3872d9-356b-4738-86c1-5bed9f410a6e-kube-api-access-rjcq5\") pod \"authorino-58cd955675-zldnp\" (UID: \"1a3872d9-356b-4738-86c1-5bed9f410a6e\") " pod="kuadrant-system/authorino-58cd955675-zldnp" Jul 15 10:55:53.415109 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.415087 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zldnp" Jul 15 10:55:53.539846 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.539821 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zldnp"] Jul 15 10:55:53.542739 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:55:53.542691 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a3872d9_356b_4738_86c1_5bed9f410a6e.slice/crio-dca7d32aae963c3908d8d013d30c7032eb51a6b09b18339d43134b2b081bdc75 WatchSource:0}: Error finding container dca7d32aae963c3908d8d013d30c7032eb51a6b09b18339d43134b2b081bdc75: Status 404 returned error can't find the container with id dca7d32aae963c3908d8d013d30c7032eb51a6b09b18339d43134b2b081bdc75 Jul 15 10:55:53.892690 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:53.892607 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zldnp" event={"ID":"1a3872d9-356b-4738-86c1-5bed9f410a6e","Type":"ContainerStarted","Data":"dca7d32aae963c3908d8d013d30c7032eb51a6b09b18339d43134b2b081bdc75"} Jul 15 10:55:58.617064 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:58.617026 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zldnp"] Jul 15 10:55:58.927003 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:58.926894 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" event={"ID":"ce6db04e-71a1-407b-98f2-b7abf6a0f722","Type":"ContainerStarted","Data":"75c4e3f6ce76ae40c5cb886d607ef53b993254ac1bc01c9969bd8fe7d4521c3b"} Jul 15 10:55:58.927003 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:58.926963 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:55:58.928457 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:58.928431 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zldnp" event={"ID":"1a3872d9-356b-4738-86c1-5bed9f410a6e","Type":"ContainerStarted","Data":"2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f"} Jul 15 10:55:58.943172 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:58.943103 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" podStartSLOduration=1.537813437 podStartE2EDuration="6.943080494s" totalImagesPullingTime="5.405267057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:55:58.940447168 +0000 UTC m=+479.907764971" watchObservedRunningTime="2026-07-15 10:55:58.943080494 +0000 UTC m=+479.910398295" Jul 15 10:55:58.955957 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:58.955891 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zldnp" podStartSLOduration=1.335724643 podStartE2EDuration="5.955875325s" totalImagesPullingTime="4.620150682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:55:58.955742764 +0000 UTC m=+479.923060571" watchObservedRunningTime="2026-07-15 10:55:58.955875325 +0000 UTC m=+479.923193128" Jul 15 10:55:59.934037 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:55:59.933931 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zldnp" podUID="1a3872d9-356b-4738-86c1-5bed9f410a6e" containerName="authorino" containerID="cri-o://2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f" gracePeriod=30 Jul 15 10:56:00.204013 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.203983 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zldnp" Jul 15 10:56:00.299579 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.299541 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjcq5\" (UniqueName: \"kubernetes.io/projected/1a3872d9-356b-4738-86c1-5bed9f410a6e-kube-api-access-rjcq5\") pod \"1a3872d9-356b-4738-86c1-5bed9f410a6e\" (UID: \"1a3872d9-356b-4738-86c1-5bed9f410a6e\") " Jul 15 10:56:00.301661 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.301630 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a3872d9-356b-4738-86c1-5bed9f410a6e-kube-api-access-rjcq5" (OuterVolumeSpecName: "kube-api-access-rjcq5") pod "1a3872d9-356b-4738-86c1-5bed9f410a6e" (UID: "1a3872d9-356b-4738-86c1-5bed9f410a6e"). InnerVolumeSpecName "kube-api-access-rjcq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:56:00.400947 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.400909 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjcq5\" (UniqueName: \"kubernetes.io/projected/1a3872d9-356b-4738-86c1-5bed9f410a6e-kube-api-access-rjcq5\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:56:00.939141 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.939106 2553 generic.go:356] "Generic (PLEG): container finished" podID="1a3872d9-356b-4738-86c1-5bed9f410a6e" containerID="2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f" exitCode=0 Jul 15 10:56:00.939583 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.939148 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zldnp" Jul 15 10:56:00.939583 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.939194 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zldnp" event={"ID":"1a3872d9-356b-4738-86c1-5bed9f410a6e","Type":"ContainerDied","Data":"2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f"} Jul 15 10:56:00.939583 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.939234 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zldnp" event={"ID":"1a3872d9-356b-4738-86c1-5bed9f410a6e","Type":"ContainerDied","Data":"dca7d32aae963c3908d8d013d30c7032eb51a6b09b18339d43134b2b081bdc75"} Jul 15 10:56:00.939583 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.939251 2553 scope.go:117] "RemoveContainer" containerID="2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f" Jul 15 10:56:00.948322 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.948304 2553 scope.go:117] "RemoveContainer" containerID="2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f" Jul 15 10:56:00.948670 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:56:00.948652 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f\": container with ID starting with 2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f not found: ID does not exist" containerID="2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f" Jul 15 10:56:00.948719 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.948680 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f"} err="failed to get container status \"2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f\": rpc error: code = NotFound desc = could not find container \"2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f\": container with ID starting with 2d00b4fc34c5a2b299fc14f1ce6d3636058110d1b5901e4a28c893e2183eb40f not found: ID does not exist" Jul 15 10:56:00.959136 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.959104 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zldnp"] Jul 15 10:56:00.961899 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:00.961873 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zldnp"] Jul 15 10:56:01.564955 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:01.564924 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a3872d9-356b-4738-86c1-5bed9f410a6e" path="/var/lib/kubelet/pods/1a3872d9-356b-4738-86c1-5bed9f410a6e/volumes" Jul 15 10:56:09.621115 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:09.621076 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-94fgn"] Jul 15 10:56:09.621553 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:09.621300 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" podUID="ce6db04e-71a1-407b-98f2-b7abf6a0f722" containerName="limitador" containerID="cri-o://75c4e3f6ce76ae40c5cb886d607ef53b993254ac1bc01c9969bd8fe7d4521c3b" gracePeriod=30 Jul 15 10:56:09.623647 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:09.623624 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:56:09.989517 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:09.989479 2553 generic.go:356] "Generic (PLEG): container finished" podID="ce6db04e-71a1-407b-98f2-b7abf6a0f722" containerID="75c4e3f6ce76ae40c5cb886d607ef53b993254ac1bc01c9969bd8fe7d4521c3b" exitCode=0 Jul 15 10:56:09.989679 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:09.989552 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" event={"ID":"ce6db04e-71a1-407b-98f2-b7abf6a0f722","Type":"ContainerDied","Data":"75c4e3f6ce76ae40c5cb886d607ef53b993254ac1bc01c9969bd8fe7d4521c3b"} Jul 15 10:56:10.591901 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:10.591868 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:56:10.691187 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:10.691085 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce6db04e-71a1-407b-98f2-b7abf6a0f722-config-file\") pod \"ce6db04e-71a1-407b-98f2-b7abf6a0f722\" (UID: \"ce6db04e-71a1-407b-98f2-b7abf6a0f722\") " Jul 15 10:56:10.691187 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:10.691176 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnbz6\" (UniqueName: \"kubernetes.io/projected/ce6db04e-71a1-407b-98f2-b7abf6a0f722-kube-api-access-pnbz6\") pod \"ce6db04e-71a1-407b-98f2-b7abf6a0f722\" (UID: \"ce6db04e-71a1-407b-98f2-b7abf6a0f722\") " Jul 15 10:56:10.691730 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:10.691576 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce6db04e-71a1-407b-98f2-b7abf6a0f722-config-file" (OuterVolumeSpecName: "config-file") pod "ce6db04e-71a1-407b-98f2-b7abf6a0f722" (UID: "ce6db04e-71a1-407b-98f2-b7abf6a0f722"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 10:56:10.693301 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:10.693279 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6db04e-71a1-407b-98f2-b7abf6a0f722-kube-api-access-pnbz6" (OuterVolumeSpecName: "kube-api-access-pnbz6") pod "ce6db04e-71a1-407b-98f2-b7abf6a0f722" (UID: "ce6db04e-71a1-407b-98f2-b7abf6a0f722"). InnerVolumeSpecName "kube-api-access-pnbz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:56:10.792293 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:10.792250 2553 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce6db04e-71a1-407b-98f2-b7abf6a0f722-config-file\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:56:10.792293 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:10.792283 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnbz6\" (UniqueName: \"kubernetes.io/projected/ce6db04e-71a1-407b-98f2-b7abf6a0f722-kube-api-access-pnbz6\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:56:10.996054 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:10.996016 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" event={"ID":"ce6db04e-71a1-407b-98f2-b7abf6a0f722","Type":"ContainerDied","Data":"b691d3a4927ad5eafee03ce412cd04329bc9f32f9c3635cfdf4ab716a2ee15dd"} Jul 15 10:56:10.996274 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:10.996077 2553 scope.go:117] "RemoveContainer" containerID="75c4e3f6ce76ae40c5cb886d607ef53b993254ac1bc01c9969bd8fe7d4521c3b" Jul 15 10:56:10.996274 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:10.996032 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-94fgn" Jul 15 10:56:11.015714 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.015684 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-94fgn"] Jul 15 10:56:11.017345 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.017311 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-94fgn"] Jul 15 10:56:11.488462 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.488429 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:11.565579 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.565539 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6db04e-71a1-407b-98f2-b7abf6a0f722" path="/var/lib/kubelet/pods/ce6db04e-71a1-407b-98f2-b7abf6a0f722/volumes" Jul 15 10:56:11.584960 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.584922 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:11.961900 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.961867 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l"] Jul 15 10:56:11.962402 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.962357 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6db04e-71a1-407b-98f2-b7abf6a0f722" containerName="limitador" Jul 15 10:56:11.962402 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.962376 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6db04e-71a1-407b-98f2-b7abf6a0f722" containerName="limitador" Jul 15 10:56:11.962402 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.962394 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a3872d9-356b-4738-86c1-5bed9f410a6e" containerName="authorino" Jul 15 10:56:11.962402 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.962403 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3872d9-356b-4738-86c1-5bed9f410a6e" containerName="authorino" Jul 15 10:56:11.962545 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.962509 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6db04e-71a1-407b-98f2-b7abf6a0f722" containerName="limitador" Jul 15 10:56:11.962545 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.962523 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a3872d9-356b-4738-86c1-5bed9f410a6e" containerName="authorino" Jul 15 10:56:11.967007 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.966982 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" Jul 15 10:56:11.969704 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.969678 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-c64q5\"" Jul 15 10:56:11.969850 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.969699 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 10:56:11.969850 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.969770 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 10:56:11.969850 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.969682 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 15 10:56:11.971772 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.971743 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l"] Jul 15 10:56:11.987736 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:11.987699 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:12.000865 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:12.000836 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/63c2ea81-acbe-48ee-af26-810ba6d9eb78-data\") pod \"postgres-69fb4594cf-7lm6l\" (UID: \"63c2ea81-acbe-48ee-af26-810ba6d9eb78\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" Jul 15 10:56:12.001044 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:12.000931 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgj6d\" (UniqueName: \"kubernetes.io/projected/63c2ea81-acbe-48ee-af26-810ba6d9eb78-kube-api-access-cgj6d\") pod \"postgres-69fb4594cf-7lm6l\" (UID: \"63c2ea81-acbe-48ee-af26-810ba6d9eb78\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" Jul 15 10:56:12.102256 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:12.102219 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgj6d\" (UniqueName: \"kubernetes.io/projected/63c2ea81-acbe-48ee-af26-810ba6d9eb78-kube-api-access-cgj6d\") pod \"postgres-69fb4594cf-7lm6l\" (UID: \"63c2ea81-acbe-48ee-af26-810ba6d9eb78\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" Jul 15 10:56:12.102432 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:12.102264 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/63c2ea81-acbe-48ee-af26-810ba6d9eb78-data\") pod \"postgres-69fb4594cf-7lm6l\" (UID: \"63c2ea81-acbe-48ee-af26-810ba6d9eb78\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" Jul 15 10:56:12.102747 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:12.102725 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/63c2ea81-acbe-48ee-af26-810ba6d9eb78-data\") pod \"postgres-69fb4594cf-7lm6l\" (UID: \"63c2ea81-acbe-48ee-af26-810ba6d9eb78\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" Jul 15 10:56:12.110608 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:12.110583 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgj6d\" (UniqueName: \"kubernetes.io/projected/63c2ea81-acbe-48ee-af26-810ba6d9eb78-kube-api-access-cgj6d\") pod \"postgres-69fb4594cf-7lm6l\" (UID: \"63c2ea81-acbe-48ee-af26-810ba6d9eb78\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" Jul 15 10:56:12.279543 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:12.279433 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" Jul 15 10:56:12.416559 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:12.416528 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l"] Jul 15 10:56:12.419348 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:56:12.419297 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c2ea81_acbe_48ee_af26_810ba6d9eb78.slice/crio-8556e75a580929225359fdefb7adce1424ae45c13f36c60ecb526788be40c1c4 WatchSource:0}: Error finding container 8556e75a580929225359fdefb7adce1424ae45c13f36c60ecb526788be40c1c4: Status 404 returned error can't find the container with id 8556e75a580929225359fdefb7adce1424ae45c13f36c60ecb526788be40c1c4 Jul 15 10:56:13.008675 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:13.008637 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" event={"ID":"63c2ea81-acbe-48ee-af26-810ba6d9eb78","Type":"ContainerStarted","Data":"8556e75a580929225359fdefb7adce1424ae45c13f36c60ecb526788be40c1c4"} Jul 15 10:56:18.037962 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:18.037924 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" event={"ID":"63c2ea81-acbe-48ee-af26-810ba6d9eb78","Type":"ContainerStarted","Data":"63c5ed77e2b3040a45f7a841be6f21346631dbca4e41ccaba1feb3bb92dbc70a"} Jul 15 10:56:18.038515 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:18.038116 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" Jul 15 10:56:18.054294 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:18.054241 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" podStartSLOduration=2.048772988 podStartE2EDuration="7.054225226s" totalImagesPullingTime="5.005452238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:56:18.051801455 +0000 UTC m=+499.019119256" watchObservedRunningTime="2026-07-15 10:56:18.054225226 +0000 UTC m=+499.021543027" Jul 15 10:56:24.073287 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.073246 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7lm6l" Jul 15 10:56:24.376931 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.376840 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:24.593433 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.593382 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:24.596916 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.596887 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbtfp"] Jul 15 10:56:24.600569 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.600548 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zbtfp" Jul 15 10:56:24.602922 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.602900 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8rhd4\"" Jul 15 10:56:24.607014 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.606989 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbtfp"] Jul 15 10:56:24.716356 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.716297 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzqvd\" (UniqueName: \"kubernetes.io/projected/e9d5b75b-54c6-408b-8628-95318afd49d3-kube-api-access-lzqvd\") pod \"authorino-5d4b67c446-zbtfp\" (UID: \"e9d5b75b-54c6-408b-8628-95318afd49d3\") " pod="kuadrant-system/authorino-5d4b67c446-zbtfp" Jul 15 10:56:24.817194 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.817063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzqvd\" (UniqueName: \"kubernetes.io/projected/e9d5b75b-54c6-408b-8628-95318afd49d3-kube-api-access-lzqvd\") pod \"authorino-5d4b67c446-zbtfp\" (UID: \"e9d5b75b-54c6-408b-8628-95318afd49d3\") " pod="kuadrant-system/authorino-5d4b67c446-zbtfp" Jul 15 10:56:24.819005 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.818984 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbtfp"] Jul 15 10:56:24.819214 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:56:24.819194 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lzqvd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-zbtfp" podUID="e9d5b75b-54c6-408b-8628-95318afd49d3" Jul 15 10:56:24.828375 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.828320 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzqvd\" (UniqueName: \"kubernetes.io/projected/e9d5b75b-54c6-408b-8628-95318afd49d3-kube-api-access-lzqvd\") pod \"authorino-5d4b67c446-zbtfp\" (UID: \"e9d5b75b-54c6-408b-8628-95318afd49d3\") " pod="kuadrant-system/authorino-5d4b67c446-zbtfp" Jul 15 10:56:24.843794 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.843761 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59dcb5bc56-jwqhg"] Jul 15 10:56:24.847299 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.847273 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dcb5bc56-jwqhg" Jul 15 10:56:24.850902 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.850875 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59dcb5bc56-jwqhg"] Jul 15 10:56:24.917786 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.917744 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4ptm\" (UniqueName: \"kubernetes.io/projected/72ac5952-be15-4166-89b2-dfe2b4f3aa51-kube-api-access-m4ptm\") pod \"authorino-59dcb5bc56-jwqhg\" (UID: \"72ac5952-be15-4166-89b2-dfe2b4f3aa51\") " pod="kuadrant-system/authorino-59dcb5bc56-jwqhg" Jul 15 10:56:24.948841 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:24.948801 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59dcb5bc56-jwqhg"] Jul 15 10:56:24.949107 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:56:24.949087 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-m4ptm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-59dcb5bc56-jwqhg" podUID="72ac5952-be15-4166-89b2-dfe2b4f3aa51" Jul 15 10:56:25.018585 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.018488 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4ptm\" (UniqueName: \"kubernetes.io/projected/72ac5952-be15-4166-89b2-dfe2b4f3aa51-kube-api-access-m4ptm\") pod \"authorino-59dcb5bc56-jwqhg\" (UID: \"72ac5952-be15-4166-89b2-dfe2b4f3aa51\") " pod="kuadrant-system/authorino-59dcb5bc56-jwqhg" Jul 15 10:56:25.026359 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.026294 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4ptm\" (UniqueName: \"kubernetes.io/projected/72ac5952-be15-4166-89b2-dfe2b4f3aa51-kube-api-access-m4ptm\") pod \"authorino-59dcb5bc56-jwqhg\" (UID: \"72ac5952-be15-4166-89b2-dfe2b4f3aa51\") " pod="kuadrant-system/authorino-59dcb5bc56-jwqhg" Jul 15 10:56:25.071370 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.071323 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dcb5bc56-jwqhg" Jul 15 10:56:25.071565 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.071323 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zbtfp" Jul 15 10:56:25.079275 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.079249 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dcb5bc56-jwqhg" Jul 15 10:56:25.082552 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.082528 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zbtfp" Jul 15 10:56:25.119736 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.119701 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4ptm\" (UniqueName: \"kubernetes.io/projected/72ac5952-be15-4166-89b2-dfe2b4f3aa51-kube-api-access-m4ptm\") pod \"72ac5952-be15-4166-89b2-dfe2b4f3aa51\" (UID: \"72ac5952-be15-4166-89b2-dfe2b4f3aa51\") " Jul 15 10:56:25.119955 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.119770 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzqvd\" (UniqueName: \"kubernetes.io/projected/e9d5b75b-54c6-408b-8628-95318afd49d3-kube-api-access-lzqvd\") pod \"e9d5b75b-54c6-408b-8628-95318afd49d3\" (UID: \"e9d5b75b-54c6-408b-8628-95318afd49d3\") " Jul 15 10:56:25.122004 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.121967 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ac5952-be15-4166-89b2-dfe2b4f3aa51-kube-api-access-m4ptm" (OuterVolumeSpecName: "kube-api-access-m4ptm") pod "72ac5952-be15-4166-89b2-dfe2b4f3aa51" (UID: "72ac5952-be15-4166-89b2-dfe2b4f3aa51"). InnerVolumeSpecName "kube-api-access-m4ptm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:56:25.122004 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.121999 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d5b75b-54c6-408b-8628-95318afd49d3-kube-api-access-lzqvd" (OuterVolumeSpecName: "kube-api-access-lzqvd") pod "e9d5b75b-54c6-408b-8628-95318afd49d3" (UID: "e9d5b75b-54c6-408b-8628-95318afd49d3"). InnerVolumeSpecName "kube-api-access-lzqvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:56:25.220770 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.220726 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4ptm\" (UniqueName: \"kubernetes.io/projected/72ac5952-be15-4166-89b2-dfe2b4f3aa51-kube-api-access-m4ptm\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:56:25.220770 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:25.220761 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzqvd\" (UniqueName: \"kubernetes.io/projected/e9d5b75b-54c6-408b-8628-95318afd49d3-kube-api-access-lzqvd\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:56:26.076283 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:26.076257 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dcb5bc56-jwqhg" Jul 15 10:56:26.076485 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:26.076257 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zbtfp" Jul 15 10:56:26.105162 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:26.105116 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59dcb5bc56-jwqhg"] Jul 15 10:56:26.106925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:26.106903 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59dcb5bc56-jwqhg"] Jul 15 10:56:26.127912 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:26.127884 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbtfp"] Jul 15 10:56:26.130599 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:26.130573 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zbtfp"] Jul 15 10:56:27.565655 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:27.565621 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72ac5952-be15-4166-89b2-dfe2b4f3aa51" path="/var/lib/kubelet/pods/72ac5952-be15-4166-89b2-dfe2b4f3aa51/volumes" Jul 15 10:56:27.566048 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:27.565852 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9d5b75b-54c6-408b-8628-95318afd49d3" path="/var/lib/kubelet/pods/e9d5b75b-54c6-408b-8628-95318afd49d3/volumes" Jul 15 10:56:31.315879 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.315838 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:31.323417 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.323389 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58756c97c4-zd88t"] Jul 15 10:56:31.412262 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.412220 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:31.494480 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.494435 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:31.531521 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.531489 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58756c97c4-zd88t"] Jul 15 10:56:31.531686 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.531536 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5957c57f74-ffmcd"] Jul 15 10:56:31.531686 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.531608 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:31.534121 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.534096 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 10:56:31.534121 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.534112 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 10:56:31.534394 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.534139 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pqgxn\"" Jul 15 10:56:31.548748 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.548723 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5957c57f74-ffmcd"] Jul 15 10:56:31.548870 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.548815 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 10:56:31.577414 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.577317 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e20770f6-6b11-48e2-a411-241396f7f57a-webhook-cert\") pod \"maas-controller-58756c97c4-zd88t\" (UID: \"e20770f6-6b11-48e2-a411-241396f7f57a\") " pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:31.577580 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.577413 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29np\" (UniqueName: \"kubernetes.io/projected/e20770f6-6b11-48e2-a411-241396f7f57a-kube-api-access-q29np\") pod \"maas-controller-58756c97c4-zd88t\" (UID: \"e20770f6-6b11-48e2-a411-241396f7f57a\") " pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:31.577580 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.577494 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxlhr\" (UniqueName: \"kubernetes.io/projected/c61c97ae-1c2c-4759-a21a-5b318060fe8e-kube-api-access-jxlhr\") pod \"maas-controller-5957c57f74-ffmcd\" (UID: \"c61c97ae-1c2c-4759-a21a-5b318060fe8e\") " pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 10:56:31.577690 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.577586 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c61c97ae-1c2c-4759-a21a-5b318060fe8e-webhook-cert\") pod \"maas-controller-5957c57f74-ffmcd\" (UID: \"c61c97ae-1c2c-4759-a21a-5b318060fe8e\") " pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 10:56:31.678932 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.678893 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q29np\" (UniqueName: \"kubernetes.io/projected/e20770f6-6b11-48e2-a411-241396f7f57a-kube-api-access-q29np\") pod \"maas-controller-58756c97c4-zd88t\" (UID: \"e20770f6-6b11-48e2-a411-241396f7f57a\") " pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:31.679162 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.678954 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxlhr\" (UniqueName: \"kubernetes.io/projected/c61c97ae-1c2c-4759-a21a-5b318060fe8e-kube-api-access-jxlhr\") pod \"maas-controller-5957c57f74-ffmcd\" (UID: \"c61c97ae-1c2c-4759-a21a-5b318060fe8e\") " pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 10:56:31.679162 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.679039 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c61c97ae-1c2c-4759-a21a-5b318060fe8e-webhook-cert\") pod \"maas-controller-5957c57f74-ffmcd\" (UID: \"c61c97ae-1c2c-4759-a21a-5b318060fe8e\") " pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 10:56:31.679162 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.679103 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e20770f6-6b11-48e2-a411-241396f7f57a-webhook-cert\") pod \"maas-controller-58756c97c4-zd88t\" (UID: \"e20770f6-6b11-48e2-a411-241396f7f57a\") " pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:31.681688 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.681656 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e20770f6-6b11-48e2-a411-241396f7f57a-webhook-cert\") pod \"maas-controller-58756c97c4-zd88t\" (UID: \"e20770f6-6b11-48e2-a411-241396f7f57a\") " pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:31.681824 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.681711 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c61c97ae-1c2c-4759-a21a-5b318060fe8e-webhook-cert\") pod \"maas-controller-5957c57f74-ffmcd\" (UID: \"c61c97ae-1c2c-4759-a21a-5b318060fe8e\") " pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 10:56:31.686633 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.686606 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxlhr\" (UniqueName: \"kubernetes.io/projected/c61c97ae-1c2c-4759-a21a-5b318060fe8e-kube-api-access-jxlhr\") pod \"maas-controller-5957c57f74-ffmcd\" (UID: \"c61c97ae-1c2c-4759-a21a-5b318060fe8e\") " pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 10:56:31.686869 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.686847 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29np\" (UniqueName: \"kubernetes.io/projected/e20770f6-6b11-48e2-a411-241396f7f57a-kube-api-access-q29np\") pod \"maas-controller-58756c97c4-zd88t\" (UID: \"e20770f6-6b11-48e2-a411-241396f7f57a\") " pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:31.763220 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.763178 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:31.844692 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.844585 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:31.858899 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:31.858866 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 10:56:32.013208 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:32.013175 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58756c97c4-zd88t"] Jul 15 10:56:32.016168 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:56:32.016134 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20770f6_6b11_48e2_a411_241396f7f57a.slice/crio-39468032e97e5b04043df210441f997016375647467961b07fce76ac818267e6 WatchSource:0}: Error finding container 39468032e97e5b04043df210441f997016375647467961b07fce76ac818267e6: Status 404 returned error can't find the container with id 39468032e97e5b04043df210441f997016375647467961b07fce76ac818267e6 Jul 15 10:56:32.039719 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:32.039690 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5957c57f74-ffmcd"] Jul 15 10:56:32.042359 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:56:32.042313 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61c97ae_1c2c_4759_a21a_5b318060fe8e.slice/crio-75c839685f3f901149b52f2835de78476946a6dc1f4ebd3b604199323ff3841e WatchSource:0}: Error finding container 75c839685f3f901149b52f2835de78476946a6dc1f4ebd3b604199323ff3841e: Status 404 returned error can't find the container with id 75c839685f3f901149b52f2835de78476946a6dc1f4ebd3b604199323ff3841e Jul 15 10:56:32.109407 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:32.109290 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58756c97c4-zd88t" event={"ID":"e20770f6-6b11-48e2-a411-241396f7f57a","Type":"ContainerStarted","Data":"39468032e97e5b04043df210441f997016375647467961b07fce76ac818267e6"} Jul 15 10:56:32.110591 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:32.110567 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5957c57f74-ffmcd" event={"ID":"c61c97ae-1c2c-4759-a21a-5b318060fe8e","Type":"ContainerStarted","Data":"75c839685f3f901149b52f2835de78476946a6dc1f4ebd3b604199323ff3841e"} Jul 15 10:56:34.982956 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:34.982858 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:35.082813 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:35.082779 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:35.129985 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:35.129952 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5957c57f74-ffmcd" event={"ID":"c61c97ae-1c2c-4759-a21a-5b318060fe8e","Type":"ContainerStarted","Data":"c588765595c83c06510b550666bba15de9b55344660aa5919600d4b37c06dc3d"} Jul 15 10:56:35.130198 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:35.130023 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 10:56:35.131484 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:35.131460 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58756c97c4-zd88t" event={"ID":"e20770f6-6b11-48e2-a411-241396f7f57a","Type":"ContainerStarted","Data":"252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08"} Jul 15 10:56:35.131623 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:35.131573 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:35.147852 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:35.147807 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5957c57f74-ffmcd" podStartSLOduration=1.45710616 podStartE2EDuration="4.147793117s" totalImagesPullingTime="2.690686957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:56:35.145969253 +0000 UTC m=+516.113287053" watchObservedRunningTime="2026-07-15 10:56:35.147793117 +0000 UTC m=+516.115110918" Jul 15 10:56:35.161925 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:35.161861 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58756c97c4-zd88t" podStartSLOduration=1.434094528 podStartE2EDuration="4.161845518s" totalImagesPullingTime="2.72775099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:56:35.161713577 +0000 UTC m=+516.129031400" watchObservedRunningTime="2026-07-15 10:56:35.161845518 +0000 UTC m=+516.129163319" Jul 15 10:56:43.349218 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:43.349173 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:43.402888 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:43.402851 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:46.145466 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.145433 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 10:56:46.145904 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.145768 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:46.204596 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.204499 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58756c97c4-zd88t"] Jul 15 10:56:46.205390 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.205348 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58756c97c4-zd88t" podUID="e20770f6-6b11-48e2-a411-241396f7f57a" containerName="manager" containerID="cri-o://252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08" gracePeriod=30 Jul 15 10:56:46.465093 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.465062 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:46.615973 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.615938 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e20770f6-6b11-48e2-a411-241396f7f57a-webhook-cert\") pod \"e20770f6-6b11-48e2-a411-241396f7f57a\" (UID: \"e20770f6-6b11-48e2-a411-241396f7f57a\") " Jul 15 10:56:46.616205 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.615995 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q29np\" (UniqueName: \"kubernetes.io/projected/e20770f6-6b11-48e2-a411-241396f7f57a-kube-api-access-q29np\") pod \"e20770f6-6b11-48e2-a411-241396f7f57a\" (UID: \"e20770f6-6b11-48e2-a411-241396f7f57a\") " Jul 15 10:56:46.618358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.618293 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e20770f6-6b11-48e2-a411-241396f7f57a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e20770f6-6b11-48e2-a411-241396f7f57a" (UID: "e20770f6-6b11-48e2-a411-241396f7f57a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 10:56:46.618358 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.618320 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e20770f6-6b11-48e2-a411-241396f7f57a-kube-api-access-q29np" (OuterVolumeSpecName: "kube-api-access-q29np") pod "e20770f6-6b11-48e2-a411-241396f7f57a" (UID: "e20770f6-6b11-48e2-a411-241396f7f57a"). InnerVolumeSpecName "kube-api-access-q29np". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 10:56:46.716954 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.716914 2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e20770f6-6b11-48e2-a411-241396f7f57a-webhook-cert\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:56:46.716954 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:46.716953 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q29np\" (UniqueName: \"kubernetes.io/projected/e20770f6-6b11-48e2-a411-241396f7f57a-kube-api-access-q29np\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 10:56:47.201722 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:47.201632 2553 generic.go:356] "Generic (PLEG): container finished" podID="e20770f6-6b11-48e2-a411-241396f7f57a" containerID="252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08" exitCode=0 Jul 15 10:56:47.201722 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:47.201683 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58756c97c4-zd88t" event={"ID":"e20770f6-6b11-48e2-a411-241396f7f57a","Type":"ContainerDied","Data":"252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08"} Jul 15 10:56:47.202189 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:47.201728 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58756c97c4-zd88t" event={"ID":"e20770f6-6b11-48e2-a411-241396f7f57a","Type":"ContainerDied","Data":"39468032e97e5b04043df210441f997016375647467961b07fce76ac818267e6"} Jul 15 10:56:47.202189 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:47.201751 2553 scope.go:117] "RemoveContainer" containerID="252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08" Jul 15 10:56:47.202189 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:47.201684 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58756c97c4-zd88t" Jul 15 10:56:47.211295 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:47.211094 2553 scope.go:117] "RemoveContainer" containerID="252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08" Jul 15 10:56:47.211446 ip-10-0-131-232 kubenswrapper[2553]: E0715 10:56:47.211427 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08\": container with ID starting with 252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08 not found: ID does not exist" containerID="252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08" Jul 15 10:56:47.211506 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:47.211461 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08"} err="failed to get container status \"252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08\": rpc error: code = NotFound desc = could not find container \"252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08\": container with ID starting with 252f8bf2c4da1a895914471c63b3fb9dd920ec3cdfa4ed4400a71c358c31ff08 not found: ID does not exist" Jul 15 10:56:47.223725 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:47.223695 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58756c97c4-zd88t"] Jul 15 10:56:47.227630 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:47.227596 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58756c97c4-zd88t"] Jul 15 10:56:47.564840 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:47.564804 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e20770f6-6b11-48e2-a411-241396f7f57a" path="/var/lib/kubelet/pods/e20770f6-6b11-48e2-a411-241396f7f57a/volumes" Jul 15 10:56:48.940799 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:48.940766 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:56:57.402168 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:56:57.402071 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:07.533771 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:07.533713 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:07.633175 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:07.633141 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:08.165450 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.165410 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt"] Jul 15 10:57:08.166744 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.166715 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20770f6-6b11-48e2-a411-241396f7f57a" containerName="manager" Jul 15 10:57:08.166894 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.166776 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20770f6-6b11-48e2-a411-241396f7f57a" containerName="manager" Jul 15 10:57:08.166894 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.166797 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:08.167015 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.166992 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e20770f6-6b11-48e2-a411-241396f7f57a" containerName="manager" Jul 15 10:57:08.174590 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.174561 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.177270 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.177245 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 15 10:57:08.180305 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.180282 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt"] Jul 15 10:57:08.201620 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.201585 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/022bf7fa-ba07-41d3-9ba3-73a55cca08ba-maas-api-tls\") pod \"maas-api-8b5b8dd7f-q88bt\" (UID: \"022bf7fa-ba07-41d3-9ba3-73a55cca08ba\") " pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.201782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.201635 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/022bf7fa-ba07-41d3-9ba3-73a55cca08ba-openshift-service-ca\") pod \"maas-api-8b5b8dd7f-q88bt\" (UID: \"022bf7fa-ba07-41d3-9ba3-73a55cca08ba\") " pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.201782 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.201726 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926tl\" (UniqueName: \"kubernetes.io/projected/022bf7fa-ba07-41d3-9ba3-73a55cca08ba-kube-api-access-926tl\") pod \"maas-api-8b5b8dd7f-q88bt\" (UID: \"022bf7fa-ba07-41d3-9ba3-73a55cca08ba\") " pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.232825 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.232786 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:08.302689 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.302649 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/022bf7fa-ba07-41d3-9ba3-73a55cca08ba-openshift-service-ca\") pod \"maas-api-8b5b8dd7f-q88bt\" (UID: \"022bf7fa-ba07-41d3-9ba3-73a55cca08ba\") " pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.302888 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.302722 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926tl\" (UniqueName: \"kubernetes.io/projected/022bf7fa-ba07-41d3-9ba3-73a55cca08ba-kube-api-access-926tl\") pod \"maas-api-8b5b8dd7f-q88bt\" (UID: \"022bf7fa-ba07-41d3-9ba3-73a55cca08ba\") " pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.302888 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.302773 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/022bf7fa-ba07-41d3-9ba3-73a55cca08ba-maas-api-tls\") pod \"maas-api-8b5b8dd7f-q88bt\" (UID: \"022bf7fa-ba07-41d3-9ba3-73a55cca08ba\") " pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.303405 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.303375 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/022bf7fa-ba07-41d3-9ba3-73a55cca08ba-openshift-service-ca\") pod \"maas-api-8b5b8dd7f-q88bt\" (UID: \"022bf7fa-ba07-41d3-9ba3-73a55cca08ba\") " pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.305468 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.305442 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/022bf7fa-ba07-41d3-9ba3-73a55cca08ba-maas-api-tls\") pod \"maas-api-8b5b8dd7f-q88bt\" (UID: \"022bf7fa-ba07-41d3-9ba3-73a55cca08ba\") " pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.310784 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.310754 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-926tl\" (UniqueName: \"kubernetes.io/projected/022bf7fa-ba07-41d3-9ba3-73a55cca08ba-kube-api-access-926tl\") pod \"maas-api-8b5b8dd7f-q88bt\" (UID: \"022bf7fa-ba07-41d3-9ba3-73a55cca08ba\") " pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.486895 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.486850 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:08.573228 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.573164 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:08.675200 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.675174 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt"] Jul 15 10:57:08.718421 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.718383 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-wvfsw"] Jul 15 10:57:08.739232 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.739131 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:08.756988 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.756944 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-wvfsw"] Jul 15 10:57:08.757157 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.757069 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" Jul 15 10:57:08.759496 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.759473 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-67wgr\"" Jul 15 10:57:08.759644 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.759475 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 10:57:08.807026 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.806987 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgl7c\" (UniqueName: \"kubernetes.io/projected/3c8e280b-958d-4b82-be14-7c32baf566a1-kube-api-access-zgl7c\") pod \"payload-processing-f9b8d9b9b-wvfsw\" (UID: \"3c8e280b-958d-4b82-be14-7c32baf566a1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" Jul 15 10:57:08.807214 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.807050 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c8e280b-958d-4b82-be14-7c32baf566a1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-wvfsw\" (UID: \"3c8e280b-958d-4b82-be14-7c32baf566a1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" Jul 15 10:57:08.908487 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.908447 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c8e280b-958d-4b82-be14-7c32baf566a1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-wvfsw\" (UID: \"3c8e280b-958d-4b82-be14-7c32baf566a1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" Jul 15 10:57:08.908684 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.908534 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgl7c\" (UniqueName: \"kubernetes.io/projected/3c8e280b-958d-4b82-be14-7c32baf566a1-kube-api-access-zgl7c\") pod \"payload-processing-f9b8d9b9b-wvfsw\" (UID: \"3c8e280b-958d-4b82-be14-7c32baf566a1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" Jul 15 10:57:08.909227 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.909205 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c8e280b-958d-4b82-be14-7c32baf566a1-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-wvfsw\" (UID: \"3c8e280b-958d-4b82-be14-7c32baf566a1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" Jul 15 10:57:08.916929 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:08.916897 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgl7c\" (UniqueName: \"kubernetes.io/projected/3c8e280b-958d-4b82-be14-7c32baf566a1-kube-api-access-zgl7c\") pod \"payload-processing-f9b8d9b9b-wvfsw\" (UID: \"3c8e280b-958d-4b82-be14-7c32baf566a1\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" Jul 15 10:57:09.069781 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:09.069689 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" Jul 15 10:57:09.215536 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:09.215461 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-wvfsw"] Jul 15 10:57:09.218289 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:57:09.218259 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8e280b_958d_4b82_be14_7c32baf566a1.slice/crio-562786a3c3356a1afd9e663779de8567abc3416d0ab7ce7ceddc8a100f62227a WatchSource:0}: Error finding container 562786a3c3356a1afd9e663779de8567abc3416d0ab7ce7ceddc8a100f62227a: Status 404 returned error can't find the container with id 562786a3c3356a1afd9e663779de8567abc3416d0ab7ce7ceddc8a100f62227a Jul 15 10:57:09.312424 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:09.312388 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" event={"ID":"3c8e280b-958d-4b82-be14-7c32baf566a1","Type":"ContainerStarted","Data":"562786a3c3356a1afd9e663779de8567abc3416d0ab7ce7ceddc8a100f62227a"} Jul 15 10:57:09.313720 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:09.313690 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" event={"ID":"022bf7fa-ba07-41d3-9ba3-73a55cca08ba","Type":"ContainerStarted","Data":"e1f2e49631e26bad7006a112552edde135111b6476178246bc0265dc020f12c2"} Jul 15 10:57:11.325234 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:11.325175 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" event={"ID":"022bf7fa-ba07-41d3-9ba3-73a55cca08ba","Type":"ContainerStarted","Data":"048cf3f19c986a1aa85af8c62f9b06910727f76d4a9de34c634583555fd94b73"} Jul 15 10:57:11.325741 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:11.325259 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:11.326936 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:11.326912 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" event={"ID":"3c8e280b-958d-4b82-be14-7c32baf566a1","Type":"ContainerStarted","Data":"cb4b510ac392f08ca9ea8268d42900163c6f6bf5ff7362d86b3c8b0ac2a9a787"} Jul 15 10:57:11.327086 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:11.327019 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" Jul 15 10:57:11.342137 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:11.342091 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" podStartSLOduration=1.3387809019999999 podStartE2EDuration="3.342075354s" totalImagesPullingTime="2.003294452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:57:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:57:11.340500974 +0000 UTC m=+552.307818788" watchObservedRunningTime="2026-07-15 10:57:11.342075354 +0000 UTC m=+552.309393155" Jul 15 10:57:11.354273 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:11.354221 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" podStartSLOduration=1.888061333 podStartE2EDuration="3.354204015s" totalImagesPullingTime="1.466142682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:57:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:57:11.353593145 +0000 UTC m=+552.320910976" watchObservedRunningTime="2026-07-15 10:57:11.354204015 +0000 UTC m=+552.321521815" Jul 15 10:57:17.337005 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:17.336962 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8b5b8dd7f-q88bt" Jul 15 10:57:18.325526 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:18.325479 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:18.429227 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:18.429186 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:22.333874 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:22.333842 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvfsw" Jul 15 10:57:30.801169 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.801132 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr"] Jul 15 10:57:30.805518 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.805481 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:30.808032 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.808008 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 10:57:30.808189 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.808139 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 10:57:30.809034 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.809013 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jlgfq\"" Jul 15 10:57:30.809157 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.809075 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 15 10:57:30.815093 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.814826 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr"] Jul 15 10:57:30.834353 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.834309 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:30.913515 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.913479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:30.913688 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.913530 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5753e349-117b-4a2e-a0e7-949bbdb48291-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:30.913688 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.913576 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:30.913688 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.913634 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2chks\" (UniqueName: \"kubernetes.io/projected/5753e349-117b-4a2e-a0e7-949bbdb48291-kube-api-access-2chks\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:30.913816 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.913694 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:30.913816 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:30.913722 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.014234 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.014198 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.014234 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.014239 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5753e349-117b-4a2e-a0e7-949bbdb48291-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.014481 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.014280 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.014481 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.014362 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chks\" (UniqueName: \"kubernetes.io/projected/5753e349-117b-4a2e-a0e7-949bbdb48291-kube-api-access-2chks\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.014481 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.014421 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.014481 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.014457 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.014713 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.014694 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.014748 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.014738 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.014822 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.014802 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.016591 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.016570 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5753e349-117b-4a2e-a0e7-949bbdb48291-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.016845 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.016825 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5753e349-117b-4a2e-a0e7-949bbdb48291-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.021669 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.021645 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2chks\" (UniqueName: \"kubernetes.io/projected/5753e349-117b-4a2e-a0e7-949bbdb48291-kube-api-access-2chks\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr\" (UID: \"5753e349-117b-4a2e-a0e7-949bbdb48291\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.118748 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.118647 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:31.262515 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.262482 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr"] Jul 15 10:57:31.265974 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:57:31.265946 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5753e349_117b_4a2e_a0e7_949bbdb48291.slice/crio-cc06d60f14b909d808c92947dd8e47d06fddfbb1aad5efae1abdc03ce164266b WatchSource:0}: Error finding container cc06d60f14b909d808c92947dd8e47d06fddfbb1aad5efae1abdc03ce164266b: Status 404 returned error can't find the container with id cc06d60f14b909d808c92947dd8e47d06fddfbb1aad5efae1abdc03ce164266b Jul 15 10:57:31.431095 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:31.431004 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" event={"ID":"5753e349-117b-4a2e-a0e7-949bbdb48291","Type":"ContainerStarted","Data":"cc06d60f14b909d808c92947dd8e47d06fddfbb1aad5efae1abdc03ce164266b"} Jul 15 10:57:33.442631 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:33.442593 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" event={"ID":"5753e349-117b-4a2e-a0e7-949bbdb48291","Type":"ContainerStarted","Data":"3c930dbf1edc4315a261bc2d7af52e3462584fdb79434b5ce5c098ca47261e41"} Jul 15 10:57:33.459453 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:33.459401 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" podStartSLOduration=2.285567127 podStartE2EDuration="3.459384329s" totalImagesPullingTime="1.173817202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:57:33.457063898 +0000 UTC m=+574.424381697" watchObservedRunningTime="2026-07-15 10:57:33.459384329 +0000 UTC m=+574.426702132" Jul 15 10:57:35.236796 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:35.236744 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:41.119520 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:41.119491 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:41.119895 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:41.119538 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:41.131974 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:41.131950 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:41.490649 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:41.490628 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr" Jul 15 10:57:44.399708 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:44.399671 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:46.899674 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:46.899629 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq"] Jul 15 10:57:46.906575 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:46.906547 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:46.909018 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:46.908984 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 10:57:46.912221 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:46.912184 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq"] Jul 15 10:57:47.010386 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.010350 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:47.049610 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.049563 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.049610 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.049613 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq6mj\" (UniqueName: \"kubernetes.io/projected/03f786be-a5ab-4707-8cf8-2dc9f665551f-kube-api-access-tq6mj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.049862 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.049675 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.049862 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.049727 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03f786be-a5ab-4707-8cf8-2dc9f665551f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.049862 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.049764 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.049862 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.049782 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.150698 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.150599 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.150698 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.150643 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq6mj\" (UniqueName: \"kubernetes.io/projected/03f786be-a5ab-4707-8cf8-2dc9f665551f-kube-api-access-tq6mj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.150698 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.150664 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.150698 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.150694 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03f786be-a5ab-4707-8cf8-2dc9f665551f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.151023 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.150725 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.151023 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.150740 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.151192 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.151168 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.151285 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.151190 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.151285 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.151255 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.153002 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.152980 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03f786be-a5ab-4707-8cf8-2dc9f665551f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.153268 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.153250 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03f786be-a5ab-4707-8cf8-2dc9f665551f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.158643 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.158611 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq6mj\" (UniqueName: \"kubernetes.io/projected/03f786be-a5ab-4707-8cf8-2dc9f665551f-kube-api-access-tq6mj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq\" (UID: \"03f786be-a5ab-4707-8cf8-2dc9f665551f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.219216 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.219171 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:47.374134 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.374105 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq"] Jul 15 10:57:47.376606 ip-10-0-131-232 kubenswrapper[2553]: W0715 10:57:47.376569 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f786be_a5ab_4707_8cf8_2dc9f665551f.slice/crio-430cdab935f141a90d3a30e01ef7b1f903a00c00a16cfbaf4eb4f17648f94152 WatchSource:0}: Error finding container 430cdab935f141a90d3a30e01ef7b1f903a00c00a16cfbaf4eb4f17648f94152: Status 404 returned error can't find the container with id 430cdab935f141a90d3a30e01ef7b1f903a00c00a16cfbaf4eb4f17648f94152 Jul 15 10:57:47.510248 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:47.510207 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" event={"ID":"03f786be-a5ab-4707-8cf8-2dc9f665551f","Type":"ContainerStarted","Data":"430cdab935f141a90d3a30e01ef7b1f903a00c00a16cfbaf4eb4f17648f94152"} Jul 15 10:57:48.521464 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:48.521425 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" event={"ID":"03f786be-a5ab-4707-8cf8-2dc9f665551f","Type":"ContainerStarted","Data":"934a0c313679c6f8ab3900265e0fe2b381f81c1451d86055b48616aa72d065c5"} Jul 15 10:57:48.539320 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:48.539258 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" podStartSLOduration=2.367601015 podStartE2EDuration="2.539237289s" totalImagesPullingTime="171.636274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:57:48.537511429 +0000 UTC m=+589.504829305" watchObservedRunningTime="2026-07-15 10:57:48.539237289 +0000 UTC m=+589.506555147" Jul 15 10:57:56.939927 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:56.939896 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:57:57.219400 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:57.219373 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:57.219562 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:57.219429 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:57.231861 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:57.231835 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:57.582968 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:57.582895 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq" Jul 15 10:57:59.478826 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:59.478797 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 10:57:59.484869 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:59.484844 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 10:57:59.486670 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:59.486649 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 10:57:59.492466 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:57:59.492448 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 10:58:07.535338 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:58:07.535302 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:58:47.871955 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:58:47.871924 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:58:47.971570 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:58:47.971532 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:58:55.012542 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:58:55.012501 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:59:23.953746 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:59:23.953695 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:59:24.106180 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:59:24.106147 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:59:25.065843 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:59:25.065805 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:59:25.166655 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:59:25.166617 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 10:59:33.898215 ip-10-0-131-232 kubenswrapper[2553]: I0715 10:59:33.898184 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:00:00.139150 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:00.139069 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9"] Jul 15 11:00:00.142796 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:00.142773 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9" Jul 15 11:00:00.145163 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:00.145134 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t47dh\"" Jul 15 11:00:00.147665 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:00.147643 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9"] Jul 15 11:00:00.154193 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:00.154177 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9" Jul 15 11:00:00.287796 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:00.287764 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9"] Jul 15 11:00:00.289280 ip-10-0-131-232 kubenswrapper[2553]: W0715 11:00:00.289251 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11973d8_4140_44cb_a491_021116c2678b.slice/crio-dd7de10c8d516e19093eb8cd6a915a8b64ff122c7465b31c7dcfbe2dc2f7b250 WatchSource:0}: Error finding container dd7de10c8d516e19093eb8cd6a915a8b64ff122c7465b31c7dcfbe2dc2f7b250: Status 404 returned error can't find the container with id dd7de10c8d516e19093eb8cd6a915a8b64ff122c7465b31c7dcfbe2dc2f7b250 Jul 15 11:00:00.291311 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:00.291295 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 11:00:01.167073 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:01.167042 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9" event={"ID":"b11973d8-4140-44cb-a491-021116c2678b","Type":"ContainerStarted","Data":"dd7de10c8d516e19093eb8cd6a915a8b64ff122c7465b31c7dcfbe2dc2f7b250"} Jul 15 11:00:03.179966 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:03.179927 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9" event={"ID":"b11973d8-4140-44cb-a491-021116c2678b","Type":"ContainerStarted","Data":"bfac3063755f223c831c30bc5e7323b83dec6f756047602a94f4de8b929304c0"} Jul 15 11:00:03.193806 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:03.193763 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9" podStartSLOduration=0.522483403 podStartE2EDuration="3.193747234s" totalImagesPullingTime="2.671263831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:00:03.193109948 +0000 UTC m=+724.160427747" watchObservedRunningTime="2026-07-15 11:00:03.193747234 +0000 UTC m=+724.161065072" Jul 15 11:00:04.187475 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:04.187438 2553 generic.go:356] "Generic (PLEG): container finished" podID="b11973d8-4140-44cb-a491-021116c2678b" containerID="bfac3063755f223c831c30bc5e7323b83dec6f756047602a94f4de8b929304c0" exitCode=0 Jul 15 11:00:04.187797 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:04.187521 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9" event={"ID":"b11973d8-4140-44cb-a491-021116c2678b","Type":"ContainerDied","Data":"bfac3063755f223c831c30bc5e7323b83dec6f756047602a94f4de8b929304c0"} Jul 15 11:00:05.329981 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:05.329899 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9" Jul 15 11:00:06.198294 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:06.198272 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9" Jul 15 11:00:06.198503 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:06.198309 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735220-cw2v9" event={"ID":"b11973d8-4140-44cb-a491-021116c2678b","Type":"ContainerDied","Data":"dd7de10c8d516e19093eb8cd6a915a8b64ff122c7465b31c7dcfbe2dc2f7b250"} Jul 15 11:00:06.198503 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:06.198374 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd7de10c8d516e19093eb8cd6a915a8b64ff122c7465b31c7dcfbe2dc2f7b250" Jul 15 11:00:56.149059 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.149025 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:00:56.235765 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.235732 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5957c57f74-ffmcd"] Jul 15 11:00:56.236075 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.236044 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5957c57f74-ffmcd" podUID="c61c97ae-1c2c-4759-a21a-5b318060fe8e" containerName="manager" containerID="cri-o://c588765595c83c06510b550666bba15de9b55344660aa5919600d4b37c06dc3d" gracePeriod=30 Jul 15 11:00:56.447493 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.447463 2553 generic.go:356] "Generic (PLEG): container finished" podID="c61c97ae-1c2c-4759-a21a-5b318060fe8e" containerID="c588765595c83c06510b550666bba15de9b55344660aa5919600d4b37c06dc3d" exitCode=0 Jul 15 11:00:56.447652 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.447530 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5957c57f74-ffmcd" event={"ID":"c61c97ae-1c2c-4759-a21a-5b318060fe8e","Type":"ContainerDied","Data":"c588765595c83c06510b550666bba15de9b55344660aa5919600d4b37c06dc3d"} Jul 15 11:00:56.489566 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.489542 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 11:00:56.554814 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.554788 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c61c97ae-1c2c-4759-a21a-5b318060fe8e-webhook-cert\") pod \"c61c97ae-1c2c-4759-a21a-5b318060fe8e\" (UID: \"c61c97ae-1c2c-4759-a21a-5b318060fe8e\") " Jul 15 11:00:56.554966 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.554854 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxlhr\" (UniqueName: \"kubernetes.io/projected/c61c97ae-1c2c-4759-a21a-5b318060fe8e-kube-api-access-jxlhr\") pod \"c61c97ae-1c2c-4759-a21a-5b318060fe8e\" (UID: \"c61c97ae-1c2c-4759-a21a-5b318060fe8e\") " Jul 15 11:00:56.556726 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.556697 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c61c97ae-1c2c-4759-a21a-5b318060fe8e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c61c97ae-1c2c-4759-a21a-5b318060fe8e" (UID: "c61c97ae-1c2c-4759-a21a-5b318060fe8e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 11:00:56.556839 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.556770 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c61c97ae-1c2c-4759-a21a-5b318060fe8e-kube-api-access-jxlhr" (OuterVolumeSpecName: "kube-api-access-jxlhr") pod "c61c97ae-1c2c-4759-a21a-5b318060fe8e" (UID: "c61c97ae-1c2c-4759-a21a-5b318060fe8e"). InnerVolumeSpecName "kube-api-access-jxlhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 11:00:56.655554 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.655465 2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c61c97ae-1c2c-4759-a21a-5b318060fe8e-webhook-cert\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 11:00:56.655554 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:56.655502 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxlhr\" (UniqueName: \"kubernetes.io/projected/c61c97ae-1c2c-4759-a21a-5b318060fe8e-kube-api-access-jxlhr\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 11:00:57.453629 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:57.453604 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5957c57f74-ffmcd" Jul 15 11:00:57.453629 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:57.453629 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5957c57f74-ffmcd" event={"ID":"c61c97ae-1c2c-4759-a21a-5b318060fe8e","Type":"ContainerDied","Data":"75c839685f3f901149b52f2835de78476946a6dc1f4ebd3b604199323ff3841e"} Jul 15 11:00:57.454100 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:57.453686 2553 scope.go:117] "RemoveContainer" containerID="c588765595c83c06510b550666bba15de9b55344660aa5919600d4b37c06dc3d" Jul 15 11:00:57.480149 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:57.480127 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5957c57f74-ffmcd"] Jul 15 11:00:57.483437 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:57.483414 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5957c57f74-ffmcd"] Jul 15 11:00:57.565025 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:57.564993 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c61c97ae-1c2c-4759-a21a-5b318060fe8e" path="/var/lib/kubelet/pods/c61c97ae-1c2c-4759-a21a-5b318060fe8e/volumes" Jul 15 11:00:58.196447 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.196416 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:00:58.328098 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.328062 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5957c57f74-lvn6m"] Jul 15 11:00:58.328597 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.328566 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c61c97ae-1c2c-4759-a21a-5b318060fe8e" containerName="manager" Jul 15 11:00:58.328597 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.328588 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c61c97ae-1c2c-4759-a21a-5b318060fe8e" containerName="manager" Jul 15 11:00:58.328597 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.328600 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b11973d8-4140-44cb-a491-021116c2678b" containerName="cleanup" Jul 15 11:00:58.328827 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.328608 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b11973d8-4140-44cb-a491-021116c2678b" containerName="cleanup" Jul 15 11:00:58.328827 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.328747 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c61c97ae-1c2c-4759-a21a-5b318060fe8e" containerName="manager" Jul 15 11:00:58.328827 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.328758 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b11973d8-4140-44cb-a491-021116c2678b" containerName="cleanup" Jul 15 11:00:58.333290 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.333273 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5957c57f74-lvn6m" Jul 15 11:00:58.336712 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.336690 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pqgxn\"" Jul 15 11:00:58.336712 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.336704 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 11:00:58.336853 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.336694 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 11:00:58.341894 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.341869 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5957c57f74-lvn6m"] Jul 15 11:00:58.473955 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.473925 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f965997b-d81f-48ef-aa33-4a74b4246e74-webhook-cert\") pod \"maas-controller-5957c57f74-lvn6m\" (UID: \"f965997b-d81f-48ef-aa33-4a74b4246e74\") " pod="opendatahub/maas-controller-5957c57f74-lvn6m" Jul 15 11:00:58.474366 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.473977 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmfm5\" (UniqueName: \"kubernetes.io/projected/f965997b-d81f-48ef-aa33-4a74b4246e74-kube-api-access-pmfm5\") pod \"maas-controller-5957c57f74-lvn6m\" (UID: \"f965997b-d81f-48ef-aa33-4a74b4246e74\") " pod="opendatahub/maas-controller-5957c57f74-lvn6m" Jul 15 11:00:58.575457 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.575422 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f965997b-d81f-48ef-aa33-4a74b4246e74-webhook-cert\") pod \"maas-controller-5957c57f74-lvn6m\" (UID: \"f965997b-d81f-48ef-aa33-4a74b4246e74\") " pod="opendatahub/maas-controller-5957c57f74-lvn6m" Jul 15 11:00:58.575625 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.575505 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmfm5\" (UniqueName: \"kubernetes.io/projected/f965997b-d81f-48ef-aa33-4a74b4246e74-kube-api-access-pmfm5\") pod \"maas-controller-5957c57f74-lvn6m\" (UID: \"f965997b-d81f-48ef-aa33-4a74b4246e74\") " pod="opendatahub/maas-controller-5957c57f74-lvn6m" Jul 15 11:00:58.577966 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.577939 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f965997b-d81f-48ef-aa33-4a74b4246e74-webhook-cert\") pod \"maas-controller-5957c57f74-lvn6m\" (UID: \"f965997b-d81f-48ef-aa33-4a74b4246e74\") " pod="opendatahub/maas-controller-5957c57f74-lvn6m" Jul 15 11:00:58.583097 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.583076 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmfm5\" (UniqueName: \"kubernetes.io/projected/f965997b-d81f-48ef-aa33-4a74b4246e74-kube-api-access-pmfm5\") pod \"maas-controller-5957c57f74-lvn6m\" (UID: \"f965997b-d81f-48ef-aa33-4a74b4246e74\") " pod="opendatahub/maas-controller-5957c57f74-lvn6m" Jul 15 11:00:58.645109 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.645073 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5957c57f74-lvn6m" Jul 15 11:00:58.782371 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:58.782347 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5957c57f74-lvn6m"] Jul 15 11:00:58.784672 ip-10-0-131-232 kubenswrapper[2553]: W0715 11:00:58.784641 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf965997b_d81f_48ef_aa33_4a74b4246e74.slice/crio-51444d780d41b394a8f147a8bac87d781a01486a045376f3bc3c99894ad9944b WatchSource:0}: Error finding container 51444d780d41b394a8f147a8bac87d781a01486a045376f3bc3c99894ad9944b: Status 404 returned error can't find the container with id 51444d780d41b394a8f147a8bac87d781a01486a045376f3bc3c99894ad9944b Jul 15 11:00:59.465791 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:00:59.465764 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5957c57f74-lvn6m" event={"ID":"f965997b-d81f-48ef-aa33-4a74b4246e74","Type":"ContainerStarted","Data":"51444d780d41b394a8f147a8bac87d781a01486a045376f3bc3c99894ad9944b"} Jul 15 11:01:00.292186 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:00.292162 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 11:01:00.472487 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:00.472450 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5957c57f74-lvn6m" event={"ID":"f965997b-d81f-48ef-aa33-4a74b4246e74","Type":"ContainerStarted","Data":"07552a575035104acdd1bec8e39c8a169e6d14d9bc57f5ba04e23ee459298b3f"} Jul 15 11:01:00.472652 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:00.472581 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5957c57f74-lvn6m" Jul 15 11:01:00.489278 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:00.489227 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5957c57f74-lvn6m" podStartSLOduration=0.985773097 podStartE2EDuration="2.489212077s" totalImagesPullingTime="1.50343898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:01:00.486942954 +0000 UTC m=+781.454260754" watchObservedRunningTime="2026-07-15 11:01:00.489212077 +0000 UTC m=+781.456529878" Jul 15 11:01:11.479838 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:11.479804 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5957c57f74-lvn6m" Jul 15 11:01:39.407678 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:39.407643 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:01:40.527173 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:40.527137 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:01:44.132477 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:44.132448 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:01:44.233870 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:44.233830 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:01:44.334511 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:44.334481 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:01:44.502493 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:44.502462 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:01:50.061142 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:50.061106 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:01:50.120071 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:01:50.120036 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:02:37.743728 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:02:37.743692 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:02:59.512207 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:02:59.512135 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 11:02:59.514972 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:02:59.514951 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 11:02:59.520285 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:02:59.520267 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 11:02:59.522206 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:02:59.522188 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 11:03:22.286159 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:03:22.286121 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:03:38.653685 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:03:38.653648 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:03:52.160656 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:03:52.160617 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:05:39.091818 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:39.091774 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm"] Jul 15 11:05:39.092368 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:39.092007 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" podUID="b6141d40-ed87-4f99-85d9-08d02a00b79e" containerName="manager" containerID="cri-o://137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b" gracePeriod=10 Jul 15 11:05:42.762365 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.762314 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 11:05:42.890890 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.890788 2553 generic.go:356] "Generic (PLEG): container finished" podID="b6141d40-ed87-4f99-85d9-08d02a00b79e" containerID="137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b" exitCode=0 Jul 15 11:05:42.890890 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.890832 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" Jul 15 11:05:42.891129 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.890882 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" event={"ID":"b6141d40-ed87-4f99-85d9-08d02a00b79e","Type":"ContainerDied","Data":"137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b"} Jul 15 11:05:42.891129 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.890989 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm" event={"ID":"b6141d40-ed87-4f99-85d9-08d02a00b79e","Type":"ContainerDied","Data":"5efac7d9dde2d3dcfac90189b55d4561cd9f31d3534739f997ef5b772f518a39"} Jul 15 11:05:42.891129 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.891022 2553 scope.go:117] "RemoveContainer" containerID="137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b" Jul 15 11:05:42.891672 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.891658 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx78j\" (UniqueName: \"kubernetes.io/projected/b6141d40-ed87-4f99-85d9-08d02a00b79e-kube-api-access-bx78j\") pod \"b6141d40-ed87-4f99-85d9-08d02a00b79e\" (UID: \"b6141d40-ed87-4f99-85d9-08d02a00b79e\") " Jul 15 11:05:42.891728 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.891692 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6141d40-ed87-4f99-85d9-08d02a00b79e-extensions-socket-volume\") pod \"b6141d40-ed87-4f99-85d9-08d02a00b79e\" (UID: \"b6141d40-ed87-4f99-85d9-08d02a00b79e\") " Jul 15 11:05:42.892102 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.892078 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6141d40-ed87-4f99-85d9-08d02a00b79e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b6141d40-ed87-4f99-85d9-08d02a00b79e" (UID: "b6141d40-ed87-4f99-85d9-08d02a00b79e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 11:05:42.893964 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.893933 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6141d40-ed87-4f99-85d9-08d02a00b79e-kube-api-access-bx78j" (OuterVolumeSpecName: "kube-api-access-bx78j") pod "b6141d40-ed87-4f99-85d9-08d02a00b79e" (UID: "b6141d40-ed87-4f99-85d9-08d02a00b79e"). InnerVolumeSpecName "kube-api-access-bx78j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 11:05:42.911209 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.911188 2553 scope.go:117] "RemoveContainer" containerID="137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b" Jul 15 11:05:42.911622 ip-10-0-131-232 kubenswrapper[2553]: E0715 11:05:42.911600 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b\": container with ID starting with 137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b not found: ID does not exist" containerID="137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b" Jul 15 11:05:42.911736 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.911631 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b"} err="failed to get container status \"137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b\": rpc error: code = NotFound desc = could not find container \"137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b\": container with ID starting with 137c037af00a4165153b512ab217c5831cf93ec2fee34e9396a6b144de74a10b not found: ID does not exist" Jul 15 11:05:42.992304 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.992263 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx78j\" (UniqueName: \"kubernetes.io/projected/b6141d40-ed87-4f99-85d9-08d02a00b79e-kube-api-access-bx78j\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 11:05:42.992304 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:42.992296 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6141d40-ed87-4f99-85d9-08d02a00b79e-extensions-socket-volume\") on node \"ip-10-0-131-232.ec2.internal\" DevicePath \"\"" Jul 15 11:05:43.228136 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:43.228096 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm"] Jul 15 11:05:43.239069 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:43.239037 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r4lbm"] Jul 15 11:05:43.566010 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:05:43.565978 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6141d40-ed87-4f99-85d9-08d02a00b79e" path="/var/lib/kubelet/pods/b6141d40-ed87-4f99-85d9-08d02a00b79e/volumes" Jul 15 11:06:40.228788 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.228744 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5"] Jul 15 11:06:40.229454 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.229411 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6141d40-ed87-4f99-85d9-08d02a00b79e" containerName="manager" Jul 15 11:06:40.229454 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.229433 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6141d40-ed87-4f99-85d9-08d02a00b79e" containerName="manager" Jul 15 11:06:40.229588 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.229548 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6141d40-ed87-4f99-85d9-08d02a00b79e" containerName="manager" Jul 15 11:06:40.232568 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.232546 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" Jul 15 11:06:40.234991 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.234970 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xvngj\"" Jul 15 11:06:40.243698 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.243672 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5"] Jul 15 11:06:40.343091 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.343051 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96458630-f1b0-4adc-bb1b-9c1ea4cc19ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-62qr5\" (UID: \"96458630-f1b0-4adc-bb1b-9c1ea4cc19ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" Jul 15 11:06:40.343091 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.343094 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56wv5\" (UniqueName: \"kubernetes.io/projected/96458630-f1b0-4adc-bb1b-9c1ea4cc19ca-kube-api-access-56wv5\") pod \"kuadrant-operator-controller-manager-86878c769f-62qr5\" (UID: \"96458630-f1b0-4adc-bb1b-9c1ea4cc19ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" Jul 15 11:06:40.444458 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.444414 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96458630-f1b0-4adc-bb1b-9c1ea4cc19ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-62qr5\" (UID: \"96458630-f1b0-4adc-bb1b-9c1ea4cc19ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" Jul 15 11:06:40.444634 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.444476 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56wv5\" (UniqueName: \"kubernetes.io/projected/96458630-f1b0-4adc-bb1b-9c1ea4cc19ca-kube-api-access-56wv5\") pod \"kuadrant-operator-controller-manager-86878c769f-62qr5\" (UID: \"96458630-f1b0-4adc-bb1b-9c1ea4cc19ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" Jul 15 11:06:40.444901 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.444875 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96458630-f1b0-4adc-bb1b-9c1ea4cc19ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-62qr5\" (UID: \"96458630-f1b0-4adc-bb1b-9c1ea4cc19ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" Jul 15 11:06:40.455223 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.455189 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56wv5\" (UniqueName: \"kubernetes.io/projected/96458630-f1b0-4adc-bb1b-9c1ea4cc19ca-kube-api-access-56wv5\") pod \"kuadrant-operator-controller-manager-86878c769f-62qr5\" (UID: \"96458630-f1b0-4adc-bb1b-9c1ea4cc19ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" Jul 15 11:06:40.544106 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.544033 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" Jul 15 11:06:40.685473 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:40.685445 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5"] Jul 15 11:06:40.687272 ip-10-0-131-232 kubenswrapper[2553]: W0715 11:06:40.687238 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96458630_f1b0_4adc_bb1b_9c1ea4cc19ca.slice/crio-86850eec91f996f6188d95c67e1eeafbb6f559388fc0c28eca0ae399cfd8054e WatchSource:0}: Error finding container 86850eec91f996f6188d95c67e1eeafbb6f559388fc0c28eca0ae399cfd8054e: Status 404 returned error can't find the container with id 86850eec91f996f6188d95c67e1eeafbb6f559388fc0c28eca0ae399cfd8054e Jul 15 11:06:41.208407 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:41.208372 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" event={"ID":"96458630-f1b0-4adc-bb1b-9c1ea4cc19ca","Type":"ContainerStarted","Data":"8c1a5bab86302f0b8bec30127893629c13d2e8dc25cb8ae340fa2eb1335d9bb6"} Jul 15 11:06:41.208593 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:41.208429 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" event={"ID":"96458630-f1b0-4adc-bb1b-9c1ea4cc19ca","Type":"ContainerStarted","Data":"86850eec91f996f6188d95c67e1eeafbb6f559388fc0c28eca0ae399cfd8054e"} Jul 15 11:06:41.208593 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:41.208459 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" Jul 15 11:06:41.232157 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:41.232108 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" podStartSLOduration=1.232091262 podStartE2EDuration="1.232091262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:06:41.229363001 +0000 UTC m=+1122.196680823" watchObservedRunningTime="2026-07-15 11:06:41.232091262 +0000 UTC m=+1122.199409063" Jul 15 11:06:52.215900 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:06:52.215854 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-62qr5" Jul 15 11:07:32.848019 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:07:32.847934 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:07:32.936709 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:07:32.936677 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:07:59.545785 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:07:59.545750 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 11:07:59.547581 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:07:59.547560 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 11:07:59.553004 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:07:59.552981 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 11:07:59.554778 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:07:59.554757 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 11:09:27.202798 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:09:27.202709 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:11:19.687891 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:11:19.687849 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:12:53.205897 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:53.205866 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4zvlb_282c1c11-0da1-4533-89f8-276810df505e/manager/0.log" Jul 15 11:12:53.437715 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:53.437686 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5957c57f74-lvn6m_f965997b-d81f-48ef-aa33-4a74b4246e74/manager/0.log" Jul 15 11:12:53.551761 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:53.551735 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-w5tgs_ca9acaca-e6e0-40ae-a719-41beb2371044/server/0.log" Jul 15 11:12:53.791742 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:53.791713 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85886567-2dqdb_564dbd70-3401-4628-95d7-7bb059627148/copy-manifests/0.log" Jul 15 11:12:53.803689 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:53.803622 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85886567-2dqdb_564dbd70-3401-4628-95d7-7bb059627148/manager/0.log" Jul 15 11:12:54.376104 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:54.376072 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8b5b8dd7f-q88bt_022bf7fa-ba07-41d3-9ba3-73a55cca08ba/maas-api/0.log" Jul 15 11:12:54.482682 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:54.482654 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735220-cw2v9_b11973d8-4140-44cb-a491-021116c2678b/cleanup/0.log" Jul 15 11:12:54.591464 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:54.591437 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-7lm6l_63c2ea81-acbe-48ee-af26-810ba6d9eb78/postgres/0.log" Jul 15 11:12:55.969932 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:55.969903 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mgpl9_f0d28e56-04e1-4e28-b654-adc70e32c9bc/manager/0.log" Jul 15 11:12:56.080983 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:56.080949 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zlz7c_b69b2028-0b1d-40af-a39b-08d5341c6383/manager/0.log" Jul 15 11:12:56.304148 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:56.304074 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jpplh_7c9e3177-2e49-4972-9c54-ce94c85a0d72/registry-server/0.log" Jul 15 11:12:56.432282 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:56.432248 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-62qr5_96458630-f1b0-4adc-bb1b-9c1ea4cc19ca/manager/0.log" Jul 15 11:12:56.665119 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:56.665052 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8l4vz_70df92f7-77c3-411b-8ab7-ed7be9f28e68/manager/0.log" Jul 15 11:12:57.355823 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:57.355787 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db8857594-w4rtz_3b279303-f0b6-4c80-8dda-7f3009cdebe0/kube-auth-proxy/0.log" Jul 15 11:12:57.714082 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:57.714059 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-wvfsw_3c8e280b-958d-4b82-be14-7c32baf566a1/payload-processing/0.log" Jul 15 11:12:57.827136 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:57.827112 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75b95db498-7ftm6_641ced34-704d-4252-ad95-9400b513397e/router/0.log" Jul 15 11:12:58.157559 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:58.157473 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-r8fnr_5753e349-117b-4a2e-a0e7-949bbdb48291/main/0.log" Jul 15 11:12:58.504922 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:58.504892 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6b7lq_03f786be-a5ab-4707-8cf8-2dc9f665551f/main/0.log" Jul 15 11:12:59.583611 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:59.583579 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 11:12:59.587369 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:59.587319 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 11:12:59.591354 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:59.591311 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 11:12:59.595192 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:12:59.595169 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z6m8d_e72bb67f-c3f6-4428-8f95-f4550c74a728/ovn-acl-logging/0.log" Jul 15 11:13:00.858078 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:00.858045 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:13:03.035867 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:03.035831 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:13:03.172006 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:03.171976 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:13:05.845478 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:05.845447 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n9zm5_4937210a-24fb-45a5-b3b4-dd096d5eec3d/global-pull-secret-syncer/0.log" Jul 15 11:13:05.936883 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:05.936857 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" Jul 15 11:13:06.038667 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:06.038642 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-232.ec2.internal_f0c77009e9fb924b9ca7fe1c784feaaf/haproxy/0.log" Jul 15 11:13:11.195536 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:11.195501 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mgpl9_f0d28e56-04e1-4e28-b654-adc70e32c9bc/manager/0.log" Jul 15 11:13:11.223904 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:11.223876 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zlz7c_b69b2028-0b1d-40af-a39b-08d5341c6383/manager/0.log" Jul 15 11:13:11.285663 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:11.285633 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jpplh_7c9e3177-2e49-4972-9c54-ce94c85a0d72/registry-server/0.log" Jul 15 11:13:11.348858 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:11.348830 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-62qr5_96458630-f1b0-4adc-bb1b-9c1ea4cc19ca/manager/0.log" Jul 15 11:13:11.416367 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:11.416323 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8l4vz_70df92f7-77c3-411b-8ab7-ed7be9f28e68/manager/0.log" Jul 15 11:13:13.213689 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:13.213660 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-4zbws_ec52f8cc-5de4-4328-9b9d-a2eb26e599a1/cluster-monitoring-operator/0.log" Jul 15 11:13:13.361967 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:13.361936 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9fdc_4725afd7-21b0-4583-9a5b-baf54881e9ba/node-exporter/0.log" Jul 15 11:13:13.382196 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:13.382171 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9fdc_4725afd7-21b0-4583-9a5b-baf54881e9ba/kube-rbac-proxy/0.log" Jul 15 11:13:13.402064 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:13.402044 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9fdc_4725afd7-21b0-4583-9a5b-baf54881e9ba/init-textfile/0.log" Jul 15 11:13:13.954771 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:13.954741 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-94lr2_6745c10e-ed37-402d-8bcc-4e281da981fa/prometheus-operator-admission-webhook/0.log" Jul 15 11:13:15.315950 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:15.315921 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-jhfrt_9703a2d9-e2b3-453f-9dd5-795d429a21a5/networking-console-plugin/0.log" Jul 15 11:13:15.877482 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:15.877448 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs"] Jul 15 11:13:15.881036 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:15.881020 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:15.883654 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:15.883631 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6rwgm\"/\"kube-root-ca.crt\"" Jul 15 11:13:15.883815 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:15.883725 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6rwgm\"/\"openshift-service-ca.crt\"" Jul 15 11:13:15.884437 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:15.884423 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6rwgm\"/\"default-dockercfg-xl68j\"" Jul 15 11:13:15.890080 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:15.890058 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs"] Jul 15 11:13:15.933190 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:15.933170 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/1.log" Jul 15 11:13:15.938157 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:15.938141 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-jzskx_16501ed3-6671-462f-8b7e-df5fd5ebddbb/console-operator/2.log" Jul 15 11:13:16.017790 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.017763 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n7gs\" (UniqueName: \"kubernetes.io/projected/34853fa2-c54f-40a7-a0d6-333e0c9570fe-kube-api-access-4n7gs\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.017885 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.017795 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-sys\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.017885 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.017811 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-podres\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.017885 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.017837 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-proc\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.018002 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.017897 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-lib-modules\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.119117 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.119092 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n7gs\" (UniqueName: \"kubernetes.io/projected/34853fa2-c54f-40a7-a0d6-333e0c9570fe-kube-api-access-4n7gs\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.119205 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.119123 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-sys\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.119205 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.119138 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-podres\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.119205 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.119155 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-proc\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.119205 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.119176 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-lib-modules\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.119391 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.119222 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-sys\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.119391 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.119236 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-proc\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.119391 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.119265 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-podres\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.119391 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.119378 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34853fa2-c54f-40a7-a0d6-333e0c9570fe-lib-modules\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.126806 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.126787 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n7gs\" (UniqueName: \"kubernetes.io/projected/34853fa2-c54f-40a7-a0d6-333e0c9570fe-kube-api-access-4n7gs\") pod \"perf-node-gather-daemonset-48tqs\" (UID: \"34853fa2-c54f-40a7-a0d6-333e0c9570fe\") " pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.191400 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.191348 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:16.514465 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.514439 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-6lkhx_faee1bc3-08a2-4cac-a984-dfa5a8737f16/download-server/0.log" Jul 15 11:13:16.527960 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:16.527938 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs"] Jul 15 11:13:16.529598 ip-10-0-131-232 kubenswrapper[2553]: W0715 11:13:16.529574 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod34853fa2_c54f_40a7_a0d6_333e0c9570fe.slice/crio-ebbd9016bbdf560c945404beba6fdc4a4996ae57bc96f9bdb2c0c76b5de7d392 WatchSource:0}: Error finding container ebbd9016bbdf560c945404beba6fdc4a4996ae57bc96f9bdb2c0c76b5de7d392: Status 404 returned error can't find the container with id ebbd9016bbdf560c945404beba6fdc4a4996ae57bc96f9bdb2c0c76b5de7d392 Jul 15 11:13:17.112199 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:17.112175 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-cd69k_a7401eb5-89e1-4f00-b397-65770902a27d/volume-data-source-validator/0.log" Jul 15 11:13:17.228067 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:17.228036 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" event={"ID":"34853fa2-c54f-40a7-a0d6-333e0c9570fe","Type":"ContainerStarted","Data":"f00c28a0f83582a18bd8ce16a350c964ce0c991453f9b596d8650907baf49855"} Jul 15 11:13:17.228204 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:17.228093 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:17.228204 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:17.228116 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" event={"ID":"34853fa2-c54f-40a7-a0d6-333e0c9570fe","Type":"ContainerStarted","Data":"ebbd9016bbdf560c945404beba6fdc4a4996ae57bc96f9bdb2c0c76b5de7d392"} Jul 15 11:13:17.245718 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:17.245675 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" podStartSLOduration=2.245660599 podStartE2EDuration="2.245660599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:13:17.243872712 +0000 UTC m=+1518.211190535" watchObservedRunningTime="2026-07-15 11:13:17.245660599 +0000 UTC m=+1518.212978397" Jul 15 11:13:18.196442 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:18.196411 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w8vqp_742e4915-dbfa-4d56-9d88-9cac05b2d551/dns/0.log" Jul 15 11:13:18.215810 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:18.215789 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w8vqp_742e4915-dbfa-4d56-9d88-9cac05b2d551/kube-rbac-proxy/0.log" Jul 15 11:13:18.239613 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:18.239592 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9glqk_2bb78eef-9330-46a0-b932-5e69c17c5209/dns-node-resolver/0.log" Jul 15 11:13:18.833907 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:18.833882 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8hbsr_0d4bd1d2-8706-4238-a438-5bbe25fb41ab/node-ca/0.log" Jul 15 11:13:19.849903 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:19.849872 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db8857594-w4rtz_3b279303-f0b6-4c80-8dda-7f3009cdebe0/kube-auth-proxy/0.log" Jul 15 11:13:19.981898 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:19.981858 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-wvfsw_3c8e280b-958d-4b82-be14-7c32baf566a1/payload-processing/0.log" Jul 15 11:13:20.020827 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:20.020805 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75b95db498-7ftm6_641ced34-704d-4252-ad95-9400b513397e/router/0.log" Jul 15 11:13:20.663793 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:20.663764 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d4jkb_cb750dcc-239b-4aec-9ea1-10d74ae15425/serve-healthcheck-canary/0.log" Jul 15 11:13:21.157275 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:21.157252 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-4lwd5_0a77fdc9-59c2-4ebf-879b-cfe375881b24/insights-operator/0.log" Jul 15 11:13:21.199540 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:21.199517 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7q8sl_df7755ca-33a0-48dc-884c-0b57ccdb3ca7/kube-rbac-proxy/0.log" Jul 15 11:13:21.241599 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:21.241582 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7q8sl_df7755ca-33a0-48dc-884c-0b57ccdb3ca7/exporter/0.log" Jul 15 11:13:21.273543 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:21.273524 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7q8sl_df7755ca-33a0-48dc-884c-0b57ccdb3ca7/extractor/0.log" Jul 15 11:13:21.957782 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:21.957740 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h8wwv_6633f6d2-7af7-4b3f-9dad-f46935acdf23/konnectivity-agent/0.log" limit=1024 Jul 15 11:13:23.245128 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:23.245103 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6rwgm/perf-node-gather-daemonset-48tqs" Jul 15 11:13:23.766625 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:23.766557 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4zvlb_282c1c11-0da1-4533-89f8-276810df505e/manager/0.log" Jul 15 11:13:23.881691 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:23.881664 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5957c57f74-lvn6m_f965997b-d81f-48ef-aa33-4a74b4246e74/manager/0.log" Jul 15 11:13:23.901787 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:23.901767 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-w5tgs_ca9acaca-e6e0-40ae-a719-41beb2371044/server/0.log" Jul 15 11:13:24.004901 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:24.004880 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85886567-2dqdb_564dbd70-3401-4628-95d7-7bb059627148/manager/0.log" Jul 15 11:13:24.020685 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:24.020624 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85886567-2dqdb_564dbd70-3401-4628-95d7-7bb059627148/copy-manifests/0.log" Jul 15 11:13:26.241706 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:26.241684 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db8857594-w4rtz_3b279303-f0b6-4c80-8dda-7f3009cdebe0/kube-auth-proxy/0.log" Jul 15 11:13:26.308263 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:26.308239 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-wvfsw_3c8e280b-958d-4b82-be14-7c32baf566a1/payload-processing/0.log" Jul 15 11:13:26.320081 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:26.320064 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75b95db498-7ftm6_641ced34-704d-4252-ad95-9400b513397e/router/0.log" Jul 15 11:13:27.433793 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:27.433760 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db8857594-w4rtz_3b279303-f0b6-4c80-8dda-7f3009cdebe0/kube-auth-proxy/0.log" Jul 15 11:13:27.537621 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:27.537597 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-wvfsw_3c8e280b-958d-4b82-be14-7c32baf566a1/payload-processing/0.log" Jul 15 11:13:27.556286 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:27.556232 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75b95db498-7ftm6_641ced34-704d-4252-ad95-9400b513397e/router/0.log" Jul 15 11:13:30.538563 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:30.538533 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-f6ps4_82a4d1da-6468-486d-aa8e-03879587cd76/migrator/0.log" Jul 15 11:13:30.558955 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:30.558911 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-f6ps4_82a4d1da-6468-486d-aa8e-03879587cd76/graceful-termination/0.log" Jul 15 11:13:30.942913 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:30.942822 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-jwkzd_b2a5dfe8-7042-4808-9598-50daf570cba7/kube-storage-version-migrator-operator/1.log" Jul 15 11:13:30.943646 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:30.943616 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-jwkzd_b2a5dfe8-7042-4808-9598-50daf570cba7/kube-storage-version-migrator-operator/0.log" Jul 15 11:13:32.166539 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:32.166502 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrkq_cca9c267-e327-4934-912a-5e6183d3cd90/kube-multus-additional-cni-plugins/0.log" Jul 15 11:13:32.188139 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:32.188103 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrkq_cca9c267-e327-4934-912a-5e6183d3cd90/egress-router-binary-copy/0.log" Jul 15 11:13:32.207203 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:32.207175 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrkq_cca9c267-e327-4934-912a-5e6183d3cd90/cni-plugins/0.log" Jul 15 11:13:32.227199 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:32.227172 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrkq_cca9c267-e327-4934-912a-5e6183d3cd90/bond-cni-plugin/0.log" Jul 15 11:13:32.245869 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:32.245843 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrkq_cca9c267-e327-4934-912a-5e6183d3cd90/routeoverride-cni/0.log" Jul 15 11:13:32.264103 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:32.264082 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrkq_cca9c267-e327-4934-912a-5e6183d3cd90/whereabouts-cni-bincopy/0.log" Jul 15 11:13:32.289077 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:32.289052 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrkq_cca9c267-e327-4934-912a-5e6183d3cd90/whereabouts-cni/0.log" Jul 15 11:13:32.369172 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:32.369145 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v6k8q_48db0132-07ec-45ae-a403-33dbef104301/kube-multus/0.log" Jul 15 11:13:32.466125 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:32.466097 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z4hz6_e9700e2f-eb72-46e7-ba4d-667b3c5942fc/network-metrics-daemon/0.log" Jul 15 11:13:32.485198 ip-10-0-131-232 kubenswrapper[2553]: I0715 11:13:32.485168 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z4hz6_e9700e2f-eb72-46e7-ba4d-667b3c5942fc/kube-rbac-proxy/0.log"