Jul 08 18:59:05.999853 ip-10-0-130-102 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 18:59:05.999864 ip-10-0-130-102 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 18:59:05.999874 ip-10-0-130-102 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 18:59:06.000211 ip-10-0-130-102 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 18:59:16.036093 ip-10-0-130-102 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 18:59:16.036113 ip-10-0-130-102 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 00176b3423d7459abb0278267f08e29f -- Jul 08 19:00:52.873211 ip-10-0-130-102 systemd[1]: Starting Kubernetes Kubelet... Jul 08 19:00:53.301093 ip-10-0-130-102 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:00:53.301093 ip-10-0-130-102 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 19:00:53.301093 ip-10-0-130-102 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:00:53.301093 ip-10-0-130-102 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 19:00:53.301093 ip-10-0-130-102 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:00:53.302266 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.302129 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 19:00:53.309107 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309081 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:00:53.309107 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309103 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:00:53.309107 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309107 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:00:53.309107 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309111 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:00:53.309107 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309114 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:00:53.309107 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309117 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309120 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309123 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309125 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309128 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309132 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309134 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309137 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309140 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309142 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309150 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309152 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309155 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309157 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309160 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309163 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309166 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309168 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309170 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309173 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:00:53.309334 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309179 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309182 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309185 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309187 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309190 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309192 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309195 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309197 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309200 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309202 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309205 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309207 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309210 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309214 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309218 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309222 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309224 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309227 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309230 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:00:53.309803 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309233 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309236 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309238 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309241 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309244 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309246 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309249 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309251 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309253 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309263 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309266 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309268 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309271 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309274 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309277 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309279 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309282 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309284 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309287 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309290 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:00:53.310317 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309293 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309295 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309298 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309301 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309303 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309306 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309308 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309311 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309314 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309316 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309319 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309322 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309325 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309328 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309332 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309336 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309339 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309342 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309346 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:00:53.310792 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309352 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309355 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309358 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309360 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309363 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309366 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309369 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309371 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309374 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309377 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309380 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309384 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309387 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309390 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309392 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.309395 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310199 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310207 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310212 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310214 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:00:53.311285 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310217 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310220 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310222 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310225 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310228 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310230 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310233 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310235 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310238 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310241 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310243 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310247 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310251 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310255 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310258 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310261 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310264 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310266 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310270 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:00:53.311781 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310273 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310276 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310280 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310283 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310286 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310290 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310293 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310295 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310298 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310301 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310303 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310306 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310309 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310311 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310314 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310316 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310319 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310321 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310324 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310326 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:00:53.312274 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310329 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310332 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310334 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310337 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310340 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310342 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310345 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310354 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310356 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310360 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310364 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310367 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310370 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310373 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310375 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310378 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310383 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310385 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310388 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310390 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:00:53.312756 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310393 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310395 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310399 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310402 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310405 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310407 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310410 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310412 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310415 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310417 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310420 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310422 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310424 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310427 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310430 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310433 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310436 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310438 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310441 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:00:53.313251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310444 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310447 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310449 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310451 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310454 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310456 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310459 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310461 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310463 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310469 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310471 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310474 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310476 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310479 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310481 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310484 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310486 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310873 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310878 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310880 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:00:53.313710 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310883 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310886 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310888 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310891 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310893 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310896 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310898 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310901 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310903 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310906 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310909 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310911 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310913 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310916 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310919 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310922 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310924 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310926 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310929 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310931 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:00:53.314247 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310934 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310938 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310940 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310943 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310945 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310966 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310971 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310973 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310978 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310981 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310985 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310988 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310990 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310993 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310996 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.310998 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311002 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311005 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311009 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:00:53.314765 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311012 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311016 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311019 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311021 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311024 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311027 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311029 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311033 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311036 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311038 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311041 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311043 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311045 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311048 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311052 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311054 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311057 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311059 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311062 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:00:53.315363 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311064 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311067 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311069 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311072 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311074 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311077 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311079 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311081 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311084 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311087 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311089 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311091 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311094 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311096 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311099 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311102 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311104 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311107 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311109 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311112 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:00:53.315870 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311114 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311117 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311119 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311122 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311126 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311128 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311131 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311135 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311137 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311140 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311142 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311145 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311147 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311151 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311154 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311157 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311159 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311162 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311235 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311243 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 19:00:53.316374 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311249 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311253 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311258 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311261 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311266 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311270 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311273 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311276 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311280 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311283 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311286 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311289 2570 flags.go:64] FLAG: --cgroup-root="" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311293 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311296 2570 flags.go:64] FLAG: --client-ca-file="" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311300 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311303 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311308 2570 flags.go:64] FLAG: --cluster-domain="" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311311 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311314 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311318 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311321 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311325 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311328 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 19:00:53.316865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311330 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311334 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311337 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311339 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311342 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311345 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311348 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311352 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311355 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311357 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311360 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311363 2570 flags.go:64] FLAG: --enable-server="true" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311365 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311370 2570 flags.go:64] FLAG: --event-burst="100" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311373 2570 flags.go:64] FLAG: --event-qps="50" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311376 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311378 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311381 2570 flags.go:64] FLAG: --eviction-hard="" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311385 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311387 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311390 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311393 2570 flags.go:64] FLAG: --eviction-soft="" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311396 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311399 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311412 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 19:00:53.317467 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311415 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311418 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311421 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311424 2570 flags.go:64] FLAG: --feature-gates="" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311428 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311431 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311435 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311438 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311441 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311444 2570 flags.go:64] FLAG: --help="false" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311447 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311450 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311453 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311456 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311459 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311463 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311466 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311469 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311471 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311474 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311477 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311480 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311482 2570 flags.go:64] FLAG: --kube-reserved="" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311485 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 19:00:53.318093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311488 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311491 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311494 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311496 2570 flags.go:64] FLAG: --lock-file="" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311499 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311502 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311505 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311510 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311513 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311516 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311519 2570 flags.go:64] FLAG: --logging-format="text" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311521 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311525 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311527 2570 flags.go:64] FLAG: --manifest-url="" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311531 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311535 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311538 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311542 2570 flags.go:64] FLAG: --max-pods="110" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311545 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311548 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311551 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311554 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311556 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311559 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311562 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 19:00:53.318704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311569 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311572 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311575 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311578 2570 flags.go:64] FLAG: --pod-cidr="" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311581 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311586 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311589 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311591 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311594 2570 flags.go:64] FLAG: --port="10250" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311597 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311599 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0537892b60626d012" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311603 2570 flags.go:64] FLAG: --qos-reserved="" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311605 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311608 2570 flags.go:64] FLAG: --register-node="true" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311611 2570 flags.go:64] FLAG: --register-with-taints="" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311614 2570 flags.go:64] FLAG: --registry-burst="10" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311617 2570 flags.go:64] FLAG: --registry-qps="5" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311620 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311623 2570 flags.go:64] FLAG: --reserved-memory="" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311626 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311629 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311633 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311636 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311639 2570 flags.go:64] FLAG: --runonce="false" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311641 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 19:00:53.319342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311644 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311647 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311649 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311652 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311655 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311658 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311661 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311663 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311666 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311669 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311672 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311675 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311677 2570 flags.go:64] FLAG: --system-cgroups="" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311680 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311685 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311688 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311690 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311694 2570 flags.go:64] FLAG: --tls-min-version="" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311698 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311701 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311704 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311707 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311710 2570 flags.go:64] FLAG: --v="2" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311714 2570 flags.go:64] FLAG: --version="false" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311718 2570 flags.go:64] FLAG: --vmodule="" Jul 08 19:00:53.319992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311722 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.311725 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311841 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311847 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311850 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311853 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311856 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311858 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311860 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311863 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311866 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311868 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311871 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311875 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311878 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311882 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311885 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311887 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311891 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:00:53.320610 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311893 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311896 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311900 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311903 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311905 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311908 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311912 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311914 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311917 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311919 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311922 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311924 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311927 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311930 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311932 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311935 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311939 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311942 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311944 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311962 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:00:53.321139 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311966 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311970 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311973 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311976 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311979 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311981 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311984 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311987 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311989 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311992 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311994 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311997 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.311999 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312002 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312005 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312007 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312009 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312012 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312016 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:00:53.321634 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312018 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312021 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312023 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312027 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312029 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312032 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312034 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312037 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312040 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312044 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312046 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312049 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312052 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312054 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312057 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312059 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312061 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312064 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312066 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312069 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:00:53.322105 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312071 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312075 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312078 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312081 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312083 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312087 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312090 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312092 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312095 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312097 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312099 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312103 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312106 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312108 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312111 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312113 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312116 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312118 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312121 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312124 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:00:53.322600 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312127 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312131 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.312134 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.312139 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.319775 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.319796 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.321612 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.321622 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321694 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321701 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321705 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321708 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321710 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321713 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321715 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:00:53.323207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321718 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321721 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321723 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321727 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321729 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321732 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321735 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321738 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321740 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321743 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321745 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321748 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321750 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321753 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321756 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321758 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321761 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321768 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321770 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321773 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:00:53.323593 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321775 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321778 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321781 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321784 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321787 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321790 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321793 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321795 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321798 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321801 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321803 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321806 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321808 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321810 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321813 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321815 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321820 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321824 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321827 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:00:53.324077 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321830 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321833 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321836 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321838 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321841 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321844 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321846 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321849 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321851 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321854 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321856 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321859 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321862 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321864 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321868 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321872 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321875 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321877 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321880 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:00:53.324546 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321882 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321885 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321887 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321890 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321893 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321895 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321898 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321900 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321902 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321906 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321910 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321913 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321916 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321919 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321921 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321924 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321927 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321930 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321932 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:00:53.325052 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321935 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321938 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321941 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321943 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321946 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.321960 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322322 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322326 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322329 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322333 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322336 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322338 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322341 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322343 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322347 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:00:53.325511 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.322352 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322470 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322474 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322477 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322480 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322483 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322487 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322491 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322494 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322497 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322499 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322502 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322505 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322507 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322509 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322513 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322515 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322518 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322520 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:00:53.325887 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322523 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322525 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322527 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322530 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322532 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322535 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322539 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322542 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322545 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322547 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322550 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322552 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322554 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322557 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322559 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322562 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322565 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322567 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322570 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:00:53.326348 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322572 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322574 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322577 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322579 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322582 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322584 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322586 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322589 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322591 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322594 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322596 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322599 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322601 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322604 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322607 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322609 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322612 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322614 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322617 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:00:53.326811 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322620 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322622 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322625 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322628 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322630 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322633 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322635 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322638 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322640 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322642 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322645 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322647 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322650 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322653 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322655 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322659 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322662 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322664 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322667 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322670 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:00:53.327279 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322672 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322675 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322678 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322680 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322683 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322685 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322688 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322690 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322693 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322695 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322697 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322700 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322702 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322705 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322708 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322710 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322713 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322716 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322718 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322720 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:00:53.327773 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322723 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:00:53.328275 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322725 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:00:53.328275 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:53.322728 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:00:53.328275 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.322733 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:00:53.328275 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.322865 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 19:00:53.328275 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.325246 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 19:00:53.328275 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.326825 2570 server.go:1019] "Starting client certificate rotation" Jul 08 19:00:53.328275 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.326930 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:00:53.328275 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.327000 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:00:53.329623 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.329607 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:00:53.331786 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.331772 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:00:53.345072 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.345041 2570 log.go:25] "Validated CRI v1 runtime API" Jul 08 19:00:53.347927 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.347904 2570 log.go:25] "Validated CRI v1 image API" Jul 08 19:00:53.351265 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.351248 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 19:00:53.353875 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.353852 2570 fs.go:135] Filesystem UUIDs: map[1a47cc63-b239-40d7-aaf8-052710c55a67:/dev/nvme0n1p4 2c24518a-eb2b-4be4-be2e-1b29b578dfce:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 08 19:00:53.353964 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.353873 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 19:00:53.360785 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.360673 2570 manager.go:216] Machine: {Timestamp:2026-07-08 19:00:53.358126771 +0000 UTC m=+0.379568036 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101482 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec235a0ed549b9a5b62ec073060057f7 SystemUUID:ec235a0e-d549-b9a5-b62e-c073060057f7 BootID:00176b34-23d7-459a-bb02-78267f08e29f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:77:f2:74:b1:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:77:f2:74:b1:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:7b:f8:e7:23:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 19:00:53.360785 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.360782 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 19:00:53.360903 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.360876 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 19:00:53.362063 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.362045 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:00:53.365159 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.365125 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 19:00:53.365308 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.365165 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 19:00:53.365987 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.365976 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 19:00:53.366022 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.365988 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 19:00:53.366022 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.365997 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:00:53.366022 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.366011 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:00:53.367896 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.367885 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 19:00:53.371389 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.371377 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:00:53.371528 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.371518 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 19:00:53.372438 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.372428 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 08 19:00:53.372472 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.372444 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 19:00:53.372499 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.372473 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 19:00:53.372499 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.372483 2570 kubelet.go:398] "Adding apiserver pod source" Jul 08 19:00:53.372499 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.372498 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 19:00:53.372861 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.372850 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:00:53.372903 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.372868 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:00:53.375478 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.375463 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 19:00:53.377895 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.377882 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 19:00:53.377946 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.377912 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 19:00:53.379248 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379235 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 19:00:53.379248 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379251 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 19:00:53.379348 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379256 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 19:00:53.379348 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379262 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 19:00:53.379348 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379270 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 19:00:53.379348 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379276 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 19:00:53.379348 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379284 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 19:00:53.379348 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379290 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 19:00:53.379348 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379297 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 19:00:53.379348 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379306 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 19:00:53.379348 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379319 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 19:00:53.379348 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.379325 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 19:00:53.381219 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.381208 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 19:00:53.381219 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.381219 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 19:00:53.384173 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.384128 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 19:00:53.384173 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.384157 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 19:00:53.384285 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.384189 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 19:00:53.385176 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.385159 2570 server.go:1268] "Started kubelet" Jul 08 19:00:53.385266 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.385238 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 19:00:53.385405 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.385333 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 19:00:53.385466 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.385453 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 19:00:53.386205 ip-10-0-130-102 systemd[1]: Started Kubernetes Kubelet. Jul 08 19:00:53.389193 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.389112 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 19:00:53.391388 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.391371 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 08 19:00:53.391827 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.391807 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 19:00:53.396350 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.395170 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-102.ec2.internal.18c065aeafb249c5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-102.ec2.internal,UID:ip-10-0-130-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-102.ec2.internal,},FirstTimestamp:2026-07-08 19:00:53.385128389 +0000 UTC m=+0.406569653,LastTimestamp:2026-07-08 19:00:53.385128389 +0000 UTC m=+0.406569653,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-102.ec2.internal,}" Jul 08 19:00:53.399252 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.399235 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 19:00:53.399252 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.399243 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 19:00:53.399373 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.399350 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:53.400092 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400071 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 19:00:53.400281 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400144 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 19:00:53.400281 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400157 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 19:00:53.400281 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400278 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 08 19:00:53.400281 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400288 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 08 19:00:53.400803 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400776 2570 factory.go:153] Registering CRI-O factory Jul 08 19:00:53.400803 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400796 2570 factory.go:223] Registration of the crio container factory successfully Jul 08 19:00:53.400921 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400850 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 19:00:53.400921 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400860 2570 factory.go:55] Registering systemd factory Jul 08 19:00:53.400921 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400869 2570 factory.go:223] Registration of the systemd container factory successfully Jul 08 19:00:53.400921 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400893 2570 factory.go:103] Registering Raw factory Jul 08 19:00:53.400921 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.400904 2570 manager.go:1196] Started watching for new ooms in manager Jul 08 19:00:53.401499 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.401479 2570 manager.go:349] Starting recovery of all containers Jul 08 19:00:53.401839 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.401814 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 19:00:53.401977 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.401930 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 19:00:53.407527 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.407503 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2zbhb" Jul 08 19:00:53.412682 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.412521 2570 manager.go:354] Recovery completed Jul 08 19:00:53.418524 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.418512 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:00:53.419538 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.419522 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2zbhb" Jul 08 19:00:53.420665 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.420648 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:00:53.420734 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.420680 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:00:53.420734 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.420694 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:00:53.421643 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.421623 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 19:00:53.421643 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.421643 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 19:00:53.421740 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.421656 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:00:53.421740 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.421663 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:00:53.422585 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.422572 2570 policy_none.go:49] "None policy: Start" Jul 08 19:00:53.422585 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.422587 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 19:00:53.422696 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.422596 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 19:00:53.422696 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.422660 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:00:53.422696 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.422693 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:00:53.422825 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.422713 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:00:53.423515 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.423504 2570 policy_none.go:47] "Start" Jul 08 19:00:53.469446 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.464558 2570 manager.go:337] "Starting Device Plugin manager" Jul 08 19:00:53.469446 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.464587 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 19:00:53.469446 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.464596 2570 server.go:87] "Starting device plugin registration server" Jul 08 19:00:53.469446 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.464812 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 19:00:53.469446 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.464822 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 19:00:53.469446 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.464928 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 19:00:53.469446 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.465065 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 19:00:53.469446 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.465077 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 19:00:53.469446 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.465631 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 19:00:53.469446 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.465696 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:53.502443 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.502416 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 19:00:53.503752 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.503739 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 19:00:53.503846 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.503779 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 19:00:53.503846 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.503805 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 19:00:53.503930 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.503844 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 19:00:53.506378 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.506354 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:00:53.565689 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.565611 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:00:53.566793 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.566777 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:00:53.566854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.566816 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:00:53.566854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.566827 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:00:53.566854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.566850 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.577146 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.577130 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.577194 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.577151 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-102.ec2.internal\": node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:53.600160 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.600131 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:53.604360 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.604341 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal"] Jul 08 19:00:53.604413 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.604401 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:00:53.605294 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.605280 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:00:53.605358 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.605309 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:00:53.605358 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.605318 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:00:53.606553 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.606539 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:00:53.606669 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.606652 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.606706 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.606685 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:00:53.607249 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.607233 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:00:53.607317 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.607260 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:00:53.607317 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.607270 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:00:53.607770 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.607754 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:00:53.607844 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.607792 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:00:53.607844 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.607807 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:00:53.609255 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.609238 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.609347 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.609273 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:00:53.609936 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.609919 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:00:53.610025 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.609960 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:00:53.610025 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.609975 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:00:53.631679 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.631661 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-102.ec2.internal\" not found" node="ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.636133 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.636114 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-102.ec2.internal\" not found" node="ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.700208 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.700181 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:53.701333 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.701312 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/74fdbe30727f928da25e20a7bc35e63d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal\" (UID: \"74fdbe30727f928da25e20a7bc35e63d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.701394 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.701342 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74fdbe30727f928da25e20a7bc35e63d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal\" (UID: \"74fdbe30727f928da25e20a7bc35e63d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.701394 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.701361 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc54df53a307e9a93a77d4a51b268294-config\") pod \"kube-apiserver-proxy-ip-10-0-130-102.ec2.internal\" (UID: \"cc54df53a307e9a93a77d4a51b268294\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.801033 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.800994 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:53.802111 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.802092 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/74fdbe30727f928da25e20a7bc35e63d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal\" (UID: \"74fdbe30727f928da25e20a7bc35e63d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.802172 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.802120 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74fdbe30727f928da25e20a7bc35e63d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal\" (UID: \"74fdbe30727f928da25e20a7bc35e63d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.802172 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.802137 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc54df53a307e9a93a77d4a51b268294-config\") pod \"kube-apiserver-proxy-ip-10-0-130-102.ec2.internal\" (UID: \"cc54df53a307e9a93a77d4a51b268294\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.802266 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.802193 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc54df53a307e9a93a77d4a51b268294-config\") pod \"kube-apiserver-proxy-ip-10-0-130-102.ec2.internal\" (UID: \"cc54df53a307e9a93a77d4a51b268294\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.802266 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.802213 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74fdbe30727f928da25e20a7bc35e63d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal\" (UID: \"74fdbe30727f928da25e20a7bc35e63d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.802266 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.802215 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/74fdbe30727f928da25e20a7bc35e63d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal\" (UID: \"74fdbe30727f928da25e20a7bc35e63d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.901718 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:53.901637 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:53.934882 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.934862 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" Jul 08 19:00:53.938790 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:53.938636 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal" Jul 08 19:00:54.002474 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:54.002435 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:54.102957 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:54.102926 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:54.203361 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:54.203335 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:54.303832 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:54.303796 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:54.326036 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.326008 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 19:00:54.326186 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.326168 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 19:00:54.404177 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:54.404154 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-102.ec2.internal\" not found" Jul 08 19:00:54.422051 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.422016 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 18:55:54 +0000 UTC" deadline="2028-03-23 22:37:16.744528886 +0000 UTC" Jul 08 19:00:54.422051 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.422046 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14979h36m22.322485796s" Jul 08 19:00:54.487654 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.487599 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:00:54.496036 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.496020 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:00:54.499746 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.499730 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" Jul 08 19:00:54.506791 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.506775 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:00:54.514870 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.514856 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:00:54.515611 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.515599 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal" Jul 08 19:00:54.524139 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.524127 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:00:54.803859 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:54.803818 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fdbe30727f928da25e20a7bc35e63d.slice/crio-885866cee1b8854d937c9add5bf8ab8b3a73528a45dd9ea1b049715fea4cf3d5 WatchSource:0}: Error finding container 885866cee1b8854d937c9add5bf8ab8b3a73528a45dd9ea1b049715fea4cf3d5: Status 404 returned error can't find the container with id 885866cee1b8854d937c9add5bf8ab8b3a73528a45dd9ea1b049715fea4cf3d5 Jul 08 19:00:54.807822 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:54.807806 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:00:56.619588 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.619555 2570 apiserver.go:52] "Watching apiserver" Jul 08 19:00:56.625907 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.625878 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 19:00:56.626246 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.626223 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-wzntx","openshift-network-operator/iptables-alerter-q9kgg","openshift-ovn-kubernetes/ovnkube-node-82474","kube-system/konnectivity-agent-dlz5c","kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn","openshift-dns/node-resolver-dgnx2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal","openshift-multus/multus-6npns","openshift-multus/multus-additional-cni-plugins-4tjt8","openshift-network-diagnostics/network-check-target-5hls6","kube-system/global-pull-secret-syncer-zflm9","openshift-cluster-node-tuning-operator/tuned-222cq","openshift-image-registry/node-ca-bd7xm"] Jul 08 19:00:56.628221 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.628207 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.629356 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.629336 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.630507 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.630486 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gsc9h\"" Jul 08 19:00:56.630572 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.630504 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 19:00:56.630572 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.630491 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 19:00:56.630572 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.630560 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.631119 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.631097 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 19:00:56.631638 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.631620 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 19:00:56.631719 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.631702 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.631830 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.631816 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jx8mk\"" Jul 08 19:00:56.631864 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.631834 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:00:56.632964 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.632946 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 19:00:56.633194 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.633179 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-77vqq\"" Jul 08 19:00:56.633379 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.633359 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:00:56.633525 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.633400 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 19:00:56.633701 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.633683 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 19:00:56.633785 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.633769 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 19:00:56.634164 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.634131 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.634773 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.634698 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 19:00:56.634773 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.634761 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 19:00:56.634773 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.634768 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 19:00:56.635083 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.634960 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9rgkq\"" Jul 08 19:00:56.635083 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.635080 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 19:00:56.635327 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.635299 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 19:00:56.635435 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.635418 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6npns" Jul 08 19:00:56.635861 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.635842 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 19:00:56.636128 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.636108 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 19:00:56.636221 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.636171 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 19:00:56.636221 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.636178 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6s5dl\"" Jul 08 19:00:56.636221 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.636199 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 19:00:56.636221 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.636202 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 19:00:56.636385 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.636223 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9znjg\"" Jul 08 19:00:56.637109 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.637091 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.637714 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.637697 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 19:00:56.638041 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.638022 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 19:00:56.638505 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.638028 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 19:00:56.638505 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.638152 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4dp5p\"" Jul 08 19:00:56.638505 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.638319 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 19:00:56.640807 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.640783 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:00:56.640928 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.640908 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vsl44\"" Jul 08 19:00:56.640993 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.640930 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 19:00:56.640993 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.640938 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:00:56.641100 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.641018 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 19:00:56.641935 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.641921 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:56.641998 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.641977 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:00:56.643275 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.643262 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.644775 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.644758 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:00:56.644853 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.644818 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:00:56.645178 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.645158 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 19:00:56.645272 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.645256 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:00:56.645385 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.645369 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 19:00:56.645536 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.645522 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dkf2w\"" Jul 08 19:00:56.646434 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.646420 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 19:00:56.652926 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.652909 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-kubelet\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.653034 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.652932 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-run-openvswitch\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.653034 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.652948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-system-cni-dir\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.653034 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.652965 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-kubernetes\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.653034 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.652986 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-run-netns\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.653180 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-cni-bin\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.653180 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653062 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d8f321d-d047-435f-9cdd-ba893bf5ff07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.653180 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653094 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d8f321d-d047-435f-9cdd-ba893bf5ff07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.653180 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653120 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.653180 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653144 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-var-lib-kubelet\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.653180 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653164 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81394296-08c3-43e9-b8e7-c357233fc33d-etc-tuned\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.653349 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653183 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-node-log\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.653349 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653198 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cb07635-ed09-4f4d-a7d5-fc56a8c9859f-hosts-file\") pod \"node-resolver-dgnx2\" (UID: \"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f\") " pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.653349 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653212 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f272e0f-0ed3-43f0-ae36-1456ca186b8c-host\") pod \"node-ca-bd7xm\" (UID: \"5f272e0f-0ed3-43f0-ae36-1456ca186b8c\") " pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.653349 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653241 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-sys\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.653349 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653270 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c1f41c1-41f0-4b55-abc6-89feb52ba630-ovnkube-config\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.653349 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653299 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c1f41c1-41f0-4b55-abc6-89feb52ba630-env-overrides\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.653349 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653320 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqx6x\" (UniqueName: \"kubernetes.io/projected/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-kube-api-access-gqx6x\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:00:56.653349 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653336 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cb07635-ed09-4f4d-a7d5-fc56a8c9859f-tmp-dir\") pod \"node-resolver-dgnx2\" (UID: \"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f\") " pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.653349 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653349 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d5bbbb9-0b90-42bf-9a67-443fe82bbe34-iptables-alerter-script\") pod \"iptables-alerter-q9kgg\" (UID: \"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34\") " pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653369 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-device-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653391 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653412 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-run-netns\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653432 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-cni-netd\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653472 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25-konnectivity-ca\") pod \"konnectivity-agent-dlz5c\" (UID: \"c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25\") " pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653487 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6prx\" (UniqueName: \"kubernetes.io/projected/81394296-08c3-43e9-b8e7-c357233fc33d-kube-api-access-c6prx\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653500 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d5bbbb9-0b90-42bf-9a67-443fe82bbe34-host-slash\") pod \"iptables-alerter-q9kgg\" (UID: \"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34\") " pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653515 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc69n\" (UniqueName: \"kubernetes.io/projected/89d0b23b-e056-4b6c-9be8-302a6cab3435-kube-api-access-fc69n\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653536 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-run-k8s-cni-cncf-io\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653563 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-hostroot\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653600 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-run-multus-certs\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653630 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65h9w\" (UniqueName: \"kubernetes.io/projected/61ca997c-4091-4c14-8fa0-b33055810105-kube-api-access-65h9w\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.653656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653652 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5thgz\" (UniqueName: \"kubernetes.io/projected/5f272e0f-0ed3-43f0-ae36-1456ca186b8c-kube-api-access-5thgz\") pod \"node-ca-bd7xm\" (UID: \"5f272e0f-0ed3-43f0-ae36-1456ca186b8c\") " pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653689 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-multus-cni-dir\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653723 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-systemd-units\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653743 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6573bd34-7a4b-42da-8126-b90510b483e4-kubelet-config\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653762 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqhr6\" (UniqueName: \"kubernetes.io/projected/2cb07635-ed09-4f4d-a7d5-fc56a8c9859f-kube-api-access-nqhr6\") pod \"node-resolver-dgnx2\" (UID: \"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f\") " pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653776 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf2m7\" (UniqueName: \"kubernetes.io/projected/1d5bbbb9-0b90-42bf-9a67-443fe82bbe34-kube-api-access-tf2m7\") pod \"iptables-alerter-q9kgg\" (UID: \"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34\") " pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653789 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-os-release\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653832 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653857 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61ca997c-4091-4c14-8fa0-b33055810105-cni-binary-copy\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653875 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-var-lib-openvswitch\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653912 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-cnibin\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653951 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f272e0f-0ed3-43f0-ae36-1456ca186b8c-serviceca\") pod \"node-ca-bd7xm\" (UID: \"5f272e0f-0ed3-43f0-ae36-1456ca186b8c\") " pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.653983 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-socket-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-registration-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654035 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-host\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.654152 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654088 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-system-cni-dir\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654110 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-var-lib-cni-bin\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654133 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-var-lib-kubelet\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654155 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nms9\" (UniqueName: \"kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9\") pod \"network-check-target-5hls6\" (UID: \"0fa43b64-fa90-427f-a7e3-666964b16bf8\") " pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654176 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-run-ovn\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654201 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-multus-socket-dir-parent\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654237 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-sysctl-d\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654269 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-slash\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654287 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-etc-openvswitch\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654301 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-run-ovn-kubernetes\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654319 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdtxd\" (UniqueName: \"kubernetes.io/projected/6d8f321d-d047-435f-9cdd-ba893bf5ff07-kube-api-access-fdtxd\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654337 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6573bd34-7a4b-42da-8126-b90510b483e4-dbus\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654350 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-modprobe-d\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654364 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/61ca997c-4091-4c14-8fa0-b33055810105-multus-daemon-config\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654381 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-log-socket\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.654816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654406 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654430 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-cnibin\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654471 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-systemd\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654493 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81394296-08c3-43e9-b8e7-c357233fc33d-tmp\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654517 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-run-systemd\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654584 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c1f41c1-41f0-4b55-abc6-89feb52ba630-ovnkube-script-lib\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654609 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7mfs\" (UniqueName: \"kubernetes.io/projected/4c1f41c1-41f0-4b55-abc6-89feb52ba630-kube-api-access-f7mfs\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654641 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25-agent-certs\") pod \"konnectivity-agent-dlz5c\" (UID: \"c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25\") " pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654666 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-os-release\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654692 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-sys-fs\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654728 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-var-lib-cni-multus\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654751 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-multus-conf-dir\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654778 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-sysctl-conf\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-run\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654830 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c1f41c1-41f0-4b55-abc6-89feb52ba630-ovn-node-metrics-cert\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654850 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d8f321d-d047-435f-9cdd-ba893bf5ff07-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654867 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-etc-kubernetes\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.655240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654898 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-sysconfig\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.655745 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.654921 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-lib-modules\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.658748 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.658731 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:00:56.682582 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.682567 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7bb6h" Jul 08 19:00:56.689610 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.689596 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7bb6h" Jul 08 19:00:56.752893 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.752857 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal" event={"ID":"cc54df53a307e9a93a77d4a51b268294","Type":"ContainerStarted","Data":"3f577d25df1a2f20c37759599a068cb892de9a1537f3f0d1b19a3e986a69f7d1"} Jul 08 19:00:56.753869 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.753845 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" event={"ID":"74fdbe30727f928da25e20a7bc35e63d","Type":"ContainerStarted","Data":"885866cee1b8854d937c9add5bf8ab8b3a73528a45dd9ea1b049715fea4cf3d5"} Jul 08 19:00:56.756128 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756107 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-modprobe-d\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.756217 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756139 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/61ca997c-4091-4c14-8fa0-b33055810105-multus-daemon-config\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.756217 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756165 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-log-socket\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.756217 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756189 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:56.756404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756225 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-cnibin\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.756404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756239 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-log-socket\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.756404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756248 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-systemd\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.756404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756252 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-modprobe-d\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.756404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756280 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81394296-08c3-43e9-b8e7-c357233fc33d-tmp\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.756404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756306 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-systemd\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.756404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756358 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-cnibin\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.756404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756363 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-run-systemd\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.756404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756401 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c1f41c1-41f0-4b55-abc6-89feb52ba630-ovnkube-script-lib\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756497 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7mfs\" (UniqueName: \"kubernetes.io/projected/4c1f41c1-41f0-4b55-abc6-89feb52ba630-kube-api-access-f7mfs\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756467 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-run-systemd\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756525 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25-agent-certs\") pod \"konnectivity-agent-dlz5c\" (UID: \"c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25\") " pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.756535 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756563 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-os-release\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-sys-fs\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756612 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.756646 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret podName:6573bd34-7a4b-42da-8126-b90510b483e4 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:57.256607526 +0000 UTC m=+3.032560001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret") pod "global-pull-secret-syncer-zflm9" (UID: "6573bd34-7a4b-42da-8126-b90510b483e4") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756701 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-var-lib-cni-multus\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756708 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-os-release\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756658 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-sys-fs\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756730 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-multus-conf-dir\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756755 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-sysctl-conf\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756777 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-run\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756784 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/61ca997c-4091-4c14-8fa0-b33055810105-multus-daemon-config\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756801 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c1f41c1-41f0-4b55-abc6-89feb52ba630-ovn-node-metrics-cert\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.756854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756829 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d8f321d-d047-435f-9cdd-ba893bf5ff07-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756847 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-var-lib-cni-multus\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756854 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-etc-kubernetes\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756877 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-sysconfig\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756879 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-run\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756908 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-lib-modules\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756952 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-kubelet\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756974 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-sysctl-conf\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.756976 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-run-openvswitch\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757007 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-etc-kubernetes\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757041 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-run-openvswitch\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757086 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-multus-conf-dir\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757121 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-sysconfig\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757164 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-kubelet\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757201 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-system-cni-dir\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757225 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-kubernetes\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757248 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-run-netns\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757253 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-lib-modules\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.757673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757272 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-cni-bin\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757298 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d8f321d-d047-435f-9cdd-ba893bf5ff07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757328 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-kubernetes\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757339 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d8f321d-d047-435f-9cdd-ba893bf5ff07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757366 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757378 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d8f321d-d047-435f-9cdd-ba893bf5ff07-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757398 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-system-cni-dir\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757428 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-var-lib-kubelet\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757462 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-cni-bin\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757471 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81394296-08c3-43e9-b8e7-c357233fc33d-etc-tuned\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757503 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-run-netns\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757517 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-node-log\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757554 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cb07635-ed09-4f4d-a7d5-fc56a8c9859f-hosts-file\") pod \"node-resolver-dgnx2\" (UID: \"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f\") " pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757582 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f272e0f-0ed3-43f0-ae36-1456ca186b8c-host\") pod \"node-ca-bd7xm\" (UID: \"5f272e0f-0ed3-43f0-ae36-1456ca186b8c\") " pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757622 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-sys\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757656 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c1f41c1-41f0-4b55-abc6-89feb52ba630-ovnkube-script-lib\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757743 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-var-lib-kubelet\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.758541 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757558 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757762 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cb07635-ed09-4f4d-a7d5-fc56a8c9859f-hosts-file\") pod \"node-resolver-dgnx2\" (UID: \"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f\") " pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757799 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f272e0f-0ed3-43f0-ae36-1456ca186b8c-host\") pod \"node-ca-bd7xm\" (UID: \"5f272e0f-0ed3-43f0-ae36-1456ca186b8c\") " pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757845 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-sys\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757644 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c1f41c1-41f0-4b55-abc6-89feb52ba630-ovnkube-config\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757881 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c1f41c1-41f0-4b55-abc6-89feb52ba630-env-overrides\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757905 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqx6x\" (UniqueName: \"kubernetes.io/projected/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-kube-api-access-gqx6x\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757930 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cb07635-ed09-4f4d-a7d5-fc56a8c9859f-tmp-dir\") pod \"node-resolver-dgnx2\" (UID: \"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f\") " pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757953 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d5bbbb9-0b90-42bf-9a67-443fe82bbe34-iptables-alerter-script\") pod \"iptables-alerter-q9kgg\" (UID: \"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34\") " pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.757981 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-device-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758020 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758043 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-run-netns\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758083 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-cni-netd\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758107 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25-konnectivity-ca\") pod \"konnectivity-agent-dlz5c\" (UID: \"c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25\") " pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758130 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6prx\" (UniqueName: \"kubernetes.io/projected/81394296-08c3-43e9-b8e7-c357233fc33d-kube-api-access-c6prx\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758155 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d5bbbb9-0b90-42bf-9a67-443fe82bbe34-host-slash\") pod \"iptables-alerter-q9kgg\" (UID: \"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34\") " pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc69n\" (UniqueName: \"kubernetes.io/projected/89d0b23b-e056-4b6c-9be8-302a6cab3435-kube-api-access-fc69n\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.759330 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-run-k8s-cni-cncf-io\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758229 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-hostroot\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758240 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c1f41c1-41f0-4b55-abc6-89feb52ba630-ovnkube-config\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758251 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-run-multus-certs\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758264 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d8f321d-d047-435f-9cdd-ba893bf5ff07-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758276 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65h9w\" (UniqueName: \"kubernetes.io/projected/61ca997c-4091-4c14-8fa0-b33055810105-kube-api-access-65h9w\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758304 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5thgz\" (UniqueName: \"kubernetes.io/projected/5f272e0f-0ed3-43f0-ae36-1456ca186b8c-kube-api-access-5thgz\") pod \"node-ca-bd7xm\" (UID: \"5f272e0f-0ed3-43f0-ae36-1456ca186b8c\") " pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758323 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-node-log\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758329 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-multus-cni-dir\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758353 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-systemd-units\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758379 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6573bd34-7a4b-42da-8126-b90510b483e4-kubelet-config\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758422 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqhr6\" (UniqueName: \"kubernetes.io/projected/2cb07635-ed09-4f4d-a7d5-fc56a8c9859f-kube-api-access-nqhr6\") pod \"node-resolver-dgnx2\" (UID: \"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f\") " pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758505 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf2m7\" (UniqueName: \"kubernetes.io/projected/1d5bbbb9-0b90-42bf-9a67-443fe82bbe34-kube-api-access-tf2m7\") pod \"iptables-alerter-q9kgg\" (UID: \"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34\") " pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758535 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-os-release\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758558 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758565 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d8f321d-d047-435f-9cdd-ba893bf5ff07-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758581 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:00:56.760149 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758586 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c1f41c1-41f0-4b55-abc6-89feb52ba630-env-overrides\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758608 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61ca997c-4091-4c14-8fa0-b33055810105-cni-binary-copy\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758634 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-var-lib-openvswitch\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758651 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-device-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758665 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-cnibin\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758690 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f272e0f-0ed3-43f0-ae36-1456ca186b8c-serviceca\") pod \"node-ca-bd7xm\" (UID: \"5f272e0f-0ed3-43f0-ae36-1456ca186b8c\") " pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758715 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-socket-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758734 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758742 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-registration-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758765 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-host\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758780 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-run-netns\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758790 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758815 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-system-cni-dir\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758872 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-var-lib-cni-bin\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758897 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-var-lib-kubelet\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758926 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nms9\" (UniqueName: \"kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9\") pod \"network-check-target-5hls6\" (UID: \"0fa43b64-fa90-427f-a7e3-666964b16bf8\") " pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758963 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-run-ovn\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.760732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758990 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-multus-socket-dir-parent\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.758991 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1d5bbbb9-0b90-42bf-9a67-443fe82bbe34-iptables-alerter-script\") pod \"iptables-alerter-q9kgg\" (UID: \"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34\") " pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759014 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-sysctl-d\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759038 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-slash\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759041 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cb07635-ed09-4f4d-a7d5-fc56a8c9859f-tmp-dir\") pod \"node-resolver-dgnx2\" (UID: \"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f\") " pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759054 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-run-multus-certs\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759093 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-slash\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759094 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-etc-openvswitch\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759126 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-run-ovn-kubernetes\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759155 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdtxd\" (UniqueName: \"kubernetes.io/projected/6d8f321d-d047-435f-9cdd-ba893bf5ff07-kube-api-access-fdtxd\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759128 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-etc-openvswitch\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759310 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-multus-cni-dir\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759323 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-run-k8s-cni-cncf-io\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759353 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-systemd-units\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759386 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-cni-netd\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.759409 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759415 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6573bd34-7a4b-42da-8126-b90510b483e4-dbus\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759502 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25-konnectivity-ca\") pod \"konnectivity-agent-dlz5c\" (UID: \"c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25\") " pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:00:56.761197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759518 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d5bbbb9-0b90-42bf-9a67-443fe82bbe34-host-slash\") pod \"iptables-alerter-q9kgg\" (UID: \"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34\") " pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759554 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6573bd34-7a4b-42da-8126-b90510b483e4-dbus\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759562 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-var-lib-kubelet\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759568 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-registration-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759612 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-run-ovn\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759658 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-multus-socket-dir-parent\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759694 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-run-ovn-kubernetes\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759701 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-hostroot\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.759713 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs podName:ceb9c45b-e849-4da2-a8a6-ad602bf66af9 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:57.259697528 +0000 UTC m=+3.035649977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs") pod "network-metrics-daemon-wzntx" (UID: "ceb9c45b-e849-4da2-a8a6-ad602bf66af9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759788 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89d0b23b-e056-4b6c-9be8-302a6cab3435-socket-dir\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759793 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-etc-sysctl-d\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759815 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-host-var-lib-cni-bin\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759817 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759815 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61ca997c-4091-4c14-8fa0-b33055810105-os-release\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759838 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-system-cni-dir\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759856 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6573bd34-7a4b-42da-8126-b90510b483e4-kubelet-config\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759878 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c1f41c1-41f0-4b55-abc6-89feb52ba630-var-lib-openvswitch\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.761768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759896 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81394296-08c3-43e9-b8e7-c357233fc33d-host\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.762241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.759996 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.762241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.760084 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81394296-08c3-43e9-b8e7-c357233fc33d-tmp\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.762241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.760138 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5f272e0f-0ed3-43f0-ae36-1456ca186b8c-serviceca\") pod \"node-ca-bd7xm\" (UID: \"5f272e0f-0ed3-43f0-ae36-1456ca186b8c\") " pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.762241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.760203 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d8f321d-d047-435f-9cdd-ba893bf5ff07-cnibin\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.762241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.760244 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25-agent-certs\") pod \"konnectivity-agent-dlz5c\" (UID: \"c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25\") " pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:00:56.762241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.760264 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c1f41c1-41f0-4b55-abc6-89feb52ba630-ovn-node-metrics-cert\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.762241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.760328 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61ca997c-4091-4c14-8fa0-b33055810105-cni-binary-copy\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.762241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.761865 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81394296-08c3-43e9-b8e7-c357233fc33d-etc-tuned\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.764605 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.764585 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7mfs\" (UniqueName: \"kubernetes.io/projected/4c1f41c1-41f0-4b55-abc6-89feb52ba630-kube-api-access-f7mfs\") pod \"ovnkube-node-82474\" (UID: \"4c1f41c1-41f0-4b55-abc6-89feb52ba630\") " pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.771275 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.771244 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:00:56.771275 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.771273 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:00:56.771423 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.771288 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5nms9 for pod openshift-network-diagnostics/network-check-target-5hls6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:00:56.771423 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:56.771373 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9 podName:0fa43b64-fa90-427f-a7e3-666964b16bf8 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:57.271355904 +0000 UTC m=+3.047308379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5nms9" (UniqueName: "kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9") pod "network-check-target-5hls6" (UID: "0fa43b64-fa90-427f-a7e3-666964b16bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:00:56.772254 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.772228 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf2m7\" (UniqueName: \"kubernetes.io/projected/1d5bbbb9-0b90-42bf-9a67-443fe82bbe34-kube-api-access-tf2m7\") pod \"iptables-alerter-q9kgg\" (UID: \"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34\") " pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.772661 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.772641 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqx6x\" (UniqueName: \"kubernetes.io/projected/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-kube-api-access-gqx6x\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:00:56.773040 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.773017 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65h9w\" (UniqueName: \"kubernetes.io/projected/61ca997c-4091-4c14-8fa0-b33055810105-kube-api-access-65h9w\") pod \"multus-6npns\" (UID: \"61ca997c-4091-4c14-8fa0-b33055810105\") " pod="openshift-multus/multus-6npns" Jul 08 19:00:56.773737 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.773709 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqhr6\" (UniqueName: \"kubernetes.io/projected/2cb07635-ed09-4f4d-a7d5-fc56a8c9859f-kube-api-access-nqhr6\") pod \"node-resolver-dgnx2\" (UID: \"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f\") " pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.774132 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.774110 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdtxd\" (UniqueName: \"kubernetes.io/projected/6d8f321d-d047-435f-9cdd-ba893bf5ff07-kube-api-access-fdtxd\") pod \"multus-additional-cni-plugins-4tjt8\" (UID: \"6d8f321d-d047-435f-9cdd-ba893bf5ff07\") " pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.774195 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.774176 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6prx\" (UniqueName: \"kubernetes.io/projected/81394296-08c3-43e9-b8e7-c357233fc33d-kube-api-access-c6prx\") pod \"tuned-222cq\" (UID: \"81394296-08c3-43e9-b8e7-c357233fc33d\") " pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.775244 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.775224 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc69n\" (UniqueName: \"kubernetes.io/projected/89d0b23b-e056-4b6c-9be8-302a6cab3435-kube-api-access-fc69n\") pod \"aws-ebs-csi-driver-node-nhfqn\" (UID: \"89d0b23b-e056-4b6c-9be8-302a6cab3435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.775797 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.775779 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5thgz\" (UniqueName: \"kubernetes.io/projected/5f272e0f-0ed3-43f0-ae36-1456ca186b8c-kube-api-access-5thgz\") pod \"node-ca-bd7xm\" (UID: \"5f272e0f-0ed3-43f0-ae36-1456ca186b8c\") " pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.938356 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.938316 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgnx2" Jul 08 19:00:56.946498 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:56.946470 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb07635_ed09_4f4d_a7d5_fc56a8c9859f.slice/crio-5c3d3f2920d17ebffc0e41200be3cd25609263bad0380c063e6776054680a757 WatchSource:0}: Error finding container 5c3d3f2920d17ebffc0e41200be3cd25609263bad0380c063e6776054680a757: Status 404 returned error can't find the container with id 5c3d3f2920d17ebffc0e41200be3cd25609263bad0380c063e6776054680a757 Jul 08 19:00:56.947926 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.947905 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q9kgg" Jul 08 19:00:56.953908 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.953885 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:00:56.954934 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:56.954907 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5bbbb9_0b90_42bf_9a67_443fe82bbe34.slice/crio-9f05609f7bc758b6a86f9b964f73659c0c8585033fe0f3ef837da080d47d5c11 WatchSource:0}: Error finding container 9f05609f7bc758b6a86f9b964f73659c0c8585033fe0f3ef837da080d47d5c11: Status 404 returned error can't find the container with id 9f05609f7bc758b6a86f9b964f73659c0c8585033fe0f3ef837da080d47d5c11 Jul 08 19:00:56.958259 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.958239 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bd7xm" Jul 08 19:00:56.961853 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:56.961832 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1f41c1_41f0_4b55_abc6_89feb52ba630.slice/crio-2c9a51ab0ad47d20623a8f328ed279de8e6d9a2800e265d535242c522dba0b06 WatchSource:0}: Error finding container 2c9a51ab0ad47d20623a8f328ed279de8e6d9a2800e265d535242c522dba0b06: Status 404 returned error can't find the container with id 2c9a51ab0ad47d20623a8f328ed279de8e6d9a2800e265d535242c522dba0b06 Jul 08 19:00:56.964249 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.964235 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:00:56.968550 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:56.968523 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f272e0f_0ed3_43f0_ae36_1456ca186b8c.slice/crio-663d800fdc4be7bc502ee1b85659bf71f139afd78705ba49f022d2dc62aa8452 WatchSource:0}: Error finding container 663d800fdc4be7bc502ee1b85659bf71f139afd78705ba49f022d2dc62aa8452: Status 404 returned error can't find the container with id 663d800fdc4be7bc502ee1b85659bf71f139afd78705ba49f022d2dc62aa8452 Jul 08 19:00:56.969629 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.969610 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" Jul 08 19:00:56.973407 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:56.973374 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28d20fe_3ff4_4bbf_b3b2_7de8800a3e25.slice/crio-2168baba81a9567533655e72d0a11b3620398646f852de34b91adcc631eb0618 WatchSource:0}: Error finding container 2168baba81a9567533655e72d0a11b3620398646f852de34b91adcc631eb0618: Status 404 returned error can't find the container with id 2168baba81a9567533655e72d0a11b3620398646f852de34b91adcc631eb0618 Jul 08 19:00:56.975386 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.975368 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6npns" Jul 08 19:00:56.979886 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:56.979865 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d0b23b_e056_4b6c_9be8_302a6cab3435.slice/crio-3ed29553c1346b6b23e5e1784f1957e5279baf59690502525d9798564e8448b0 WatchSource:0}: Error finding container 3ed29553c1346b6b23e5e1784f1957e5279baf59690502525d9798564e8448b0: Status 404 returned error can't find the container with id 3ed29553c1346b6b23e5e1784f1957e5279baf59690502525d9798564e8448b0 Jul 08 19:00:56.979962 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.979886 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" Jul 08 19:00:56.983493 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:56.983474 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ca997c_4091_4c14_8fa0_b33055810105.slice/crio-7c2c1803ddc06931c4f76fb4517449d62720974afb865528cce3ba93aac89ca3 WatchSource:0}: Error finding container 7c2c1803ddc06931c4f76fb4517449d62720974afb865528cce3ba93aac89ca3: Status 404 returned error can't find the container with id 7c2c1803ddc06931c4f76fb4517449d62720974afb865528cce3ba93aac89ca3 Jul 08 19:00:56.984103 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.984090 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-222cq" Jul 08 19:00:56.990817 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:56.990792 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d8f321d_d047_435f_9cdd_ba893bf5ff07.slice/crio-534c1cd054cda0d2795dea980c5dfdb384d7e55a085d059792ff4f7f5dbe9fc6 WatchSource:0}: Error finding container 534c1cd054cda0d2795dea980c5dfdb384d7e55a085d059792ff4f7f5dbe9fc6: Status 404 returned error can't find the container with id 534c1cd054cda0d2795dea980c5dfdb384d7e55a085d059792ff4f7f5dbe9fc6 Jul 08 19:00:56.991193 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:56.991175 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:00:56.992836 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:00:56.992816 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81394296_08c3_43e9_b8e7_c357233fc33d.slice/crio-52fc3be0bc05adace27ab3aaacef4891165c6db025d9b215ee076a1308456250 WatchSource:0}: Error finding container 52fc3be0bc05adace27ab3aaacef4891165c6db025d9b215ee076a1308456250: Status 404 returned error can't find the container with id 52fc3be0bc05adace27ab3aaacef4891165c6db025d9b215ee076a1308456250 Jul 08 19:00:57.262539 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.262453 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:00:57.262539 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.262511 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:57.262710 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:57.262610 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:00:57.262710 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:57.262668 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs podName:ceb9c45b-e849-4da2-a8a6-ad602bf66af9 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:58.262655351 +0000 UTC m=+4.038607800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs") pod "network-metrics-daemon-wzntx" (UID: "ceb9c45b-e849-4da2-a8a6-ad602bf66af9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:00:57.262710 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:57.262611 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:00:57.262710 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:57.262699 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret podName:6573bd34-7a4b-42da-8126-b90510b483e4 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:58.262693676 +0000 UTC m=+4.038646125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret") pod "global-pull-secret-syncer-zflm9" (UID: "6573bd34-7a4b-42da-8126-b90510b483e4") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:00:57.363303 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.363267 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nms9\" (UniqueName: \"kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9\") pod \"network-check-target-5hls6\" (UID: \"0fa43b64-fa90-427f-a7e3-666964b16bf8\") " pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:00:57.363492 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:57.363429 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:00:57.363492 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:57.363464 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:00:57.363492 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:57.363474 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5nms9 for pod openshift-network-diagnostics/network-check-target-5hls6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:00:57.363611 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:57.363532 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9 podName:0fa43b64-fa90-427f-a7e3-666964b16bf8 nodeName:}" failed. No retries permitted until 2026-07-08 19:00:58.363515103 +0000 UTC m=+4.139467553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nms9" (UniqueName: "kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9") pod "network-check-target-5hls6" (UID: "0fa43b64-fa90-427f-a7e3-666964b16bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:00:57.692530 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.692471 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:55:56 +0000 UTC" deadline="2028-03-31 06:01:04.769773144 +0000 UTC" Jul 08 19:00:57.692530 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.692528 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15155h0m7.077249542s" Jul 08 19:00:57.749919 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.749882 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:57.750085 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:57.750023 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:00:57.757489 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.757430 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-222cq" event={"ID":"81394296-08c3-43e9-b8e7-c357233fc33d","Type":"ContainerStarted","Data":"52fc3be0bc05adace27ab3aaacef4891165c6db025d9b215ee076a1308456250"} Jul 08 19:00:57.759800 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.759769 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" event={"ID":"6d8f321d-d047-435f-9cdd-ba893bf5ff07","Type":"ContainerStarted","Data":"534c1cd054cda0d2795dea980c5dfdb384d7e55a085d059792ff4f7f5dbe9fc6"} Jul 08 19:00:57.761531 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.761504 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6npns" event={"ID":"61ca997c-4091-4c14-8fa0-b33055810105","Type":"ContainerStarted","Data":"7c2c1803ddc06931c4f76fb4517449d62720974afb865528cce3ba93aac89ca3"} Jul 08 19:00:57.764239 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.764214 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dlz5c" event={"ID":"c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25","Type":"ContainerStarted","Data":"2168baba81a9567533655e72d0a11b3620398646f852de34b91adcc631eb0618"} Jul 08 19:00:57.765781 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.765760 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82474" event={"ID":"4c1f41c1-41f0-4b55-abc6-89feb52ba630","Type":"ContainerStarted","Data":"2c9a51ab0ad47d20623a8f328ed279de8e6d9a2800e265d535242c522dba0b06"} Jul 08 19:00:57.770995 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.770964 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q9kgg" event={"ID":"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34","Type":"ContainerStarted","Data":"9f05609f7bc758b6a86f9b964f73659c0c8585033fe0f3ef837da080d47d5c11"} Jul 08 19:00:57.773820 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.773739 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" event={"ID":"89d0b23b-e056-4b6c-9be8-302a6cab3435","Type":"ContainerStarted","Data":"3ed29553c1346b6b23e5e1784f1957e5279baf59690502525d9798564e8448b0"} Jul 08 19:00:57.775656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.775630 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bd7xm" event={"ID":"5f272e0f-0ed3-43f0-ae36-1456ca186b8c","Type":"ContainerStarted","Data":"663d800fdc4be7bc502ee1b85659bf71f139afd78705ba49f022d2dc62aa8452"} Jul 08 19:00:57.777410 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:57.777388 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgnx2" event={"ID":"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f","Type":"ContainerStarted","Data":"5c3d3f2920d17ebffc0e41200be3cd25609263bad0380c063e6776054680a757"} Jul 08 19:00:58.271209 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:58.271172 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:00:58.271484 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:58.271245 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:58.271484 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:58.271400 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:00:58.271484 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:58.271478 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret podName:6573bd34-7a4b-42da-8126-b90510b483e4 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:00.271459457 +0000 UTC m=+6.047411924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret") pod "global-pull-secret-syncer-zflm9" (UID: "6573bd34-7a4b-42da-8126-b90510b483e4") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:00:58.271926 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:58.271906 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:00:58.272008 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:58.271965 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs podName:ceb9c45b-e849-4da2-a8a6-ad602bf66af9 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:00.271947152 +0000 UTC m=+6.047899604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs") pod "network-metrics-daemon-wzntx" (UID: "ceb9c45b-e849-4da2-a8a6-ad602bf66af9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:00:58.371824 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:58.371786 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nms9\" (UniqueName: \"kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9\") pod \"network-check-target-5hls6\" (UID: \"0fa43b64-fa90-427f-a7e3-666964b16bf8\") " pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:00:58.372042 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:58.372025 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:00:58.372115 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:58.372053 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:00:58.372115 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:58.372066 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5nms9 for pod openshift-network-diagnostics/network-check-target-5hls6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:00:58.372213 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:58.372122 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9 podName:0fa43b64-fa90-427f-a7e3-666964b16bf8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:00.37210407 +0000 UTC m=+6.148056533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nms9" (UniqueName: "kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9") pod "network-check-target-5hls6" (UID: "0fa43b64-fa90-427f-a7e3-666964b16bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:00:58.693379 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:58.693089 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:55:56 +0000 UTC" deadline="2028-01-10 09:24:42.874070959 +0000 UTC" Jul 08 19:00:58.693379 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:58.693369 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13214h23m44.180710638s" Jul 08 19:00:58.754482 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:58.751967 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:00:58.754482 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:58.752091 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:00:58.754482 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:58.752486 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:00:58.754482 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:58.752593 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:00:59.750505 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:00:59.750471 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:00:59.750975 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:00:59.750605 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:00.287858 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:00.287790 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:00.288077 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:00.287886 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:00.288077 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:00.288064 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:00.288186 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:00.288130 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs podName:ceb9c45b-e849-4da2-a8a6-ad602bf66af9 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:04.288111092 +0000 UTC m=+10.064063542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs") pod "network-metrics-daemon-wzntx" (UID: "ceb9c45b-e849-4da2-a8a6-ad602bf66af9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:00.288234 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:00.288196 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:00.288234 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:00.288230 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret podName:6573bd34-7a4b-42da-8126-b90510b483e4 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:04.288218947 +0000 UTC m=+10.064171400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret") pod "global-pull-secret-syncer-zflm9" (UID: "6573bd34-7a4b-42da-8126-b90510b483e4") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:00.389665 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:00.389007 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nms9\" (UniqueName: \"kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9\") pod \"network-check-target-5hls6\" (UID: \"0fa43b64-fa90-427f-a7e3-666964b16bf8\") " pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:00.389665 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:00.389230 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:00.389665 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:00.389249 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:00.389665 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:00.389261 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5nms9 for pod openshift-network-diagnostics/network-check-target-5hls6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:00.389665 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:00.389317 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9 podName:0fa43b64-fa90-427f-a7e3-666964b16bf8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:04.38930005 +0000 UTC m=+10.165252501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nms9" (UniqueName: "kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9") pod "network-check-target-5hls6" (UID: "0fa43b64-fa90-427f-a7e3-666964b16bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:00.749713 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:00.749675 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:00.749909 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:00.749675 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:00.749909 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:00.749815 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:00.750026 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:00.749914 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:01.750371 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:01.750337 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:01.750839 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:01.750506 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:02.750065 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:02.750036 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:02.750259 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:02.750165 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:02.750594 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:02.750575 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:02.750984 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:02.750670 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:03.750328 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:03.750289 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:03.750542 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:03.750419 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:04.319794 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:04.319762 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:04.320199 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:04.319824 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:04.320199 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:04.319919 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:04.320199 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:04.319935 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:04.320199 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:04.319980 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs podName:ceb9c45b-e849-4da2-a8a6-ad602bf66af9 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:12.319963151 +0000 UTC m=+18.095915601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs") pod "network-metrics-daemon-wzntx" (UID: "ceb9c45b-e849-4da2-a8a6-ad602bf66af9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:04.320199 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:04.320000 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret podName:6573bd34-7a4b-42da-8126-b90510b483e4 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:12.319991323 +0000 UTC m=+18.095943773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret") pod "global-pull-secret-syncer-zflm9" (UID: "6573bd34-7a4b-42da-8126-b90510b483e4") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:04.420839 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:04.420801 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nms9\" (UniqueName: \"kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9\") pod \"network-check-target-5hls6\" (UID: \"0fa43b64-fa90-427f-a7e3-666964b16bf8\") " pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:04.421038 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:04.420967 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:04.421038 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:04.420984 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:04.421038 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:04.420996 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5nms9 for pod openshift-network-diagnostics/network-check-target-5hls6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:04.421204 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:04.421058 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9 podName:0fa43b64-fa90-427f-a7e3-666964b16bf8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:12.421039993 +0000 UTC m=+18.196992446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nms9" (UniqueName: "kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9") pod "network-check-target-5hls6" (UID: "0fa43b64-fa90-427f-a7e3-666964b16bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:04.752397 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:04.752367 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:04.752566 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:04.752471 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:04.752566 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:04.752483 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:04.752635 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:04.752568 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:05.749526 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:05.749491 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:05.749912 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:05.749617 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:06.751058 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:06.750396 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:06.751058 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:06.750565 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:06.751058 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:06.750921 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:06.751058 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:06.751019 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:07.750131 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:07.750091 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:07.750325 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:07.750231 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:08.749624 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:08.749596 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:08.750083 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:08.749607 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:08.750083 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:08.749746 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:08.750083 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:08.749832 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:08.809479 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:08.809427 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-222cq" event={"ID":"81394296-08c3-43e9-b8e7-c357233fc33d","Type":"ContainerStarted","Data":"9148be45fe127b6f9a20c3751a81822736dbf87a20c592653a75b08082250b10"} Jul 08 19:01:08.810882 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:08.810860 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal" event={"ID":"cc54df53a307e9a93a77d4a51b268294","Type":"ContainerStarted","Data":"adf2ce20aa62efdaac8e040176aa63777e23b99fa4b3e648187d74faa5352ce5"} Jul 08 19:01:08.826990 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:08.826946 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-222cq" podStartSLOduration=2.374475426 podStartE2EDuration="13.826933167s" totalImagesPullingTime="11.452457741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:08.82692556 +0000 UTC m=+14.602878030" watchObservedRunningTime="2026-07-08 19:01:08.826933167 +0000 UTC m=+14.602885637" Jul 08 19:01:09.751118 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:09.750469 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:09.751118 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:09.750587 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:10.751728 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.751484 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:10.752137 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:10.751807 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:10.752179 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.752169 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:10.752267 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:10.752243 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:10.817573 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.817536 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" event={"ID":"89d0b23b-e056-4b6c-9be8-302a6cab3435","Type":"ContainerStarted","Data":"331791a1049473cccc835ae55657835ba83fa786de8c41e1468ece247bdcc200"} Jul 08 19:01:10.819352 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.819323 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bd7xm" event={"ID":"5f272e0f-0ed3-43f0-ae36-1456ca186b8c","Type":"ContainerStarted","Data":"714d7f503a31253c10bea413bf9c3696032f1bd12dc289e7f2d9d9f68b6bf690"} Jul 08 19:01:10.821601 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.821579 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgnx2" event={"ID":"2cb07635-ed09-4f4d-a7d5-fc56a8c9859f","Type":"ContainerStarted","Data":"cbd3efcb7a481a1f8f93f4bde0f17de695e64198014e3b9ba151657270f58104"} Jul 08 19:01:10.823631 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.823607 2570 generic.go:356] "Generic (PLEG): container finished" podID="74fdbe30727f928da25e20a7bc35e63d" containerID="fed26c74ecefa0f2805858b4528e05daf2e882357a91276e461952e3be8e3461" exitCode=0 Jul 08 19:01:10.823727 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.823694 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" event={"ID":"74fdbe30727f928da25e20a7bc35e63d","Type":"ContainerDied","Data":"fed26c74ecefa0f2805858b4528e05daf2e882357a91276e461952e3be8e3461"} Jul 08 19:01:10.826100 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.825639 2570 generic.go:356] "Generic (PLEG): container finished" podID="6d8f321d-d047-435f-9cdd-ba893bf5ff07" containerID="25558f89c89aee1f14a746f95ec894076c5d118a7ec1b42cda24b939c4cb51e4" exitCode=0 Jul 08 19:01:10.826100 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.825716 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" event={"ID":"6d8f321d-d047-435f-9cdd-ba893bf5ff07","Type":"ContainerDied","Data":"25558f89c89aee1f14a746f95ec894076c5d118a7ec1b42cda24b939c4cb51e4"} Jul 08 19:01:10.827927 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.827900 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dlz5c" event={"ID":"c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25","Type":"ContainerStarted","Data":"c79db74cdc5f45eeff9ce57796d170d2547f1274e34a56cd0c4e57dddc182e58"} Jul 08 19:01:10.829844 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.829821 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q9kgg" event={"ID":"1d5bbbb9-0b90-42bf-9a67-443fe82bbe34","Type":"ContainerStarted","Data":"a87954ae00e8011b781403a3ca834dfb4ec88c78d0dadf06321e2a262037929e"} Jul 08 19:01:10.839110 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.839065 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bd7xm" podStartSLOduration=5.376508946 podStartE2EDuration="16.839051909s" totalImagesPullingTime="11.462542963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:10.838657867 +0000 UTC m=+16.614610340" watchObservedRunningTime="2026-07-08 19:01:10.839051909 +0000 UTC m=+16.615004379" Jul 08 19:01:10.839462 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.839420 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-102.ec2.internal" podStartSLOduration=15.839414367 podStartE2EDuration="15.839414367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:08.840515021 +0000 UTC m=+14.616467492" watchObservedRunningTime="2026-07-08 19:01:10.839414367 +0000 UTC m=+16.615366838" Jul 08 19:01:10.870502 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.870455 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dgnx2" podStartSLOduration=5.385900499 podStartE2EDuration="16.870421673s" totalImagesPullingTime="11.484521174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:10.870233044 +0000 UTC m=+16.646185519" watchObservedRunningTime="2026-07-08 19:01:10.870421673 +0000 UTC m=+16.646374144" Jul 08 19:01:10.898475 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.898028 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q9kgg" podStartSLOduration=5.402889453 podStartE2EDuration="16.898009052s" totalImagesPullingTime="11.495119599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:10.883403503 +0000 UTC m=+16.659355974" watchObservedRunningTime="2026-07-08 19:01:10.898009052 +0000 UTC m=+16.673961524" Jul 08 19:01:10.898475 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:10.898326 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dlz5c" podStartSLOduration=4.424696132 podStartE2EDuration="15.898315539s" totalImagesPullingTime="11.473619407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:10.897251354 +0000 UTC m=+16.673203846" watchObservedRunningTime="2026-07-08 19:01:10.898315539 +0000 UTC m=+16.674268010" Jul 08 19:01:11.352784 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:11.352756 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 19:01:11.721158 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:11.721055 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T19:01:11.352778042Z","UUID":"d6042b13-17a2-43dc-89e2-4fe556bfdce4","Handler":null,"Name":"","Endpoint":""} Jul 08 19:01:11.722512 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:11.722495 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 19:01:11.722619 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:11.722529 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 19:01:11.749539 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:11.749510 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:11.749705 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:11.749619 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:11.834374 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:11.834338 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" event={"ID":"74fdbe30727f928da25e20a7bc35e63d","Type":"ContainerStarted","Data":"e94f28cc38fdff93819461641e08d8562b007e1247e06fd0fd6e5c5fa84b77a1"} Jul 08 19:01:11.836073 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:11.836052 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" event={"ID":"89d0b23b-e056-4b6c-9be8-302a6cab3435","Type":"ContainerStarted","Data":"ca262b4e3c89bb4d92102c5da1b75ffeb0954c6d628c1cdc1c040a3eaf799f2f"} Jul 08 19:01:11.848800 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:11.848754 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-102.ec2.internal" podStartSLOduration=16.848739868 podStartE2EDuration="16.848739868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:11.848411558 +0000 UTC m=+17.624364029" watchObservedRunningTime="2026-07-08 19:01:11.848739868 +0000 UTC m=+17.624692338" Jul 08 19:01:12.174600 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:12.174566 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:01:12.175752 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:12.175563 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:01:12.383842 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:12.383814 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:12.383999 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:12.383862 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:12.383999 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:12.383956 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:12.383999 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:12.383972 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:12.384132 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:12.384023 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret podName:6573bd34-7a4b-42da-8126-b90510b483e4 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:28.384007151 +0000 UTC m=+34.159959604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret") pod "global-pull-secret-syncer-zflm9" (UID: "6573bd34-7a4b-42da-8126-b90510b483e4") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:12.384132 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:12.384038 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs podName:ceb9c45b-e849-4da2-a8a6-ad602bf66af9 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:28.384030744 +0000 UTC m=+34.159983193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs") pod "network-metrics-daemon-wzntx" (UID: "ceb9c45b-e849-4da2-a8a6-ad602bf66af9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:12.485100 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:12.485015 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nms9\" (UniqueName: \"kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9\") pod \"network-check-target-5hls6\" (UID: \"0fa43b64-fa90-427f-a7e3-666964b16bf8\") " pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:12.485269 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:12.485176 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:12.485269 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:12.485210 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:12.485269 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:12.485225 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5nms9 for pod openshift-network-diagnostics/network-check-target-5hls6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:12.485393 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:12.485295 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9 podName:0fa43b64-fa90-427f-a7e3-666964b16bf8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:28.485275557 +0000 UTC m=+34.261228006 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nms9" (UniqueName: "kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9") pod "network-check-target-5hls6" (UID: "0fa43b64-fa90-427f-a7e3-666964b16bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:12.750462 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:12.750353 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:12.750624 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:12.750353 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:12.750624 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:12.750508 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:12.750624 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:12.750581 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:13.750301 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:13.750265 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:13.750865 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:13.750388 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:13.840829 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:13.840799 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 19:01:14.754660 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:14.753789 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:14.754660 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:14.754147 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:14.754660 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:14.753789 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:14.754660 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:14.754310 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:15.750288 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:15.750242 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:15.750511 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:15.750386 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:16.750336 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:16.750303 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:16.750336 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:16.750303 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:16.750863 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:16.750478 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:16.750863 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:16.750524 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:17.750455 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:17.750400 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:17.751003 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:17.750545 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:18.308454 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:18.308407 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:01:18.308637 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:18.308554 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 19:01:18.309331 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:18.309308 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dlz5c" Jul 08 19:01:18.750155 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:18.750120 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:18.750344 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:18.750163 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:18.750344 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:18.750274 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:18.750477 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:18.750348 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:19.749742 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:19.749708 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:19.749907 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:19.749841 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:20.750057 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:20.750030 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:20.750368 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:20.750030 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:20.750368 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:20.750149 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:20.750368 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:20.750196 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:21.750534 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:21.750502 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:21.750934 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:21.750623 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:22.750401 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:22.750325 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:22.750585 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:22.750540 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:22.750585 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:22.750545 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:22.751052 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:22.750635 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:22.863626 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:22.863591 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6npns" event={"ID":"61ca997c-4091-4c14-8fa0-b33055810105","Type":"ContainerStarted","Data":"e0387fc828a3b01a726dd085a97929762e3fa38f9e8cf1ed95bda99d577f720f"} Jul 08 19:01:22.865343 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:22.865312 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82474" event={"ID":"4c1f41c1-41f0-4b55-abc6-89feb52ba630","Type":"ContainerStarted","Data":"38f3efd6b3b093ae2cfdcba24acbd84629db622d6759705ed1d06ef666319080"} Jul 08 19:01:22.867585 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:22.867561 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" event={"ID":"89d0b23b-e056-4b6c-9be8-302a6cab3435","Type":"ContainerStarted","Data":"b1075101b757ea64b7e7dc313b8c175a2df05a3f210bb98e057b20f1713cf725"} Jul 08 19:01:22.881651 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:22.881604 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6npns" podStartSLOduration=2.389886734 podStartE2EDuration="27.881590989s" totalImagesPullingTime="25.491704255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:22.881218522 +0000 UTC m=+28.657170994" watchObservedRunningTime="2026-07-08 19:01:22.881590989 +0000 UTC m=+28.657543460" Jul 08 19:01:22.897074 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:22.897028 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfqn" podStartSLOduration=3.935569568 podStartE2EDuration="27.897012058s" totalImagesPullingTime="23.96144249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:22.896907372 +0000 UTC m=+28.672859871" watchObservedRunningTime="2026-07-08 19:01:22.897012058 +0000 UTC m=+28.672964529" Jul 08 19:01:23.750210 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:23.750172 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:23.750409 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:23.750286 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:23.871830 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:23.871795 2570 generic.go:356] "Generic (PLEG): container finished" podID="6d8f321d-d047-435f-9cdd-ba893bf5ff07" containerID="7be7a8afadde0364337d9aeaa4fc1db6b5b998a1b5fb74a8d0eb7ad55f962245" exitCode=0 Jul 08 19:01:23.872490 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:23.871869 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" event={"ID":"6d8f321d-d047-435f-9cdd-ba893bf5ff07","Type":"ContainerDied","Data":"7be7a8afadde0364337d9aeaa4fc1db6b5b998a1b5fb74a8d0eb7ad55f962245"} Jul 08 19:01:23.874988 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:23.874962 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82474" event={"ID":"4c1f41c1-41f0-4b55-abc6-89feb52ba630","Type":"ContainerStarted","Data":"ab252d15cafe655b1c610bfb9101605cba8a7f664ad3dd8d3f6a83dcc98f2ef1"} Jul 08 19:01:23.875140 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:23.875031 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82474" event={"ID":"4c1f41c1-41f0-4b55-abc6-89feb52ba630","Type":"ContainerStarted","Data":"5138e1589648c5d5ec96baeac4f1394333b607e232cbb3b2e6c438198dcd2511"} Jul 08 19:01:23.875140 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:23.875076 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82474" event={"ID":"4c1f41c1-41f0-4b55-abc6-89feb52ba630","Type":"ContainerStarted","Data":"5b279459dcc0d631116f7a43ea9adf6bf4dfc9ee4273cdb39886ab5a753f64f0"} Jul 08 19:01:23.875140 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:23.875104 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82474" event={"ID":"4c1f41c1-41f0-4b55-abc6-89feb52ba630","Type":"ContainerStarted","Data":"2b0bb080dd2853615d0dd59dcc4dfe33360f86c42b184050f90fb1456adcf6a3"} Jul 08 19:01:23.875332 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:23.875144 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82474" event={"ID":"4c1f41c1-41f0-4b55-abc6-89feb52ba630","Type":"ContainerStarted","Data":"444dbbb5767dfc482841ba5c18cdebb9fbd9088b54a30c2eb8d435cef61f766d"} Jul 08 19:01:24.750671 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:24.750640 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:24.750943 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:24.750757 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:24.750943 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:24.750808 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:24.751058 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:24.750933 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:25.750354 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:25.750319 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:25.750924 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:25.750420 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:25.881869 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:25.881833 2570 generic.go:356] "Generic (PLEG): container finished" podID="6d8f321d-d047-435f-9cdd-ba893bf5ff07" containerID="806f461c1ce6ef5cfaf7e30ae1d4e97644273b7871b2ecd4507798902a6e92e4" exitCode=0 Jul 08 19:01:25.882051 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:25.881871 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" event={"ID":"6d8f321d-d047-435f-9cdd-ba893bf5ff07","Type":"ContainerDied","Data":"806f461c1ce6ef5cfaf7e30ae1d4e97644273b7871b2ecd4507798902a6e92e4"} Jul 08 19:01:25.885381 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:25.885358 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82474" event={"ID":"4c1f41c1-41f0-4b55-abc6-89feb52ba630","Type":"ContainerStarted","Data":"843daa1a60065af6a1f2be9d16910326f5763d812a5908ea661dcf3cee61e886"} Jul 08 19:01:26.750431 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:26.750393 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:26.750823 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:26.750465 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:26.750823 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:26.750561 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:26.750823 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:26.750668 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:27.750376 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:27.750188 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:27.750558 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:27.750474 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:27.891916 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:27.891826 2570 generic.go:356] "Generic (PLEG): container finished" podID="6d8f321d-d047-435f-9cdd-ba893bf5ff07" containerID="d3c470c7545ac97dd006b32856aca4833d0798afaa215b825afd0cfd77b0acd8" exitCode=0 Jul 08 19:01:27.892094 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:27.891917 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" event={"ID":"6d8f321d-d047-435f-9cdd-ba893bf5ff07","Type":"ContainerDied","Data":"d3c470c7545ac97dd006b32856aca4833d0798afaa215b825afd0cfd77b0acd8"} Jul 08 19:01:27.895836 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:27.895811 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82474" event={"ID":"4c1f41c1-41f0-4b55-abc6-89feb52ba630","Type":"ContainerStarted","Data":"4eeeb996f38825ce7966c7634c78ac49ee5ca5c92f485c4e9a4c17eec2bf2585"} Jul 08 19:01:27.896018 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:27.896004 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:01:27.896073 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:27.896063 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:01:27.912547 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:27.912433 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:01:27.936759 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:27.936704 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-82474" podStartSLOduration=8.374023841 podStartE2EDuration="33.936682963s" totalImagesPullingTime="25.562659122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:27.93621474 +0000 UTC m=+33.712167220" watchObservedRunningTime="2026-07-08 19:01:27.936682963 +0000 UTC m=+33.712635431" Jul 08 19:01:28.401606 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:28.401560 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:28.401817 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:28.401637 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:28.401817 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:28.401722 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:28.401817 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:28.401747 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:28.401817 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:28.401801 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs podName:ceb9c45b-e849-4da2-a8a6-ad602bf66af9 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:00.40178667 +0000 UTC m=+66.177739118 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs") pod "network-metrics-daemon-wzntx" (UID: "ceb9c45b-e849-4da2-a8a6-ad602bf66af9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:28.401817 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:28.401817 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret podName:6573bd34-7a4b-42da-8126-b90510b483e4 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:00.401810595 +0000 UTC m=+66.177763044 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret") pod "global-pull-secret-syncer-zflm9" (UID: "6573bd34-7a4b-42da-8126-b90510b483e4") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:28.502641 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:28.502604 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nms9\" (UniqueName: \"kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9\") pod \"network-check-target-5hls6\" (UID: \"0fa43b64-fa90-427f-a7e3-666964b16bf8\") " pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:28.502821 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:28.502771 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:28.502821 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:28.502792 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:28.502821 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:28.502802 2570 projected.go:196] Error preparing data for projected volume kube-api-access-5nms9 for pod openshift-network-diagnostics/network-check-target-5hls6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:28.502916 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:28.502857 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9 podName:0fa43b64-fa90-427f-a7e3-666964b16bf8 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:00.502843393 +0000 UTC m=+66.278795843 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5nms9" (UniqueName: "kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9") pod "network-check-target-5hls6" (UID: "0fa43b64-fa90-427f-a7e3-666964b16bf8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:28.749913 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:28.749876 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:28.750067 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:28.750000 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:28.750132 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:28.750056 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:28.750185 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:28.750164 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:28.899472 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:28.899415 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:01:28.919824 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:28.919793 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:01:29.750430 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:29.750386 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:29.750628 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:29.750527 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:29.848772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:29.848728 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5hls6"] Jul 08 19:01:29.848938 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:29.848844 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:29.848996 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:29.848948 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:29.851992 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:29.851960 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wzntx"] Jul 08 19:01:29.852156 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:29.852092 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:29.852238 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:29.852212 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:29.852637 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:29.852613 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zflm9"] Jul 08 19:01:29.901392 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:29.901362 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:29.901759 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:29.901485 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:31.750001 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:31.749955 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:31.750469 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:31.750001 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:31.750469 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:31.749955 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:31.750469 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:31.750101 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:31.750469 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:31.750248 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:31.750469 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:31.750339 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:33.749708 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:33.749674 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:33.749708 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:33.749707 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:33.750139 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:33.749778 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:33.750139 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:33.749796 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:33.750139 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:33.749854 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:33.750139 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:33.749927 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:33.912609 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:33.912571 2570 generic.go:356] "Generic (PLEG): container finished" podID="6d8f321d-d047-435f-9cdd-ba893bf5ff07" containerID="3c01bff1b8d6ade31754534e0b34e6b5392e8d7afc5612de30c1febda7e1adfa" exitCode=0 Jul 08 19:01:33.912816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:33.912646 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" event={"ID":"6d8f321d-d047-435f-9cdd-ba893bf5ff07","Type":"ContainerDied","Data":"3c01bff1b8d6ade31754534e0b34e6b5392e8d7afc5612de30c1febda7e1adfa"} Jul 08 19:01:34.917765 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:34.917731 2570 generic.go:356] "Generic (PLEG): container finished" podID="6d8f321d-d047-435f-9cdd-ba893bf5ff07" containerID="1b56e54174fb151ae89d93f01046332d3a54f760812a523245ba302b93ca3054" exitCode=0 Jul 08 19:01:34.918218 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:34.917806 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" event={"ID":"6d8f321d-d047-435f-9cdd-ba893bf5ff07","Type":"ContainerDied","Data":"1b56e54174fb151ae89d93f01046332d3a54f760812a523245ba302b93ca3054"} Jul 08 19:01:35.749604 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:35.749569 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:35.749756 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:35.749671 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wzntx" podUID="ceb9c45b-e849-4da2-a8a6-ad602bf66af9" Jul 08 19:01:35.749756 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:35.749699 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:35.749859 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:35.749704 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:35.749859 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:35.749783 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zflm9" podUID="6573bd34-7a4b-42da-8126-b90510b483e4" Jul 08 19:01:35.749859 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:35.749842 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5hls6" podUID="0fa43b64-fa90-427f-a7e3-666964b16bf8" Jul 08 19:01:35.924163 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:35.924132 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" event={"ID":"6d8f321d-d047-435f-9cdd-ba893bf5ff07","Type":"ContainerStarted","Data":"6da770495a13126b4d5fa3098d44f42a70d550c1b64e6aba84975c46a1f9661b"} Jul 08 19:01:35.947980 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:35.947927 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4tjt8" podStartSLOduration=9.335116753 podStartE2EDuration="40.947910109s" totalImagesPullingTime="31.612793356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:35.947468794 +0000 UTC m=+41.723421281" watchObservedRunningTime="2026-07-08 19:01:35.947910109 +0000 UTC m=+41.723862603" Jul 08 19:01:36.066778 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.066705 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-102.ec2.internal" event="NodeReady" Jul 08 19:01:36.066925 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.066836 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 19:01:36.104681 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.104572 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x"] Jul 08 19:01:36.120263 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.120219 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq"] Jul 08 19:01:36.120263 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.120247 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x" Jul 08 19:01:36.126221 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.126119 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nmjd7\"" Jul 08 19:01:36.126453 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.126364 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 19:01:36.126619 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.126593 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:01:36.132816 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.132787 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56ddc95c58-5mhvs"] Jul 08 19:01:36.132975 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.132922 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:36.137494 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.137474 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 19:01:36.137599 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.137522 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 19:01:36.137773 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.137756 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pvj5b\"" Jul 08 19:01:36.137863 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.137764 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 19:01:36.137920 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.137764 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 19:01:36.141420 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.141399 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-f28q6"] Jul 08 19:01:36.141558 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.141541 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.143708 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.143688 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 19:01:36.146783 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.144020 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 19:01:36.146783 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.144061 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2wp6b\"" Jul 08 19:01:36.146783 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.144061 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 19:01:36.152785 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.152723 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 19:01:36.157017 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.154805 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x"] Jul 08 19:01:36.157017 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.154847 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq"] Jul 08 19:01:36.157017 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.154869 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-f28q6"] Jul 08 19:01:36.157017 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.154886 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56ddc95c58-5mhvs"] Jul 08 19:01:36.157017 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.154907 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tzqd2"] Jul 08 19:01:36.157017 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.155040 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.158227 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.158204 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 19:01:36.158320 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.158262 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 19:01:36.158399 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.158216 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 19:01:36.158586 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.158566 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-554kf\"" Jul 08 19:01:36.158836 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.158819 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 19:01:36.166841 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.166807 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 19:01:36.170254 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.170234 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb"] Jul 08 19:01:36.170368 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.170344 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.172195 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.172180 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 19:01:36.172296 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.172181 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 19:01:36.172296 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.172247 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgfwc\"" Jul 08 19:01:36.183502 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.183480 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8c8kn"] Jul 08 19:01:36.183609 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.183591 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.185374 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.185359 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 19:01:36.185474 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.185459 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 19:01:36.185742 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.185725 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 19:01:36.186005 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.185989 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:01:36.186005 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.185997 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-55ldb\"" Jul 08 19:01:36.198618 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.198597 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8"] Jul 08 19:01:36.198715 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.198700 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.200692 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.200657 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 19:01:36.200692 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.200671 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 19:01:36.200868 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.200731 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:01:36.200868 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.200743 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 19:01:36.200991 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.200974 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vft8f\"" Jul 08 19:01:36.206734 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.206716 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 19:01:36.209505 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.209489 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64778d56b5-wngf5"] Jul 08 19:01:36.209617 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.209604 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.211522 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.211506 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 19:01:36.211589 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.211577 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 19:01:36.211695 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.211678 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:01:36.211842 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.211825 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7jksq\"" Jul 08 19:01:36.211886 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.211856 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 19:01:36.222015 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.221995 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pxzvm"] Jul 08 19:01:36.222127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.222114 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.224219 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.224200 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 19:01:36.224316 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.224264 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sthsh\"" Jul 08 19:01:36.224580 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.224567 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 19:01:36.224737 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.224718 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 19:01:36.224798 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.224751 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 19:01:36.224798 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.224765 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 19:01:36.224881 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.224753 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 19:01:36.238052 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.238033 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994"] Jul 08 19:01:36.238164 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.238154 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pxzvm" Jul 08 19:01:36.240279 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.240221 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 19:01:36.240279 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.240276 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 19:01:36.240473 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.240325 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hl22b\"" Jul 08 19:01:36.240595 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.240581 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 19:01:36.248410 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.248390 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7"] Jul 08 19:01:36.248543 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.248526 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:36.250564 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.250540 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 19:01:36.250850 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.250831 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qxpcc\"" Jul 08 19:01:36.251145 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.251129 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 19:01:36.251380 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.251365 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:01:36.256532 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256507 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:36.256645 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256542 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-image-registry-private-configuration\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.256645 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256569 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.256768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256672 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-ca-trust-extracted\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.256768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256693 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf28b91-47d9-4dc5-8eee-80defdeddea6-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-b75bb\" (UID: \"4cf28b91-47d9-4dc5-8eee-80defdeddea6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.256768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256735 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cf28b91-47d9-4dc5-8eee-80defdeddea6-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-b75bb\" (UID: \"4cf28b91-47d9-4dc5-8eee-80defdeddea6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.256937 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256768 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htqkj\" (UniqueName: \"kubernetes.io/projected/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-kube-api-access-htqkj\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:36.256937 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256801 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-trusted-ca\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.256937 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256822 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-installation-pull-secrets\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.256937 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256846 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v7v7\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-kube-api-access-4v7v7\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.257127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c167b4f1-d95a-4ee5-8466-5a189a3600fb-config-volume\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.257127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256958 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-snapshots\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.257127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256977 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167b4f1-d95a-4ee5-8466-5a189a3600fb-tmp-dir\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.257127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.256994 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m89nz\" (UniqueName: \"kubernetes.io/projected/4cf28b91-47d9-4dc5-8eee-80defdeddea6-kube-api-access-m89nz\") pod \"kube-storage-version-migrator-operator-846bf668f7-b75bb\" (UID: \"4cf28b91-47d9-4dc5-8eee-80defdeddea6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.257127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257018 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znvhm\" (UniqueName: \"kubernetes.io/projected/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-kube-api-access-znvhm\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.257127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257052 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:36.257127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257066 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.257127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257080 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.257552 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257133 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8bwt\" (UniqueName: \"kubernetes.io/projected/939e047c-755a-4851-a350-d00794ac7fc8-kube-api-access-z8bwt\") pod \"volume-data-source-validator-5d456fdbcd-hnz5x\" (UID: \"939e047c-755a-4851-a350-d00794ac7fc8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x" Jul 08 19:01:36.257552 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-certificates\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.257552 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257175 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xzl9\" (UniqueName: \"kubernetes.io/projected/c167b4f1-d95a-4ee5-8466-5a189a3600fb-kube-api-access-9xzl9\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.257552 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257194 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-tmp\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.257552 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257237 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-serving-cert\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.257552 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257268 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.257552 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.257291 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-bound-sa-token\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.259158 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.259136 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg"] Jul 08 19:01:36.259254 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.259239 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:36.261897 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.261877 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mnpp8\"" Jul 08 19:01:36.261897 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.261887 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 19:01:36.262027 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.261894 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 19:01:36.272998 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.272979 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tzqd2"] Jul 08 19:01:36.273087 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.273013 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb"] Jul 08 19:01:36.273087 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.273034 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7"] Jul 08 19:01:36.273087 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.273053 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg"] Jul 08 19:01:36.273087 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.273065 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8c8kn"] Jul 08 19:01:36.273087 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.273076 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pxzvm"] Jul 08 19:01:36.273087 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.273088 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994"] Jul 08 19:01:36.273335 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.273091 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg" Jul 08 19:01:36.273335 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.273111 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8"] Jul 08 19:01:36.273335 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.273125 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64778d56b5-wngf5"] Jul 08 19:01:36.275169 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.275139 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 19:01:36.275169 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.275150 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 19:01:36.275301 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.275199 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rjft5\"" Jul 08 19:01:36.357859 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.357768 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:36.357859 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.357810 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.357859 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.357840 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-526tz\" (UniqueName: \"kubernetes.io/projected/22df694d-ac54-4092-ac48-0e20ef2b935d-kube-api-access-526tz\") pod \"service-ca-operator-5d46d9ffd4-jrfj8\" (UID: \"22df694d-ac54-4092-ac48-0e20ef2b935d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.358163 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.357865 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:36.358163 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.357988 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cf28b91-47d9-4dc5-8eee-80defdeddea6-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-b75bb\" (UID: \"4cf28b91-47d9-4dc5-8eee-80defdeddea6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.358163 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358031 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htqkj\" (UniqueName: \"kubernetes.io/projected/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-kube-api-access-htqkj\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:36.358163 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85tml\" (UniqueName: \"kubernetes.io/projected/e0d192cc-aed5-434e-b755-a36efbd0e639-kube-api-access-85tml\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.358163 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358092 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-trusted-ca\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.358163 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358117 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znvhm\" (UniqueName: \"kubernetes.io/projected/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-kube-api-access-znvhm\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.358163 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358150 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-snapshots\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.358537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358177 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:36.358537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-stats-auth\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.358537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358250 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.358537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358277 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.358537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358323 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-certificates\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.358537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358366 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9dcr\" (UniqueName: \"kubernetes.io/projected/5ef26f7e-91d4-407a-88d0-d7ea9fcf666c-kube-api-access-s9dcr\") pod \"ingress-canary-pxzvm\" (UID: \"5ef26f7e-91d4-407a-88d0-d7ea9fcf666c\") " pod="openshift-ingress-canary/ingress-canary-pxzvm" Jul 08 19:01:36.358537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358415 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.358537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358479 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-image-registry-private-configuration\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.358537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358509 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22df694d-ac54-4092-ac48-0e20ef2b935d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jrfj8\" (UID: \"22df694d-ac54-4092-ac48-0e20ef2b935d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.358537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358539 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22df694d-ac54-4092-ac48-0e20ef2b935d-config\") pod \"service-ca-operator-5d46d9ffd4-jrfj8\" (UID: \"22df694d-ac54-4092-ac48-0e20ef2b935d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.358548 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358564 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxrkk\" (UniqueName: \"kubernetes.io/projected/488e905f-34e0-4bfa-8593-ea7814dc79ab-kube-api-access-rxrkk\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358588 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.358606 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls podName:c167b4f1-d95a-4ee5-8466-5a189a3600fb nodeName:}" failed. No retries permitted until 2026-07-08 19:01:36.85858794 +0000 UTC m=+42.634540388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls") pod "dns-default-tzqd2" (UID: "c167b4f1-d95a-4ee5-8466-5a189a3600fb") : secret "dns-default-metrics-tls" not found Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358658 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cf28b91-47d9-4dc5-8eee-80defdeddea6-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-b75bb\" (UID: \"4cf28b91-47d9-4dc5-8eee-80defdeddea6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358673 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358742 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txms2\" (UniqueName: \"kubernetes.io/projected/10997390-ded2-4c80-8d1f-2e6cc355830d-kube-api-access-txms2\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358791 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-ca-trust-extracted\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358818 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf28b91-47d9-4dc5-8eee-80defdeddea6-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-b75bb\" (UID: \"4cf28b91-47d9-4dc5-8eee-80defdeddea6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358852 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pqwh\" (UniqueName: \"kubernetes.io/projected/c4e41273-c221-4b57-8d24-e6fd15925c22-kube-api-access-4pqwh\") pod \"network-check-source-989f8b8dc-hq4zg\" (UID: \"c4e41273-c221-4b57-8d24-e6fd15925c22\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358880 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.358893 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358900 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-certificates\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.358884 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-installation-pull-secrets\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.359047 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.358909 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ddc95c58-5mhvs: secret "image-registry-tls" not found Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359147 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-snapshots\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359203 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-trusted-ca\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359245 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-ca-trust-extracted\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359256 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167b4f1-d95a-4ee5-8466-5a189a3600fb-tmp-dir\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.359292 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls podName:e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc nodeName:}" failed. No retries permitted until 2026-07-08 19:01:36.859248296 +0000 UTC m=+42.635200745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls") pod "image-registry-56ddc95c58-5mhvs" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc") : secret "image-registry-tls" not found Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359341 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m89nz\" (UniqueName: \"kubernetes.io/projected/4cf28b91-47d9-4dc5-8eee-80defdeddea6-kube-api-access-m89nz\") pod \"kube-storage-version-migrator-operator-846bf668f7-b75bb\" (UID: \"4cf28b91-47d9-4dc5-8eee-80defdeddea6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359386 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359390 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v7v7\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-kube-api-access-4v7v7\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359434 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d192cc-aed5-434e-b755-a36efbd0e639-serving-cert\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359480 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d192cc-aed5-434e-b755-a36efbd0e639-trusted-ca\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359508 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c167b4f1-d95a-4ee5-8466-5a189a3600fb-config-volume\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359542 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8bwt\" (UniqueName: \"kubernetes.io/projected/939e047c-755a-4851-a350-d00794ac7fc8-kube-api-access-z8bwt\") pod \"volume-data-source-validator-5d456fdbcd-hnz5x\" (UID: \"939e047c-755a-4851-a350-d00794ac7fc8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359572 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6fa83f9f-b701-4b0d-b47e-a49ae5340571-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359598 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:36.359772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359627 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0d192cc-aed5-434e-b755-a36efbd0e639-config\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359658 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-default-certificate\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359569 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167b4f1-d95a-4ee5-8466-5a189a3600fb-tmp-dir\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359685 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xzl9\" (UniqueName: \"kubernetes.io/projected/c167b4f1-d95a-4ee5-8466-5a189a3600fb-kube-api-access-9xzl9\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359718 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-tmp\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359759 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-serving-cert\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359806 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-bound-sa-token\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359835 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.359865 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ef26f7e-91d4-407a-88d0-d7ea9fcf666c-cert\") pod \"ingress-canary-pxzvm\" (UID: \"5ef26f7e-91d4-407a-88d0-d7ea9fcf666c\") " pod="openshift-ingress-canary/ingress-canary-pxzvm" Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.359988 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.360032 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-tmp\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.360044 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls podName:83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb nodeName:}" failed. No retries permitted until 2026-07-08 19:01:36.860027656 +0000 UTC m=+42.635980122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8sq" (UID: "83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:36.360426 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.360141 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c167b4f1-d95a-4ee5-8466-5a189a3600fb-config-volume\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.363241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.363220 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cf28b91-47d9-4dc5-8eee-80defdeddea6-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-b75bb\" (UID: \"4cf28b91-47d9-4dc5-8eee-80defdeddea6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.363241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.363231 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-serving-cert\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.363404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.363337 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-installation-pull-secrets\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.363404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.363373 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-image-registry-private-configuration\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.366705 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.366653 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znvhm\" (UniqueName: \"kubernetes.io/projected/b01866af-cfdb-4883-bcd3-2f6d0f7a98f1-kube-api-access-znvhm\") pod \"insights-operator-5c847dcfc4-f28q6\" (UID: \"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1\") " pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.366888 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.366865 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htqkj\" (UniqueName: \"kubernetes.io/projected/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-kube-api-access-htqkj\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:36.368072 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.368048 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v7v7\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-kube-api-access-4v7v7\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.368219 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.368199 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-bound-sa-token\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.368324 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.368309 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xzl9\" (UniqueName: \"kubernetes.io/projected/c167b4f1-d95a-4ee5-8466-5a189a3600fb-kube-api-access-9xzl9\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.368958 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.368938 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m89nz\" (UniqueName: \"kubernetes.io/projected/4cf28b91-47d9-4dc5-8eee-80defdeddea6-kube-api-access-m89nz\") pod \"kube-storage-version-migrator-operator-846bf668f7-b75bb\" (UID: \"4cf28b91-47d9-4dc5-8eee-80defdeddea6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.373857 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.373834 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8bwt\" (UniqueName: \"kubernetes.io/projected/939e047c-755a-4851-a350-d00794ac7fc8-kube-api-access-z8bwt\") pod \"volume-data-source-validator-5d456fdbcd-hnz5x\" (UID: \"939e047c-755a-4851-a350-d00794ac7fc8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x" Jul 08 19:01:36.439881 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.439844 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x" Jul 08 19:01:36.460512 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.460489 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6fa83f9f-b701-4b0d-b47e-a49ae5340571-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:36.460626 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.460532 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0d192cc-aed5-434e-b755-a36efbd0e639-config\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.460626 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.460560 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-default-certificate\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.460758 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.460736 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.460809 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.460768 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ef26f7e-91d4-407a-88d0-d7ea9fcf666c-cert\") pod \"ingress-canary-pxzvm\" (UID: \"5ef26f7e-91d4-407a-88d0-d7ea9fcf666c\") " pod="openshift-ingress-canary/ingress-canary-pxzvm" Jul 08 19:01:36.460809 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.460797 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-526tz\" (UniqueName: \"kubernetes.io/projected/22df694d-ac54-4092-ac48-0e20ef2b935d-kube-api-access-526tz\") pod \"service-ca-operator-5d46d9ffd4-jrfj8\" (UID: \"22df694d-ac54-4092-ac48-0e20ef2b935d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.460821 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.460851 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85tml\" (UniqueName: \"kubernetes.io/projected/e0d192cc-aed5-434e-b755-a36efbd0e639-kube-api-access-85tml\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.460886 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.460923 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:01:36.960895026 +0000 UTC m=+42.736847673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : configmap references non-existent config key: service-ca.crt Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.461013 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.461083 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls podName:488e905f-34e0-4bfa-8593-ea7814dc79ab nodeName:}" failed. No retries permitted until 2026-07-08 19:01:36.96106777 +0000 UTC m=+42.737020221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bs994" (UID: "488e905f-34e0-4bfa-8593-ea7814dc79ab") : secret "samples-operator-tls" not found Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.461103 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461112 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-stats-auth\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461183 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9dcr\" (UniqueName: \"kubernetes.io/projected/5ef26f7e-91d4-407a-88d0-d7ea9fcf666c-kube-api-access-s9dcr\") pod \"ingress-canary-pxzvm\" (UID: \"5ef26f7e-91d4-407a-88d0-d7ea9fcf666c\") " pod="openshift-ingress-canary/ingress-canary-pxzvm" Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461233 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22df694d-ac54-4092-ac48-0e20ef2b935d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jrfj8\" (UID: \"22df694d-ac54-4092-ac48-0e20ef2b935d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.461257 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert podName:6fa83f9f-b701-4b0d-b47e-a49ae5340571 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:36.961241582 +0000 UTC m=+42.737194030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fsjh7" (UID: "6fa83f9f-b701-4b0d-b47e-a49ae5340571") : secret "networking-console-plugin-cert" not found Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461287 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22df694d-ac54-4092-ac48-0e20ef2b935d-config\") pod \"service-ca-operator-5d46d9ffd4-jrfj8\" (UID: \"22df694d-ac54-4092-ac48-0e20ef2b935d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461319 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxrkk\" (UniqueName: \"kubernetes.io/projected/488e905f-34e0-4bfa-8593-ea7814dc79ab-kube-api-access-rxrkk\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461346 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.461622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461365 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0d192cc-aed5-434e-b755-a36efbd0e639-config\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.462529 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.461483 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:01:36.462529 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461485 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6fa83f9f-b701-4b0d-b47e-a49ae5340571-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:36.462529 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.461526 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:01:36.961513074 +0000 UTC m=+42.737465552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : secret "router-metrics-certs-default" not found Jul 08 19:01:36.462529 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461371 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txms2\" (UniqueName: \"kubernetes.io/projected/10997390-ded2-4c80-8d1f-2e6cc355830d-kube-api-access-txms2\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.462529 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461592 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pqwh\" (UniqueName: \"kubernetes.io/projected/c4e41273-c221-4b57-8d24-e6fd15925c22-kube-api-access-4pqwh\") pod \"network-check-source-989f8b8dc-hq4zg\" (UID: \"c4e41273-c221-4b57-8d24-e6fd15925c22\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg" Jul 08 19:01:36.462529 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461628 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d192cc-aed5-434e-b755-a36efbd0e639-serving-cert\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.462529 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461661 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d192cc-aed5-434e-b755-a36efbd0e639-trusted-ca\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.462529 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.461902 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22df694d-ac54-4092-ac48-0e20ef2b935d-config\") pod \"service-ca-operator-5d46d9ffd4-jrfj8\" (UID: \"22df694d-ac54-4092-ac48-0e20ef2b935d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.462893 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.462705 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d192cc-aed5-434e-b755-a36efbd0e639-trusted-ca\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.463962 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.463936 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-default-certificate\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.464103 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.464085 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-stats-auth\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.464551 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.464528 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/22df694d-ac54-4092-ac48-0e20ef2b935d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jrfj8\" (UID: \"22df694d-ac54-4092-ac48-0e20ef2b935d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.464625 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.464554 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ef26f7e-91d4-407a-88d0-d7ea9fcf666c-cert\") pod \"ingress-canary-pxzvm\" (UID: \"5ef26f7e-91d4-407a-88d0-d7ea9fcf666c\") " pod="openshift-ingress-canary/ingress-canary-pxzvm" Jul 08 19:01:36.465638 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.465619 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d192cc-aed5-434e-b755-a36efbd0e639-serving-cert\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.468195 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.468034 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" Jul 08 19:01:36.472791 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.472764 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxrkk\" (UniqueName: \"kubernetes.io/projected/488e905f-34e0-4bfa-8593-ea7814dc79ab-kube-api-access-rxrkk\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:36.472890 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.472812 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85tml\" (UniqueName: \"kubernetes.io/projected/e0d192cc-aed5-434e-b755-a36efbd0e639-kube-api-access-85tml\") pod \"console-operator-68b757fb67-8c8kn\" (UID: \"e0d192cc-aed5-434e-b755-a36efbd0e639\") " pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.473036 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.473015 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txms2\" (UniqueName: \"kubernetes.io/projected/10997390-ded2-4c80-8d1f-2e6cc355830d-kube-api-access-txms2\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.473324 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.473305 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9dcr\" (UniqueName: \"kubernetes.io/projected/5ef26f7e-91d4-407a-88d0-d7ea9fcf666c-kube-api-access-s9dcr\") pod \"ingress-canary-pxzvm\" (UID: \"5ef26f7e-91d4-407a-88d0-d7ea9fcf666c\") " pod="openshift-ingress-canary/ingress-canary-pxzvm" Jul 08 19:01:36.473584 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.473563 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-526tz\" (UniqueName: \"kubernetes.io/projected/22df694d-ac54-4092-ac48-0e20ef2b935d-kube-api-access-526tz\") pod \"service-ca-operator-5d46d9ffd4-jrfj8\" (UID: \"22df694d-ac54-4092-ac48-0e20ef2b935d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.474561 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.474544 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pqwh\" (UniqueName: \"kubernetes.io/projected/c4e41273-c221-4b57-8d24-e6fd15925c22-kube-api-access-4pqwh\") pod \"network-check-source-989f8b8dc-hq4zg\" (UID: \"c4e41273-c221-4b57-8d24-e6fd15925c22\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg" Jul 08 19:01:36.491540 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.491507 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" Jul 08 19:01:36.507287 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.507248 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:36.517930 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.517906 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" Jul 08 19:01:36.547631 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.547361 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pxzvm" Jul 08 19:01:36.583262 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.581848 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg" Jul 08 19:01:36.661171 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.661048 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x"] Jul 08 19:01:36.677244 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:01:36.674507 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939e047c_755a_4851_a350_d00794ac7fc8.slice/crio-0a4251a3ce962315273f428a0eddbb4069ffd430ef4f172e9e4eebb49605d9a1 WatchSource:0}: Error finding container 0a4251a3ce962315273f428a0eddbb4069ffd430ef4f172e9e4eebb49605d9a1: Status 404 returned error can't find the container with id 0a4251a3ce962315273f428a0eddbb4069ffd430ef4f172e9e4eebb49605d9a1 Jul 08 19:01:36.680069 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.677877 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-f28q6"] Jul 08 19:01:36.749014 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.748915 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb"] Jul 08 19:01:36.750680 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:01:36.750628 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf28b91_47d9_4dc5_8eee_80defdeddea6.slice/crio-0e465d6d0d17a2fa356e307e3be7c479b77af2da514056be3f5643d8b805dbc4 WatchSource:0}: Error finding container 0e465d6d0d17a2fa356e307e3be7c479b77af2da514056be3f5643d8b805dbc4: Status 404 returned error can't find the container with id 0e465d6d0d17a2fa356e307e3be7c479b77af2da514056be3f5643d8b805dbc4 Jul 08 19:01:36.762713 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.762682 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8c8kn"] Jul 08 19:01:36.767617 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.767586 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8"] Jul 08 19:01:36.768215 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:01:36.768191 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d192cc_aed5_434e_b755_a36efbd0e639.slice/crio-bbd5b1f5695ed6b656370fb59e8fb6131003b277cb3ba6c0248b28cc80b51257 WatchSource:0}: Error finding container bbd5b1f5695ed6b656370fb59e8fb6131003b277cb3ba6c0248b28cc80b51257: Status 404 returned error can't find the container with id bbd5b1f5695ed6b656370fb59e8fb6131003b277cb3ba6c0248b28cc80b51257 Jul 08 19:01:36.771426 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:01:36.771401 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22df694d_ac54_4092_ac48_0e20ef2b935d.slice/crio-40dce65d3647feba9e115c5f234d4bf57c6234dee1fc70c9ac947e82531de100 WatchSource:0}: Error finding container 40dce65d3647feba9e115c5f234d4bf57c6234dee1fc70c9ac947e82531de100: Status 404 returned error can't find the container with id 40dce65d3647feba9e115c5f234d4bf57c6234dee1fc70c9ac947e82531de100 Jul 08 19:01:36.796668 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.796636 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pxzvm"] Jul 08 19:01:36.800840 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:01:36.800802 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef26f7e_91d4_407a_88d0_d7ea9fcf666c.slice/crio-ba0030205683762d7af3bba530da3c8316538b3f880578a284fee8a33b308dee WatchSource:0}: Error finding container ba0030205683762d7af3bba530da3c8316538b3f880578a284fee8a33b308dee: Status 404 returned error can't find the container with id ba0030205683762d7af3bba530da3c8316538b3f880578a284fee8a33b308dee Jul 08 19:01:36.804464 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.804424 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg"] Jul 08 19:01:36.807220 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:01:36.807199 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e41273_c221_4b57_8d24_e6fd15925c22.slice/crio-7b6121d038a668c7fa011d0dd23d68632da3101edc120db951725b36fec0ea49 WatchSource:0}: Error finding container 7b6121d038a668c7fa011d0dd23d68632da3101edc120db951725b36fec0ea49: Status 404 returned error can't find the container with id 7b6121d038a668c7fa011d0dd23d68632da3101edc120db951725b36fec0ea49 Jul 08 19:01:36.870136 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.870046 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:36.870136 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.870099 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:36.870346 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.870193 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:01:36.870346 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.870201 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:01:36.870346 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.870204 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ddc95c58-5mhvs: secret "image-registry-tls" not found Jul 08 19:01:36.870346 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.870253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:36.870346 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.870269 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls podName:c167b4f1-d95a-4ee5-8466-5a189a3600fb nodeName:}" failed. No retries permitted until 2026-07-08 19:01:37.870250166 +0000 UTC m=+43.646202635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls") pod "dns-default-tzqd2" (UID: "c167b4f1-d95a-4ee5-8466-5a189a3600fb") : secret "dns-default-metrics-tls" not found Jul 08 19:01:36.870346 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.870308 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls podName:e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc nodeName:}" failed. No retries permitted until 2026-07-08 19:01:37.8702944 +0000 UTC m=+43.646246851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls") pod "image-registry-56ddc95c58-5mhvs" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc") : secret "image-registry-tls" not found Jul 08 19:01:36.870604 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.870349 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:36.870604 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.870418 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls podName:83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb nodeName:}" failed. No retries permitted until 2026-07-08 19:01:37.870399752 +0000 UTC m=+43.646352218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8sq" (UID: "83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:36.927741 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.927710 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" event={"ID":"22df694d-ac54-4092-ac48-0e20ef2b935d","Type":"ContainerStarted","Data":"40dce65d3647feba9e115c5f234d4bf57c6234dee1fc70c9ac947e82531de100"} Jul 08 19:01:36.928851 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.928827 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg" event={"ID":"c4e41273-c221-4b57-8d24-e6fd15925c22","Type":"ContainerStarted","Data":"7b6121d038a668c7fa011d0dd23d68632da3101edc120db951725b36fec0ea49"} Jul 08 19:01:36.929928 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.929909 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pxzvm" event={"ID":"5ef26f7e-91d4-407a-88d0-d7ea9fcf666c","Type":"ContainerStarted","Data":"ba0030205683762d7af3bba530da3c8316538b3f880578a284fee8a33b308dee"} Jul 08 19:01:36.931039 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.931008 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" event={"ID":"e0d192cc-aed5-434e-b755-a36efbd0e639","Type":"ContainerStarted","Data":"bbd5b1f5695ed6b656370fb59e8fb6131003b277cb3ba6c0248b28cc80b51257"} Jul 08 19:01:36.932089 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.932068 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" event={"ID":"4cf28b91-47d9-4dc5-8eee-80defdeddea6","Type":"ContainerStarted","Data":"0e465d6d0d17a2fa356e307e3be7c479b77af2da514056be3f5643d8b805dbc4"} Jul 08 19:01:36.933069 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.933051 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x" event={"ID":"939e047c-755a-4851-a350-d00794ac7fc8","Type":"ContainerStarted","Data":"0a4251a3ce962315273f428a0eddbb4069ffd430ef4f172e9e4eebb49605d9a1"} Jul 08 19:01:36.934093 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.934073 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" event={"ID":"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1","Type":"ContainerStarted","Data":"62d596b4c9ea28a8de27a1eda2dad549ac36fc604424df3f1c31bc7e4e610f0a"} Jul 08 19:01:36.970862 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.970828 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.971030 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.970868 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:36.971030 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.970894 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:36.971030 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.970977 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 19:01:36.971030 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.970992 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:01:36.971030 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.971016 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:01:37.971000006 +0000 UTC m=+43.746952454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : configmap references non-existent config key: service-ca.crt Jul 08 19:01:36.971210 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.971087 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert podName:6fa83f9f-b701-4b0d-b47e-a49ae5340571 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:37.971067546 +0000 UTC m=+43.747019995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fsjh7" (UID: "6fa83f9f-b701-4b0d-b47e-a49ae5340571") : secret "networking-console-plugin-cert" not found Jul 08 19:01:36.971210 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.971119 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls podName:488e905f-34e0-4bfa-8593-ea7814dc79ab nodeName:}" failed. No retries permitted until 2026-07-08 19:01:37.971107552 +0000 UTC m=+43.747060006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bs994" (UID: "488e905f-34e0-4bfa-8593-ea7814dc79ab") : secret "samples-operator-tls" not found Jul 08 19:01:36.971210 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:36.971180 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:36.971305 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.971299 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:01:36.971336 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:36.971331 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:01:37.971323731 +0000 UTC m=+43.747276180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : secret "router-metrics-certs-default" not found Jul 08 19:01:37.751188 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.749736 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:01:37.751188 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.750217 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:01:37.751188 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.750666 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:01:37.753943 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.753914 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-72lbb\"" Jul 08 19:01:37.754198 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.754180 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:01:37.754371 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.754357 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:01:37.754575 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.754559 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-db4b9\"" Jul 08 19:01:37.880427 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.880384 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:37.880617 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.880485 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:37.880617 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.880577 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:37.880808 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.880790 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:37.880866 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.880861 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls podName:83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb nodeName:}" failed. No retries permitted until 2026-07-08 19:01:39.880841663 +0000 UTC m=+45.656794115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8sq" (UID: "83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:37.881914 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.881884 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:01:37.882048 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.881945 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls podName:c167b4f1-d95a-4ee5-8466-5a189a3600fb nodeName:}" failed. No retries permitted until 2026-07-08 19:01:39.881928145 +0000 UTC m=+45.657880596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls") pod "dns-default-tzqd2" (UID: "c167b4f1-d95a-4ee5-8466-5a189a3600fb") : secret "dns-default-metrics-tls" not found Jul 08 19:01:37.882048 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.882016 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:01:37.882048 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.882028 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ddc95c58-5mhvs: secret "image-registry-tls" not found Jul 08 19:01:37.882205 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.882058 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls podName:e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc nodeName:}" failed. No retries permitted until 2026-07-08 19:01:39.882047586 +0000 UTC m=+45.658000038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls") pod "image-registry-56ddc95c58-5mhvs" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc") : secret "image-registry-tls" not found Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.981596 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.981722 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.981759 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:37.981802 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.981972 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.982038 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert podName:6fa83f9f-b701-4b0d-b47e-a49ae5340571 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:39.982019824 +0000 UTC m=+45.757972276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fsjh7" (UID: "6fa83f9f-b701-4b0d-b47e-a49ae5340571") : secret "networking-console-plugin-cert" not found Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.982457 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.982511 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:01:39.982495234 +0000 UTC m=+45.758447697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : secret "router-metrics-certs-default" not found Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.982584 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:01:39.982572709 +0000 UTC m=+45.758525160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : configmap references non-existent config key: service-ca.crt Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.982644 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:01:37.982725 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:37.982677 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls podName:488e905f-34e0-4bfa-8593-ea7814dc79ab nodeName:}" failed. No retries permitted until 2026-07-08 19:01:39.982666184 +0000 UTC m=+45.758618636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bs994" (UID: "488e905f-34e0-4bfa-8593-ea7814dc79ab") : secret "samples-operator-tls" not found Jul 08 19:01:39.901887 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:39.901640 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:39.902351 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:39.901938 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:39.902351 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:39.901823 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:01:39.902351 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:39.902038 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls podName:c167b4f1-d95a-4ee5-8466-5a189a3600fb nodeName:}" failed. No retries permitted until 2026-07-08 19:01:43.902008846 +0000 UTC m=+49.677961314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls") pod "dns-default-tzqd2" (UID: "c167b4f1-d95a-4ee5-8466-5a189a3600fb") : secret "dns-default-metrics-tls" not found Jul 08 19:01:39.902351 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:39.902066 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:39.902351 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:39.902088 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:01:39.902351 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:39.902104 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ddc95c58-5mhvs: secret "image-registry-tls" not found Jul 08 19:01:39.902351 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:39.902147 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls podName:e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc nodeName:}" failed. No retries permitted until 2026-07-08 19:01:43.902133419 +0000 UTC m=+49.678085872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls") pod "image-registry-56ddc95c58-5mhvs" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc") : secret "image-registry-tls" not found Jul 08 19:01:39.902351 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:39.902208 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:39.902351 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:39.902251 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls podName:83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb nodeName:}" failed. No retries permitted until 2026-07-08 19:01:43.902239159 +0000 UTC m=+49.678191607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8sq" (UID: "83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:40.003307 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:40.003272 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:40.003512 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:40.003318 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:40.003512 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:40.003400 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:40.003512 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:40.003468 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:01:40.003700 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:40.003527 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 19:01:40.003700 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:40.003541 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:01:40.003700 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:40.003535 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls podName:488e905f-34e0-4bfa-8593-ea7814dc79ab nodeName:}" failed. No retries permitted until 2026-07-08 19:01:44.003519632 +0000 UTC m=+49.779472082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bs994" (UID: "488e905f-34e0-4bfa-8593-ea7814dc79ab") : secret "samples-operator-tls" not found Jul 08 19:01:40.003700 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:40.003597 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:01:44.003580862 +0000 UTC m=+49.779533324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : secret "router-metrics-certs-default" not found Jul 08 19:01:40.003700 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:40.003613 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert podName:6fa83f9f-b701-4b0d-b47e-a49ae5340571 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:44.003602999 +0000 UTC m=+49.779555454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fsjh7" (UID: "6fa83f9f-b701-4b0d-b47e-a49ae5340571") : secret "networking-console-plugin-cert" not found Jul 08 19:01:40.003700 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:40.003655 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:40.003970 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:40.003766 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:01:44.003755541 +0000 UTC m=+49.779707993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : configmap references non-existent config key: service-ca.crt Jul 08 19:01:43.943873 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:43.943837 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:43.944409 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:43.943888 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:43.944409 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:43.943939 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:43.944409 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:43.943996 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:01:43.944409 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:43.944022 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:43.944409 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:43.944065 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls podName:83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb nodeName:}" failed. No retries permitted until 2026-07-08 19:01:51.944052476 +0000 UTC m=+57.720004924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8sq" (UID: "83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:43.944409 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:43.944066 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:01:43.944409 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:43.944076 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls podName:c167b4f1-d95a-4ee5-8466-5a189a3600fb nodeName:}" failed. No retries permitted until 2026-07-08 19:01:51.944070831 +0000 UTC m=+57.720023280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls") pod "dns-default-tzqd2" (UID: "c167b4f1-d95a-4ee5-8466-5a189a3600fb") : secret "dns-default-metrics-tls" not found Jul 08 19:01:43.944409 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:43.944085 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ddc95c58-5mhvs: secret "image-registry-tls" not found Jul 08 19:01:43.944409 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:43.944130 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls podName:e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc nodeName:}" failed. No retries permitted until 2026-07-08 19:01:51.944114083 +0000 UTC m=+57.720066532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls") pod "image-registry-56ddc95c58-5mhvs" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc") : secret "image-registry-tls" not found Jul 08 19:01:44.044978 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.044934 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:44.044978 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.044982 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:44.045227 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.045021 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:44.045227 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:44.045099 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:01:52.045082279 +0000 UTC m=+57.821034732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : configmap references non-existent config key: service-ca.crt Jul 08 19:01:44.045227 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.045128 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:44.045227 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:44.045152 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:01:44.045227 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:44.045155 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 19:01:44.045227 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:44.045212 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert podName:6fa83f9f-b701-4b0d-b47e-a49ae5340571 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:52.045194747 +0000 UTC m=+57.821147199 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fsjh7" (UID: "6fa83f9f-b701-4b0d-b47e-a49ae5340571") : secret "networking-console-plugin-cert" not found Jul 08 19:01:44.045227 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:44.045227 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:01:44.045462 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:44.045228 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls podName:488e905f-34e0-4bfa-8593-ea7814dc79ab nodeName:}" failed. No retries permitted until 2026-07-08 19:01:52.045219914 +0000 UTC m=+57.821172363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bs994" (UID: "488e905f-34e0-4bfa-8593-ea7814dc79ab") : secret "samples-operator-tls" not found Jul 08 19:01:44.045462 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:44.045265 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:01:52.045256849 +0000 UTC m=+57.821209298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : secret "router-metrics-certs-default" not found Jul 08 19:01:44.961110 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.960663 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg" event={"ID":"c4e41273-c221-4b57-8d24-e6fd15925c22","Type":"ContainerStarted","Data":"fafdcb874699bbdc07ebbabac2656d5a14e1ec4cd309396d4f848ad536ca8fc1"} Jul 08 19:01:44.963303 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.963277 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pxzvm" event={"ID":"5ef26f7e-91d4-407a-88d0-d7ea9fcf666c","Type":"ContainerStarted","Data":"565e570f157dd2efd4fa8c26846bef9e09065e67377293b82b83f0d95d644ba3"} Jul 08 19:01:44.965266 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.965245 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/0.log" Jul 08 19:01:44.965357 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.965289 2570 generic.go:356] "Generic (PLEG): container finished" podID="e0d192cc-aed5-434e-b755-a36efbd0e639" containerID="3709905c794c64c4d9dd2746ffa15ee1192a9615834ce326bee014f462d91706" exitCode=255 Jul 08 19:01:44.965428 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.965368 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" event={"ID":"e0d192cc-aed5-434e-b755-a36efbd0e639","Type":"ContainerDied","Data":"3709905c794c64c4d9dd2746ffa15ee1192a9615834ce326bee014f462d91706"} Jul 08 19:01:44.965871 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.965611 2570 scope.go:117] "RemoveContainer" containerID="3709905c794c64c4d9dd2746ffa15ee1192a9615834ce326bee014f462d91706" Jul 08 19:01:44.967514 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.967489 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" event={"ID":"4cf28b91-47d9-4dc5-8eee-80defdeddea6","Type":"ContainerStarted","Data":"664a17474578c3fa0bf8cfe8f486a56c26731c3732f8372fc570893be78c2bf0"} Jul 08 19:01:44.969084 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.969062 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x" event={"ID":"939e047c-755a-4851-a350-d00794ac7fc8","Type":"ContainerStarted","Data":"cb70850e00ff07945b5206fac1a41d960ddb9fa8b72391f78bbfcf071a39fe0f"} Jul 08 19:01:44.970701 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.970678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" event={"ID":"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1","Type":"ContainerStarted","Data":"26b959886e99d9a66ca981875b8437f8f58ae789f3d1f7fc7f3421b244e8cc00"} Jul 08 19:01:44.972320 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.972302 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" event={"ID":"22df694d-ac54-4092-ac48-0e20ef2b935d","Type":"ContainerStarted","Data":"a96c1550d8a41090befc8caac4de88168286bb1eeacc6a791ac6de7c9dfce0e1"} Jul 08 19:01:44.978820 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.978776 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hq4zg" podStartSLOduration=9.539567764 podStartE2EDuration="16.978760379s" totalImagesPullingTime="7.439192615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:44.977293178 +0000 UTC m=+50.753245651" watchObservedRunningTime="2026-07-08 19:01:44.978760379 +0000 UTC m=+50.754712850" Jul 08 19:01:44.993241 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:44.993204 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" podStartSLOduration=9.44629423 podStartE2EDuration="16.993191034s" totalImagesPullingTime="7.546896804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:44.99171922 +0000 UTC m=+50.767671689" watchObservedRunningTime="2026-07-08 19:01:44.993191034 +0000 UTC m=+50.769143483" Jul 08 19:01:45.029540 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.028945 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pxzvm" podStartSLOduration=1.593382612 podStartE2EDuration="9.028922171s" totalImagesPullingTime="7.435539559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:45.028049209 +0000 UTC m=+50.804001681" watchObservedRunningTime="2026-07-08 19:01:45.028922171 +0000 UTC m=+50.804874643" Jul 08 19:01:45.029919 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.029877 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" podStartSLOduration=9.547217966 podStartE2EDuration="17.029861697s" totalImagesPullingTime="7.482643731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:45.010417456 +0000 UTC m=+50.786369928" watchObservedRunningTime="2026-07-08 19:01:45.029861697 +0000 UTC m=+50.805814170" Jul 08 19:01:45.053544 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.053486 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" podStartSLOduration=9.58873559 podStartE2EDuration="17.053463959s" totalImagesPullingTime="7.464728369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:45.052495688 +0000 UTC m=+50.828448164" watchObservedRunningTime="2026-07-08 19:01:45.053463959 +0000 UTC m=+50.829416431" Jul 08 19:01:45.076824 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.076252 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hnz5x" podStartSLOduration=9.671211625 podStartE2EDuration="17.076234093s" totalImagesPullingTime="7.405022468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:45.075640289 +0000 UTC m=+50.851592784" watchObservedRunningTime="2026-07-08 19:01:45.076234093 +0000 UTC m=+50.852186564" Jul 08 19:01:45.451533 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.451495 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x54s2"] Jul 08 19:01:45.471534 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.471494 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x54s2"] Jul 08 19:01:45.471744 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.471648 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.474019 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.473994 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 19:01:45.474266 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.473994 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 19:01:45.474266 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.474107 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bk24w\"" Jul 08 19:01:45.560087 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.559991 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-data-volume\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.560226 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.560134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-crio-socket\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.560226 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.560175 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.560226 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.560206 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.560375 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.560346 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl9sl\" (UniqueName: \"kubernetes.io/projected/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-api-access-dl9sl\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.661711 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.661676 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl9sl\" (UniqueName: \"kubernetes.io/projected/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-api-access-dl9sl\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.661711 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.661717 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-data-volume\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.661961 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.661892 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-crio-socket\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.661961 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.661943 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.662067 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.661979 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.662120 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.662081 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-data-volume\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.662120 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:45.662102 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:01:45.662224 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:45.662168 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:01:45.662224 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.662161 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-crio-socket\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.662224 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:45.662170 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm podName:0f2f4a79-ddf3-4258-9e98-d8ec662155d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:46.162150559 +0000 UTC m=+51.938103011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x54s2" (UID: "0f2f4a79-ddf3-4258-9e98-d8ec662155d8") : configmap "kube-rbac-proxy" not found Jul 08 19:01:45.662224 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:45.662221 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls podName:0f2f4a79-ddf3-4258-9e98-d8ec662155d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:46.162209323 +0000 UTC m=+51.938161775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x54s2" (UID: "0f2f4a79-ddf3-4258-9e98-d8ec662155d8") : secret "insights-runtime-extractor-tls" not found Jul 08 19:01:45.672219 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.672186 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl9sl\" (UniqueName: \"kubernetes.io/projected/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-api-access-dl9sl\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:45.890514 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.890423 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6"] Jul 08 19:01:45.909118 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.909087 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6"] Jul 08 19:01:45.909339 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.909214 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6" Jul 08 19:01:45.913281 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.913243 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 19:01:45.913281 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.913272 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gtg95\"" Jul 08 19:01:45.913422 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.913279 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 19:01:45.964787 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.964750 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxsw5\" (UniqueName: \"kubernetes.io/projected/31f386ae-841a-4f4b-be35-b891ed799001-kube-api-access-vxsw5\") pod \"migrator-d57d58cc9-299c6\" (UID: \"31f386ae-841a-4f4b-be35-b891ed799001\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6" Jul 08 19:01:45.980770 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.980747 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:01:45.981158 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.981141 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/0.log" Jul 08 19:01:45.981273 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.981183 2570 generic.go:356] "Generic (PLEG): container finished" podID="e0d192cc-aed5-434e-b755-a36efbd0e639" containerID="53f70c7a42c2745e80df5a46c1c338700470a94d7cb6e803ffad1d5afb693656" exitCode=255 Jul 08 19:01:45.981341 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.981311 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" event={"ID":"e0d192cc-aed5-434e-b755-a36efbd0e639","Type":"ContainerDied","Data":"53f70c7a42c2745e80df5a46c1c338700470a94d7cb6e803ffad1d5afb693656"} Jul 08 19:01:45.981408 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.981395 2570 scope.go:117] "RemoveContainer" containerID="3709905c794c64c4d9dd2746ffa15ee1192a9615834ce326bee014f462d91706" Jul 08 19:01:45.981550 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:45.981531 2570 scope.go:117] "RemoveContainer" containerID="53f70c7a42c2745e80df5a46c1c338700470a94d7cb6e803ffad1d5afb693656" Jul 08 19:01:45.981753 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:45.981730 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8c8kn_openshift-console-operator(e0d192cc-aed5-434e-b755-a36efbd0e639)\"" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" podUID="e0d192cc-aed5-434e-b755-a36efbd0e639" Jul 08 19:01:46.065885 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.065847 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxsw5\" (UniqueName: \"kubernetes.io/projected/31f386ae-841a-4f4b-be35-b891ed799001-kube-api-access-vxsw5\") pod \"migrator-d57d58cc9-299c6\" (UID: \"31f386ae-841a-4f4b-be35-b891ed799001\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6" Jul 08 19:01:46.075688 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.075657 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxsw5\" (UniqueName: \"kubernetes.io/projected/31f386ae-841a-4f4b-be35-b891ed799001-kube-api-access-vxsw5\") pod \"migrator-d57d58cc9-299c6\" (UID: \"31f386ae-841a-4f4b-be35-b891ed799001\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6" Jul 08 19:01:46.167758 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.167720 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:46.167758 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.167761 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:46.167954 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:46.167844 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:01:46.167954 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:46.167886 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:01:46.167954 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:46.167909 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm podName:0f2f4a79-ddf3-4258-9e98-d8ec662155d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:47.167884254 +0000 UTC m=+52.943836705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x54s2" (UID: "0f2f4a79-ddf3-4258-9e98-d8ec662155d8") : configmap "kube-rbac-proxy" not found Jul 08 19:01:46.168048 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:46.167982 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls podName:0f2f4a79-ddf3-4258-9e98-d8ec662155d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:47.167957321 +0000 UTC m=+52.943909783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x54s2" (UID: "0f2f4a79-ddf3-4258-9e98-d8ec662155d8") : secret "insights-runtime-extractor-tls" not found Jul 08 19:01:46.222062 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.221992 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6" Jul 08 19:01:46.369629 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.369597 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6"] Jul 08 19:01:46.372395 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:01:46.372368 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f386ae_841a_4f4b_be35_b891ed799001.slice/crio-b3e25f84f7389a4bf31e6fce6ea427f984d6e757546266d0c908ef1a27a4c505 WatchSource:0}: Error finding container b3e25f84f7389a4bf31e6fce6ea427f984d6e757546266d0c908ef1a27a4c505: Status 404 returned error can't find the container with id b3e25f84f7389a4bf31e6fce6ea427f984d6e757546266d0c908ef1a27a4c505 Jul 08 19:01:46.438107 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.438029 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgnx2_2cb07635-ed09-4f4d-a7d5-fc56a8c9859f/dns-node-resolver/0.log" Jul 08 19:01:46.508054 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.508016 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:46.508218 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.508082 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:01:46.985976 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.985885 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6" event={"ID":"31f386ae-841a-4f4b-be35-b891ed799001","Type":"ContainerStarted","Data":"b3e25f84f7389a4bf31e6fce6ea427f984d6e757546266d0c908ef1a27a4c505"} Jul 08 19:01:46.987227 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.987211 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:01:46.987553 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:46.987535 2570 scope.go:117] "RemoveContainer" containerID="53f70c7a42c2745e80df5a46c1c338700470a94d7cb6e803ffad1d5afb693656" Jul 08 19:01:46.987728 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:46.987707 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8c8kn_openshift-console-operator(e0d192cc-aed5-434e-b755-a36efbd0e639)\"" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" podUID="e0d192cc-aed5-434e-b755-a36efbd0e639" Jul 08 19:01:47.176048 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:47.176002 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:47.176048 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:47.176046 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:47.176294 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:47.176162 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:01:47.176294 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:47.176225 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:01:47.176294 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:47.176240 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls podName:0f2f4a79-ddf3-4258-9e98-d8ec662155d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:49.176218973 +0000 UTC m=+54.952171423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x54s2" (UID: "0f2f4a79-ddf3-4258-9e98-d8ec662155d8") : secret "insights-runtime-extractor-tls" not found Jul 08 19:01:47.176294 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:47.176273 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm podName:0f2f4a79-ddf3-4258-9e98-d8ec662155d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:49.176261529 +0000 UTC m=+54.952213978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x54s2" (UID: "0f2f4a79-ddf3-4258-9e98-d8ec662155d8") : configmap "kube-rbac-proxy" not found Jul 08 19:01:47.635106 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:47.635076 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bd7xm_5f272e0f-0ed3-43f0-ae36-1456ca186b8c/node-ca/0.log" Jul 08 19:01:47.990603 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:47.990573 2570 scope.go:117] "RemoveContainer" containerID="53f70c7a42c2745e80df5a46c1c338700470a94d7cb6e803ffad1d5afb693656" Jul 08 19:01:47.991078 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:47.990782 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8c8kn_openshift-console-operator(e0d192cc-aed5-434e-b755-a36efbd0e639)\"" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" podUID="e0d192cc-aed5-434e-b755-a36efbd0e639" Jul 08 19:01:48.227398 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.227367 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-g4q9z"] Jul 08 19:01:48.239415 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.239388 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pxzvm_5ef26f7e-91d4-407a-88d0-d7ea9fcf666c/serve-healthcheck-canary/0.log" Jul 08 19:01:48.246355 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.246290 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-g4q9z"] Jul 08 19:01:48.246501 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.246379 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.248824 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.248806 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 08 19:01:48.248953 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.248838 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 08 19:01:48.248953 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.248845 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 08 19:01:48.249235 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.249219 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n4h2q\"" Jul 08 19:01:48.249299 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.249281 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 08 19:01:48.286492 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.286465 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b4bbae00-71c0-414d-ae53-ec083bc8b610-signing-cabundle\") pod \"service-ca-758f599c5-g4q9z\" (UID: \"b4bbae00-71c0-414d-ae53-ec083bc8b610\") " pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.286627 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.286539 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b4bbae00-71c0-414d-ae53-ec083bc8b610-signing-key\") pod \"service-ca-758f599c5-g4q9z\" (UID: \"b4bbae00-71c0-414d-ae53-ec083bc8b610\") " pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.286677 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.286648 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xdgm\" (UniqueName: \"kubernetes.io/projected/b4bbae00-71c0-414d-ae53-ec083bc8b610-kube-api-access-4xdgm\") pod \"service-ca-758f599c5-g4q9z\" (UID: \"b4bbae00-71c0-414d-ae53-ec083bc8b610\") " pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.387532 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.387497 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b4bbae00-71c0-414d-ae53-ec083bc8b610-signing-cabundle\") pod \"service-ca-758f599c5-g4q9z\" (UID: \"b4bbae00-71c0-414d-ae53-ec083bc8b610\") " pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.387708 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.387585 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b4bbae00-71c0-414d-ae53-ec083bc8b610-signing-key\") pod \"service-ca-758f599c5-g4q9z\" (UID: \"b4bbae00-71c0-414d-ae53-ec083bc8b610\") " pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.387769 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.387720 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xdgm\" (UniqueName: \"kubernetes.io/projected/b4bbae00-71c0-414d-ae53-ec083bc8b610-kube-api-access-4xdgm\") pod \"service-ca-758f599c5-g4q9z\" (UID: \"b4bbae00-71c0-414d-ae53-ec083bc8b610\") " pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.388235 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.388211 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b4bbae00-71c0-414d-ae53-ec083bc8b610-signing-cabundle\") pod \"service-ca-758f599c5-g4q9z\" (UID: \"b4bbae00-71c0-414d-ae53-ec083bc8b610\") " pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.390347 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.390325 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b4bbae00-71c0-414d-ae53-ec083bc8b610-signing-key\") pod \"service-ca-758f599c5-g4q9z\" (UID: \"b4bbae00-71c0-414d-ae53-ec083bc8b610\") " pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.395837 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.395813 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xdgm\" (UniqueName: \"kubernetes.io/projected/b4bbae00-71c0-414d-ae53-ec083bc8b610-kube-api-access-4xdgm\") pod \"service-ca-758f599c5-g4q9z\" (UID: \"b4bbae00-71c0-414d-ae53-ec083bc8b610\") " pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.556227 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.556136 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-g4q9z" Jul 08 19:01:48.755952 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.755922 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-g4q9z"] Jul 08 19:01:48.759015 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:01:48.758990 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4bbae00_71c0_414d_ae53_ec083bc8b610.slice/crio-d65c6f09f1002a9b647e0ef8e3c112c142b1059c0e533d6ea5e695fef3b27587 WatchSource:0}: Error finding container d65c6f09f1002a9b647e0ef8e3c112c142b1059c0e533d6ea5e695fef3b27587: Status 404 returned error can't find the container with id d65c6f09f1002a9b647e0ef8e3c112c142b1059c0e533d6ea5e695fef3b27587 Jul 08 19:01:48.995823 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.995792 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6" event={"ID":"31f386ae-841a-4f4b-be35-b891ed799001","Type":"ContainerStarted","Data":"6a2155deaa1af31b2070ba489bdd7c8d58ecd0e7e26f6fda1015f122b248bec9"} Jul 08 19:01:48.996247 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.995854 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6" event={"ID":"31f386ae-841a-4f4b-be35-b891ed799001","Type":"ContainerStarted","Data":"205b20c8d2bb76b00b3d26cacd93c4c0abce5a62421d13c1aab1618d432a9d29"} Jul 08 19:01:48.997506 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.997480 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-g4q9z" event={"ID":"b4bbae00-71c0-414d-ae53-ec083bc8b610","Type":"ContainerStarted","Data":"c340433344add6e63eb4b6542a3a8192768b75bb06788537427b9c994452c574"} Jul 08 19:01:48.997635 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:48.997529 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-g4q9z" event={"ID":"b4bbae00-71c0-414d-ae53-ec083bc8b610","Type":"ContainerStarted","Data":"d65c6f09f1002a9b647e0ef8e3c112c142b1059c0e533d6ea5e695fef3b27587"} Jul 08 19:01:49.019405 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:49.016866 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-299c6" podStartSLOduration=1.767854392 podStartE2EDuration="4.016845712s" totalImagesPullingTime="2.24899132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:49.014108126 +0000 UTC m=+54.790060598" watchObservedRunningTime="2026-07-08 19:01:49.016845712 +0000 UTC m=+54.792798185" Jul 08 19:01:49.032798 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:49.032740 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-g4q9z" podStartSLOduration=1.032722902 podStartE2EDuration="1.032722902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:49.03177393 +0000 UTC m=+54.807726402" watchObservedRunningTime="2026-07-08 19:01:49.032722902 +0000 UTC m=+54.808675376" Jul 08 19:01:49.193990 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:49.193948 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:49.193990 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:49.193989 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:49.194221 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:49.194071 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:01:49.194221 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:49.194121 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:01:49.194221 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:49.194142 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm podName:0f2f4a79-ddf3-4258-9e98-d8ec662155d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:53.194123001 +0000 UTC m=+58.970075453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x54s2" (UID: "0f2f4a79-ddf3-4258-9e98-d8ec662155d8") : configmap "kube-rbac-proxy" not found Jul 08 19:01:49.194221 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:49.194188 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls podName:0f2f4a79-ddf3-4258-9e98-d8ec662155d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:53.194169268 +0000 UTC m=+58.970121731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x54s2" (UID: "0f2f4a79-ddf3-4258-9e98-d8ec662155d8") : secret "insights-runtime-extractor-tls" not found Jul 08 19:01:52.024633 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:52.024591 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:01:52.025117 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:52.024717 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:01:52.025117 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.024777 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:01:52.025117 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.024802 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56ddc95c58-5mhvs: secret "image-registry-tls" not found Jul 08 19:01:52.025117 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.024851 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:52.025117 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.024876 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls podName:e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc nodeName:}" failed. No retries permitted until 2026-07-08 19:02:08.024851153 +0000 UTC m=+73.800803618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls") pod "image-registry-56ddc95c58-5mhvs" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc") : secret "image-registry-tls" not found Jul 08 19:01:52.025117 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:52.024910 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:01:52.025117 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.024921 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls podName:83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb nodeName:}" failed. No retries permitted until 2026-07-08 19:02:08.024905409 +0000 UTC m=+73.800857857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8sq" (UID: "83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb") : secret "cluster-monitoring-operator-tls" not found Jul 08 19:01:52.025117 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.024982 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:01:52.025117 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.025017 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls podName:c167b4f1-d95a-4ee5-8466-5a189a3600fb nodeName:}" failed. No retries permitted until 2026-07-08 19:02:08.025005045 +0000 UTC m=+73.800957497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls") pod "dns-default-tzqd2" (UID: "c167b4f1-d95a-4ee5-8466-5a189a3600fb") : secret "dns-default-metrics-tls" not found Jul 08 19:01:52.125978 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:52.125934 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:52.126184 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:52.126044 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:01:52.126184 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:52.126070 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:01:52.126184 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.126098 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 19:01:52.126184 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.126169 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:02:08.126150434 +0000 UTC m=+73.902102904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : secret "router-metrics-certs-default" not found Jul 08 19:01:52.126184 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.126181 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 19:01:52.126418 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.126195 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle podName:10997390-ded2-4c80-8d1f-2e6cc355830d nodeName:}" failed. No retries permitted until 2026-07-08 19:02:08.126179333 +0000 UTC m=+73.902131803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle") pod "router-default-64778d56b5-wngf5" (UID: "10997390-ded2-4c80-8d1f-2e6cc355830d") : configmap references non-existent config key: service-ca.crt Jul 08 19:01:52.126418 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.126198 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:01:52.126418 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.126219 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert podName:6fa83f9f-b701-4b0d-b47e-a49ae5340571 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:08.126208116 +0000 UTC m=+73.902160565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fsjh7" (UID: "6fa83f9f-b701-4b0d-b47e-a49ae5340571") : secret "networking-console-plugin-cert" not found Jul 08 19:01:52.126418 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:52.126246 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls podName:488e905f-34e0-4bfa-8593-ea7814dc79ab nodeName:}" failed. No retries permitted until 2026-07-08 19:02:08.12623466 +0000 UTC m=+73.902187109 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bs994" (UID: "488e905f-34e0-4bfa-8593-ea7814dc79ab") : secret "samples-operator-tls" not found Jul 08 19:01:52.126418 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:52.126103 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:01:53.235855 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:53.235821 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:53.236328 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:01:53.235869 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:01:53.236328 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:53.236006 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:01:53.236328 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:53.236040 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:01:53.236328 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:53.236076 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls podName:0f2f4a79-ddf3-4258-9e98-d8ec662155d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:01.236056637 +0000 UTC m=+67.012009088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x54s2" (UID: "0f2f4a79-ddf3-4258-9e98-d8ec662155d8") : secret "insights-runtime-extractor-tls" not found Jul 08 19:01:53.236328 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:01:53.236101 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm podName:0f2f4a79-ddf3-4258-9e98-d8ec662155d8 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:01.236083462 +0000 UTC m=+67.012035925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x54s2" (UID: "0f2f4a79-ddf3-4258-9e98-d8ec662155d8") : configmap "kube-rbac-proxy" not found Jul 08 19:02:00.408656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.408561 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:02:00.408656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.408641 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:02:00.411147 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.411128 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:02:00.411568 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.411551 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:02:00.421649 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.421609 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ceb9c45b-e849-4da2-a8a6-ad602bf66af9-metrics-certs\") pod \"network-metrics-daemon-wzntx\" (UID: \"ceb9c45b-e849-4da2-a8a6-ad602bf66af9\") " pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:02:00.421796 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.421609 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6573bd34-7a4b-42da-8126-b90510b483e4-original-pull-secret\") pod \"global-pull-secret-syncer-zflm9\" (UID: \"6573bd34-7a4b-42da-8126-b90510b483e4\") " pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:02:00.510033 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.509974 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nms9\" (UniqueName: \"kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9\") pod \"network-check-target-5hls6\" (UID: \"0fa43b64-fa90-427f-a7e3-666964b16bf8\") " pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:02:00.512619 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.512599 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nms9\" (UniqueName: \"kubernetes.io/projected/0fa43b64-fa90-427f-a7e3-666964b16bf8-kube-api-access-5nms9\") pod \"network-check-target-5hls6\" (UID: \"0fa43b64-fa90-427f-a7e3-666964b16bf8\") " pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:02:00.568073 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.568035 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-72lbb\"" Jul 08 19:02:00.576186 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.576163 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wzntx" Jul 08 19:02:00.577590 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.577564 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-db4b9\"" Jul 08 19:02:00.582013 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.581995 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zflm9" Jul 08 19:02:00.585760 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.585731 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:02:00.730964 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.730924 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zflm9"] Jul 08 19:02:00.734322 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:00.734295 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6573bd34_7a4b_42da_8126_b90510b483e4.slice/crio-25fc7bc8c7d1056e775a22ee7f6562683bbf52a02d8ba3946a29cecf97bff2e2 WatchSource:0}: Error finding container 25fc7bc8c7d1056e775a22ee7f6562683bbf52a02d8ba3946a29cecf97bff2e2: Status 404 returned error can't find the container with id 25fc7bc8c7d1056e775a22ee7f6562683bbf52a02d8ba3946a29cecf97bff2e2 Jul 08 19:02:00.914635 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.914610 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82474" Jul 08 19:02:00.948283 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.948202 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5hls6"] Jul 08 19:02:00.951490 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:00.951466 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wzntx"] Jul 08 19:02:00.951725 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:00.951703 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa43b64_fa90_427f_a7e3_666964b16bf8.slice/crio-b66716b1346677f9102ddb639545ab9a90fff5d2c20d35cd46b6a01e0c3b9a99 WatchSource:0}: Error finding container b66716b1346677f9102ddb639545ab9a90fff5d2c20d35cd46b6a01e0c3b9a99: Status 404 returned error can't find the container with id b66716b1346677f9102ddb639545ab9a90fff5d2c20d35cd46b6a01e0c3b9a99 Jul 08 19:02:00.954156 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:00.954139 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb9c45b_e849_4da2_a8a6_ad602bf66af9.slice/crio-40ea29f8f69632ddc2e438234a95a182d0ae3a462e6f8f3bdd0c9bd7ce92673b WatchSource:0}: Error finding container 40ea29f8f69632ddc2e438234a95a182d0ae3a462e6f8f3bdd0c9bd7ce92673b: Status 404 returned error can't find the container with id 40ea29f8f69632ddc2e438234a95a182d0ae3a462e6f8f3bdd0c9bd7ce92673b Jul 08 19:02:01.035723 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.035686 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5hls6" event={"ID":"0fa43b64-fa90-427f-a7e3-666964b16bf8","Type":"ContainerStarted","Data":"a0524eae4ca6f68f3ba0cc66c4e57595d7ed56f5fd1b5e8265177cf8701ba562"} Jul 08 19:02:01.035885 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.035746 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:02:01.035885 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.035766 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5hls6" event={"ID":"0fa43b64-fa90-427f-a7e3-666964b16bf8","Type":"ContainerStarted","Data":"b66716b1346677f9102ddb639545ab9a90fff5d2c20d35cd46b6a01e0c3b9a99"} Jul 08 19:02:01.036845 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.036810 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzntx" event={"ID":"ceb9c45b-e849-4da2-a8a6-ad602bf66af9","Type":"ContainerStarted","Data":"40ea29f8f69632ddc2e438234a95a182d0ae3a462e6f8f3bdd0c9bd7ce92673b"} Jul 08 19:02:01.037841 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.037821 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zflm9" event={"ID":"6573bd34-7a4b-42da-8126-b90510b483e4","Type":"ContainerStarted","Data":"25fc7bc8c7d1056e775a22ee7f6562683bbf52a02d8ba3946a29cecf97bff2e2"} Jul 08 19:02:01.052321 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.052276 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5hls6" podStartSLOduration=66.05226359 podStartE2EDuration="1m6.05226359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:01.051344238 +0000 UTC m=+66.827296709" watchObservedRunningTime="2026-07-08 19:02:01.05226359 +0000 UTC m=+66.828216105" Jul 08 19:02:01.317759 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.317659 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:02:01.317759 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.317702 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:02:01.318270 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.318245 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:02:01.320060 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.320034 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f2f4a79-ddf3-4258-9e98-d8ec662155d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54s2\" (UID: \"0f2f4a79-ddf3-4258-9e98-d8ec662155d8\") " pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:02:01.385073 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.385039 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bk24w\"" Jul 08 19:02:01.393675 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.393653 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x54s2" Jul 08 19:02:01.541926 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:01.541896 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x54s2"] Jul 08 19:02:01.545083 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:01.545049 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2f4a79_ddf3_4258_9e98_d8ec662155d8.slice/crio-91b86e221c64e2c9782963d5beb2b2c6a1af887c8d958f0985974ccda769a3e7 WatchSource:0}: Error finding container 91b86e221c64e2c9782963d5beb2b2c6a1af887c8d958f0985974ccda769a3e7: Status 404 returned error can't find the container with id 91b86e221c64e2c9782963d5beb2b2c6a1af887c8d958f0985974ccda769a3e7 Jul 08 19:02:02.044171 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:02.044086 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x54s2" event={"ID":"0f2f4a79-ddf3-4258-9e98-d8ec662155d8","Type":"ContainerStarted","Data":"91b86e221c64e2c9782963d5beb2b2c6a1af887c8d958f0985974ccda769a3e7"} Jul 08 19:02:02.751498 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:02.751075 2570 scope.go:117] "RemoveContainer" containerID="53f70c7a42c2745e80df5a46c1c338700470a94d7cb6e803ffad1d5afb693656" Jul 08 19:02:03.053336 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:03.052224 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzntx" event={"ID":"ceb9c45b-e849-4da2-a8a6-ad602bf66af9","Type":"ContainerStarted","Data":"771fbb0a6cfd9fba5108aef844777341a42db0a856a72486bc32ae997ac8ccf6"} Jul 08 19:02:03.053336 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:03.052300 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wzntx" event={"ID":"ceb9c45b-e849-4da2-a8a6-ad602bf66af9","Type":"ContainerStarted","Data":"e636b5be25c43aa009cd7f0420f4b07ef1c4e26cdfb04fa171ba67ffbb5b30f1"} Jul 08 19:02:03.055813 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:03.055789 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:02:03.055959 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:03.055873 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" event={"ID":"e0d192cc-aed5-434e-b755-a36efbd0e639","Type":"ContainerStarted","Data":"45ff44c8de6b4073d0eb0119a25e4fc8058a1b123a888470636ae6893b8e75b8"} Jul 08 19:02:03.057657 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:03.057622 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:02:03.074132 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:03.074074 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wzntx" podStartSLOduration=66.623528983 podStartE2EDuration="1m8.074053876s" totalImagesPullingTime="1.450524893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:03.072232836 +0000 UTC m=+68.848185334" watchObservedRunningTime="2026-07-08 19:02:03.074053876 +0000 UTC m=+68.850006351" Jul 08 19:02:03.338372 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:03.338297 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" Jul 08 19:02:03.370549 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:03.370477 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-8c8kn" podStartSLOduration=27.903640091 podStartE2EDuration="35.370427151s" totalImagesPullingTime="7.46678706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:03.09555167 +0000 UTC m=+68.871504144" watchObservedRunningTime="2026-07-08 19:02:03.370427151 +0000 UTC m=+69.146379625" Jul 08 19:02:08.075225 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.075183 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zflm9" event={"ID":"6573bd34-7a4b-42da-8126-b90510b483e4","Type":"ContainerStarted","Data":"cb8852090b7777c3f1924dd463c790b12175aa3227aa991010ec5b3a118bab4a"} Jul 08 19:02:08.076943 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.076911 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x54s2" event={"ID":"0f2f4a79-ddf3-4258-9e98-d8ec662155d8","Type":"ContainerStarted","Data":"30354f8345d816eb4d000073fb78a7d91b446569cd27ca5d9e70612a240d7a3a"} Jul 08 19:02:08.077055 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.076974 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x54s2" event={"ID":"0f2f4a79-ddf3-4258-9e98-d8ec662155d8","Type":"ContainerStarted","Data":"bc3fd075a42eb24111b67c38cf0168f25bf61d855e373e1df126d4c6b25c5ff8"} Jul 08 19:02:08.087312 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.087292 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:02:08.087393 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.087325 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:02:08.087494 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.087469 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:02:08.089777 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.089758 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") pod \"image-registry-56ddc95c58-5mhvs\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:02:08.089850 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.089790 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167b4f1-d95a-4ee5-8466-5a189a3600fb-metrics-tls\") pod \"dns-default-tzqd2\" (UID: \"c167b4f1-d95a-4ee5-8466-5a189a3600fb\") " pod="openshift-dns/dns-default-tzqd2" Jul 08 19:02:08.089885 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.089849 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8sq\" (UID: \"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:02:08.090839 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.090792 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zflm9" podStartSLOduration=66.437252095 podStartE2EDuration="1m13.09077549s" totalImagesPullingTime="6.653523395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:08.090229706 +0000 UTC m=+73.866182177" watchObservedRunningTime="2026-07-08 19:02:08.09077549 +0000 UTC m=+73.866727967" Jul 08 19:02:08.188642 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.188604 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:02:08.188642 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.188645 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:02:08.188837 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.188671 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:02:08.188837 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.188799 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:02:08.189355 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.189324 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10997390-ded2-4c80-8d1f-2e6cc355830d-service-ca-bundle\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:02:08.191221 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.191200 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10997390-ded2-4c80-8d1f-2e6cc355830d-metrics-certs\") pod \"router-default-64778d56b5-wngf5\" (UID: \"10997390-ded2-4c80-8d1f-2e6cc355830d\") " pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:02:08.191638 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.191622 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fa83f9f-b701-4b0d-b47e-a49ae5340571-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fsjh7\" (UID: \"6fa83f9f-b701-4b0d-b47e-a49ae5340571\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:02:08.191686 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.191623 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/488e905f-34e0-4bfa-8593-ea7814dc79ab-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bs994\" (UID: \"488e905f-34e0-4bfa-8593-ea7814dc79ab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:02:08.250800 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.250715 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pvj5b\"" Jul 08 19:02:08.259384 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.259364 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" Jul 08 19:02:08.261042 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.261025 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2wp6b\"" Jul 08 19:02:08.270094 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.270078 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:02:08.281158 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.281134 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgfwc\"" Jul 08 19:02:08.288787 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.288753 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tzqd2" Jul 08 19:02:08.334156 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.332850 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sthsh\"" Jul 08 19:02:08.341849 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.341624 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:02:08.380987 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.380839 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mnpp8\"" Jul 08 19:02:08.382321 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.381229 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qxpcc\"" Jul 08 19:02:08.382321 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.381422 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" Jul 08 19:02:08.382321 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.381710 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" Jul 08 19:02:08.458265 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.456814 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq"] Jul 08 19:02:08.462064 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:08.462015 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d705a3_ab7b_4a88_8b16_ed9ab5c2cadb.slice/crio-6e2cdd4e36f7b2cd6110707fa0ac6cc8c000bef3361448f5dcf88c677e441b19 WatchSource:0}: Error finding container 6e2cdd4e36f7b2cd6110707fa0ac6cc8c000bef3361448f5dcf88c677e441b19: Status 404 returned error can't find the container with id 6e2cdd4e36f7b2cd6110707fa0ac6cc8c000bef3361448f5dcf88c677e441b19 Jul 08 19:02:08.475803 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.475743 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56ddc95c58-5mhvs"] Jul 08 19:02:08.517471 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.516111 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tzqd2"] Jul 08 19:02:08.521965 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.520066 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h"] Jul 08 19:02:08.526593 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.526570 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4"] Jul 08 19:02:08.527046 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.526956 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" Jul 08 19:02:08.531538 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.530246 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq"] Jul 08 19:02:08.531538 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.530588 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 08 19:02:08.531538 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.530852 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 19:02:08.531538 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.531073 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ng7cs\"" Jul 08 19:02:08.531538 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.531311 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 19:02:08.533598 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.533173 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.533718 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.533701 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 19:02:08.538495 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.538476 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 08 19:02:08.545880 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.545506 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h"] Jul 08 19:02:08.545880 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.545541 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4"] Jul 08 19:02:08.545880 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.545572 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq"] Jul 08 19:02:08.545880 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.545682 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.550681 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.549736 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 19:02:08.550681 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.549836 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 19:02:08.550681 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.550004 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 19:02:08.550681 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.550044 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 19:02:08.603637 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.603608 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64778d56b5-wngf5"] Jul 08 19:02:08.605856 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:08.605815 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10997390_ded2_4c80_8d1f_2e6cc355830d.slice/crio-68b9071d94bded4c2861e2429f8f04fdb9064ac4c3799cf62ca22a93d5ffc945 WatchSource:0}: Error finding container 68b9071d94bded4c2861e2429f8f04fdb9064ac4c3799cf62ca22a93d5ffc945: Status 404 returned error can't find the container with id 68b9071d94bded4c2861e2429f8f04fdb9064ac4c3799cf62ca22a93d5ffc945 Jul 08 19:02:08.613486 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.613459 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-6259x"] Jul 08 19:02:08.615980 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.615956 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-6259x" Jul 08 19:02:08.619825 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.619801 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 19:02:08.619908 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.619852 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-npj5v\"" Jul 08 19:02:08.619975 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.619808 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 19:02:08.625608 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.625587 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994"] Jul 08 19:02:08.629571 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.629552 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-6259x"] Jul 08 19:02:08.644555 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.644531 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7"] Jul 08 19:02:08.648184 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:08.648148 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa83f9f_b701_4b0d_b47e_a49ae5340571.slice/crio-a40139154fc30a4ce9a5374f3d22cb6c500f2ce76df8ddbb9021f9995e38623c WatchSource:0}: Error finding container a40139154fc30a4ce9a5374f3d22cb6c500f2ce76df8ddbb9021f9995e38623c: Status 404 returned error can't find the container with id a40139154fc30a4ce9a5374f3d22cb6c500f2ce76df8ddbb9021f9995e38623c Jul 08 19:02:08.694850 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.694822 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.695009 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.694859 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fba1d159-cf99-4f76-a29e-24c7f67afb0c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h\" (UID: \"fba1d159-cf99-4f76-a29e-24c7f67afb0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" Jul 08 19:02:08.695009 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.694885 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2gvq\" (UniqueName: \"kubernetes.io/projected/fba1d159-cf99-4f76-a29e-24c7f67afb0c-kube-api-access-t2gvq\") pod \"managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h\" (UID: \"fba1d159-cf99-4f76-a29e-24c7f67afb0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" Jul 08 19:02:08.695009 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.694910 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-ca\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.695009 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.694933 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-hub\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.695009 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.694956 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.695176 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.695060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t95ms\" (UniqueName: \"kubernetes.io/projected/2311f6c3-06b0-49ae-9ae1-11a97129b50d-kube-api-access-t95ms\") pod \"downloads-685bfb5f64-6259x\" (UID: \"2311f6c3-06b0-49ae-9ae1-11a97129b50d\") " pod="openshift-console/downloads-685bfb5f64-6259x" Jul 08 19:02:08.695176 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.695089 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d09f3d0-a054-43ac-8b1b-849aecad44d3-tmp\") pod \"klusterlet-addon-workmgr-6897d5b4dc-jtpx4\" (UID: \"5d09f3d0-a054-43ac-8b1b-849aecad44d3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.695176 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.695108 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4mxw\" (UniqueName: \"kubernetes.io/projected/5d09f3d0-a054-43ac-8b1b-849aecad44d3-kube-api-access-h4mxw\") pod \"klusterlet-addon-workmgr-6897d5b4dc-jtpx4\" (UID: \"5d09f3d0-a054-43ac-8b1b-849aecad44d3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.695262 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.695187 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6483d0e-9c65-4513-8ba3-fd9da20e5412-additional-service-ca\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.695262 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.695241 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9fxr\" (UniqueName: \"kubernetes.io/projected/c6483d0e-9c65-4513-8ba3-fd9da20e5412-kube-api-access-s9fxr\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.695319 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.695270 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5d09f3d0-a054-43ac-8b1b-849aecad44d3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6897d5b4dc-jtpx4\" (UID: \"5d09f3d0-a054-43ac-8b1b-849aecad44d3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.795985 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.795901 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t95ms\" (UniqueName: \"kubernetes.io/projected/2311f6c3-06b0-49ae-9ae1-11a97129b50d-kube-api-access-t95ms\") pod \"downloads-685bfb5f64-6259x\" (UID: \"2311f6c3-06b0-49ae-9ae1-11a97129b50d\") " pod="openshift-console/downloads-685bfb5f64-6259x" Jul 08 19:02:08.795985 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.795937 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d09f3d0-a054-43ac-8b1b-849aecad44d3-tmp\") pod \"klusterlet-addon-workmgr-6897d5b4dc-jtpx4\" (UID: \"5d09f3d0-a054-43ac-8b1b-849aecad44d3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.795985 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.795957 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4mxw\" (UniqueName: \"kubernetes.io/projected/5d09f3d0-a054-43ac-8b1b-849aecad44d3-kube-api-access-h4mxw\") pod \"klusterlet-addon-workmgr-6897d5b4dc-jtpx4\" (UID: \"5d09f3d0-a054-43ac-8b1b-849aecad44d3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.796485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.795995 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6483d0e-9c65-4513-8ba3-fd9da20e5412-additional-service-ca\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.796485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.796034 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9fxr\" (UniqueName: \"kubernetes.io/projected/c6483d0e-9c65-4513-8ba3-fd9da20e5412-kube-api-access-s9fxr\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.796485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.796057 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5d09f3d0-a054-43ac-8b1b-849aecad44d3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6897d5b4dc-jtpx4\" (UID: \"5d09f3d0-a054-43ac-8b1b-849aecad44d3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.796485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.796111 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.796485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.796138 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fba1d159-cf99-4f76-a29e-24c7f67afb0c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h\" (UID: \"fba1d159-cf99-4f76-a29e-24c7f67afb0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" Jul 08 19:02:08.796485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.796163 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2gvq\" (UniqueName: \"kubernetes.io/projected/fba1d159-cf99-4f76-a29e-24c7f67afb0c-kube-api-access-t2gvq\") pod \"managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h\" (UID: \"fba1d159-cf99-4f76-a29e-24c7f67afb0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" Jul 08 19:02:08.796485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.796211 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-ca\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.796485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.796236 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-hub\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.796485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.796259 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.796485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.796350 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d09f3d0-a054-43ac-8b1b-849aecad44d3-tmp\") pod \"klusterlet-addon-workmgr-6897d5b4dc-jtpx4\" (UID: \"5d09f3d0-a054-43ac-8b1b-849aecad44d3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.797871 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.797543 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6483d0e-9c65-4513-8ba3-fd9da20e5412-additional-service-ca\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.799690 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.799617 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-ca\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.800752 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.800364 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fba1d159-cf99-4f76-a29e-24c7f67afb0c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h\" (UID: \"fba1d159-cf99-4f76-a29e-24c7f67afb0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" Jul 08 19:02:08.800752 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.800619 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-hub\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.800948 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.800822 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5d09f3d0-a054-43ac-8b1b-849aecad44d3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6897d5b4dc-jtpx4\" (UID: \"5d09f3d0-a054-43ac-8b1b-849aecad44d3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.801934 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.801911 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.802377 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.802353 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6483d0e-9c65-4513-8ba3-fd9da20e5412-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.809565 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.809535 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9fxr\" (UniqueName: \"kubernetes.io/projected/c6483d0e-9c65-4513-8ba3-fd9da20e5412-kube-api-access-s9fxr\") pod \"cluster-proxy-proxy-agent-99d7fc6f5-2p2mq\" (UID: \"c6483d0e-9c65-4513-8ba3-fd9da20e5412\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.810028 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.809942 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4mxw\" (UniqueName: \"kubernetes.io/projected/5d09f3d0-a054-43ac-8b1b-849aecad44d3-kube-api-access-h4mxw\") pod \"klusterlet-addon-workmgr-6897d5b4dc-jtpx4\" (UID: \"5d09f3d0-a054-43ac-8b1b-849aecad44d3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.810119 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.810036 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t95ms\" (UniqueName: \"kubernetes.io/projected/2311f6c3-06b0-49ae-9ae1-11a97129b50d-kube-api-access-t95ms\") pod \"downloads-685bfb5f64-6259x\" (UID: \"2311f6c3-06b0-49ae-9ae1-11a97129b50d\") " pod="openshift-console/downloads-685bfb5f64-6259x" Jul 08 19:02:08.810242 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.810224 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2gvq\" (UniqueName: \"kubernetes.io/projected/fba1d159-cf99-4f76-a29e-24c7f67afb0c-kube-api-access-t2gvq\") pod \"managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h\" (UID: \"fba1d159-cf99-4f76-a29e-24c7f67afb0c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" Jul 08 19:02:08.886256 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.886225 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" Jul 08 19:02:08.896935 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.896893 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:08.906815 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.906614 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" Jul 08 19:02:08.951960 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:08.951506 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-6259x" Jul 08 19:02:09.085718 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.085684 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h"] Jul 08 19:02:09.087737 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:09.087703 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfba1d159_cf99_4f76_a29e_24c7f67afb0c.slice/crio-8e8b3719247a96bc86f7cd5441f414e258f5145c65088ce9f144c14691b14a37 WatchSource:0}: Error finding container 8e8b3719247a96bc86f7cd5441f414e258f5145c65088ce9f144c14691b14a37: Status 404 returned error can't find the container with id 8e8b3719247a96bc86f7cd5441f414e258f5145c65088ce9f144c14691b14a37 Jul 08 19:02:09.093776 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.093742 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" event={"ID":"6fa83f9f-b701-4b0d-b47e-a49ae5340571","Type":"ContainerStarted","Data":"a40139154fc30a4ce9a5374f3d22cb6c500f2ce76df8ddbb9021f9995e38623c"} Jul 08 19:02:09.097847 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.097774 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tzqd2" event={"ID":"c167b4f1-d95a-4ee5-8466-5a189a3600fb","Type":"ContainerStarted","Data":"a3044b5a4052e546a54e077d042c01ca77737a00fd0a2e2b6e88722d3d0eaa86"} Jul 08 19:02:09.100724 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.100697 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64778d56b5-wngf5" event={"ID":"10997390-ded2-4c80-8d1f-2e6cc355830d","Type":"ContainerStarted","Data":"8b190908ac95a48a0877367278a4a7586ad51100014a379a901a3121dbe90cca"} Jul 08 19:02:09.100823 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.100745 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64778d56b5-wngf5" event={"ID":"10997390-ded2-4c80-8d1f-2e6cc355830d","Type":"ContainerStarted","Data":"68b9071d94bded4c2861e2429f8f04fdb9064ac4c3799cf62ca22a93d5ffc945"} Jul 08 19:02:09.102821 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.102730 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" event={"ID":"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc","Type":"ContainerStarted","Data":"6a43351661429806b229b788e6a2423a33f5d2c45ce05cdec5093212998ca379"} Jul 08 19:02:09.102821 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.102773 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" event={"ID":"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc","Type":"ContainerStarted","Data":"4ff19147a2b8c0e57172926202b6bc2a25622cb7da8576d5cb6ebd057f4d67e5"} Jul 08 19:02:09.102976 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.102827 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:02:09.104664 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.104606 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" event={"ID":"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb","Type":"ContainerStarted","Data":"6e2cdd4e36f7b2cd6110707fa0ac6cc8c000bef3361448f5dcf88c677e441b19"} Jul 08 19:02:09.105887 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.105863 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" event={"ID":"488e905f-34e0-4bfa-8593-ea7814dc79ab","Type":"ContainerStarted","Data":"c28cb8754ad67d2c17561179f21406ad7408243f5495c5429dc96052248eb446"} Jul 08 19:02:09.120714 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.120658 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64778d56b5-wngf5" podStartSLOduration=41.120637208 podStartE2EDuration="41.120637208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:09.119353647 +0000 UTC m=+74.895306119" watchObservedRunningTime="2026-07-08 19:02:09.120637208 +0000 UTC m=+74.896589681" Jul 08 19:02:09.139662 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.139607 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" podStartSLOduration=74.139586438 podStartE2EDuration="1m14.139586438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:09.139127463 +0000 UTC m=+74.915079958" watchObservedRunningTime="2026-07-08 19:02:09.139586438 +0000 UTC m=+74.915538909" Jul 08 19:02:09.182893 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.182857 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-6259x"] Jul 08 19:02:09.187251 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:09.187200 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2311f6c3_06b0_49ae_9ae1_11a97129b50d.slice/crio-4b00ea1e9dc7ccfc10323fab5df80de9810e048463ff5980b15972998c2694c5 WatchSource:0}: Error finding container 4b00ea1e9dc7ccfc10323fab5df80de9810e048463ff5980b15972998c2694c5: Status 404 returned error can't find the container with id 4b00ea1e9dc7ccfc10323fab5df80de9810e048463ff5980b15972998c2694c5 Jul 08 19:02:09.312162 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.312066 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4"] Jul 08 19:02:09.320483 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.319896 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq"] Jul 08 19:02:09.320483 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:09.319996 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d09f3d0_a054_43ac_8b1b_849aecad44d3.slice/crio-d526ff23daca65bd63fcc4637c619120fb9fe7de81947a6c8ba41e5da737d70d WatchSource:0}: Error finding container d526ff23daca65bd63fcc4637c619120fb9fe7de81947a6c8ba41e5da737d70d: Status 404 returned error can't find the container with id d526ff23daca65bd63fcc4637c619120fb9fe7de81947a6c8ba41e5da737d70d Jul 08 19:02:09.321933 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:09.321129 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6483d0e_9c65_4513_8ba3_fd9da20e5412.slice/crio-2b15570ed0933b198d8513a0934bea84a67c08132bc73beda75d885eae43d747 WatchSource:0}: Error finding container 2b15570ed0933b198d8513a0934bea84a67c08132bc73beda75d885eae43d747: Status 404 returned error can't find the container with id 2b15570ed0933b198d8513a0934bea84a67c08132bc73beda75d885eae43d747 Jul 08 19:02:09.343127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.343071 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:02:09.345884 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:09.345860 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:02:10.121586 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:10.121508 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" event={"ID":"5d09f3d0-a054-43ac-8b1b-849aecad44d3","Type":"ContainerStarted","Data":"d526ff23daca65bd63fcc4637c619120fb9fe7de81947a6c8ba41e5da737d70d"} Jul 08 19:02:10.124881 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:10.124844 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" event={"ID":"fba1d159-cf99-4f76-a29e-24c7f67afb0c","Type":"ContainerStarted","Data":"8e8b3719247a96bc86f7cd5441f414e258f5145c65088ce9f144c14691b14a37"} Jul 08 19:02:10.129571 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:10.129504 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" event={"ID":"c6483d0e-9c65-4513-8ba3-fd9da20e5412","Type":"ContainerStarted","Data":"2b15570ed0933b198d8513a0934bea84a67c08132bc73beda75d885eae43d747"} Jul 08 19:02:10.139676 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:10.139547 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-6259x" event={"ID":"2311f6c3-06b0-49ae-9ae1-11a97129b50d","Type":"ContainerStarted","Data":"4b00ea1e9dc7ccfc10323fab5df80de9810e048463ff5980b15972998c2694c5"} Jul 08 19:02:10.147748 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:10.139939 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:02:10.147748 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:10.141573 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64778d56b5-wngf5" Jul 08 19:02:20.186805 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.186763 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tzqd2" event={"ID":"c167b4f1-d95a-4ee5-8466-5a189a3600fb","Type":"ContainerStarted","Data":"c7b377660012d85883f4608cda5f365f62b261a033001cefc3be7e113ec95a07"} Jul 08 19:02:20.187286 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.186869 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tzqd2" event={"ID":"c167b4f1-d95a-4ee5-8466-5a189a3600fb","Type":"ContainerStarted","Data":"4338f8ff3e8dabb6ff982fdeff5e87c02736d4b5d85fe2ca25603794e0895a4f"} Jul 08 19:02:20.187286 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.186900 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tzqd2" Jul 08 19:02:20.189769 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.189734 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x54s2" event={"ID":"0f2f4a79-ddf3-4258-9e98-d8ec662155d8","Type":"ContainerStarted","Data":"2b2836a7cab13649c60438e2c5d82dee6c9519cc250249999eca0fea49f1fc3c"} Jul 08 19:02:20.192221 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.192192 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" event={"ID":"c6483d0e-9c65-4513-8ba3-fd9da20e5412","Type":"ContainerStarted","Data":"799b3014805d78bf4a42717af8efd120cf1adbd7ecde35f06c627799562dda4d"} Jul 08 19:02:20.192363 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.192237 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" event={"ID":"c6483d0e-9c65-4513-8ba3-fd9da20e5412","Type":"ContainerStarted","Data":"32ed86b67a364946399d06b65f6ac82fdbbc3c516d20e3a2b6f6750b7b2f57c3"} Jul 08 19:02:20.192363 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.192256 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" event={"ID":"c6483d0e-9c65-4513-8ba3-fd9da20e5412","Type":"ContainerStarted","Data":"7e5151278f8e5658bc25760f58160e32fa7d1e188f0e2670f68e24500e04e528"} Jul 08 19:02:20.194760 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.194730 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" event={"ID":"83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb","Type":"ContainerStarted","Data":"a058c939b6f8f1b5786adf571fbc0d56f9ae647824b82a1c9ee76ec4b1f336c2"} Jul 08 19:02:20.196401 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.196367 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" event={"ID":"5d09f3d0-a054-43ac-8b1b-849aecad44d3","Type":"ContainerStarted","Data":"1187015db613244ea7875db44b232814dde5fe3a4bc6ec5a6c54c07826299f53"} Jul 08 19:02:20.196552 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.196535 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:20.198524 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.198317 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" event={"ID":"fba1d159-cf99-4f76-a29e-24c7f67afb0c","Type":"ContainerStarted","Data":"363f6fa8420e6828c89515b6931dbbccca1224f65d813c971022d6d65ad70563"} Jul 08 19:02:20.198524 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.198493 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" Jul 08 19:02:20.200967 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.200939 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" event={"ID":"488e905f-34e0-4bfa-8593-ea7814dc79ab","Type":"ContainerStarted","Data":"99c251663dca0ae018b536a95c3fdf003b19645c9ae049c6a39947b25f197f26"} Jul 08 19:02:20.201065 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.200993 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" event={"ID":"488e905f-34e0-4bfa-8593-ea7814dc79ab","Type":"ContainerStarted","Data":"659b17999840600928658ed6373a5e64d56d538dfa9c1ada4456a9831777ccc7"} Jul 08 19:02:20.203030 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.203005 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" event={"ID":"6fa83f9f-b701-4b0d-b47e-a49ae5340571","Type":"ContainerStarted","Data":"0517ef834b9bc7a4bc4c522a71d5f3f145d532605f259bb4855a0d085e217d98"} Jul 08 19:02:20.216356 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.216304 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tzqd2" podStartSLOduration=33.506862578 podStartE2EDuration="44.216286518s" totalImagesPullingTime="10.70942394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:20.21525692 +0000 UTC m=+85.991209395" watchObservedRunningTime="2026-07-08 19:02:20.216286518 +0000 UTC m=+85.992238989" Jul 08 19:02:20.237514 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.237432 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6897d5b4dc-jtpx4" podStartSLOduration=2.292443017 podStartE2EDuration="12.23741455s" totalImagesPullingTime="9.944971533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:20.236304554 +0000 UTC m=+86.012257025" watchObservedRunningTime="2026-07-08 19:02:20.23741455 +0000 UTC m=+86.013367021" Jul 08 19:02:20.255888 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.255828 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fsjh7" podStartSLOduration=37.671062821 podStartE2EDuration="48.255809579s" totalImagesPullingTime="10.584746758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:20.255664913 +0000 UTC m=+86.031617385" watchObservedRunningTime="2026-07-08 19:02:20.255809579 +0000 UTC m=+86.031762049" Jul 08 19:02:20.319067 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.318289 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fdc8d45b-5wc5h" podStartSLOduration=2.158401794 podStartE2EDuration="12.318265278s" totalImagesPullingTime="10.159863484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:20.284181048 +0000 UTC m=+86.060133519" watchObservedRunningTime="2026-07-08 19:02:20.318265278 +0000 UTC m=+86.094217750" Jul 08 19:02:20.346530 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.346471 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8sq" podStartSLOduration=41.577284673 podStartE2EDuration="52.346451946s" totalImagesPullingTime="10.769167273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:20.34506516 +0000 UTC m=+86.121017630" watchObservedRunningTime="2026-07-08 19:02:20.346451946 +0000 UTC m=+86.122404408" Jul 08 19:02:20.346683 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.346591 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-99d7fc6f5-2p2mq" podStartSLOduration=2.428505127 podStartE2EDuration="12.346585713s" totalImagesPullingTime="9.918080586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:20.317754312 +0000 UTC m=+86.093706783" watchObservedRunningTime="2026-07-08 19:02:20.346585713 +0000 UTC m=+86.122538183" Jul 08 19:02:20.374119 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.374061 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bs994" podStartSLOduration=41.812461653 podStartE2EDuration="52.374038651s" totalImagesPullingTime="10.561576998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:20.372698365 +0000 UTC m=+86.148650837" watchObservedRunningTime="2026-07-08 19:02:20.374038651 +0000 UTC m=+86.149991123" Jul 08 19:02:20.400696 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:20.400627 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x54s2" podStartSLOduration=17.841511354 podStartE2EDuration="35.400606572s" totalImagesPullingTime="17.559095218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:20.39937644 +0000 UTC m=+86.175328912" watchObservedRunningTime="2026-07-08 19:02:20.400606572 +0000 UTC m=+86.176559044" Jul 08 19:02:28.274909 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:28.274873 2570 patch_prober.go:28] interesting pod/image-registry-56ddc95c58-5mhvs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 19:02:28.275390 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:28.274927 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" podUID="e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 19:02:30.145362 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:30.145330 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:02:30.210751 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:30.210712 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tzqd2" Jul 08 19:02:31.710484 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.710430 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tdrgk"] Jul 08 19:02:31.714197 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.714174 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.717312 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.716789 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 19:02:31.717312 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.717066 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 19:02:31.717312 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.717251 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 19:02:31.717616 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.717538 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hngkx\"" Jul 08 19:02:31.717616 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.717554 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 19:02:31.798767 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.798729 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205a80d1-bab5-4b71-9bc0-59a4f53715b9-metrics-client-ca\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.798956 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.798780 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql52x\" (UniqueName: \"kubernetes.io/projected/205a80d1-bab5-4b71-9bc0-59a4f53715b9-kube-api-access-ql52x\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.798956 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.798812 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-tls\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.798956 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.798861 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/205a80d1-bab5-4b71-9bc0-59a4f53715b9-root\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.798956 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.798895 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.798956 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.798935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.799207 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.798991 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-textfile\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.799207 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.799013 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-wtmp\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.799207 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.799042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/205a80d1-bab5-4b71-9bc0-59a4f53715b9-sys\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.899553 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205a80d1-bab5-4b71-9bc0-59a4f53715b9-metrics-client-ca\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.899608 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql52x\" (UniqueName: \"kubernetes.io/projected/205a80d1-bab5-4b71-9bc0-59a4f53715b9-kube-api-access-ql52x\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.899641 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-tls\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.899690 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/205a80d1-bab5-4b71-9bc0-59a4f53715b9-root\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.899725 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.899753 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.899799 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-textfile\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.899820 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-wtmp\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.899845 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/205a80d1-bab5-4b71-9bc0-59a4f53715b9-sys\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.899924 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/205a80d1-bab5-4b71-9bc0-59a4f53715b9-sys\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.900565 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/205a80d1-bab5-4b71-9bc0-59a4f53715b9-root\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.900944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.900722 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-wtmp\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.901485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.901024 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.901485 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:02:31.901216 2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 19:02:31.901485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.901261 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-textfile\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.901485 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:02:31.901278 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-tls podName:205a80d1-bab5-4b71-9bc0-59a4f53715b9 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:32.401258536 +0000 UTC m=+98.177210989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-tls") pod "node-exporter-tdrgk" (UID: "205a80d1-bab5-4b71-9bc0-59a4f53715b9") : secret "node-exporter-tls" not found Jul 08 19:02:31.901697 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.901593 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205a80d1-bab5-4b71-9bc0-59a4f53715b9-metrics-client-ca\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.903466 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.903413 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:31.924706 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:31.924650 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql52x\" (UniqueName: \"kubernetes.io/projected/205a80d1-bab5-4b71-9bc0-59a4f53715b9-kube-api-access-ql52x\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:32.047705 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:32.047579 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5hls6" Jul 08 19:02:32.407641 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:32.407536 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-tls\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:32.410389 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:32.410366 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/205a80d1-bab5-4b71-9bc0-59a4f53715b9-node-exporter-tls\") pod \"node-exporter-tdrgk\" (UID: \"205a80d1-bab5-4b71-9bc0-59a4f53715b9\") " pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:32.627258 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:32.627216 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tdrgk" Jul 08 19:02:33.159999 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:33.159953 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56ddc95c58-5mhvs"] Jul 08 19:02:37.313207 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:02:37.313159 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205a80d1_bab5_4b71_9bc0_59a4f53715b9.slice/crio-79a994be0dfe449eaf225157f08032806685478372ca63839ee10937c21a803e WatchSource:0}: Error finding container 79a994be0dfe449eaf225157f08032806685478372ca63839ee10937c21a803e: Status 404 returned error can't find the container with id 79a994be0dfe449eaf225157f08032806685478372ca63839ee10937c21a803e Jul 08 19:02:38.293162 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:38.293049 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdrgk" event={"ID":"205a80d1-bab5-4b71-9bc0-59a4f53715b9","Type":"ContainerStarted","Data":"79a994be0dfe449eaf225157f08032806685478372ca63839ee10937c21a803e"} Jul 08 19:02:38.294920 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:38.294858 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-6259x" event={"ID":"2311f6c3-06b0-49ae-9ae1-11a97129b50d","Type":"ContainerStarted","Data":"48962a58572cc1aed6ca70c5c07832a3d542a886f40b1f14b205a5480829a249"} Jul 08 19:02:38.295385 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:38.295358 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-6259x" Jul 08 19:02:38.307691 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:38.307628 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-6259x" Jul 08 19:02:38.320549 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:38.320407 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-6259x" podStartSLOduration=1.803202999 podStartE2EDuration="30.320385999s" totalImagesPullingTime="28.517183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:38.317772116 +0000 UTC m=+104.093724587" watchObservedRunningTime="2026-07-08 19:02:38.320385999 +0000 UTC m=+104.096338472" Jul 08 19:02:39.305114 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:39.305002 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdrgk" event={"ID":"205a80d1-bab5-4b71-9bc0-59a4f53715b9","Type":"ContainerStarted","Data":"dab405c45018d1801efda6adb5442ea9c66f04db34b16fcba66951e8069d816f"} Jul 08 19:02:40.311276 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:40.311241 2570 generic.go:356] "Generic (PLEG): container finished" podID="205a80d1-bab5-4b71-9bc0-59a4f53715b9" containerID="dab405c45018d1801efda6adb5442ea9c66f04db34b16fcba66951e8069d816f" exitCode=0 Jul 08 19:02:40.311795 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:40.311344 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdrgk" event={"ID":"205a80d1-bab5-4b71-9bc0-59a4f53715b9","Type":"ContainerDied","Data":"dab405c45018d1801efda6adb5442ea9c66f04db34b16fcba66951e8069d816f"} Jul 08 19:02:41.318935 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:41.318896 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdrgk" event={"ID":"205a80d1-bab5-4b71-9bc0-59a4f53715b9","Type":"ContainerStarted","Data":"36c00865e1b2de696f23e8d53b4e880fa3846bd8800bdf5d2bf76157cf0b54ea"} Jul 08 19:02:41.319390 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:41.318961 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdrgk" event={"ID":"205a80d1-bab5-4b71-9bc0-59a4f53715b9","Type":"ContainerStarted","Data":"bfa8f7f9c41c4a8a98c7f1c627f28697804cf3c9b56f5ba02113e7374b9eff76"} Jul 08 19:02:41.351211 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:41.345484 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tdrgk" podStartSLOduration=8.496770925 podStartE2EDuration="10.345460853s" totalImagesPullingTime="1.728689211s" totalInitContainerRuntime="120.000717ms" isStatefulPod=true podCreationTimestamp="2026-07-08 19:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:41.341841736 +0000 UTC m=+107.117794232" watchObservedRunningTime="2026-07-08 19:02:41.345460853 +0000 UTC m=+107.121413326" Jul 08 19:02:50.359646 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:50.359548 2570 generic.go:356] "Generic (PLEG): container finished" podID="b01866af-cfdb-4883-bcd3-2f6d0f7a98f1" containerID="26b959886e99d9a66ca981875b8437f8f58ae789f3d1f7fc7f3421b244e8cc00" exitCode=0 Jul 08 19:02:50.359646 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:50.359601 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" event={"ID":"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1","Type":"ContainerDied","Data":"26b959886e99d9a66ca981875b8437f8f58ae789f3d1f7fc7f3421b244e8cc00"} Jul 08 19:02:50.360105 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:50.359918 2570 scope.go:117] "RemoveContainer" containerID="26b959886e99d9a66ca981875b8437f8f58ae789f3d1f7fc7f3421b244e8cc00" Jul 08 19:02:50.976778 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:50.976737 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-bs994_488e905f-34e0-4bfa-8593-ea7814dc79ab/cluster-samples-operator/0.log" Jul 08 19:02:50.989978 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:50.989949 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-bs994_488e905f-34e0-4bfa-8593-ea7814dc79ab/cluster-samples-operator-watch/0.log" Jul 08 19:02:51.365543 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:51.365433 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-f28q6" event={"ID":"b01866af-cfdb-4883-bcd3-2f6d0f7a98f1","Type":"ContainerStarted","Data":"cba1747e9f6eb9ed3c400f61dd824b4488464865125fd4f834d4993a5dcd01c6"} Jul 08 19:02:55.382279 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:55.382198 2570 generic.go:356] "Generic (PLEG): container finished" podID="4cf28b91-47d9-4dc5-8eee-80defdeddea6" containerID="664a17474578c3fa0bf8cfe8f486a56c26731c3732f8372fc570893be78c2bf0" exitCode=0 Jul 08 19:02:55.382663 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:55.382271 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" event={"ID":"4cf28b91-47d9-4dc5-8eee-80defdeddea6","Type":"ContainerDied","Data":"664a17474578c3fa0bf8cfe8f486a56c26731c3732f8372fc570893be78c2bf0"} Jul 08 19:02:55.382704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:55.382663 2570 scope.go:117] "RemoveContainer" containerID="664a17474578c3fa0bf8cfe8f486a56c26731c3732f8372fc570893be78c2bf0" Jul 08 19:02:56.388419 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:56.388383 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-b75bb" event={"ID":"4cf28b91-47d9-4dc5-8eee-80defdeddea6","Type":"ContainerStarted","Data":"44d93704eef33cb589fde2a85dc370c6e6f6955f5f635cde805f1f50e155cb3a"} Jul 08 19:02:58.184983 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.184919 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" podUID="e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" containerName="registry" containerID="cri-o://6a43351661429806b229b788e6a2423a33f5d2c45ce05cdec5093212998ca379" gracePeriod=30 Jul 08 19:02:58.399140 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.399104 2570 generic.go:356] "Generic (PLEG): container finished" podID="e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" containerID="6a43351661429806b229b788e6a2423a33f5d2c45ce05cdec5093212998ca379" exitCode=0 Jul 08 19:02:58.399320 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.399148 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" event={"ID":"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc","Type":"ContainerDied","Data":"6a43351661429806b229b788e6a2423a33f5d2c45ce05cdec5093212998ca379"} Jul 08 19:02:58.472960 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.472927 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:02:58.556757 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.556714 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v7v7\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-kube-api-access-4v7v7\") pod \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " Jul 08 19:02:58.556757 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.556756 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-ca-trust-extracted\") pod \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " Jul 08 19:02:58.556987 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.556794 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-bound-sa-token\") pod \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " Jul 08 19:02:58.556987 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.556832 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-trusted-ca\") pod \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " Jul 08 19:02:58.556987 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.556892 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-image-registry-private-configuration\") pod \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " Jul 08 19:02:58.556987 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.556924 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-certificates\") pod \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " Jul 08 19:02:58.556987 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.556974 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-installation-pull-secrets\") pod \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " Jul 08 19:02:58.557246 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.557029 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") pod \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\" (UID: \"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc\") " Jul 08 19:02:58.557531 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.557475 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:02:58.557827 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.557604 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:02:58.559953 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.559909 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:02:58.560079 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.560007 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:02:58.560138 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.560075 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-kube-api-access-4v7v7" (OuterVolumeSpecName: "kube-api-access-4v7v7") pod "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc"). InnerVolumeSpecName "kube-api-access-4v7v7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:02:58.560138 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.560095 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:02:58.560205 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.560180 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:02:58.565915 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.565891 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" (UID: "e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:02:58.658527 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.658492 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-bound-sa-token\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:02:58.658527 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.658523 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-trusted-ca\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:02:58.658527 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.658534 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-image-registry-private-configuration\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:02:58.658755 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.658543 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-certificates\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:02:58.658755 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.658553 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-installation-pull-secrets\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:02:58.658755 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.658561 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-registry-tls\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:02:58.658755 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.658569 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v7v7\" (UniqueName: \"kubernetes.io/projected/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-kube-api-access-4v7v7\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:02:58.658755 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:58.658577 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc-ca-trust-extracted\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:02:59.404597 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:59.404561 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" event={"ID":"e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc","Type":"ContainerDied","Data":"4ff19147a2b8c0e57172926202b6bc2a25622cb7da8576d5cb6ebd057f4d67e5"} Jul 08 19:02:59.404597 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:59.404593 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56ddc95c58-5mhvs" Jul 08 19:02:59.405232 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:59.404619 2570 scope.go:117] "RemoveContainer" containerID="6a43351661429806b229b788e6a2423a33f5d2c45ce05cdec5093212998ca379" Jul 08 19:02:59.424428 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:59.424400 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56ddc95c58-5mhvs"] Jul 08 19:02:59.432113 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:02:59.432089 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56ddc95c58-5mhvs"] Jul 08 19:03:00.755667 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:03:00.755630 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" path="/var/lib/kubelet/pods/e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc/volumes" Jul 08 19:03:10.452714 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:03:10.452680 2570 generic.go:356] "Generic (PLEG): container finished" podID="22df694d-ac54-4092-ac48-0e20ef2b935d" containerID="a96c1550d8a41090befc8caac4de88168286bb1eeacc6a791ac6de7c9dfce0e1" exitCode=0 Jul 08 19:03:10.453087 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:03:10.452753 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" event={"ID":"22df694d-ac54-4092-ac48-0e20ef2b935d","Type":"ContainerDied","Data":"a96c1550d8a41090befc8caac4de88168286bb1eeacc6a791ac6de7c9dfce0e1"} Jul 08 19:03:10.453087 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:03:10.453078 2570 scope.go:117] "RemoveContainer" containerID="a96c1550d8a41090befc8caac4de88168286bb1eeacc6a791ac6de7c9dfce0e1" Jul 08 19:03:11.464287 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:03:11.464251 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jrfj8" event={"ID":"22df694d-ac54-4092-ac48-0e20ef2b935d","Type":"ContainerStarted","Data":"5de94127ed5ec63787ed40dd324ab49b83132882c20793ba12a9d2834e2dc550"} Jul 08 19:05:54.651673 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:05:54.651646 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:05:54.660774 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:05:54.660751 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:05:54.661927 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:05:54.661902 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 19:06:06.754794 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.754760 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm"] Jul 08 19:06:06.756142 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.755074 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" containerName="registry" Jul 08 19:06:06.756142 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.755091 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" containerName="registry" Jul 08 19:06:06.756142 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.755148 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e521d4c3-8c55-4c9d-b2fb-0acc1c3ca7fc" containerName="registry" Jul 08 19:06:06.757016 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.756997 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:06.759342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.759310 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 19:06:06.759520 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.759319 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 19:06:06.759520 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.759417 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-np4sl\"" Jul 08 19:06:06.759821 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.759549 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 19:06:06.759821 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.759610 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 19:06:06.769733 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.769708 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm"] Jul 08 19:06:06.913728 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.913691 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c33c1230-3a74-4eb6-8226-8dea023e0b84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:06.913944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.913737 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33c1230-3a74-4eb6-8226-8dea023e0b84-tmp\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:06.913944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.913780 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56fr4\" (UniqueName: \"kubernetes.io/projected/c33c1230-3a74-4eb6-8226-8dea023e0b84-kube-api-access-56fr4\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:06.913944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.913836 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c33c1230-3a74-4eb6-8226-8dea023e0b84-webhook-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:06.913944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:06.913865 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c33c1230-3a74-4eb6-8226-8dea023e0b84-manifests\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.014587 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.014500 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c33c1230-3a74-4eb6-8226-8dea023e0b84-webhook-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.014587 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.014542 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c33c1230-3a74-4eb6-8226-8dea023e0b84-manifests\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.014587 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.014578 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c33c1230-3a74-4eb6-8226-8dea023e0b84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.014785 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.014607 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33c1230-3a74-4eb6-8226-8dea023e0b84-tmp\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.014785 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.014640 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56fr4\" (UniqueName: \"kubernetes.io/projected/c33c1230-3a74-4eb6-8226-8dea023e0b84-kube-api-access-56fr4\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.015042 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.015010 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c33c1230-3a74-4eb6-8226-8dea023e0b84-manifests\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.017200 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.017177 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c33c1230-3a74-4eb6-8226-8dea023e0b84-tmp\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.017339 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.017321 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c33c1230-3a74-4eb6-8226-8dea023e0b84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.017542 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.017523 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c33c1230-3a74-4eb6-8226-8dea023e0b84-webhook-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.023762 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.023733 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56fr4\" (UniqueName: \"kubernetes.io/projected/c33c1230-3a74-4eb6-8226-8dea023e0b84-kube-api-access-56fr4\") pod \"opendatahub-operator-controller-manager-9dc45487-9w4cm\" (UID: \"c33c1230-3a74-4eb6-8226-8dea023e0b84\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.067411 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.067372 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:07.212019 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.211990 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm"] Jul 08 19:06:07.215332 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:06:07.215127 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33c1230_3a74_4eb6_8226_8dea023e0b84.slice/crio-7ba9bd839e44767520a3a3fbebddb19cf2810ab4d67d61e5ebb11bea4313ec9e WatchSource:0}: Error finding container 7ba9bd839e44767520a3a3fbebddb19cf2810ab4d67d61e5ebb11bea4313ec9e: Status 404 returned error can't find the container with id 7ba9bd839e44767520a3a3fbebddb19cf2810ab4d67d61e5ebb11bea4313ec9e Jul 08 19:06:07.217182 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:07.217161 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:06:08.155701 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:08.155655 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" event={"ID":"c33c1230-3a74-4eb6-8226-8dea023e0b84","Type":"ContainerStarted","Data":"7ba9bd839e44767520a3a3fbebddb19cf2810ab4d67d61e5ebb11bea4313ec9e"} Jul 08 19:06:11.170844 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:11.170806 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" event={"ID":"c33c1230-3a74-4eb6-8226-8dea023e0b84","Type":"ContainerStarted","Data":"5fe87e2c49d15702f3c6f777e46c7bd4c6754ec5e1f54254416a68c4927538b0"} Jul 08 19:06:12.176398 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:12.176357 2570 generic.go:356] "Generic (PLEG): container finished" podID="c33c1230-3a74-4eb6-8226-8dea023e0b84" containerID="5fe87e2c49d15702f3c6f777e46c7bd4c6754ec5e1f54254416a68c4927538b0" exitCode=0 Jul 08 19:06:12.176829 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:12.176471 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" event={"ID":"c33c1230-3a74-4eb6-8226-8dea023e0b84","Type":"ContainerDied","Data":"5fe87e2c49d15702f3c6f777e46c7bd4c6754ec5e1f54254416a68c4927538b0"} Jul 08 19:06:13.182538 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:13.182492 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" event={"ID":"c33c1230-3a74-4eb6-8226-8dea023e0b84","Type":"ContainerStarted","Data":"3fd98ad4d3c7d4426f8258c2f94d1985339ed34073827f810db63705a5cdebc4"} Jul 08 19:06:13.182984 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:13.182665 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:13.203046 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:13.203000 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" podStartSLOduration=2.970370909 podStartE2EDuration="7.202984538s" totalImagesPullingTime="3.213436711s" totalInitContainerRuntime="1.019176918s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:13.202053884 +0000 UTC m=+318.978006379" watchObservedRunningTime="2026-07-08 19:06:13.202984538 +0000 UTC m=+318.978937010" Jul 08 19:06:24.189931 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:24.189894 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-9w4cm" Jul 08 19:06:26.124917 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.124882 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf"] Jul 08 19:06:26.131671 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.131646 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.134403 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.134381 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 19:06:26.134559 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.134381 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 19:06:26.134559 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.134417 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kqqnn\"" Jul 08 19:06:26.147823 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.147798 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf"] Jul 08 19:06:26.174278 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.174254 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4zcb\" (UniqueName: \"kubernetes.io/projected/912fa866-801d-4d31-bb36-d6bdab2322d8-kube-api-access-q4zcb\") pod \"kube-auth-proxy-9cd5f7d96-8tcgf\" (UID: \"912fa866-801d-4d31-bb36-d6bdab2322d8\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.174457 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.174295 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/912fa866-801d-4d31-bb36-d6bdab2322d8-tls-certs\") pod \"kube-auth-proxy-9cd5f7d96-8tcgf\" (UID: \"912fa866-801d-4d31-bb36-d6bdab2322d8\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.174457 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.174316 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/912fa866-801d-4d31-bb36-d6bdab2322d8-tmp\") pod \"kube-auth-proxy-9cd5f7d96-8tcgf\" (UID: \"912fa866-801d-4d31-bb36-d6bdab2322d8\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.275430 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.275396 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4zcb\" (UniqueName: \"kubernetes.io/projected/912fa866-801d-4d31-bb36-d6bdab2322d8-kube-api-access-q4zcb\") pod \"kube-auth-proxy-9cd5f7d96-8tcgf\" (UID: \"912fa866-801d-4d31-bb36-d6bdab2322d8\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.275622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.275457 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/912fa866-801d-4d31-bb36-d6bdab2322d8-tls-certs\") pod \"kube-auth-proxy-9cd5f7d96-8tcgf\" (UID: \"912fa866-801d-4d31-bb36-d6bdab2322d8\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.275622 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.275610 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/912fa866-801d-4d31-bb36-d6bdab2322d8-tmp\") pod \"kube-auth-proxy-9cd5f7d96-8tcgf\" (UID: \"912fa866-801d-4d31-bb36-d6bdab2322d8\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.277832 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.277810 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/912fa866-801d-4d31-bb36-d6bdab2322d8-tmp\") pod \"kube-auth-proxy-9cd5f7d96-8tcgf\" (UID: \"912fa866-801d-4d31-bb36-d6bdab2322d8\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.277968 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.277951 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/912fa866-801d-4d31-bb36-d6bdab2322d8-tls-certs\") pod \"kube-auth-proxy-9cd5f7d96-8tcgf\" (UID: \"912fa866-801d-4d31-bb36-d6bdab2322d8\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.283931 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.283906 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4zcb\" (UniqueName: \"kubernetes.io/projected/912fa866-801d-4d31-bb36-d6bdab2322d8-kube-api-access-q4zcb\") pod \"kube-auth-proxy-9cd5f7d96-8tcgf\" (UID: \"912fa866-801d-4d31-bb36-d6bdab2322d8\") " pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.443303 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.443274 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" Jul 08 19:06:26.445989 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.445968 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mxh69"] Jul 08 19:06:26.448162 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.448147 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" Jul 08 19:06:26.450507 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.450488 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-g56fp\"" Jul 08 19:06:26.451530 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.451506 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 08 19:06:26.462398 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.462374 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mxh69"] Jul 08 19:06:26.578483 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.578424 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3182457d-49f3-4090-9360-69341a5a9e79-cert\") pod \"odh-model-controller-7998c67dc4-mxh69\" (UID: \"3182457d-49f3-4090-9360-69341a5a9e79\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" Jul 08 19:06:26.578672 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.578606 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hzjk\" (UniqueName: \"kubernetes.io/projected/3182457d-49f3-4090-9360-69341a5a9e79-kube-api-access-4hzjk\") pod \"odh-model-controller-7998c67dc4-mxh69\" (UID: \"3182457d-49f3-4090-9360-69341a5a9e79\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" Jul 08 19:06:26.588290 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.588266 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf"] Jul 08 19:06:26.589838 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:06:26.589810 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912fa866_801d_4d31_bb36_d6bdab2322d8.slice/crio-f90622f580e3794effad8fd9b51aac419eef605b6d0d46181d1b9910e6c9f70c WatchSource:0}: Error finding container f90622f580e3794effad8fd9b51aac419eef605b6d0d46181d1b9910e6c9f70c: Status 404 returned error can't find the container with id f90622f580e3794effad8fd9b51aac419eef605b6d0d46181d1b9910e6c9f70c Jul 08 19:06:26.680028 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.679994 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3182457d-49f3-4090-9360-69341a5a9e79-cert\") pod \"odh-model-controller-7998c67dc4-mxh69\" (UID: \"3182457d-49f3-4090-9360-69341a5a9e79\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" Jul 08 19:06:26.680230 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.680058 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzjk\" (UniqueName: \"kubernetes.io/projected/3182457d-49f3-4090-9360-69341a5a9e79-kube-api-access-4hzjk\") pod \"odh-model-controller-7998c67dc4-mxh69\" (UID: \"3182457d-49f3-4090-9360-69341a5a9e79\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" Jul 08 19:06:26.682579 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.682555 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3182457d-49f3-4090-9360-69341a5a9e79-cert\") pod \"odh-model-controller-7998c67dc4-mxh69\" (UID: \"3182457d-49f3-4090-9360-69341a5a9e79\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" Jul 08 19:06:26.694934 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.694883 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hzjk\" (UniqueName: \"kubernetes.io/projected/3182457d-49f3-4090-9360-69341a5a9e79-kube-api-access-4hzjk\") pod \"odh-model-controller-7998c67dc4-mxh69\" (UID: \"3182457d-49f3-4090-9360-69341a5a9e79\") " pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" Jul 08 19:06:26.777429 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.777390 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" Jul 08 19:06:26.919393 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:26.919361 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mxh69"] Jul 08 19:06:26.922298 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:06:26.922267 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3182457d_49f3_4090_9360_69341a5a9e79.slice/crio-a40b185f19df9a0d9bf732cba1fc9d45e469e2eb77cfc25d7918c8f8a1cd7ef0 WatchSource:0}: Error finding container a40b185f19df9a0d9bf732cba1fc9d45e469e2eb77cfc25d7918c8f8a1cd7ef0: Status 404 returned error can't find the container with id a40b185f19df9a0d9bf732cba1fc9d45e469e2eb77cfc25d7918c8f8a1cd7ef0 Jul 08 19:06:27.244038 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.244001 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" event={"ID":"3182457d-49f3-4090-9360-69341a5a9e79","Type":"ContainerStarted","Data":"a40b185f19df9a0d9bf732cba1fc9d45e469e2eb77cfc25d7918c8f8a1cd7ef0"} Jul 08 19:06:27.245341 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.245314 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" event={"ID":"912fa866-801d-4d31-bb36-d6bdab2322d8","Type":"ContainerStarted","Data":"f90622f580e3794effad8fd9b51aac419eef605b6d0d46181d1b9910e6c9f70c"} Jul 08 19:06:27.365595 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.365558 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pclpf"] Jul 08 19:06:27.367626 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.367611 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" Jul 08 19:06:27.369683 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.369662 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 19:06:27.381123 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.381099 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pclpf"] Jul 08 19:06:27.483272 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.483237 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-892xw"] Jul 08 19:06:27.485748 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.485724 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.487332 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.487304 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c49ccd-c1d1-4cc5-869d-24a0e4802821-tls-certs\") pod \"model-serving-api-54d89bd5fc-pclpf\" (UID: \"09c49ccd-c1d1-4cc5-869d-24a0e4802821\") " pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" Jul 08 19:06:27.487523 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.487369 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrv2l\" (UniqueName: \"kubernetes.io/projected/09c49ccd-c1d1-4cc5-869d-24a0e4802821-kube-api-access-mrv2l\") pod \"model-serving-api-54d89bd5fc-pclpf\" (UID: \"09c49ccd-c1d1-4cc5-869d-24a0e4802821\") " pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" Jul 08 19:06:27.487906 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.487724 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 19:06:27.487906 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.487745 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 19:06:27.487906 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.487867 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-q79pb\"" Jul 08 19:06:27.487906 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.487894 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 19:06:27.488165 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.487949 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 19:06:27.499105 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.499048 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-892xw"] Jul 08 19:06:27.588359 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.588326 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrv2l\" (UniqueName: \"kubernetes.io/projected/09c49ccd-c1d1-4cc5-869d-24a0e4802821-kube-api-access-mrv2l\") pod \"model-serving-api-54d89bd5fc-pclpf\" (UID: \"09c49ccd-c1d1-4cc5-869d-24a0e4802821\") " pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" Jul 08 19:06:27.588359 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.588364 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0689d3-8417-4686-b576-3a0661d2fc3a-local-certs\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.588602 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.588416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.588602 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.588434 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-token\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.588602 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.588489 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.588602 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.588518 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2gsq\" (UniqueName: \"kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-kube-api-access-n2gsq\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.588602 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.588538 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-cacerts\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.588602 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.588565 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.588854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.588673 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c49ccd-c1d1-4cc5-869d-24a0e4802821-tls-certs\") pod \"model-serving-api-54d89bd5fc-pclpf\" (UID: \"09c49ccd-c1d1-4cc5-869d-24a0e4802821\") " pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" Jul 08 19:06:27.591214 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.591183 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09c49ccd-c1d1-4cc5-869d-24a0e4802821-tls-certs\") pod \"model-serving-api-54d89bd5fc-pclpf\" (UID: \"09c49ccd-c1d1-4cc5-869d-24a0e4802821\") " pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" Jul 08 19:06:27.597240 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.597214 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrv2l\" (UniqueName: \"kubernetes.io/projected/09c49ccd-c1d1-4cc5-869d-24a0e4802821-kube-api-access-mrv2l\") pod \"model-serving-api-54d89bd5fc-pclpf\" (UID: \"09c49ccd-c1d1-4cc5-869d-24a0e4802821\") " pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" Jul 08 19:06:27.678846 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.678803 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" Jul 08 19:06:27.690109 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.690082 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0689d3-8417-4686-b576-3a0661d2fc3a-local-certs\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.690201 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.690144 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.690201 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.690174 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-token\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.690302 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.690204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.690302 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.690247 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2gsq\" (UniqueName: \"kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-kube-api-access-n2gsq\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.690302 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.690275 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-cacerts\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.690633 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.690302 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.691074 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.691044 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.693205 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.693170 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-cacerts\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.693664 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.693618 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0689d3-8417-4686-b576-3a0661d2fc3a-local-certs\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.693769 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.693697 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.694634 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.694410 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.700280 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.700247 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-token\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.701174 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.701149 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2gsq\" (UniqueName: \"kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-kube-api-access-n2gsq\") pod \"istiod-openshift-gateway-7574459656-892xw\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.797987 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.797893 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:27.865700 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.864854 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pclpf"] Jul 08 19:06:27.870157 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:06:27.870120 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c49ccd_c1d1_4cc5_869d_24a0e4802821.slice/crio-66429532c876fb9e663cdfa55fbd49474e158eacf3f18348a0908ad61e6473cf WatchSource:0}: Error finding container 66429532c876fb9e663cdfa55fbd49474e158eacf3f18348a0908ad61e6473cf: Status 404 returned error can't find the container with id 66429532c876fb9e663cdfa55fbd49474e158eacf3f18348a0908ad61e6473cf Jul 08 19:06:27.967284 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:27.967204 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-892xw"] Jul 08 19:06:27.973499 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:06:27.973472 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0689d3_8417_4686_b576_3a0661d2fc3a.slice/crio-ea3669cc0c85247ce9ed7a69ffceb33197aed885bc4fd7e63df390bb17fcd474 WatchSource:0}: Error finding container ea3669cc0c85247ce9ed7a69ffceb33197aed885bc4fd7e63df390bb17fcd474: Status 404 returned error can't find the container with id ea3669cc0c85247ce9ed7a69ffceb33197aed885bc4fd7e63df390bb17fcd474 Jul 08 19:06:28.252147 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:28.252109 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" event={"ID":"3f0689d3-8417-4686-b576-3a0661d2fc3a","Type":"ContainerStarted","Data":"ea3669cc0c85247ce9ed7a69ffceb33197aed885bc4fd7e63df390bb17fcd474"} Jul 08 19:06:28.253199 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:28.253172 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" event={"ID":"09c49ccd-c1d1-4cc5-869d-24a0e4802821","Type":"ContainerStarted","Data":"66429532c876fb9e663cdfa55fbd49474e158eacf3f18348a0908ad61e6473cf"} Jul 08 19:06:32.477863 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:32.477832 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 19:06:32.478132 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:32.477895 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 19:06:33.281027 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.280988 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" event={"ID":"3f0689d3-8417-4686-b576-3a0661d2fc3a","Type":"ContainerStarted","Data":"65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1"} Jul 08 19:06:33.281229 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.281057 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:33.282863 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.282830 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" event={"ID":"912fa866-801d-4d31-bb36-d6bdab2322d8","Type":"ContainerStarted","Data":"ed1a29d563f179ccdbb35d914b6f81c44de3f74d93327acd10a6552747cc9092"} Jul 08 19:06:33.283114 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.283072 2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-892xw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 19:06:33.283251 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.283140 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" podUID="3f0689d3-8417-4686-b576-3a0661d2fc3a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 19:06:33.284492 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.284468 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" event={"ID":"09c49ccd-c1d1-4cc5-869d-24a0e4802821","Type":"ContainerStarted","Data":"fd389367dc6950c9eedcbe49d5f3a67c718c069b0602921e55c1f4f66e1d3439"} Jul 08 19:06:33.284584 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.284556 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" Jul 08 19:06:33.285967 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.285945 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" event={"ID":"3182457d-49f3-4090-9360-69341a5a9e79","Type":"ContainerStarted","Data":"1dc6101213a13c4f604332d1d27ff7b892b26df621208159e3853b32719fd1b9"} Jul 08 19:06:33.286112 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.286090 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" Jul 08 19:06:33.306199 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.306160 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" podStartSLOduration=1.804776404 podStartE2EDuration="6.306148684s" totalImagesPullingTime="4.50137228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:33.305335837 +0000 UTC m=+339.081288326" watchObservedRunningTime="2026-07-08 19:06:33.306148684 +0000 UTC m=+339.082101155" Jul 08 19:06:33.325677 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.325633 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9cd5f7d96-8tcgf" podStartSLOduration=1.44559834 podStartE2EDuration="7.325618572s" totalImagesPullingTime="5.880020232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:33.323350373 +0000 UTC m=+339.099302843" watchObservedRunningTime="2026-07-08 19:06:33.325618572 +0000 UTC m=+339.101571042" Jul 08 19:06:33.351566 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.351512 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" podStartSLOduration=1.752164183 podStartE2EDuration="6.351495183s" totalImagesPullingTime="4.599331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:33.349733209 +0000 UTC m=+339.125685680" watchObservedRunningTime="2026-07-08 19:06:33.351495183 +0000 UTC m=+339.127447654" Jul 08 19:06:33.382329 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:33.382281 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" podStartSLOduration=1.83389596 podStartE2EDuration="7.382266404s" totalImagesPullingTime="5.548370444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:33.382006362 +0000 UTC m=+339.157958834" watchObservedRunningTime="2026-07-08 19:06:33.382266404 +0000 UTC m=+339.158218883" Jul 08 19:06:34.291838 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:34.291809 2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-892xw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 19:06:34.292190 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:34.291861 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" podUID="3f0689d3-8417-4686-b576-3a0661d2fc3a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 19:06:37.053265 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.053227 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7btcd"] Jul 08 19:06:37.056779 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.056755 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" Jul 08 19:06:37.060618 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.060596 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 08 19:06:37.061259 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.061242 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zncnm\"" Jul 08 19:06:37.072189 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.072167 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7btcd"] Jul 08 19:06:37.180960 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.180930 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6783bade-690d-4b18-95e5-a4d277e9eb53-cert\") pod \"kserve-controller-manager-d6f4b65b8-7btcd\" (UID: \"6783bade-690d-4b18-95e5-a4d277e9eb53\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" Jul 08 19:06:37.180960 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.180959 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz6ht\" (UniqueName: \"kubernetes.io/projected/6783bade-690d-4b18-95e5-a4d277e9eb53-kube-api-access-nz6ht\") pod \"kserve-controller-manager-d6f4b65b8-7btcd\" (UID: \"6783bade-690d-4b18-95e5-a4d277e9eb53\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" Jul 08 19:06:37.282303 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.282262 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6783bade-690d-4b18-95e5-a4d277e9eb53-cert\") pod \"kserve-controller-manager-d6f4b65b8-7btcd\" (UID: \"6783bade-690d-4b18-95e5-a4d277e9eb53\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" Jul 08 19:06:37.282303 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.282300 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz6ht\" (UniqueName: \"kubernetes.io/projected/6783bade-690d-4b18-95e5-a4d277e9eb53-kube-api-access-nz6ht\") pod \"kserve-controller-manager-d6f4b65b8-7btcd\" (UID: \"6783bade-690d-4b18-95e5-a4d277e9eb53\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" Jul 08 19:06:37.284969 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.284942 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6783bade-690d-4b18-95e5-a4d277e9eb53-cert\") pod \"kserve-controller-manager-d6f4b65b8-7btcd\" (UID: \"6783bade-690d-4b18-95e5-a4d277e9eb53\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" Jul 08 19:06:37.292519 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.292497 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:37.293419 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.293393 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz6ht\" (UniqueName: \"kubernetes.io/projected/6783bade-690d-4b18-95e5-a4d277e9eb53-kube-api-access-nz6ht\") pod \"kserve-controller-manager-d6f4b65b8-7btcd\" (UID: \"6783bade-690d-4b18-95e5-a4d277e9eb53\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" Jul 08 19:06:37.368820 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.368729 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" Jul 08 19:06:37.496830 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.496783 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-892xw"] Jul 08 19:06:37.497055 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.497026 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" podUID="3f0689d3-8417-4686-b576-3a0661d2fc3a" containerName="discovery" containerID="cri-o://65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1" gracePeriod=30 Jul 08 19:06:37.524545 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.524515 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7btcd"] Jul 08 19:06:37.525937 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:06:37.525910 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6783bade_690d_4b18_95e5_a4d277e9eb53.slice/crio-6e6f59d8bb046c85aff8ce7a01aa962097e73baa190fb6a1fd2f4b72d76ed30e WatchSource:0}: Error finding container 6e6f59d8bb046c85aff8ce7a01aa962097e73baa190fb6a1fd2f4b72d76ed30e: Status 404 returned error can't find the container with id 6e6f59d8bb046c85aff8ce7a01aa962097e73baa190fb6a1fd2f4b72d76ed30e Jul 08 19:06:37.728144 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.728118 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:37.887861 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.887827 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2gsq\" (UniqueName: \"kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-kube-api-access-n2gsq\") pod \"3f0689d3-8417-4686-b576-3a0661d2fc3a\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " Jul 08 19:06:37.888004 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.887887 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-ca-configmap\") pod \"3f0689d3-8417-4686-b576-3a0661d2fc3a\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " Jul 08 19:06:37.888004 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.887934 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-dns-cert\") pod \"3f0689d3-8417-4686-b576-3a0661d2fc3a\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " Jul 08 19:06:37.888004 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.887956 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0689d3-8417-4686-b576-3a0661d2fc3a-local-certs\") pod \"3f0689d3-8417-4686-b576-3a0661d2fc3a\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " Jul 08 19:06:37.888004 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.887975 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-token\") pod \"3f0689d3-8417-4686-b576-3a0661d2fc3a\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " Jul 08 19:06:37.888204 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.888009 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-kubeconfig\") pod \"3f0689d3-8417-4686-b576-3a0661d2fc3a\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " Jul 08 19:06:37.888204 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.888063 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-cacerts\") pod \"3f0689d3-8417-4686-b576-3a0661d2fc3a\" (UID: \"3f0689d3-8417-4686-b576-3a0661d2fc3a\") " Jul 08 19:06:37.888592 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.888542 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "3f0689d3-8417-4686-b576-3a0661d2fc3a" (UID: "3f0689d3-8417-4686-b576-3a0661d2fc3a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:06:37.890487 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.890427 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0689d3-8417-4686-b576-3a0661d2fc3a-local-certs" (OuterVolumeSpecName: "local-certs") pod "3f0689d3-8417-4686-b576-3a0661d2fc3a" (UID: "3f0689d3-8417-4686-b576-3a0661d2fc3a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:06:37.890602 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.890501 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-cacerts" (OuterVolumeSpecName: "cacerts") pod "3f0689d3-8417-4686-b576-3a0661d2fc3a" (UID: "3f0689d3-8417-4686-b576-3a0661d2fc3a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:06:37.890665 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.890644 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "3f0689d3-8417-4686-b576-3a0661d2fc3a" (UID: "3f0689d3-8417-4686-b576-3a0661d2fc3a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:06:37.890703 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.890660 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-kube-api-access-n2gsq" (OuterVolumeSpecName: "kube-api-access-n2gsq") pod "3f0689d3-8417-4686-b576-3a0661d2fc3a" (UID: "3f0689d3-8417-4686-b576-3a0661d2fc3a"). InnerVolumeSpecName "kube-api-access-n2gsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:06:37.890814 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.890794 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "3f0689d3-8417-4686-b576-3a0661d2fc3a" (UID: "3f0689d3-8417-4686-b576-3a0661d2fc3a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:06:37.890857 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.890811 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f0689d3-8417-4686-b576-3a0661d2fc3a" (UID: "3f0689d3-8417-4686-b576-3a0661d2fc3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:06:37.989502 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.989399 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-token\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:06:37.989502 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.989428 2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-kubeconfig\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:06:37.989502 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.989461 2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-cacerts\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:06:37.989502 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.989471 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2gsq\" (UniqueName: \"kubernetes.io/projected/3f0689d3-8417-4686-b576-3a0661d2fc3a-kube-api-access-n2gsq\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:06:37.989502 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.989482 2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-ca-configmap\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:06:37.989502 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.989490 2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3f0689d3-8417-4686-b576-3a0661d2fc3a-istio-csr-dns-cert\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:06:37.989502 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:37.989498 2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0689d3-8417-4686-b576-3a0661d2fc3a-local-certs\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:06:38.312004 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.311972 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" event={"ID":"6783bade-690d-4b18-95e5-a4d277e9eb53","Type":"ContainerStarted","Data":"6e6f59d8bb046c85aff8ce7a01aa962097e73baa190fb6a1fd2f4b72d76ed30e"} Jul 08 19:06:38.313130 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.313105 2570 generic.go:356] "Generic (PLEG): container finished" podID="3f0689d3-8417-4686-b576-3a0661d2fc3a" containerID="65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1" exitCode=0 Jul 08 19:06:38.313251 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.313151 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" Jul 08 19:06:38.313251 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.313189 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" event={"ID":"3f0689d3-8417-4686-b576-3a0661d2fc3a","Type":"ContainerDied","Data":"65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1"} Jul 08 19:06:38.313251 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.313232 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-892xw" event={"ID":"3f0689d3-8417-4686-b576-3a0661d2fc3a","Type":"ContainerDied","Data":"ea3669cc0c85247ce9ed7a69ffceb33197aed885bc4fd7e63df390bb17fcd474"} Jul 08 19:06:38.313362 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.313254 2570 scope.go:117] "RemoveContainer" containerID="65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1" Jul 08 19:06:38.321602 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.321581 2570 scope.go:117] "RemoveContainer" containerID="65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1" Jul 08 19:06:38.321869 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:06:38.321846 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1\": container with ID starting with 65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1 not found: ID does not exist" containerID="65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1" Jul 08 19:06:38.321963 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.321886 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1"} err="failed to get container status \"65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1\": rpc error: code = NotFound desc = could not find container \"65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1\": container with ID starting with 65c7314e609c0e1f292f0a0d04a26d1583ee39600a0909d0fbf41c5a7ee55ff1 not found: ID does not exist" Jul 08 19:06:38.337308 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.337276 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-892xw"] Jul 08 19:06:38.340518 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.340499 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-892xw"] Jul 08 19:06:38.758081 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:38.758046 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0689d3-8417-4686-b576-3a0661d2fc3a" path="/var/lib/kubelet/pods/3f0689d3-8417-4686-b576-3a0661d2fc3a/volumes" Jul 08 19:06:41.329987 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:41.329952 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" event={"ID":"6783bade-690d-4b18-95e5-a4d277e9eb53","Type":"ContainerStarted","Data":"e5aaeba06347ba033b7879d3dfbfa5bd9d062e4028fa431df15d1b92833b2e8c"} Jul 08 19:06:41.330478 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:41.330091 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" Jul 08 19:06:41.350608 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:41.350558 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" podStartSLOduration=1.3740833000000001 podStartE2EDuration="4.350542137s" totalImagesPullingTime="2.976458837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:41.34941773 +0000 UTC m=+347.125370202" watchObservedRunningTime="2026-07-08 19:06:41.350542137 +0000 UTC m=+347.126494610" Jul 08 19:06:44.293463 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:44.293418 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mxh69" Jul 08 19:06:44.295490 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:06:44.295467 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pclpf" Jul 08 19:07:12.341039 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:12.341007 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7btcd" Jul 08 19:07:27.426860 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.426826 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4gcwr"] Jul 08 19:07:27.427401 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.427351 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0689d3-8417-4686-b576-3a0661d2fc3a" containerName="discovery" Jul 08 19:07:27.427401 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.427372 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0689d3-8417-4686-b576-3a0661d2fc3a" containerName="discovery" Jul 08 19:07:27.427557 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.427504 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0689d3-8417-4686-b576-3a0661d2fc3a" containerName="discovery" Jul 08 19:07:27.430558 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.430525 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" Jul 08 19:07:27.432764 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.432744 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 19:07:27.433191 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.433171 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-r9q9g\"" Jul 08 19:07:27.433306 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.433231 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 19:07:27.442914 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.442889 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4gcwr"] Jul 08 19:07:27.513610 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.513571 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-778rn\" (UniqueName: \"kubernetes.io/projected/3e27165a-cbae-47db-988c-07c7768cf4f1-kube-api-access-778rn\") pod \"kuadrant-operator-catalog-4gcwr\" (UID: \"3e27165a-cbae-47db-988c-07c7768cf4f1\") " pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" Jul 08 19:07:27.614858 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.614820 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-778rn\" (UniqueName: \"kubernetes.io/projected/3e27165a-cbae-47db-988c-07c7768cf4f1-kube-api-access-778rn\") pod \"kuadrant-operator-catalog-4gcwr\" (UID: \"3e27165a-cbae-47db-988c-07c7768cf4f1\") " pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" Jul 08 19:07:27.624347 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.624312 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-778rn\" (UniqueName: \"kubernetes.io/projected/3e27165a-cbae-47db-988c-07c7768cf4f1-kube-api-access-778rn\") pod \"kuadrant-operator-catalog-4gcwr\" (UID: \"3e27165a-cbae-47db-988c-07c7768cf4f1\") " pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" Jul 08 19:07:27.742155 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.742072 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" Jul 08 19:07:27.784004 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.783973 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4gcwr"] Jul 08 19:07:27.874482 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.874448 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4gcwr"] Jul 08 19:07:27.877011 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:07:27.876984 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e27165a_cbae_47db_988c_07c7768cf4f1.slice/crio-9121f6f6739d1ca348c29d1c1e7823070a5e57e4bfd7da3c0967ab3762d1c1d6 WatchSource:0}: Error finding container 9121f6f6739d1ca348c29d1c1e7823070a5e57e4bfd7da3c0967ab3762d1c1d6: Status 404 returned error can't find the container with id 9121f6f6739d1ca348c29d1c1e7823070a5e57e4bfd7da3c0967ab3762d1c1d6 Jul 08 19:07:27.993614 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.993534 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lztjk"] Jul 08 19:07:27.997858 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:27.997842 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lztjk" Jul 08 19:07:28.005133 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:28.005108 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lztjk"] Jul 08 19:07:28.119502 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:28.119465 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnk6g\" (UniqueName: \"kubernetes.io/projected/b8d9e2a1-21ea-41ff-a5cb-778d47fa0979-kube-api-access-hnk6g\") pod \"kuadrant-operator-catalog-lztjk\" (UID: \"b8d9e2a1-21ea-41ff-a5cb-778d47fa0979\") " pod="kuadrant-system/kuadrant-operator-catalog-lztjk" Jul 08 19:07:28.220189 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:28.220144 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnk6g\" (UniqueName: \"kubernetes.io/projected/b8d9e2a1-21ea-41ff-a5cb-778d47fa0979-kube-api-access-hnk6g\") pod \"kuadrant-operator-catalog-lztjk\" (UID: \"b8d9e2a1-21ea-41ff-a5cb-778d47fa0979\") " pod="kuadrant-system/kuadrant-operator-catalog-lztjk" Jul 08 19:07:28.229821 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:28.229794 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnk6g\" (UniqueName: \"kubernetes.io/projected/b8d9e2a1-21ea-41ff-a5cb-778d47fa0979-kube-api-access-hnk6g\") pod \"kuadrant-operator-catalog-lztjk\" (UID: \"b8d9e2a1-21ea-41ff-a5cb-778d47fa0979\") " pod="kuadrant-system/kuadrant-operator-catalog-lztjk" Jul 08 19:07:28.308289 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:28.308211 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lztjk" Jul 08 19:07:28.446378 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:28.446354 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lztjk"] Jul 08 19:07:28.448846 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:07:28.448797 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d9e2a1_21ea_41ff_a5cb_778d47fa0979.slice/crio-8a173ba93fc066ae097d2f18dc5bedf76f6507170536f2408d38afe28e4833f2 WatchSource:0}: Error finding container 8a173ba93fc066ae097d2f18dc5bedf76f6507170536f2408d38afe28e4833f2: Status 404 returned error can't find the container with id 8a173ba93fc066ae097d2f18dc5bedf76f6507170536f2408d38afe28e4833f2 Jul 08 19:07:28.539779 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:28.539746 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lztjk" event={"ID":"b8d9e2a1-21ea-41ff-a5cb-778d47fa0979","Type":"ContainerStarted","Data":"8a173ba93fc066ae097d2f18dc5bedf76f6507170536f2408d38afe28e4833f2"} Jul 08 19:07:28.541025 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:28.540989 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" event={"ID":"3e27165a-cbae-47db-988c-07c7768cf4f1","Type":"ContainerStarted","Data":"9121f6f6739d1ca348c29d1c1e7823070a5e57e4bfd7da3c0967ab3762d1c1d6"} Jul 08 19:07:30.553880 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:30.553838 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lztjk" event={"ID":"b8d9e2a1-21ea-41ff-a5cb-778d47fa0979","Type":"ContainerStarted","Data":"32dba8a82ad5af49aac997446dbec92c8738d70ac7d673cd9ceb8cdb7782c08a"} Jul 08 19:07:30.555315 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:30.555288 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" event={"ID":"3e27165a-cbae-47db-988c-07c7768cf4f1","Type":"ContainerStarted","Data":"81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708"} Jul 08 19:07:30.555429 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:30.555311 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" podUID="3e27165a-cbae-47db-988c-07c7768cf4f1" containerName="registry-server" containerID="cri-o://81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708" gracePeriod=2 Jul 08 19:07:30.571927 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:30.571881 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lztjk" podStartSLOduration=1.660412756 podStartE2EDuration="3.57186395s" totalImagesPullingTime="1.911451194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:07:30.570247863 +0000 UTC m=+396.346200332" watchObservedRunningTime="2026-07-08 19:07:30.57186395 +0000 UTC m=+396.347816422" Jul 08 19:07:30.587860 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:30.587807 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" podStartSLOduration=1.107954611 podStartE2EDuration="3.587790016s" totalImagesPullingTime="2.479835405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:07:30.586057828 +0000 UTC m=+396.362010299" watchObservedRunningTime="2026-07-08 19:07:30.587790016 +0000 UTC m=+396.363742488" Jul 08 19:07:30.799899 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:30.799875 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" Jul 08 19:07:30.942416 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:30.942327 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-778rn\" (UniqueName: \"kubernetes.io/projected/3e27165a-cbae-47db-988c-07c7768cf4f1-kube-api-access-778rn\") pod \"3e27165a-cbae-47db-988c-07c7768cf4f1\" (UID: \"3e27165a-cbae-47db-988c-07c7768cf4f1\") " Jul 08 19:07:30.944501 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:30.944477 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e27165a-cbae-47db-988c-07c7768cf4f1-kube-api-access-778rn" (OuterVolumeSpecName: "kube-api-access-778rn") pod "3e27165a-cbae-47db-988c-07c7768cf4f1" (UID: "3e27165a-cbae-47db-988c-07c7768cf4f1"). InnerVolumeSpecName "kube-api-access-778rn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:07:31.043356 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:31.043325 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-778rn\" (UniqueName: \"kubernetes.io/projected/3e27165a-cbae-47db-988c-07c7768cf4f1-kube-api-access-778rn\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:07:31.561282 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:31.561249 2570 generic.go:356] "Generic (PLEG): container finished" podID="3e27165a-cbae-47db-988c-07c7768cf4f1" containerID="81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708" exitCode=0 Jul 08 19:07:31.561772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:31.561297 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" Jul 08 19:07:31.561772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:31.561338 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" event={"ID":"3e27165a-cbae-47db-988c-07c7768cf4f1","Type":"ContainerDied","Data":"81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708"} Jul 08 19:07:31.561772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:31.561398 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4gcwr" event={"ID":"3e27165a-cbae-47db-988c-07c7768cf4f1","Type":"ContainerDied","Data":"9121f6f6739d1ca348c29d1c1e7823070a5e57e4bfd7da3c0967ab3762d1c1d6"} Jul 08 19:07:31.561772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:31.561422 2570 scope.go:117] "RemoveContainer" containerID="81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708" Jul 08 19:07:31.570756 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:31.570739 2570 scope.go:117] "RemoveContainer" containerID="81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708" Jul 08 19:07:31.571053 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:07:31.571035 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708\": container with ID starting with 81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708 not found: ID does not exist" containerID="81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708" Jul 08 19:07:31.571101 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:31.571062 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708"} err="failed to get container status \"81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708\": rpc error: code = NotFound desc = could not find container \"81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708\": container with ID starting with 81f6e9e58863c54e0db621d5031bb8e0ce04b88e398e105f55f19cb19c2b8708 not found: ID does not exist" Jul 08 19:07:31.583068 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:31.583045 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4gcwr"] Jul 08 19:07:31.589315 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:31.589296 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4gcwr"] Jul 08 19:07:32.755899 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:32.755864 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e27165a-cbae-47db-988c-07c7768cf4f1" path="/var/lib/kubelet/pods/3e27165a-cbae-47db-988c-07c7768cf4f1/volumes" Jul 08 19:07:38.308754 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:38.308719 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lztjk" Jul 08 19:07:38.309243 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:38.308782 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lztjk" Jul 08 19:07:38.331645 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:38.331616 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lztjk" Jul 08 19:07:38.614582 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:38.614510 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lztjk" Jul 08 19:07:59.176676 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.176638 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55"] Jul 08 19:07:59.177139 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.177002 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e27165a-cbae-47db-988c-07c7768cf4f1" containerName="registry-server" Jul 08 19:07:59.177139 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.177015 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e27165a-cbae-47db-988c-07c7768cf4f1" containerName="registry-server" Jul 08 19:07:59.177139 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.177085 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e27165a-cbae-47db-988c-07c7768cf4f1" containerName="registry-server" Jul 08 19:07:59.184994 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.184961 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" Jul 08 19:07:59.191857 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.191834 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zprdc\"" Jul 08 19:07:59.198840 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.198812 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55"] Jul 08 19:07:59.258378 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.258336 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7q5\" (UniqueName: \"kubernetes.io/projected/c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc-kube-api-access-jp7q5\") pod \"limitador-operator-controller-manager-859d7b78bd-6rw55\" (UID: \"c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" Jul 08 19:07:59.358863 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.358824 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7q5\" (UniqueName: \"kubernetes.io/projected/c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc-kube-api-access-jp7q5\") pod \"limitador-operator-controller-manager-859d7b78bd-6rw55\" (UID: \"c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" Jul 08 19:07:59.377674 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.377642 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7q5\" (UniqueName: \"kubernetes.io/projected/c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc-kube-api-access-jp7q5\") pod \"limitador-operator-controller-manager-859d7b78bd-6rw55\" (UID: \"c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" Jul 08 19:07:59.494675 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.494569 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" Jul 08 19:07:59.653245 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.653214 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55"] Jul 08 19:07:59.654965 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:07:59.654929 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6095ef8_6b49_4d3a_aa3d_19e48f5d7bdc.slice/crio-22defc4cfa5c04f763cc7efb1ba4cedeaaa7e0f2b22f233e50c86e9713bc687a WatchSource:0}: Error finding container 22defc4cfa5c04f763cc7efb1ba4cedeaaa7e0f2b22f233e50c86e9713bc687a: Status 404 returned error can't find the container with id 22defc4cfa5c04f763cc7efb1ba4cedeaaa7e0f2b22f233e50c86e9713bc687a Jul 08 19:07:59.685713 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:07:59.685678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" event={"ID":"c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc","Type":"ContainerStarted","Data":"22defc4cfa5c04f763cc7efb1ba4cedeaaa7e0f2b22f233e50c86e9713bc687a"} Jul 08 19:08:02.704771 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:02.704736 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" event={"ID":"c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc","Type":"ContainerStarted","Data":"80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f"} Jul 08 19:08:02.705200 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:02.704811 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" Jul 08 19:08:02.728398 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:02.728349 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" podStartSLOduration=1.687142125 podStartE2EDuration="3.728333286s" totalImagesPullingTime="2.041191161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:07:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:02.726084534 +0000 UTC m=+428.502037005" watchObservedRunningTime="2026-07-08 19:08:02.728333286 +0000 UTC m=+428.504285817" Jul 08 19:08:03.255643 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:03.255603 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr"] Jul 08 19:08:03.259543 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:03.259507 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr" Jul 08 19:08:03.267048 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:03.267015 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5g25t\"" Jul 08 19:08:03.269313 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:03.269286 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr"] Jul 08 19:08:03.287225 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:03.287184 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7zmj\" (UniqueName: \"kubernetes.io/projected/25810471-0e16-4dbf-8ea4-21aa7c4ef711-kube-api-access-g7zmj\") pod \"authorino-operator-75cc8d5cb7-gc5gr\" (UID: \"25810471-0e16-4dbf-8ea4-21aa7c4ef711\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr" Jul 08 19:08:03.388557 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:03.388522 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7zmj\" (UniqueName: \"kubernetes.io/projected/25810471-0e16-4dbf-8ea4-21aa7c4ef711-kube-api-access-g7zmj\") pod \"authorino-operator-75cc8d5cb7-gc5gr\" (UID: \"25810471-0e16-4dbf-8ea4-21aa7c4ef711\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr" Jul 08 19:08:03.400288 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:03.400256 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7zmj\" (UniqueName: \"kubernetes.io/projected/25810471-0e16-4dbf-8ea4-21aa7c4ef711-kube-api-access-g7zmj\") pod \"authorino-operator-75cc8d5cb7-gc5gr\" (UID: \"25810471-0e16-4dbf-8ea4-21aa7c4ef711\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr" Jul 08 19:08:03.571732 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:03.571644 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr" Jul 08 19:08:03.755592 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:03.755555 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr"] Jul 08 19:08:03.758746 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:08:03.758717 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25810471_0e16_4dbf_8ea4_21aa7c4ef711.slice/crio-ae25beb5001ee758b22accc365110b40a14bb8c0967aa0e1e4ff3c8c90d48f6d WatchSource:0}: Error finding container ae25beb5001ee758b22accc365110b40a14bb8c0967aa0e1e4ff3c8c90d48f6d: Status 404 returned error can't find the container with id ae25beb5001ee758b22accc365110b40a14bb8c0967aa0e1e4ff3c8c90d48f6d Jul 08 19:08:04.718703 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:04.718662 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr" event={"ID":"25810471-0e16-4dbf-8ea4-21aa7c4ef711","Type":"ContainerStarted","Data":"ae25beb5001ee758b22accc365110b40a14bb8c0967aa0e1e4ff3c8c90d48f6d"} Jul 08 19:08:06.731608 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:06.731567 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr" event={"ID":"25810471-0e16-4dbf-8ea4-21aa7c4ef711","Type":"ContainerStarted","Data":"91a8df482a51d2934b403fa4d9d5268108c7de84876449019be820757b4d1471"} Jul 08 19:08:06.732038 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:06.731702 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr" Jul 08 19:08:06.758132 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:06.758071 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr" podStartSLOduration=1.24085846 podStartE2EDuration="3.758051648s" totalImagesPullingTime="2.517193188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:06.756801275 +0000 UTC m=+432.532753750" watchObservedRunningTime="2026-07-08 19:08:06.758051648 +0000 UTC m=+432.534004120" Jul 08 19:08:08.285215 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.285174 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p"] Jul 08 19:08:08.288669 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.288649 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:08.291474 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.291428 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-chtd7\"" Jul 08 19:08:08.302190 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.302162 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p"] Jul 08 19:08:08.329022 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.328756 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3521dc2-a064-44d3-a688-7a4b422dd4e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqk9p\" (UID: \"a3521dc2-a064-44d3-a688-7a4b422dd4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:08.329022 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.328812 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntvxc\" (UniqueName: \"kubernetes.io/projected/a3521dc2-a064-44d3-a688-7a4b422dd4e2-kube-api-access-ntvxc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqk9p\" (UID: \"a3521dc2-a064-44d3-a688-7a4b422dd4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:08.429468 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.429400 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3521dc2-a064-44d3-a688-7a4b422dd4e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqk9p\" (UID: \"a3521dc2-a064-44d3-a688-7a4b422dd4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:08.429468 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.429467 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvxc\" (UniqueName: \"kubernetes.io/projected/a3521dc2-a064-44d3-a688-7a4b422dd4e2-kube-api-access-ntvxc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqk9p\" (UID: \"a3521dc2-a064-44d3-a688-7a4b422dd4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:08.429825 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.429803 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3521dc2-a064-44d3-a688-7a4b422dd4e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqk9p\" (UID: \"a3521dc2-a064-44d3-a688-7a4b422dd4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:08.440139 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.440117 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntvxc\" (UniqueName: \"kubernetes.io/projected/a3521dc2-a064-44d3-a688-7a4b422dd4e2-kube-api-access-ntvxc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqk9p\" (UID: \"a3521dc2-a064-44d3-a688-7a4b422dd4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:08.599290 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.599201 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:08.746811 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:08.746783 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p"] Jul 08 19:08:08.747760 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:08:08.747732 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3521dc2_a064_44d3_a688_7a4b422dd4e2.slice/crio-5c853c1e25506e704f424cbf47adf4aad3c6c1b1a2bc7376962f2ccffb43b96b WatchSource:0}: Error finding container 5c853c1e25506e704f424cbf47adf4aad3c6c1b1a2bc7376962f2ccffb43b96b: Status 404 returned error can't find the container with id 5c853c1e25506e704f424cbf47adf4aad3c6c1b1a2bc7376962f2ccffb43b96b Jul 08 19:08:09.747210 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:09.747175 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" event={"ID":"a3521dc2-a064-44d3-a688-7a4b422dd4e2","Type":"ContainerStarted","Data":"5c853c1e25506e704f424cbf47adf4aad3c6c1b1a2bc7376962f2ccffb43b96b"} Jul 08 19:08:13.713934 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:13.713902 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" Jul 08 19:08:17.739166 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:17.739135 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gc5gr" Jul 08 19:08:17.787825 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:17.787788 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" event={"ID":"a3521dc2-a064-44d3-a688-7a4b422dd4e2","Type":"ContainerStarted","Data":"45eda436bea9ede659e3b78a1fcf0f98d2d631dd05ce2d2fb54c48fc067df0fc"} Jul 08 19:08:17.788023 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:17.787923 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:17.879717 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:17.879659 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" podStartSLOduration=1.6916350119999999 podStartE2EDuration="9.879642778s" totalImagesPullingTime="8.188007766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:17.878530227 +0000 UTC m=+443.654482722" watchObservedRunningTime="2026-07-08 19:08:17.879642778 +0000 UTC m=+443.655595249" Jul 08 19:08:28.794784 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:28.794753 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:29.941908 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:29.941873 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk"] Jul 08 19:08:29.945582 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:29.945565 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:29.959691 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:29.959661 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk"] Jul 08 19:08:30.016388 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.016345 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tq85\" (UniqueName: \"kubernetes.io/projected/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-kube-api-access-9tq85\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" (UID: \"fb8fb242-d225-4aad-bfd7-e0a28b6c0e57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:30.016599 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.016432 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" (UID: \"fb8fb242-d225-4aad-bfd7-e0a28b6c0e57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:30.117090 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.117050 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tq85\" (UniqueName: \"kubernetes.io/projected/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-kube-api-access-9tq85\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" (UID: \"fb8fb242-d225-4aad-bfd7-e0a28b6c0e57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:30.117269 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.117135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" (UID: \"fb8fb242-d225-4aad-bfd7-e0a28b6c0e57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:30.117551 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.117529 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" (UID: \"fb8fb242-d225-4aad-bfd7-e0a28b6c0e57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:30.126593 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.126571 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tq85\" (UniqueName: \"kubernetes.io/projected/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-kube-api-access-9tq85\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" (UID: \"fb8fb242-d225-4aad-bfd7-e0a28b6c0e57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:30.255481 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.255364 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:30.394696 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.394662 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk"] Jul 08 19:08:30.398088 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:08:30.398056 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8fb242_d225_4aad_bfd7_e0a28b6c0e57.slice/crio-5c42c24c22952df179945a115941aa6ed64645b396f00f4e5a821980141942e0 WatchSource:0}: Error finding container 5c42c24c22952df179945a115941aa6ed64645b396f00f4e5a821980141942e0: Status 404 returned error can't find the container with id 5c42c24c22952df179945a115941aa6ed64645b396f00f4e5a821980141942e0 Jul 08 19:08:30.686471 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.686419 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk"] Jul 08 19:08:30.695155 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.695125 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk"] Jul 08 19:08:30.710782 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.710749 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p"] Jul 08 19:08:30.710956 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.710926 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" podUID="a3521dc2-a064-44d3-a688-7a4b422dd4e2" containerName="manager" containerID="cri-o://45eda436bea9ede659e3b78a1fcf0f98d2d631dd05ce2d2fb54c48fc067df0fc" gracePeriod=2 Jul 08 19:08:30.724331 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.724292 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl"] Jul 08 19:08:30.724789 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.724757 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" containerName="manager" Jul 08 19:08:30.724789 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.724786 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" containerName="manager" Jul 08 19:08:30.724940 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.724866 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" containerName="manager" Jul 08 19:08:30.725318 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:30.725288 2570 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a3521dc2-a064-44d3-a688-7a4b422dd4e2\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-cqk9p\": pods \"kuadrant-operator-controller-manager-8684c9ff49-cqk9p\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:30.727948 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.727929 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p"] Jul 08 19:08:30.728049 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.728025 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:30.737569 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:30.730153 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cqk9p\" is forbidden: User \"system:node:ip-10-0-130-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-102.ec2.internal' and this object" podUID="a3521dc2-a064-44d3-a688-7a4b422dd4e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:30.740535 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.740506 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55"] Jul 08 19:08:30.741389 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.741362 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" podUID="c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc" containerName="manager" containerID="cri-o://80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f" gracePeriod=2 Jul 08 19:08:30.742934 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.742909 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl"] Jul 08 19:08:30.745176 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.745153 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55"] Jul 08 19:08:30.759627 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:30.759592 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6rw55\" is forbidden: User \"system:node:ip-10-0-130-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-102.ec2.internal' and this object" podUID="c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" Jul 08 19:08:30.762313 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:30.762261 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cqk9p\" is forbidden: User \"system:node:ip-10-0-130-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-102.ec2.internal' and this object" podUID="a3521dc2-a064-44d3-a688-7a4b422dd4e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:30.763337 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.763314 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm"] Jul 08 19:08:30.763717 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.763701 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3521dc2-a064-44d3-a688-7a4b422dd4e2" containerName="manager" Jul 08 19:08:30.763795 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.763720 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3521dc2-a064-44d3-a688-7a4b422dd4e2" containerName="manager" Jul 08 19:08:30.763795 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.763735 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc" containerName="manager" Jul 08 19:08:30.763795 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.763743 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc" containerName="manager" Jul 08 19:08:30.763938 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.763860 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc" containerName="manager" Jul 08 19:08:30.763938 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.763874 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3521dc2-a064-44d3-a688-7a4b422dd4e2" containerName="manager" Jul 08 19:08:30.766970 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.766950 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm" Jul 08 19:08:30.775116 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.775092 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm"] Jul 08 19:08:30.824369 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.824336 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18dc731b-97cc-497e-ad5a-57f7c0885c66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62xcl\" (UID: \"18dc731b-97cc-497e-ad5a-57f7c0885c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:30.824532 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.824383 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j76nq\" (UniqueName: \"kubernetes.io/projected/18dc731b-97cc-497e-ad5a-57f7c0885c66-kube-api-access-j76nq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62xcl\" (UID: \"18dc731b-97cc-497e-ad5a-57f7c0885c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:30.824580 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.824535 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpbd8\" (UniqueName: \"kubernetes.io/projected/8f09ae44-b987-482f-9047-53b32f053ec3-kube-api-access-dpbd8\") pod \"limitador-operator-controller-manager-859d7b78bd-slzzm\" (UID: \"8f09ae44-b987-482f-9047-53b32f053ec3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm" Jul 08 19:08:30.852912 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.852881 2570 generic.go:356] "Generic (PLEG): container finished" podID="a3521dc2-a064-44d3-a688-7a4b422dd4e2" containerID="45eda436bea9ede659e3b78a1fcf0f98d2d631dd05ce2d2fb54c48fc067df0fc" exitCode=0 Jul 08 19:08:30.854972 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:30.854952 2570 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" container="manager" Jul 08 19:08:30.925008 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.924972 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18dc731b-97cc-497e-ad5a-57f7c0885c66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62xcl\" (UID: \"18dc731b-97cc-497e-ad5a-57f7c0885c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:30.925204 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.925024 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j76nq\" (UniqueName: \"kubernetes.io/projected/18dc731b-97cc-497e-ad5a-57f7c0885c66-kube-api-access-j76nq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62xcl\" (UID: \"18dc731b-97cc-497e-ad5a-57f7c0885c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:30.925204 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.925080 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpbd8\" (UniqueName: \"kubernetes.io/projected/8f09ae44-b987-482f-9047-53b32f053ec3-kube-api-access-dpbd8\") pod \"limitador-operator-controller-manager-859d7b78bd-slzzm\" (UID: \"8f09ae44-b987-482f-9047-53b32f053ec3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm" Jul 08 19:08:30.925672 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.925646 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18dc731b-97cc-497e-ad5a-57f7c0885c66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62xcl\" (UID: \"18dc731b-97cc-497e-ad5a-57f7c0885c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:30.940411 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.940332 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpbd8\" (UniqueName: \"kubernetes.io/projected/8f09ae44-b987-482f-9047-53b32f053ec3-kube-api-access-dpbd8\") pod \"limitador-operator-controller-manager-859d7b78bd-slzzm\" (UID: \"8f09ae44-b987-482f-9047-53b32f053ec3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm" Jul 08 19:08:30.940579 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.940478 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j76nq\" (UniqueName: \"kubernetes.io/projected/18dc731b-97cc-497e-ad5a-57f7c0885c66-kube-api-access-j76nq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-62xcl\" (UID: \"18dc731b-97cc-497e-ad5a-57f7c0885c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:30.977103 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.977022 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:30.983969 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:30.983907 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" Jul 08 19:08:31.026199 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.026161 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3521dc2-a064-44d3-a688-7a4b422dd4e2-extensions-socket-volume\") pod \"a3521dc2-a064-44d3-a688-7a4b422dd4e2\" (UID: \"a3521dc2-a064-44d3-a688-7a4b422dd4e2\") " Jul 08 19:08:31.026395 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.026217 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntvxc\" (UniqueName: \"kubernetes.io/projected/a3521dc2-a064-44d3-a688-7a4b422dd4e2-kube-api-access-ntvxc\") pod \"a3521dc2-a064-44d3-a688-7a4b422dd4e2\" (UID: \"a3521dc2-a064-44d3-a688-7a4b422dd4e2\") " Jul 08 19:08:31.026395 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.026245 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp7q5\" (UniqueName: \"kubernetes.io/projected/c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc-kube-api-access-jp7q5\") pod \"c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc\" (UID: \"c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc\") " Jul 08 19:08:31.026711 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.026684 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3521dc2-a064-44d3-a688-7a4b422dd4e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a3521dc2-a064-44d3-a688-7a4b422dd4e2" (UID: "a3521dc2-a064-44d3-a688-7a4b422dd4e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:08:31.028545 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.028522 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc-kube-api-access-jp7q5" (OuterVolumeSpecName: "kube-api-access-jp7q5") pod "c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc" (UID: "c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc"). InnerVolumeSpecName "kube-api-access-jp7q5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:08:31.028620 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.028554 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3521dc2-a064-44d3-a688-7a4b422dd4e2-kube-api-access-ntvxc" (OuterVolumeSpecName: "kube-api-access-ntvxc") pod "a3521dc2-a064-44d3-a688-7a4b422dd4e2" (UID: "a3521dc2-a064-44d3-a688-7a4b422dd4e2"). InnerVolumeSpecName "kube-api-access-ntvxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:08:31.127336 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.127302 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp7q5\" (UniqueName: \"kubernetes.io/projected/c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc-kube-api-access-jp7q5\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:08:31.127336 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.127332 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3521dc2-a064-44d3-a688-7a4b422dd4e2-extensions-socket-volume\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:08:31.127336 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.127343 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntvxc\" (UniqueName: \"kubernetes.io/projected/a3521dc2-a064-44d3-a688-7a4b422dd4e2-kube-api-access-ntvxc\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:08:31.134294 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.134171 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:31.140376 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.140342 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm" Jul 08 19:08:31.299934 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.299866 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl"] Jul 08 19:08:31.302630 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:08:31.302601 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18dc731b_97cc_497e_ad5a_57f7c0885c66.slice/crio-072b4218e3d2dabb51373a6be18c4b640c595ec53f21926e0a2513c89a0d1cf6 WatchSource:0}: Error finding container 072b4218e3d2dabb51373a6be18c4b640c595ec53f21926e0a2513c89a0d1cf6: Status 404 returned error can't find the container with id 072b4218e3d2dabb51373a6be18c4b640c595ec53f21926e0a2513c89a0d1cf6 Jul 08 19:08:31.313773 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.313709 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm"] Jul 08 19:08:31.316709 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:08:31.316683 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f09ae44_b987_482f_9047_53b32f053ec3.slice/crio-c188ce1b453f39bee497b435158c8c312bfafaaf07f635be0cbbe474cb964f20 WatchSource:0}: Error finding container c188ce1b453f39bee497b435158c8c312bfafaaf07f635be0cbbe474cb964f20: Status 404 returned error can't find the container with id c188ce1b453f39bee497b435158c8c312bfafaaf07f635be0cbbe474cb964f20 Jul 08 19:08:31.861934 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.861889 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" containerName="manager" containerID="cri-o://97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6" gracePeriod=2 Jul 08 19:08:31.863801 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.863709 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm" event={"ID":"8f09ae44-b987-482f-9047-53b32f053ec3","Type":"ContainerStarted","Data":"67a944c7c2d338d47fc2127e29121382aed1e0f7771d0fa3d68d284e800f2e6a"} Jul 08 19:08:31.863801 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.863768 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm" event={"ID":"8f09ae44-b987-482f-9047-53b32f053ec3","Type":"ContainerStarted","Data":"c188ce1b453f39bee497b435158c8c312bfafaaf07f635be0cbbe474cb964f20"} Jul 08 19:08:31.863990 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.863812 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm" Jul 08 19:08:31.864202 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:31.864171 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" is forbidden: User \"system:node:ip-10-0-130-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-102.ec2.internal' and this object" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:31.867579 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.867555 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqk9p" Jul 08 19:08:31.867579 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.867576 2570 scope.go:117] "RemoveContainer" containerID="45eda436bea9ede659e3b78a1fcf0f98d2d631dd05ce2d2fb54c48fc067df0fc" Jul 08 19:08:31.869586 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.869560 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" event={"ID":"18dc731b-97cc-497e-ad5a-57f7c0885c66","Type":"ContainerStarted","Data":"e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25"} Jul 08 19:08:31.869755 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.869608 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" event={"ID":"18dc731b-97cc-497e-ad5a-57f7c0885c66","Type":"ContainerStarted","Data":"072b4218e3d2dabb51373a6be18c4b640c595ec53f21926e0a2513c89a0d1cf6"} Jul 08 19:08:31.869755 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.869644 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:31.870848 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.870827 2570 generic.go:356] "Generic (PLEG): container finished" podID="c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc" containerID="80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f" exitCode=0 Jul 08 19:08:31.870944 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.870862 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw55" Jul 08 19:08:31.878392 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.878372 2570 scope.go:117] "RemoveContainer" containerID="80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f" Jul 08 19:08:31.888756 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.888706 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm" podStartSLOduration=1.8886878660000002 podStartE2EDuration="1.888687866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:31.888540819 +0000 UTC m=+457.664493290" watchObservedRunningTime="2026-07-08 19:08:31.888687866 +0000 UTC m=+457.664640349" Jul 08 19:08:31.890566 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:31.890536 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" is forbidden: User \"system:node:ip-10-0-130-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-102.ec2.internal' and this object" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:31.920285 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:31.920235 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" is forbidden: User \"system:node:ip-10-0-130-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-102.ec2.internal' and this object" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:31.921361 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.921316 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" podStartSLOduration=1.921301362 podStartE2EDuration="1.921301362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:31.917654594 +0000 UTC m=+457.693607066" watchObservedRunningTime="2026-07-08 19:08:31.921301362 +0000 UTC m=+457.697253834" Jul 08 19:08:31.935275 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:31.935239 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" is forbidden: User \"system:node:ip-10-0-130-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-102.ec2.internal' and this object" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:31.975415 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.975384 2570 scope.go:117] "RemoveContainer" containerID="80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f" Jul 08 19:08:31.975789 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:31.975770 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f\": container with ID starting with 80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f not found: ID does not exist" containerID="80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f" Jul 08 19:08:31.975854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:31.975800 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f"} err="failed to get container status \"80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f\": rpc error: code = NotFound desc = could not find container \"80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f\": container with ID starting with 80e4dd41234116b486aa0a2798816f776a1117d33208720746fab5f612e0a95f not found: ID does not exist" Jul 08 19:08:32.099556 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.099531 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:32.101534 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:32.101507 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" is forbidden: User \"system:node:ip-10-0-130-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-102.ec2.internal' and this object" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:32.236712 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.236671 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tq85\" (UniqueName: \"kubernetes.io/projected/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-kube-api-access-9tq85\") pod \"fb8fb242-d225-4aad-bfd7-e0a28b6c0e57\" (UID: \"fb8fb242-d225-4aad-bfd7-e0a28b6c0e57\") " Jul 08 19:08:32.236921 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.236742 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-extensions-socket-volume\") pod \"fb8fb242-d225-4aad-bfd7-e0a28b6c0e57\" (UID: \"fb8fb242-d225-4aad-bfd7-e0a28b6c0e57\") " Jul 08 19:08:32.237083 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.237047 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" (UID: "fb8fb242-d225-4aad-bfd7-e0a28b6c0e57"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:08:32.238993 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.238972 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-kube-api-access-9tq85" (OuterVolumeSpecName: "kube-api-access-9tq85") pod "fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" (UID: "fb8fb242-d225-4aad-bfd7-e0a28b6c0e57"). InnerVolumeSpecName "kube-api-access-9tq85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:08:32.338059 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.338024 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tq85\" (UniqueName: \"kubernetes.io/projected/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-kube-api-access-9tq85\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:08:32.338059 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.338052 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57-extensions-socket-volume\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:08:32.756784 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.756746 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3521dc2-a064-44d3-a688-7a4b422dd4e2" path="/var/lib/kubelet/pods/a3521dc2-a064-44d3-a688-7a4b422dd4e2/volumes" Jul 08 19:08:32.757068 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.757055 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc" path="/var/lib/kubelet/pods/c6095ef8-6b49-4d3a-aa3d-19e48f5d7bdc/volumes" Jul 08 19:08:32.757355 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.757344 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" path="/var/lib/kubelet/pods/fb8fb242-d225-4aad-bfd7-e0a28b6c0e57/volumes" Jul 08 19:08:32.879571 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.879539 2570 generic.go:356] "Generic (PLEG): container finished" podID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" containerID="97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6" exitCode=2 Jul 08 19:08:32.879755 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.879585 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:32.879755 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.879634 2570 scope.go:117] "RemoveContainer" containerID="97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6" Jul 08 19:08:32.885395 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:32.885360 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" is forbidden: User \"system:node:ip-10-0-130-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-102.ec2.internal' and this object" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:32.888542 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.888521 2570 scope.go:117] "RemoveContainer" containerID="97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6" Jul 08 19:08:32.888860 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:32.888840 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6\": container with ID starting with 97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6 not found: ID does not exist" containerID="97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6" Jul 08 19:08:32.888924 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:32.888872 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6"} err="failed to get container status \"97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6\": rpc error: code = NotFound desc = could not find container \"97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6\": container with ID starting with 97bc8a8c7c7c75757731c5d62323847678888dc046c24daff03b567e206345d6 not found: ID does not exist" Jul 08 19:08:34.753768 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:34.753723 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-djklk\" is forbidden: User \"system:node:ip-10-0-130-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-102.ec2.internal' and this object" podUID="fb8fb242-d225-4aad-bfd7-e0a28b6c0e57" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-djklk" Jul 08 19:08:42.882594 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:42.882559 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:42.882981 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:42.882636 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slzzm" Jul 08 19:08:43.225967 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.225939 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w"] Jul 08 19:08:43.232970 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.232949 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:08:43.249796 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.249770 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w"] Jul 08 19:08:43.331265 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.331236 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e2258f-a092-49b3-abef-555b16c40a03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5tq8w\" (UID: \"c2e2258f-a092-49b3-abef-555b16c40a03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:08:43.331463 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.331286 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxzlp\" (UniqueName: \"kubernetes.io/projected/c2e2258f-a092-49b3-abef-555b16c40a03-kube-api-access-nxzlp\") pod \"kuadrant-operator-controller-manager-86878c769f-5tq8w\" (UID: \"c2e2258f-a092-49b3-abef-555b16c40a03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:08:43.431739 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.431705 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxzlp\" (UniqueName: \"kubernetes.io/projected/c2e2258f-a092-49b3-abef-555b16c40a03-kube-api-access-nxzlp\") pod \"kuadrant-operator-controller-manager-86878c769f-5tq8w\" (UID: \"c2e2258f-a092-49b3-abef-555b16c40a03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:08:43.431907 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.431777 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e2258f-a092-49b3-abef-555b16c40a03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5tq8w\" (UID: \"c2e2258f-a092-49b3-abef-555b16c40a03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:08:43.432142 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.432125 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e2258f-a092-49b3-abef-555b16c40a03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5tq8w\" (UID: \"c2e2258f-a092-49b3-abef-555b16c40a03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:08:43.448137 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.448106 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxzlp\" (UniqueName: \"kubernetes.io/projected/c2e2258f-a092-49b3-abef-555b16c40a03-kube-api-access-nxzlp\") pod \"kuadrant-operator-controller-manager-86878c769f-5tq8w\" (UID: \"c2e2258f-a092-49b3-abef-555b16c40a03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:08:43.543345 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.543273 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:08:43.675745 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.675713 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w"] Jul 08 19:08:43.678918 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:08:43.678885 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e2258f_a092_49b3_abef_555b16c40a03.slice/crio-098e63ab641966e03358461c8822c7086d55110cc28c0ab3110bd930dd3ba0d2 WatchSource:0}: Error finding container 098e63ab641966e03358461c8822c7086d55110cc28c0ab3110bd930dd3ba0d2: Status 404 returned error can't find the container with id 098e63ab641966e03358461c8822c7086d55110cc28c0ab3110bd930dd3ba0d2 Jul 08 19:08:43.942517 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.942484 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" event={"ID":"c2e2258f-a092-49b3-abef-555b16c40a03","Type":"ContainerStarted","Data":"9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec"} Jul 08 19:08:43.942958 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.942545 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:08:43.942958 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.942564 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" event={"ID":"c2e2258f-a092-49b3-abef-555b16c40a03","Type":"ContainerStarted","Data":"098e63ab641966e03358461c8822c7086d55110cc28c0ab3110bd930dd3ba0d2"} Jul 08 19:08:43.974586 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:43.974523 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" podStartSLOduration=0.974506955 podStartE2EDuration="974.506955ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:43.968601746 +0000 UTC m=+469.744554218" watchObservedRunningTime="2026-07-08 19:08:43.974506955 +0000 UTC m=+469.750459426" Jul 08 19:08:54.950800 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:54.950716 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:08:55.011041 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:55.011008 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl"] Jul 08 19:08:55.011305 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:55.011278 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" podUID="18dc731b-97cc-497e-ad5a-57f7c0885c66" containerName="manager" containerID="cri-o://e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25" gracePeriod=10 Jul 08 19:08:55.271404 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:55.271377 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:55.434402 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:55.434370 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j76nq\" (UniqueName: \"kubernetes.io/projected/18dc731b-97cc-497e-ad5a-57f7c0885c66-kube-api-access-j76nq\") pod \"18dc731b-97cc-497e-ad5a-57f7c0885c66\" (UID: \"18dc731b-97cc-497e-ad5a-57f7c0885c66\") " Jul 08 19:08:55.434620 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:55.434486 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18dc731b-97cc-497e-ad5a-57f7c0885c66-extensions-socket-volume\") pod \"18dc731b-97cc-497e-ad5a-57f7c0885c66\" (UID: \"18dc731b-97cc-497e-ad5a-57f7c0885c66\") " Jul 08 19:08:55.434848 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:55.434817 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18dc731b-97cc-497e-ad5a-57f7c0885c66-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "18dc731b-97cc-497e-ad5a-57f7c0885c66" (UID: "18dc731b-97cc-497e-ad5a-57f7c0885c66"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:08:55.436631 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:55.436610 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18dc731b-97cc-497e-ad5a-57f7c0885c66-kube-api-access-j76nq" (OuterVolumeSpecName: "kube-api-access-j76nq") pod "18dc731b-97cc-497e-ad5a-57f7c0885c66" (UID: "18dc731b-97cc-497e-ad5a-57f7c0885c66"). InnerVolumeSpecName "kube-api-access-j76nq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:08:55.535672 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:55.535581 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j76nq\" (UniqueName: \"kubernetes.io/projected/18dc731b-97cc-497e-ad5a-57f7c0885c66-kube-api-access-j76nq\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:08:55.535672 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:55.535617 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18dc731b-97cc-497e-ad5a-57f7c0885c66-extensions-socket-volume\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:08:56.002592 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:56.002552 2570 generic.go:356] "Generic (PLEG): container finished" podID="18dc731b-97cc-497e-ad5a-57f7c0885c66" containerID="e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25" exitCode=0 Jul 08 19:08:56.002980 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:56.002601 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" Jul 08 19:08:56.002980 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:56.002623 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" event={"ID":"18dc731b-97cc-497e-ad5a-57f7c0885c66","Type":"ContainerDied","Data":"e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25"} Jul 08 19:08:56.002980 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:56.002675 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl" event={"ID":"18dc731b-97cc-497e-ad5a-57f7c0885c66","Type":"ContainerDied","Data":"072b4218e3d2dabb51373a6be18c4b640c595ec53f21926e0a2513c89a0d1cf6"} Jul 08 19:08:56.002980 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:56.002704 2570 scope.go:117] "RemoveContainer" containerID="e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25" Jul 08 19:08:56.011987 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:56.011968 2570 scope.go:117] "RemoveContainer" containerID="e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25" Jul 08 19:08:56.012243 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:08:56.012224 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25\": container with ID starting with e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25 not found: ID does not exist" containerID="e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25" Jul 08 19:08:56.012301 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:56.012256 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25"} err="failed to get container status \"e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25\": rpc error: code = NotFound desc = could not find container \"e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25\": container with ID starting with e8af5ed2e463029e32a27fbc67d43df969c9c1bef0ae72f01047eef7239f3f25 not found: ID does not exist" Jul 08 19:08:56.026923 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:56.026895 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl"] Jul 08 19:08:56.031140 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:56.031120 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-62xcl"] Jul 08 19:08:56.755544 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:08:56.755509 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18dc731b-97cc-497e-ad5a-57f7c0885c66" path="/var/lib/kubelet/pods/18dc731b-97cc-497e-ad5a-57f7c0885c66/volumes" Jul 08 19:09:13.337555 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.337520 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:09:13.338074 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.337898 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18dc731b-97cc-497e-ad5a-57f7c0885c66" containerName="manager" Jul 08 19:09:13.338074 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.337910 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="18dc731b-97cc-497e-ad5a-57f7c0885c66" containerName="manager" Jul 08 19:09:13.338074 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.337997 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="18dc731b-97cc-497e-ad5a-57f7c0885c66" containerName="manager" Jul 08 19:09:13.342708 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.342690 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" Jul 08 19:09:13.344872 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.344851 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c8qc2\"" Jul 08 19:09:13.345044 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.345025 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 19:09:13.352675 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.352652 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:09:13.382095 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.382069 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:09:13.394189 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.394155 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/069ca1b5-e6af-4fb1-9318-ae839a4896e6-config-file\") pod \"limitador-limitador-54d6d988d5-574s7\" (UID: \"069ca1b5-e6af-4fb1-9318-ae839a4896e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" Jul 08 19:09:13.394317 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.394191 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77pp8\" (UniqueName: \"kubernetes.io/projected/069ca1b5-e6af-4fb1-9318-ae839a4896e6-kube-api-access-77pp8\") pod \"limitador-limitador-54d6d988d5-574s7\" (UID: \"069ca1b5-e6af-4fb1-9318-ae839a4896e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" Jul 08 19:09:13.494702 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.494661 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/069ca1b5-e6af-4fb1-9318-ae839a4896e6-config-file\") pod \"limitador-limitador-54d6d988d5-574s7\" (UID: \"069ca1b5-e6af-4fb1-9318-ae839a4896e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" Jul 08 19:09:13.494702 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.494696 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77pp8\" (UniqueName: \"kubernetes.io/projected/069ca1b5-e6af-4fb1-9318-ae839a4896e6-kube-api-access-77pp8\") pod \"limitador-limitador-54d6d988d5-574s7\" (UID: \"069ca1b5-e6af-4fb1-9318-ae839a4896e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" Jul 08 19:09:13.495281 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.495262 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/069ca1b5-e6af-4fb1-9318-ae839a4896e6-config-file\") pod \"limitador-limitador-54d6d988d5-574s7\" (UID: \"069ca1b5-e6af-4fb1-9318-ae839a4896e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" Jul 08 19:09:13.503271 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.503238 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77pp8\" (UniqueName: \"kubernetes.io/projected/069ca1b5-e6af-4fb1-9318-ae839a4896e6-kube-api-access-77pp8\") pod \"limitador-limitador-54d6d988d5-574s7\" (UID: \"069ca1b5-e6af-4fb1-9318-ae839a4896e6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" Jul 08 19:09:13.655794 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.655698 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" Jul 08 19:09:13.797048 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.797012 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:09:13.800024 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:09:13.799995 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069ca1b5_e6af_4fb1_9318_ae839a4896e6.slice/crio-74039a8bc0f42860d0a8aa1050b7bff9240737869ad57e43bed93b97c6a143ab WatchSource:0}: Error finding container 74039a8bc0f42860d0a8aa1050b7bff9240737869ad57e43bed93b97c6a143ab: Status 404 returned error can't find the container with id 74039a8bc0f42860d0a8aa1050b7bff9240737869ad57e43bed93b97c6a143ab Jul 08 19:09:13.871945 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.871910 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-llzfw"] Jul 08 19:09:13.876377 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.876360 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-llzfw" Jul 08 19:09:13.878370 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.878347 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rswsd\"" Jul 08 19:09:13.881735 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.881712 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-llzfw"] Jul 08 19:09:13.898174 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.898137 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgf6p\" (UniqueName: \"kubernetes.io/projected/beb1d36c-899b-425c-898d-8706668d98e9-kube-api-access-wgf6p\") pod \"authorino-75d556bd77-llzfw\" (UID: \"beb1d36c-899b-425c-898d-8706668d98e9\") " pod="kuadrant-system/authorino-75d556bd77-llzfw" Jul 08 19:09:13.998566 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:13.998525 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgf6p\" (UniqueName: \"kubernetes.io/projected/beb1d36c-899b-425c-898d-8706668d98e9-kube-api-access-wgf6p\") pod \"authorino-75d556bd77-llzfw\" (UID: \"beb1d36c-899b-425c-898d-8706668d98e9\") " pod="kuadrant-system/authorino-75d556bd77-llzfw" Jul 08 19:09:14.006925 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:14.006891 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgf6p\" (UniqueName: \"kubernetes.io/projected/beb1d36c-899b-425c-898d-8706668d98e9-kube-api-access-wgf6p\") pod \"authorino-75d556bd77-llzfw\" (UID: \"beb1d36c-899b-425c-898d-8706668d98e9\") " pod="kuadrant-system/authorino-75d556bd77-llzfw" Jul 08 19:09:14.086969 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:14.086918 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" event={"ID":"069ca1b5-e6af-4fb1-9318-ae839a4896e6","Type":"ContainerStarted","Data":"74039a8bc0f42860d0a8aa1050b7bff9240737869ad57e43bed93b97c6a143ab"} Jul 08 19:09:14.186596 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:14.186567 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-llzfw" Jul 08 19:09:14.353423 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:14.353379 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-llzfw"] Jul 08 19:09:14.357208 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:09:14.357175 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbeb1d36c_899b_425c_898d_8706668d98e9.slice/crio-8196c1f832fab7af3c07a69d8d0ddc4c4eacb1efec1bee5e983f5addca85d6ec WatchSource:0}: Error finding container 8196c1f832fab7af3c07a69d8d0ddc4c4eacb1efec1bee5e983f5addca85d6ec: Status 404 returned error can't find the container with id 8196c1f832fab7af3c07a69d8d0ddc4c4eacb1efec1bee5e983f5addca85d6ec Jul 08 19:09:15.094087 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:15.094044 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-llzfw" event={"ID":"beb1d36c-899b-425c-898d-8706668d98e9","Type":"ContainerStarted","Data":"8196c1f832fab7af3c07a69d8d0ddc4c4eacb1efec1bee5e983f5addca85d6ec"} Jul 08 19:09:17.107210 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:17.107172 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" event={"ID":"069ca1b5-e6af-4fb1-9318-ae839a4896e6","Type":"ContainerStarted","Data":"e5d32703732697f852a52308172f1e9ac7bd33b5c76c258004febdef2c59ba79"} Jul 08 19:09:17.107614 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:17.107255 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" Jul 08 19:09:17.127813 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:17.127750 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" podStartSLOduration=1.427587878 podStartE2EDuration="4.127733299s" totalImagesPullingTime="2.700145421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:17.127469845 +0000 UTC m=+502.903422346" watchObservedRunningTime="2026-07-08 19:09:17.127733299 +0000 UTC m=+502.903685765" Jul 08 19:09:19.118958 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:19.118857 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-llzfw" event={"ID":"beb1d36c-899b-425c-898d-8706668d98e9","Type":"ContainerStarted","Data":"c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc"} Jul 08 19:09:19.134993 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:19.134952 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-llzfw" podStartSLOduration=1.7126599649999998 podStartE2EDuration="6.134939838s" totalImagesPullingTime="4.422279873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:19.133817978 +0000 UTC m=+504.909770446" watchObservedRunningTime="2026-07-08 19:09:19.134939838 +0000 UTC m=+504.910892308" Jul 08 19:09:28.113480 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:28.113423 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-574s7" Jul 08 19:09:45.983342 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:45.983261 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6cqx"] Jul 08 19:09:45.987842 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:45.987825 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r6cqx" Jul 08 19:09:45.995532 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:45.995475 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6cqx"] Jul 08 19:09:46.068335 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.068299 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrrvq\" (UniqueName: \"kubernetes.io/projected/83445786-e772-4d1a-86a5-806b33350310-kube-api-access-rrrvq\") pod \"authorino-5d4b67c446-r6cqx\" (UID: \"83445786-e772-4d1a-86a5-806b33350310\") " pod="kuadrant-system/authorino-5d4b67c446-r6cqx" Jul 08 19:09:46.169221 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.169169 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrrvq\" (UniqueName: \"kubernetes.io/projected/83445786-e772-4d1a-86a5-806b33350310-kube-api-access-rrrvq\") pod \"authorino-5d4b67c446-r6cqx\" (UID: \"83445786-e772-4d1a-86a5-806b33350310\") " pod="kuadrant-system/authorino-5d4b67c446-r6cqx" Jul 08 19:09:46.177605 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.177576 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrrvq\" (UniqueName: \"kubernetes.io/projected/83445786-e772-4d1a-86a5-806b33350310-kube-api-access-rrrvq\") pod \"authorino-5d4b67c446-r6cqx\" (UID: \"83445786-e772-4d1a-86a5-806b33350310\") " pod="kuadrant-system/authorino-5d4b67c446-r6cqx" Jul 08 19:09:46.223266 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.223230 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6cqx"] Jul 08 19:09:46.223528 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.223514 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r6cqx" Jul 08 19:09:46.257883 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.257855 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54d96d7465-k2l2r"] Jul 08 19:09:46.261625 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.261605 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54d96d7465-k2l2r" Jul 08 19:09:46.273701 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.273673 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54d96d7465-k2l2r"] Jul 08 19:09:46.367292 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.367267 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6cqx"] Jul 08 19:09:46.369745 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:09:46.369714 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83445786_e772_4d1a_86a5_806b33350310.slice/crio-a1032386b4edee88ea1294d7a27b50862163aa6806dd5d54f745a0377507c81c WatchSource:0}: Error finding container a1032386b4edee88ea1294d7a27b50862163aa6806dd5d54f745a0377507c81c: Status 404 returned error can't find the container with id a1032386b4edee88ea1294d7a27b50862163aa6806dd5d54f745a0377507c81c Jul 08 19:09:46.370749 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.370726 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66fhz\" (UniqueName: \"kubernetes.io/projected/069c02a5-e886-460b-a30e-6ac492ee1cca-kube-api-access-66fhz\") pod \"authorino-54d96d7465-k2l2r\" (UID: \"069c02a5-e886-460b-a30e-6ac492ee1cca\") " pod="kuadrant-system/authorino-54d96d7465-k2l2r" Jul 08 19:09:46.440114 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.440075 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54d96d7465-k2l2r"] Jul 08 19:09:46.440357 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:09:46.440337 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-66fhz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-54d96d7465-k2l2r" podUID="069c02a5-e886-460b-a30e-6ac492ee1cca" Jul 08 19:09:46.467908 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.467876 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b9bb95fcc-dgpbz"] Jul 08 19:09:46.471543 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.471522 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" Jul 08 19:09:46.471772 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.471744 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66fhz\" (UniqueName: \"kubernetes.io/projected/069c02a5-e886-460b-a30e-6ac492ee1cca-kube-api-access-66fhz\") pod \"authorino-54d96d7465-k2l2r\" (UID: \"069c02a5-e886-460b-a30e-6ac492ee1cca\") " pod="kuadrant-system/authorino-54d96d7465-k2l2r" Jul 08 19:09:46.473855 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.473835 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 19:09:46.482078 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.482054 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b9bb95fcc-dgpbz"] Jul 08 19:09:46.484272 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.484249 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66fhz\" (UniqueName: \"kubernetes.io/projected/069c02a5-e886-460b-a30e-6ac492ee1cca-kube-api-access-66fhz\") pod \"authorino-54d96d7465-k2l2r\" (UID: \"069c02a5-e886-460b-a30e-6ac492ee1cca\") " pod="kuadrant-system/authorino-54d96d7465-k2l2r" Jul 08 19:09:46.572967 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.572887 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqqft\" (UniqueName: \"kubernetes.io/projected/da171be3-f1a2-4614-9c17-5029ff148575-kube-api-access-nqqft\") pod \"authorino-7b9bb95fcc-dgpbz\" (UID: \"da171be3-f1a2-4614-9c17-5029ff148575\") " pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" Jul 08 19:09:46.572967 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.572942 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da171be3-f1a2-4614-9c17-5029ff148575-tls-cert\") pod \"authorino-7b9bb95fcc-dgpbz\" (UID: \"da171be3-f1a2-4614-9c17-5029ff148575\") " pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" Jul 08 19:09:46.674066 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.674024 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da171be3-f1a2-4614-9c17-5029ff148575-tls-cert\") pod \"authorino-7b9bb95fcc-dgpbz\" (UID: \"da171be3-f1a2-4614-9c17-5029ff148575\") " pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" Jul 08 19:09:46.674233 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.674123 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqqft\" (UniqueName: \"kubernetes.io/projected/da171be3-f1a2-4614-9c17-5029ff148575-kube-api-access-nqqft\") pod \"authorino-7b9bb95fcc-dgpbz\" (UID: \"da171be3-f1a2-4614-9c17-5029ff148575\") " pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" Jul 08 19:09:46.676724 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.676700 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da171be3-f1a2-4614-9c17-5029ff148575-tls-cert\") pod \"authorino-7b9bb95fcc-dgpbz\" (UID: \"da171be3-f1a2-4614-9c17-5029ff148575\") " pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" Jul 08 19:09:46.681424 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.681403 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqqft\" (UniqueName: \"kubernetes.io/projected/da171be3-f1a2-4614-9c17-5029ff148575-kube-api-access-nqqft\") pod \"authorino-7b9bb95fcc-dgpbz\" (UID: \"da171be3-f1a2-4614-9c17-5029ff148575\") " pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" Jul 08 19:09:46.781921 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.781885 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" Jul 08 19:09:46.923827 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:46.923692 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b9bb95fcc-dgpbz"] Jul 08 19:09:46.926071 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:09:46.926046 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda171be3_f1a2_4614_9c17_5029ff148575.slice/crio-b7ede1ef8a0322e0635d3f797aba9b532aae0c461b8329b8aec36511d334ede5 WatchSource:0}: Error finding container b7ede1ef8a0322e0635d3f797aba9b532aae0c461b8329b8aec36511d334ede5: Status 404 returned error can't find the container with id b7ede1ef8a0322e0635d3f797aba9b532aae0c461b8329b8aec36511d334ede5 Jul 08 19:09:47.252756 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.252722 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" event={"ID":"da171be3-f1a2-4614-9c17-5029ff148575","Type":"ContainerStarted","Data":"b7ede1ef8a0322e0635d3f797aba9b532aae0c461b8329b8aec36511d334ede5"} Jul 08 19:09:47.254156 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.254119 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r6cqx" event={"ID":"83445786-e772-4d1a-86a5-806b33350310","Type":"ContainerStarted","Data":"459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2"} Jul 08 19:09:47.254156 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.254142 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54d96d7465-k2l2r" Jul 08 19:09:47.254372 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.254164 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r6cqx" event={"ID":"83445786-e772-4d1a-86a5-806b33350310","Type":"ContainerStarted","Data":"a1032386b4edee88ea1294d7a27b50862163aa6806dd5d54f745a0377507c81c"} Jul 08 19:09:47.254372 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.254171 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-r6cqx" podUID="83445786-e772-4d1a-86a5-806b33350310" containerName="authorino" containerID="cri-o://459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2" gracePeriod=30 Jul 08 19:09:47.262724 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.262694 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54d96d7465-k2l2r" Jul 08 19:09:47.273062 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.273015 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-r6cqx" podStartSLOduration=1.674851031 podStartE2EDuration="2.273000856s" totalImagesPullingTime="598.149825ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:47.270858477 +0000 UTC m=+533.046810949" watchObservedRunningTime="2026-07-08 19:09:47.273000856 +0000 UTC m=+533.048953328" Jul 08 19:09:47.381558 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.381535 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66fhz\" (UniqueName: \"kubernetes.io/projected/069c02a5-e886-460b-a30e-6ac492ee1cca-kube-api-access-66fhz\") pod \"069c02a5-e886-460b-a30e-6ac492ee1cca\" (UID: \"069c02a5-e886-460b-a30e-6ac492ee1cca\") " Jul 08 19:09:47.383953 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.383926 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/069c02a5-e886-460b-a30e-6ac492ee1cca-kube-api-access-66fhz" (OuterVolumeSpecName: "kube-api-access-66fhz") pod "069c02a5-e886-460b-a30e-6ac492ee1cca" (UID: "069c02a5-e886-460b-a30e-6ac492ee1cca"). InnerVolumeSpecName "kube-api-access-66fhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:09:47.482656 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.482619 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66fhz\" (UniqueName: \"kubernetes.io/projected/069c02a5-e886-460b-a30e-6ac492ee1cca-kube-api-access-66fhz\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:09:47.497266 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.497240 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r6cqx" Jul 08 19:09:47.583516 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.583402 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrrvq\" (UniqueName: \"kubernetes.io/projected/83445786-e772-4d1a-86a5-806b33350310-kube-api-access-rrrvq\") pod \"83445786-e772-4d1a-86a5-806b33350310\" (UID: \"83445786-e772-4d1a-86a5-806b33350310\") " Jul 08 19:09:47.585599 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.585572 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83445786-e772-4d1a-86a5-806b33350310-kube-api-access-rrrvq" (OuterVolumeSpecName: "kube-api-access-rrrvq") pod "83445786-e772-4d1a-86a5-806b33350310" (UID: "83445786-e772-4d1a-86a5-806b33350310"). InnerVolumeSpecName "kube-api-access-rrrvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:09:47.684146 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:47.684115 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrrvq\" (UniqueName: \"kubernetes.io/projected/83445786-e772-4d1a-86a5-806b33350310-kube-api-access-rrrvq\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:09:48.259952 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.259920 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" event={"ID":"da171be3-f1a2-4614-9c17-5029ff148575","Type":"ContainerStarted","Data":"c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa"} Jul 08 19:09:48.261201 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.261175 2570 generic.go:356] "Generic (PLEG): container finished" podID="83445786-e772-4d1a-86a5-806b33350310" containerID="459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2" exitCode=0 Jul 08 19:09:48.261316 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.261209 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r6cqx" Jul 08 19:09:48.261316 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.261258 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r6cqx" event={"ID":"83445786-e772-4d1a-86a5-806b33350310","Type":"ContainerDied","Data":"459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2"} Jul 08 19:09:48.261316 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.261297 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r6cqx" event={"ID":"83445786-e772-4d1a-86a5-806b33350310","Type":"ContainerDied","Data":"a1032386b4edee88ea1294d7a27b50862163aa6806dd5d54f745a0377507c81c"} Jul 08 19:09:48.261316 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.261315 2570 scope.go:117] "RemoveContainer" containerID="459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2" Jul 08 19:09:48.261556 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.261372 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54d96d7465-k2l2r" Jul 08 19:09:48.270597 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.270487 2570 scope.go:117] "RemoveContainer" containerID="459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2" Jul 08 19:09:48.270823 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:09:48.270803 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2\": container with ID starting with 459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2 not found: ID does not exist" containerID="459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2" Jul 08 19:09:48.270899 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.270831 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2"} err="failed to get container status \"459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2\": rpc error: code = NotFound desc = could not find container \"459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2\": container with ID starting with 459f1ca9109c0d132e740592b285f30860a7249e77dbb39845b3650fc4755bf2 not found: ID does not exist" Jul 08 19:09:48.276891 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.276844 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" podStartSLOduration=1.945742728 podStartE2EDuration="2.276828289s" totalImagesPullingTime="331.085561ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:48.275517939 +0000 UTC m=+534.051470401" watchObservedRunningTime="2026-07-08 19:09:48.276828289 +0000 UTC m=+534.052780762" Jul 08 19:09:48.299990 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.299952 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54d96d7465-k2l2r"] Jul 08 19:09:48.306007 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.305976 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54d96d7465-k2l2r"] Jul 08 19:09:48.312288 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.312256 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-llzfw"] Jul 08 19:09:48.312497 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.312473 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-llzfw" podUID="beb1d36c-899b-425c-898d-8706668d98e9" containerName="authorino" containerID="cri-o://c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc" gracePeriod=30 Jul 08 19:09:48.319234 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.319200 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6cqx"] Jul 08 19:09:48.326881 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.326853 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6cqx"] Jul 08 19:09:48.573942 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.573922 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-llzfw" Jul 08 19:09:48.693506 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.693477 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgf6p\" (UniqueName: \"kubernetes.io/projected/beb1d36c-899b-425c-898d-8706668d98e9-kube-api-access-wgf6p\") pod \"beb1d36c-899b-425c-898d-8706668d98e9\" (UID: \"beb1d36c-899b-425c-898d-8706668d98e9\") " Jul 08 19:09:48.695642 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.695606 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beb1d36c-899b-425c-898d-8706668d98e9-kube-api-access-wgf6p" (OuterVolumeSpecName: "kube-api-access-wgf6p") pod "beb1d36c-899b-425c-898d-8706668d98e9" (UID: "beb1d36c-899b-425c-898d-8706668d98e9"). InnerVolumeSpecName "kube-api-access-wgf6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:09:48.756305 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.756229 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="069c02a5-e886-460b-a30e-6ac492ee1cca" path="/var/lib/kubelet/pods/069c02a5-e886-460b-a30e-6ac492ee1cca/volumes" Jul 08 19:09:48.756489 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.756476 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83445786-e772-4d1a-86a5-806b33350310" path="/var/lib/kubelet/pods/83445786-e772-4d1a-86a5-806b33350310/volumes" Jul 08 19:09:48.794888 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:48.794864 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgf6p\" (UniqueName: \"kubernetes.io/projected/beb1d36c-899b-425c-898d-8706668d98e9-kube-api-access-wgf6p\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:09:49.268187 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:49.268150 2570 generic.go:356] "Generic (PLEG): container finished" podID="beb1d36c-899b-425c-898d-8706668d98e9" containerID="c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc" exitCode=0 Jul 08 19:09:49.268652 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:49.268195 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-llzfw" Jul 08 19:09:49.268652 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:49.268234 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-llzfw" event={"ID":"beb1d36c-899b-425c-898d-8706668d98e9","Type":"ContainerDied","Data":"c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc"} Jul 08 19:09:49.268652 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:49.268273 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-llzfw" event={"ID":"beb1d36c-899b-425c-898d-8706668d98e9","Type":"ContainerDied","Data":"8196c1f832fab7af3c07a69d8d0ddc4c4eacb1efec1bee5e983f5addca85d6ec"} Jul 08 19:09:49.268652 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:49.268290 2570 scope.go:117] "RemoveContainer" containerID="c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc" Jul 08 19:09:49.277185 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:49.277166 2570 scope.go:117] "RemoveContainer" containerID="c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc" Jul 08 19:09:49.277492 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:09:49.277470 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc\": container with ID starting with c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc not found: ID does not exist" containerID="c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc" Jul 08 19:09:49.277553 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:49.277501 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc"} err="failed to get container status \"c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc\": rpc error: code = NotFound desc = could not find container \"c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc\": container with ID starting with c59e7bca09eb56d6c686fdd3e141416c79186fb56ac2915bed18a0ef69c34bbc not found: ID does not exist" Jul 08 19:09:49.286217 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:49.286197 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-llzfw"] Jul 08 19:09:49.291033 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:49.291012 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-llzfw"] Jul 08 19:09:50.755973 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:09:50.755941 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beb1d36c-899b-425c-898d-8706668d98e9" path="/var/lib/kubelet/pods/beb1d36c-899b-425c-898d-8706668d98e9/volumes" Jul 08 19:10:27.854378 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:10:27.854341 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:10:47.910203 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:10:47.910163 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:10:54.681721 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:10:54.681691 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:10:54.689593 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:10:54.689566 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:11:01.874831 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:01.874790 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:11:07.977456 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:07.977412 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:11:09.744715 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.744674 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf"] Jul 08 19:11:09.745304 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.745283 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb1d36c-899b-425c-898d-8706668d98e9" containerName="authorino" Jul 08 19:11:09.745304 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.745305 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb1d36c-899b-425c-898d-8706668d98e9" containerName="authorino" Jul 08 19:11:09.745501 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.745319 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83445786-e772-4d1a-86a5-806b33350310" containerName="authorino" Jul 08 19:11:09.745501 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.745329 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="83445786-e772-4d1a-86a5-806b33350310" containerName="authorino" Jul 08 19:11:09.745501 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.745482 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb1d36c-899b-425c-898d-8706668d98e9" containerName="authorino" Jul 08 19:11:09.745612 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.745510 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="83445786-e772-4d1a-86a5-806b33350310" containerName="authorino" Jul 08 19:11:09.748688 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.748671 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.751283 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.751260 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 19:11:09.751283 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.751273 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 19:11:09.751519 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.751307 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 19:11:09.751519 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.751314 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-r6kqj\"" Jul 08 19:11:09.761334 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.758833 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf"] Jul 08 19:11:09.786696 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.786643 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.786893 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.786710 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.786893 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.786760 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.786893 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.786808 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10a39305-3bd3-4ace-8575-94f8fb41c481-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.786893 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.786859 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.787062 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.786903 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd82t\" (UniqueName: \"kubernetes.io/projected/10a39305-3bd3-4ace-8575-94f8fb41c481-kube-api-access-sd82t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.887262 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.887209 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.887262 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.887269 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.887534 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.887296 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10a39305-3bd3-4ace-8575-94f8fb41c481-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.887534 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.887325 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.887534 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.887347 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd82t\" (UniqueName: \"kubernetes.io/projected/10a39305-3bd3-4ace-8575-94f8fb41c481-kube-api-access-sd82t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.887534 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.887377 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.887726 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.887706 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.887781 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.887764 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.887838 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.887768 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.889826 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.889802 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10a39305-3bd3-4ace-8575-94f8fb41c481-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.890000 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.889983 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10a39305-3bd3-4ace-8575-94f8fb41c481-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:09.895696 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:09.895673 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd82t\" (UniqueName: \"kubernetes.io/projected/10a39305-3bd3-4ace-8575-94f8fb41c481-kube-api-access-sd82t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf\" (UID: \"10a39305-3bd3-4ace-8575-94f8fb41c481\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:10.063110 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:10.062985 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:10.207887 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:10.207860 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf"] Jul 08 19:11:10.209840 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:11:10.209807 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a39305_3bd3_4ace_8575_94f8fb41c481.slice/crio-ed34a328de35ad6781d16f77d72e3327c77aab0d625e6fe39f88f42353767428 WatchSource:0}: Error finding container ed34a328de35ad6781d16f77d72e3327c77aab0d625e6fe39f88f42353767428: Status 404 returned error can't find the container with id ed34a328de35ad6781d16f77d72e3327c77aab0d625e6fe39f88f42353767428 Jul 08 19:11:10.211144 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:10.211123 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:11:10.663455 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:10.663353 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" event={"ID":"10a39305-3bd3-4ace-8575-94f8fb41c481","Type":"ContainerStarted","Data":"ed34a328de35ad6781d16f77d72e3327c77aab0d625e6fe39f88f42353767428"} Jul 08 19:11:11.673314 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:11.673274 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" event={"ID":"10a39305-3bd3-4ace-8575-94f8fb41c481","Type":"ContainerStarted","Data":"2b863ef82808a4c09bb09b6a3b7ce079fcab7a15f9d18d8ad8d58aa0e06c7fc5"} Jul 08 19:11:11.691395 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:11.691336 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" podStartSLOduration=1.5362947120000001 podStartE2EDuration="2.691318837s" totalImagesPullingTime="1.155024125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:11:11.690503414 +0000 UTC m=+617.466455882" watchObservedRunningTime="2026-07-08 19:11:11.691318837 +0000 UTC m=+617.467271286" Jul 08 19:11:15.171572 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:15.171535 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:11:19.490255 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:19.490178 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:11:20.063945 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:20.063916 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:20.064116 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:20.063971 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:20.077311 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:20.077283 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:20.729782 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:20.729746 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf" Jul 08 19:11:29.952745 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:29.952710 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr"] Jul 08 19:11:29.959160 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:29.959136 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:29.961216 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:29.961197 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 08 19:11:29.965429 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:29.965395 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr"] Jul 08 19:11:30.034653 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.034619 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.034853 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.034689 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r8mc\" (UniqueName: \"kubernetes.io/projected/cb39e5a4-b81a-418e-865d-fad375603f26-kube-api-access-4r8mc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.034853 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.034715 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.034853 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.034779 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.034853 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.034813 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.034996 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.034876 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb39e5a4-b81a-418e-865d-fad375603f26-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.135613 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.135582 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r8mc\" (UniqueName: \"kubernetes.io/projected/cb39e5a4-b81a-418e-865d-fad375603f26-kube-api-access-4r8mc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.135613 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.135618 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.135883 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.135659 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.135883 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.135678 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.135883 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.135713 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb39e5a4-b81a-418e-865d-fad375603f26-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.135883 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.135755 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.136207 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.136175 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.136293 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.136219 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.136293 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.136270 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.138253 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.138225 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb39e5a4-b81a-418e-865d-fad375603f26-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.138533 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.138514 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb39e5a4-b81a-418e-865d-fad375603f26-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.143294 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.143268 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r8mc\" (UniqueName: \"kubernetes.io/projected/cb39e5a4-b81a-418e-865d-fad375603f26-kube-api-access-4r8mc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr\" (UID: \"cb39e5a4-b81a-418e-865d-fad375603f26\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.270365 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.270265 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:30.408850 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.408825 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr"] Jul 08 19:11:30.410968 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:11:30.410939 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb39e5a4_b81a_418e_865d_fad375603f26.slice/crio-b6cc727193ff3fb61458cb3f5d79c6d4229447834e96148b7c3441e817ade77f WatchSource:0}: Error finding container b6cc727193ff3fb61458cb3f5d79c6d4229447834e96148b7c3441e817ade77f: Status 404 returned error can't find the container with id b6cc727193ff3fb61458cb3f5d79c6d4229447834e96148b7c3441e817ade77f Jul 08 19:11:30.767274 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.767236 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" event={"ID":"cb39e5a4-b81a-418e-865d-fad375603f26","Type":"ContainerStarted","Data":"7269b7dd60abe3fcd07a850322c964004257f1fabd5ae66c65407cae12baba5c"} Jul 08 19:11:30.767274 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.767277 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" event={"ID":"cb39e5a4-b81a-418e-865d-fad375603f26","Type":"ContainerStarted","Data":"b6cc727193ff3fb61458cb3f5d79c6d4229447834e96148b7c3441e817ade77f"} Jul 08 19:11:30.784515 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:30.784462 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" podStartSLOduration=1.579164794 podStartE2EDuration="1.784429606s" totalImagesPullingTime="205.264812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:11:30.783322829 +0000 UTC m=+636.559275301" watchObservedRunningTime="2026-07-08 19:11:30.784429606 +0000 UTC m=+636.560382077" Jul 08 19:11:32.576285 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:32.576253 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:11:40.270748 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:40.270697 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:40.270748 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:40.270756 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:40.283460 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:40.283419 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:11:40.836507 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:11:40.836479 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr" Jul 08 19:13:03.717603 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:03.716364 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b9bb95fcc-dgpbz"] Jul 08 19:13:03.717603 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:03.716589 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" podUID="da171be3-f1a2-4614-9c17-5029ff148575" containerName="authorino" containerID="cri-o://c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa" gracePeriod=30 Jul 08 19:13:03.967652 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:03.967591 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" Jul 08 19:13:04.048537 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.048500 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqqft\" (UniqueName: \"kubernetes.io/projected/da171be3-f1a2-4614-9c17-5029ff148575-kube-api-access-nqqft\") pod \"da171be3-f1a2-4614-9c17-5029ff148575\" (UID: \"da171be3-f1a2-4614-9c17-5029ff148575\") " Jul 08 19:13:04.048727 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.048558 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da171be3-f1a2-4614-9c17-5029ff148575-tls-cert\") pod \"da171be3-f1a2-4614-9c17-5029ff148575\" (UID: \"da171be3-f1a2-4614-9c17-5029ff148575\") " Jul 08 19:13:04.050780 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.050751 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da171be3-f1a2-4614-9c17-5029ff148575-kube-api-access-nqqft" (OuterVolumeSpecName: "kube-api-access-nqqft") pod "da171be3-f1a2-4614-9c17-5029ff148575" (UID: "da171be3-f1a2-4614-9c17-5029ff148575"). InnerVolumeSpecName "kube-api-access-nqqft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:13:04.061090 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.061062 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da171be3-f1a2-4614-9c17-5029ff148575-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "da171be3-f1a2-4614-9c17-5029ff148575" (UID: "da171be3-f1a2-4614-9c17-5029ff148575"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:13:04.150271 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.150234 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqqft\" (UniqueName: \"kubernetes.io/projected/da171be3-f1a2-4614-9c17-5029ff148575-kube-api-access-nqqft\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:13:04.150271 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.150267 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da171be3-f1a2-4614-9c17-5029ff148575-tls-cert\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:13:04.226914 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.226816 2570 generic.go:356] "Generic (PLEG): container finished" podID="da171be3-f1a2-4614-9c17-5029ff148575" containerID="c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa" exitCode=0 Jul 08 19:13:04.226914 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.226873 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" Jul 08 19:13:04.226914 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.226888 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" event={"ID":"da171be3-f1a2-4614-9c17-5029ff148575","Type":"ContainerDied","Data":"c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa"} Jul 08 19:13:04.227213 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.226920 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9bb95fcc-dgpbz" event={"ID":"da171be3-f1a2-4614-9c17-5029ff148575","Type":"ContainerDied","Data":"b7ede1ef8a0322e0635d3f797aba9b532aae0c461b8329b8aec36511d334ede5"} Jul 08 19:13:04.227213 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.226938 2570 scope.go:117] "RemoveContainer" containerID="c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa" Jul 08 19:13:04.236299 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.236281 2570 scope.go:117] "RemoveContainer" containerID="c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa" Jul 08 19:13:04.236584 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:13:04.236551 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa\": container with ID starting with c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa not found: ID does not exist" containerID="c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa" Jul 08 19:13:04.236657 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.236591 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa"} err="failed to get container status \"c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa\": rpc error: code = NotFound desc = could not find container \"c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa\": container with ID starting with c4dcaa7ad042044f59c302708138f18d1871c23c8cc9fa47338995b3a3b9f3aa not found: ID does not exist" Jul 08 19:13:04.251791 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.251763 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b9bb95fcc-dgpbz"] Jul 08 19:13:04.254224 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.254202 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b9bb95fcc-dgpbz"] Jul 08 19:13:04.756322 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:04.756283 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da171be3-f1a2-4614-9c17-5029ff148575" path="/var/lib/kubelet/pods/da171be3-f1a2-4614-9c17-5029ff148575/volumes" Jul 08 19:13:30.481131 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:30.481093 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:13:41.280850 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:41.280819 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:13:53.083524 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:13:53.083490 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:14:01.672800 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:14:01.672756 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:14:12.878047 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:14:12.878013 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:14:39.590677 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:14:39.590583 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:14:51.583321 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:14:51.583288 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:15:00.153573 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.153535 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww"] Jul 08 19:15:00.153971 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.153920 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da171be3-f1a2-4614-9c17-5029ff148575" containerName="authorino" Jul 08 19:15:00.153971 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.153932 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="da171be3-f1a2-4614-9c17-5029ff148575" containerName="authorino" Jul 08 19:15:00.154053 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.153998 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="da171be3-f1a2-4614-9c17-5029ff148575" containerName="authorino" Jul 08 19:15:00.157206 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.157186 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww" Jul 08 19:15:00.159543 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.159521 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 19:15:00.159658 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.159626 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 19:15:00.160196 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.160177 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4s497\"" Jul 08 19:15:00.164829 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.164366 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww"] Jul 08 19:15:00.188817 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.188789 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djdgd\" (UniqueName: \"kubernetes.io/projected/31a4b227-8f97-4919-93d6-7e7718520e46-kube-api-access-djdgd\") pod \"maas-api-key-cleanup-29725635-hdcww\" (UID: \"31a4b227-8f97-4919-93d6-7e7718520e46\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww" Jul 08 19:15:00.289468 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.289405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djdgd\" (UniqueName: \"kubernetes.io/projected/31a4b227-8f97-4919-93d6-7e7718520e46-kube-api-access-djdgd\") pod \"maas-api-key-cleanup-29725635-hdcww\" (UID: \"31a4b227-8f97-4919-93d6-7e7718520e46\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww" Jul 08 19:15:00.301744 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.301709 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djdgd\" (UniqueName: \"kubernetes.io/projected/31a4b227-8f97-4919-93d6-7e7718520e46-kube-api-access-djdgd\") pod \"maas-api-key-cleanup-29725635-hdcww\" (UID: \"31a4b227-8f97-4919-93d6-7e7718520e46\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww" Jul 08 19:15:00.468482 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.468426 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww" Jul 08 19:15:00.613896 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.613875 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww"] Jul 08 19:15:00.616638 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:15:00.616612 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a4b227_8f97_4919_93d6_7e7718520e46.slice/crio-c3dbeed7f35bed526fc3c5b412fe9364a05f627c2d67e5710c125de566e0a656 WatchSource:0}: Error finding container c3dbeed7f35bed526fc3c5b412fe9364a05f627c2d67e5710c125de566e0a656: Status 404 returned error can't find the container with id c3dbeed7f35bed526fc3c5b412fe9364a05f627c2d67e5710c125de566e0a656 Jul 08 19:15:00.800516 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:00.800410 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww" event={"ID":"31a4b227-8f97-4919-93d6-7e7718520e46","Type":"ContainerStarted","Data":"c3dbeed7f35bed526fc3c5b412fe9364a05f627c2d67e5710c125de566e0a656"} Jul 08 19:15:03.821583 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:03.821554 2570 generic.go:356] "Generic (PLEG): container finished" podID="31a4b227-8f97-4919-93d6-7e7718520e46" containerID="401329af076c1e342dcbfce7a6dada8dac3259d56091099d98481528faf2d700" exitCode=0 Jul 08 19:15:03.821965 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:03.821649 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww" event={"ID":"31a4b227-8f97-4919-93d6-7e7718520e46","Type":"ContainerDied","Data":"401329af076c1e342dcbfce7a6dada8dac3259d56091099d98481528faf2d700"} Jul 08 19:15:04.967918 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:04.967896 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww" Jul 08 19:15:05.033010 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:05.032979 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djdgd\" (UniqueName: \"kubernetes.io/projected/31a4b227-8f97-4919-93d6-7e7718520e46-kube-api-access-djdgd\") pod \"31a4b227-8f97-4919-93d6-7e7718520e46\" (UID: \"31a4b227-8f97-4919-93d6-7e7718520e46\") " Jul 08 19:15:05.035272 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:05.035244 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31a4b227-8f97-4919-93d6-7e7718520e46-kube-api-access-djdgd" (OuterVolumeSpecName: "kube-api-access-djdgd") pod "31a4b227-8f97-4919-93d6-7e7718520e46" (UID: "31a4b227-8f97-4919-93d6-7e7718520e46"). InnerVolumeSpecName "kube-api-access-djdgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:15:05.134415 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:05.134327 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djdgd\" (UniqueName: \"kubernetes.io/projected/31a4b227-8f97-4919-93d6-7e7718520e46-kube-api-access-djdgd\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:15:05.832380 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:05.832346 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww" Jul 08 19:15:05.832572 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:05.832381 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725635-hdcww" event={"ID":"31a4b227-8f97-4919-93d6-7e7718520e46","Type":"ContainerDied","Data":"c3dbeed7f35bed526fc3c5b412fe9364a05f627c2d67e5710c125de566e0a656"} Jul 08 19:15:05.832572 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:05.832454 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3dbeed7f35bed526fc3c5b412fe9364a05f627c2d67e5710c125de566e0a656" Jul 08 19:15:33.178500 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:33.178461 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:15:40.674678 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:40.674645 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:15:51.174363 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:51.174267 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:15:54.711905 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:54.711874 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:15:54.716713 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:54.716687 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:15:57.076638 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:15:57.076600 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:16:08.481160 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:16:08.481121 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:16:17.577068 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:16:17.577036 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:16:28.674278 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:16:28.674240 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:16:38.672854 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:16:38.672813 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:17:01.074090 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:17:01.074046 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:17:13.572483 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:17:13.572432 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:17:35.486136 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:17:35.486050 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:17:45.984190 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:17:45.984152 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:18:03.077483 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:18:03.077432 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:18:14.383357 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:18:14.383320 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:18:23.980651 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:18:23.980615 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:18:33.382347 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:18:33.382307 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:18:42.773035 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:18:42.772999 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:19:08.029962 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:08.029922 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w"] Jul 08 19:19:08.030688 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:08.030128 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" podUID="c2e2258f-a092-49b3-abef-555b16c40a03" containerName="manager" containerID="cri-o://9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec" gracePeriod=10 Jul 08 19:19:11.201469 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:11.201428 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:19:11.296631 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:11.296543 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxzlp\" (UniqueName: \"kubernetes.io/projected/c2e2258f-a092-49b3-abef-555b16c40a03-kube-api-access-nxzlp\") pod \"c2e2258f-a092-49b3-abef-555b16c40a03\" (UID: \"c2e2258f-a092-49b3-abef-555b16c40a03\") " Jul 08 19:19:11.296794 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:11.296659 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e2258f-a092-49b3-abef-555b16c40a03-extensions-socket-volume\") pod \"c2e2258f-a092-49b3-abef-555b16c40a03\" (UID: \"c2e2258f-a092-49b3-abef-555b16c40a03\") " Jul 08 19:19:11.297030 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:11.297004 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2e2258f-a092-49b3-abef-555b16c40a03-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c2e2258f-a092-49b3-abef-555b16c40a03" (UID: "c2e2258f-a092-49b3-abef-555b16c40a03"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:11.298774 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:11.298752 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2e2258f-a092-49b3-abef-555b16c40a03-kube-api-access-nxzlp" (OuterVolumeSpecName: "kube-api-access-nxzlp") pod "c2e2258f-a092-49b3-abef-555b16c40a03" (UID: "c2e2258f-a092-49b3-abef-555b16c40a03"). InnerVolumeSpecName "kube-api-access-nxzlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:19:11.397679 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:11.397644 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e2258f-a092-49b3-abef-555b16c40a03-extensions-socket-volume\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:19:11.397679 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:11.397676 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxzlp\" (UniqueName: \"kubernetes.io/projected/c2e2258f-a092-49b3-abef-555b16c40a03-kube-api-access-nxzlp\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:19:12.036204 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:12.036161 2570 generic.go:356] "Generic (PLEG): container finished" podID="c2e2258f-a092-49b3-abef-555b16c40a03" containerID="9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec" exitCode=0 Jul 08 19:19:12.036204 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:12.036206 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" Jul 08 19:19:12.036432 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:12.036233 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" event={"ID":"c2e2258f-a092-49b3-abef-555b16c40a03","Type":"ContainerDied","Data":"9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec"} Jul 08 19:19:12.036432 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:12.036287 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w" event={"ID":"c2e2258f-a092-49b3-abef-555b16c40a03","Type":"ContainerDied","Data":"098e63ab641966e03358461c8822c7086d55110cc28c0ab3110bd930dd3ba0d2"} Jul 08 19:19:12.036432 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:12.036309 2570 scope.go:117] "RemoveContainer" containerID="9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec" Jul 08 19:19:12.047388 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:12.047360 2570 scope.go:117] "RemoveContainer" containerID="9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec" Jul 08 19:19:12.047720 ip-10-0-130-102 kubenswrapper[2570]: E0708 19:19:12.047703 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec\": container with ID starting with 9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec not found: ID does not exist" containerID="9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec" Jul 08 19:19:12.047768 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:12.047728 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec"} err="failed to get container status \"9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec\": rpc error: code = NotFound desc = could not find container \"9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec\": container with ID starting with 9c84f38dad36f19826683a20f7dba983825ec711de3559726470d9678b6c5bec not found: ID does not exist" Jul 08 19:19:12.059084 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:12.059047 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w"] Jul 08 19:19:12.062946 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:12.062915 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5tq8w"] Jul 08 19:19:12.756415 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:19:12.756381 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2e2258f-a092-49b3-abef-555b16c40a03" path="/var/lib/kubelet/pods/c2e2258f-a092-49b3-abef-555b16c40a03/volumes" Jul 08 19:20:09.260842 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.260795 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg"] Jul 08 19:20:09.261293 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.261164 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a4b227-8f97-4919-93d6-7e7718520e46" containerName="cleanup" Jul 08 19:20:09.261293 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.261175 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a4b227-8f97-4919-93d6-7e7718520e46" containerName="cleanup" Jul 08 19:20:09.261293 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.261200 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2e2258f-a092-49b3-abef-555b16c40a03" containerName="manager" Jul 08 19:20:09.261293 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.261206 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2e2258f-a092-49b3-abef-555b16c40a03" containerName="manager" Jul 08 19:20:09.261293 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.261265 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2e2258f-a092-49b3-abef-555b16c40a03" containerName="manager" Jul 08 19:20:09.261293 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.261276 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="31a4b227-8f97-4919-93d6-7e7718520e46" containerName="cleanup" Jul 08 19:20:09.272320 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.272293 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" Jul 08 19:20:09.274612 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.274583 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-chtd7\"" Jul 08 19:20:09.277683 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.277660 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg"] Jul 08 19:20:09.390354 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.390320 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2k8wg\" (UID: \"9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" Jul 08 19:20:09.390354 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.390368 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcdcc\" (UniqueName: \"kubernetes.io/projected/9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8-kube-api-access-mcdcc\") pod \"kuadrant-operator-controller-manager-86878c769f-2k8wg\" (UID: \"9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" Jul 08 19:20:09.491791 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.491755 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2k8wg\" (UID: \"9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" Jul 08 19:20:09.491957 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.491805 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcdcc\" (UniqueName: \"kubernetes.io/projected/9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8-kube-api-access-mcdcc\") pod \"kuadrant-operator-controller-manager-86878c769f-2k8wg\" (UID: \"9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" Jul 08 19:20:09.492157 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.492137 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2k8wg\" (UID: \"9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" Jul 08 19:20:09.500593 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.500563 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcdcc\" (UniqueName: \"kubernetes.io/projected/9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8-kube-api-access-mcdcc\") pod \"kuadrant-operator-controller-manager-86878c769f-2k8wg\" (UID: \"9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" Jul 08 19:20:09.584738 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.584647 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" Jul 08 19:20:09.733425 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:09.733395 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg"] Jul 08 19:20:09.736656 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:20:09.736629 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f73f718_d1dc_4b27_bc88_c79cbfc0a3d8.slice/crio-88d2c4ce8bb8eb750e1382db49d8aa066153df0d7f9a73649be799969f456a70 WatchSource:0}: Error finding container 88d2c4ce8bb8eb750e1382db49d8aa066153df0d7f9a73649be799969f456a70: Status 404 returned error can't find the container with id 88d2c4ce8bb8eb750e1382db49d8aa066153df0d7f9a73649be799969f456a70 Jul 08 19:20:10.311118 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:10.311081 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" event={"ID":"9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8","Type":"ContainerStarted","Data":"89dfe70dc797f3a96f1a37c2ebe5397b6136a2adfac827ad2aef60ae051d83ea"} Jul 08 19:20:10.311600 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:10.311137 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" event={"ID":"9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8","Type":"ContainerStarted","Data":"88d2c4ce8bb8eb750e1382db49d8aa066153df0d7f9a73649be799969f456a70"} Jul 08 19:20:10.311600 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:10.311168 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" Jul 08 19:20:10.331015 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:10.330957 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" podStartSLOduration=1.330939753 podStartE2EDuration="1.330939753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:20:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:20:10.328521468 +0000 UTC m=+1156.104473939" watchObservedRunningTime="2026-07-08 19:20:10.330939753 +0000 UTC m=+1156.106892225" Jul 08 19:20:21.317897 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:21.317866 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2k8wg" Jul 08 19:20:30.669144 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:30.669105 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:20:39.685246 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:39.685206 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:20:52.480725 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:52.480690 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:20:54.749485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:54.749430 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:20:54.749942 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:20:54.749727 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:21:04.171577 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:21:04.171538 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:21:14.781935 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:21:14.781897 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:21:25.778833 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:21:25.778790 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:21:34.273153 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:21:34.273115 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:21:45.275703 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:21:45.275661 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:21:52.383251 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:21:52.383214 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:22:02.476335 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:22:02.476298 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:22:13.579135 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:22:13.579095 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:22:21.573615 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:22:21.573575 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:22:40.979398 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:22:40.979348 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:22:50.089885 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:22:50.089850 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:22:59.589485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:22:59.589418 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:23:11.074147 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:23:11.074104 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:23:27.596877 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:23:27.596791 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:23:39.080838 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:23:39.080794 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:23:47.991630 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:23:47.991591 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:23:58.482001 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:23:58.481966 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:24:07.271414 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:24:07.271378 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:24:26.268594 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:24:26.268552 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:24:35.080810 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:24:35.080770 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:24:44.972878 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:24:44.972835 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:24:54.873650 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:24:54.873609 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:25:07.677581 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:25:07.677542 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:25:16.776480 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:25:16.776427 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:25:26.579326 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:25:26.579287 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:25:38.375550 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:25:38.375514 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:25:50.580661 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:25:50.580624 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:25:54.787113 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:25:54.787083 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:25:54.789245 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:25:54.789221 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:26:01.675994 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:26:01.675954 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:26:12.681279 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:26:12.681232 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:26:21.378681 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:26:21.378592 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:26:30.883303 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:26:30.881030 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:26:41.984612 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:26:41.984577 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:27:40.975230 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:27:40.975191 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:30:00.145325 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.145291 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r"] Jul 08 19:30:00.148699 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.148682 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" Jul 08 19:30:00.151088 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.151065 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 19:30:00.151360 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.151338 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4s497\"" Jul 08 19:30:00.151485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.151358 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 19:30:00.168743 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.168716 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r"] Jul 08 19:30:00.192485 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.192433 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwdp6\" (UniqueName: \"kubernetes.io/projected/c1348d31-55c0-45f1-92eb-ac86ac1a05df-kube-api-access-nwdp6\") pod \"maas-api-key-cleanup-29725650-rcf8r\" (UID: \"c1348d31-55c0-45f1-92eb-ac86ac1a05df\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" Jul 08 19:30:00.293765 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.293731 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwdp6\" (UniqueName: \"kubernetes.io/projected/c1348d31-55c0-45f1-92eb-ac86ac1a05df-kube-api-access-nwdp6\") pod \"maas-api-key-cleanup-29725650-rcf8r\" (UID: \"c1348d31-55c0-45f1-92eb-ac86ac1a05df\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" Jul 08 19:30:00.304574 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.304550 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwdp6\" (UniqueName: \"kubernetes.io/projected/c1348d31-55c0-45f1-92eb-ac86ac1a05df-kube-api-access-nwdp6\") pod \"maas-api-key-cleanup-29725650-rcf8r\" (UID: \"c1348d31-55c0-45f1-92eb-ac86ac1a05df\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" Jul 08 19:30:00.459182 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.459143 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" Jul 08 19:30:00.600837 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:00.600798 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r"] Jul 08 19:30:00.603449 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:30:00.603397 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1348d31_55c0_45f1_92eb_ac86ac1a05df.slice/crio-4e35dd308f830f76d0bd3a75c0821d4c13b41355d3203ad2d6b3c2fc31238565 WatchSource:0}: Error finding container 4e35dd308f830f76d0bd3a75c0821d4c13b41355d3203ad2d6b3c2fc31238565: Status 404 returned error can't find the container with id 4e35dd308f830f76d0bd3a75c0821d4c13b41355d3203ad2d6b3c2fc31238565 Jul 08 19:30:01.225627 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:01.225589 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" event={"ID":"c1348d31-55c0-45f1-92eb-ac86ac1a05df","Type":"ContainerStarted","Data":"2a718589d321f31345e48196db87d168bd7dad0d39160cb38f93f6b8cf24e7ce"} Jul 08 19:30:01.225994 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:01.225646 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" event={"ID":"c1348d31-55c0-45f1-92eb-ac86ac1a05df","Type":"ContainerStarted","Data":"4e35dd308f830f76d0bd3a75c0821d4c13b41355d3203ad2d6b3c2fc31238565"} Jul 08 19:30:01.242729 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:01.242678 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" podStartSLOduration=1.24266093 podStartE2EDuration="1.24266093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:30:01.241261771 +0000 UTC m=+1747.017214242" watchObservedRunningTime="2026-07-08 19:30:01.24266093 +0000 UTC m=+1747.018613401" Jul 08 19:30:02.232202 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:02.232165 2570 generic.go:356] "Generic (PLEG): container finished" podID="c1348d31-55c0-45f1-92eb-ac86ac1a05df" containerID="2a718589d321f31345e48196db87d168bd7dad0d39160cb38f93f6b8cf24e7ce" exitCode=0 Jul 08 19:30:02.232607 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:02.232255 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" event={"ID":"c1348d31-55c0-45f1-92eb-ac86ac1a05df","Type":"ContainerDied","Data":"2a718589d321f31345e48196db87d168bd7dad0d39160cb38f93f6b8cf24e7ce"} Jul 08 19:30:03.368397 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:03.368377 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" Jul 08 19:30:03.420416 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:03.420381 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwdp6\" (UniqueName: \"kubernetes.io/projected/c1348d31-55c0-45f1-92eb-ac86ac1a05df-kube-api-access-nwdp6\") pod \"c1348d31-55c0-45f1-92eb-ac86ac1a05df\" (UID: \"c1348d31-55c0-45f1-92eb-ac86ac1a05df\") " Jul 08 19:30:03.422581 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:03.422556 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1348d31-55c0-45f1-92eb-ac86ac1a05df-kube-api-access-nwdp6" (OuterVolumeSpecName: "kube-api-access-nwdp6") pod "c1348d31-55c0-45f1-92eb-ac86ac1a05df" (UID: "c1348d31-55c0-45f1-92eb-ac86ac1a05df"). InnerVolumeSpecName "kube-api-access-nwdp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:30:03.521919 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:03.521827 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwdp6\" (UniqueName: \"kubernetes.io/projected/c1348d31-55c0-45f1-92eb-ac86ac1a05df-kube-api-access-nwdp6\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:30:04.243292 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:04.243248 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" event={"ID":"c1348d31-55c0-45f1-92eb-ac86ac1a05df","Type":"ContainerDied","Data":"4e35dd308f830f76d0bd3a75c0821d4c13b41355d3203ad2d6b3c2fc31238565"} Jul 08 19:30:04.243486 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:04.243304 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e35dd308f830f76d0bd3a75c0821d4c13b41355d3203ad2d6b3c2fc31238565" Jul 08 19:30:04.243486 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:04.243261 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725650-rcf8r" Jul 08 19:30:54.817740 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:54.817699 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:30:54.820281 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:30:54.820254 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:34:22.512740 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:34:22.512702 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:34:31.680191 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:34:31.680146 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:35:54.855140 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:35:54.855103 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:35:54.859388 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:35:54.859363 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:40:54.892815 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:40:54.892787 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:40:54.895920 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:40:54.895894 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:41:15.786698 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:41:15.786665 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:41:29.018263 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:41:29.018218 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-574s7"] Jul 08 19:45:00.140376 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.140335 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87"] Jul 08 19:45:00.142839 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.140782 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1348d31-55c0-45f1-92eb-ac86ac1a05df" containerName="cleanup" Jul 08 19:45:00.142839 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.140802 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1348d31-55c0-45f1-92eb-ac86ac1a05df" containerName="cleanup" Jul 08 19:45:00.142839 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.140892 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1348d31-55c0-45f1-92eb-ac86ac1a05df" containerName="cleanup" Jul 08 19:45:00.143701 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.143685 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87" Jul 08 19:45:00.146024 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.146006 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 19:45:00.146253 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.146241 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 19:45:00.146294 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.146261 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4s497\"" Jul 08 19:45:00.160850 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.160820 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87"] Jul 08 19:45:00.240503 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.240458 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdwt8\" (UniqueName: \"kubernetes.io/projected/35fdd692-a61c-453a-a21a-803dcaafd4db-kube-api-access-kdwt8\") pod \"maas-api-key-cleanup-29725665-g7q87\" (UID: \"35fdd692-a61c-453a-a21a-803dcaafd4db\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87" Jul 08 19:45:00.341068 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.341025 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwt8\" (UniqueName: \"kubernetes.io/projected/35fdd692-a61c-453a-a21a-803dcaafd4db-kube-api-access-kdwt8\") pod \"maas-api-key-cleanup-29725665-g7q87\" (UID: \"35fdd692-a61c-453a-a21a-803dcaafd4db\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87" Jul 08 19:45:00.350143 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.350108 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdwt8\" (UniqueName: \"kubernetes.io/projected/35fdd692-a61c-453a-a21a-803dcaafd4db-kube-api-access-kdwt8\") pod \"maas-api-key-cleanup-29725665-g7q87\" (UID: \"35fdd692-a61c-453a-a21a-803dcaafd4db\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87" Jul 08 19:45:00.454167 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.454125 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87" Jul 08 19:45:00.595501 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.595474 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87"] Jul 08 19:45:00.597931 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:45:00.597903 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35fdd692_a61c_453a_a21a_803dcaafd4db.slice/crio-ce7d0106b81ca2c970503a641a5d3c8080663c38ef42db239172388a9405b65b WatchSource:0}: Error finding container ce7d0106b81ca2c970503a641a5d3c8080663c38ef42db239172388a9405b65b: Status 404 returned error can't find the container with id ce7d0106b81ca2c970503a641a5d3c8080663c38ef42db239172388a9405b65b Jul 08 19:45:00.657475 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:00.657413 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87" event={"ID":"35fdd692-a61c-453a-a21a-803dcaafd4db","Type":"ContainerStarted","Data":"ce7d0106b81ca2c970503a641a5d3c8080663c38ef42db239172388a9405b65b"} Jul 08 19:45:01.664730 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:01.664698 2570 generic.go:356] "Generic (PLEG): container finished" podID="35fdd692-a61c-453a-a21a-803dcaafd4db" containerID="69260432c5cf5d0f49197d8fe2f3970c69dcb5f1c473016b541f50d1e17fdb97" exitCode=0 Jul 08 19:45:01.665131 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:01.664746 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87" event={"ID":"35fdd692-a61c-453a-a21a-803dcaafd4db","Type":"ContainerDied","Data":"69260432c5cf5d0f49197d8fe2f3970c69dcb5f1c473016b541f50d1e17fdb97"} Jul 08 19:45:02.810153 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:02.810127 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87" Jul 08 19:45:02.862751 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:02.862716 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdwt8\" (UniqueName: \"kubernetes.io/projected/35fdd692-a61c-453a-a21a-803dcaafd4db-kube-api-access-kdwt8\") pod \"35fdd692-a61c-453a-a21a-803dcaafd4db\" (UID: \"35fdd692-a61c-453a-a21a-803dcaafd4db\") " Jul 08 19:45:02.864997 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:02.864965 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35fdd692-a61c-453a-a21a-803dcaafd4db-kube-api-access-kdwt8" (OuterVolumeSpecName: "kube-api-access-kdwt8") pod "35fdd692-a61c-453a-a21a-803dcaafd4db" (UID: "35fdd692-a61c-453a-a21a-803dcaafd4db"). InnerVolumeSpecName "kube-api-access-kdwt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:45:02.963407 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:02.963312 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdwt8\" (UniqueName: \"kubernetes.io/projected/35fdd692-a61c-453a-a21a-803dcaafd4db-kube-api-access-kdwt8\") on node \"ip-10-0-130-102.ec2.internal\" DevicePath \"\"" Jul 08 19:45:03.675868 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:03.675835 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87" event={"ID":"35fdd692-a61c-453a-a21a-803dcaafd4db","Type":"ContainerDied","Data":"ce7d0106b81ca2c970503a641a5d3c8080663c38ef42db239172388a9405b65b"} Jul 08 19:45:03.675868 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:03.675870 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725665-g7q87" Jul 08 19:45:03.676088 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:03.675882 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce7d0106b81ca2c970503a641a5d3c8080663c38ef42db239172388a9405b65b" Jul 08 19:45:22.390378 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:22.390342 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7btcd_6783bade-690d-4b18-95e5-a4d277e9eb53/manager/0.log" Jul 08 19:45:22.797977 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:22.797949 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pclpf_09c49ccd-c1d1-4cc5-869d-24a0e4802821/server/0.log" Jul 08 19:45:22.930369 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:22.930338 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mxh69_3182457d-49f3-4090-9360-69341a5a9e79/manager/0.log" Jul 08 19:45:23.062015 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:23.061928 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-9w4cm_c33c1230-3a74-4eb6-8226-8dea023e0b84/copy-manifests/0.log" Jul 08 19:45:23.069952 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:23.069927 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-9w4cm_c33c1230-3a74-4eb6-8226-8dea023e0b84/manager/0.log" Jul 08 19:45:24.959723 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:24.959693 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gc5gr_25810471-0e16-4dbf-8ea4-21aa7c4ef711/manager/0.log" Jul 08 19:45:25.337498 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:25.337421 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lztjk_b8d9e2a1-21ea-41ff-a5cb-778d47fa0979/registry-server/0.log" Jul 08 19:45:25.496648 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:25.496613 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2k8wg_9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8/manager/0.log" Jul 08 19:45:25.655391 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:25.655306 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-574s7_069ca1b5-e6af-4fb1-9318-ae839a4896e6/limitador/0.log" Jul 08 19:45:25.780459 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:25.780413 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-slzzm_8f09ae44-b987-482f-9047-53b32f053ec3/manager/0.log" Jul 08 19:45:26.400601 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:26.400571 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cd5f7d96-8tcgf_912fa866-801d-4d31-bb36-d6bdab2322d8/kube-auth-proxy/0.log" Jul 08 19:45:27.024707 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:27.024670 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64778d56b5-wngf5_10997390-ded2-4c80-8d1f-2e6cc355830d/router/0.log" Jul 08 19:45:27.759193 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:27.759161 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblrfjf_10a39305-3bd3-4ace-8575-94f8fb41c481/main/0.log" Jul 08 19:45:27.993777 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:27.993745 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-tgdsr_cb39e5a4-b81a-418e-865d-fad375603f26/main/0.log" Jul 08 19:45:32.759091 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.759055 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hlh8b/must-gather-748v6"] Jul 08 19:45:32.759573 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.759415 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35fdd692-a61c-453a-a21a-803dcaafd4db" containerName="cleanup" Jul 08 19:45:32.759573 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.759426 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="35fdd692-a61c-453a-a21a-803dcaafd4db" containerName="cleanup" Jul 08 19:45:32.759573 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.759529 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="35fdd692-a61c-453a-a21a-803dcaafd4db" containerName="cleanup" Jul 08 19:45:32.762704 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.762685 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh8b/must-gather-748v6" Jul 08 19:45:32.764505 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.764486 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hlh8b\"/\"openshift-service-ca.crt\"" Jul 08 19:45:32.765077 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.765057 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hlh8b\"/\"kube-root-ca.crt\"" Jul 08 19:45:32.765077 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.765068 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hlh8b\"/\"default-dockercfg-b6282\"" Jul 08 19:45:32.769574 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.769550 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh8b/must-gather-748v6"] Jul 08 19:45:32.927127 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.927092 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/46632ae4-ad15-4dfe-bc3a-2872c8c03476-must-gather-output\") pod \"must-gather-748v6\" (UID: \"46632ae4-ad15-4dfe-bc3a-2872c8c03476\") " pod="openshift-must-gather-hlh8b/must-gather-748v6" Jul 08 19:45:32.927311 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:32.927144 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkc5b\" (UniqueName: \"kubernetes.io/projected/46632ae4-ad15-4dfe-bc3a-2872c8c03476-kube-api-access-pkc5b\") pod \"must-gather-748v6\" (UID: \"46632ae4-ad15-4dfe-bc3a-2872c8c03476\") " pod="openshift-must-gather-hlh8b/must-gather-748v6" Jul 08 19:45:33.028178 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:33.028095 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/46632ae4-ad15-4dfe-bc3a-2872c8c03476-must-gather-output\") pod \"must-gather-748v6\" (UID: \"46632ae4-ad15-4dfe-bc3a-2872c8c03476\") " pod="openshift-must-gather-hlh8b/must-gather-748v6" Jul 08 19:45:33.028178 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:33.028137 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkc5b\" (UniqueName: \"kubernetes.io/projected/46632ae4-ad15-4dfe-bc3a-2872c8c03476-kube-api-access-pkc5b\") pod \"must-gather-748v6\" (UID: \"46632ae4-ad15-4dfe-bc3a-2872c8c03476\") " pod="openshift-must-gather-hlh8b/must-gather-748v6" Jul 08 19:45:33.028482 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:33.028430 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/46632ae4-ad15-4dfe-bc3a-2872c8c03476-must-gather-output\") pod \"must-gather-748v6\" (UID: \"46632ae4-ad15-4dfe-bc3a-2872c8c03476\") " pod="openshift-must-gather-hlh8b/must-gather-748v6" Jul 08 19:45:33.036041 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:33.036022 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkc5b\" (UniqueName: \"kubernetes.io/projected/46632ae4-ad15-4dfe-bc3a-2872c8c03476-kube-api-access-pkc5b\") pod \"must-gather-748v6\" (UID: \"46632ae4-ad15-4dfe-bc3a-2872c8c03476\") " pod="openshift-must-gather-hlh8b/must-gather-748v6" Jul 08 19:45:33.072604 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:33.072569 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh8b/must-gather-748v6" Jul 08 19:45:33.207124 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:33.207093 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh8b/must-gather-748v6"] Jul 08 19:45:33.209618 ip-10-0-130-102 kubenswrapper[2570]: W0708 19:45:33.209590 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46632ae4_ad15_4dfe_bc3a_2872c8c03476.slice/crio-42c7fde65b4ef570e3a9a7aac38b8e845a8b7f55261910d78d3fa75246793efa WatchSource:0}: Error finding container 42c7fde65b4ef570e3a9a7aac38b8e845a8b7f55261910d78d3fa75246793efa: Status 404 returned error can't find the container with id 42c7fde65b4ef570e3a9a7aac38b8e845a8b7f55261910d78d3fa75246793efa Jul 08 19:45:33.211752 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:33.211737 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:45:33.828586 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:33.828548 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh8b/must-gather-748v6" event={"ID":"46632ae4-ad15-4dfe-bc3a-2872c8c03476","Type":"ContainerStarted","Data":"42c7fde65b4ef570e3a9a7aac38b8e845a8b7f55261910d78d3fa75246793efa"} Jul 08 19:45:34.836646 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:34.836613 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh8b/must-gather-748v6" event={"ID":"46632ae4-ad15-4dfe-bc3a-2872c8c03476","Type":"ContainerStarted","Data":"709ca7ca14b61035f5b0e9ad9ad4549f6148726fc3322c81cbdbfb8d6eb35400"} Jul 08 19:45:34.837045 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:34.836656 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh8b/must-gather-748v6" event={"ID":"46632ae4-ad15-4dfe-bc3a-2872c8c03476","Type":"ContainerStarted","Data":"bbad49f9dbb84cb5f8e7e3b5aa9d4a3e34f2ed02f0cd11356766f77b7c2c8618"} Jul 08 19:45:34.853913 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:34.853847 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hlh8b/must-gather-748v6" podStartSLOduration=2.087730419 podStartE2EDuration="2.853824772s" totalImagesPullingTime="766.094353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:34.852484991 +0000 UTC m=+2680.628437482" watchObservedRunningTime="2026-07-08 19:45:34.853824772 +0000 UTC m=+2680.629777244" Jul 08 19:45:35.658755 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:35.658724 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zflm9_6573bd34-7a4b-42da-8126-b90510b483e4/global-pull-secret-syncer/0.log" Jul 08 19:45:35.813232 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:35.813198 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dlz5c_c28d20fe-3ff4-4bbf-b3b2-7de8800a3e25/konnectivity-agent/0.log" Jul 08 19:45:35.903305 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:35.903275 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-102.ec2.internal_cc54df53a307e9a93a77d4a51b268294/haproxy/0.log" Jul 08 19:45:40.997890 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:40.997858 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gc5gr_25810471-0e16-4dbf-8ea4-21aa7c4ef711/manager/0.log" Jul 08 19:45:41.111421 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:41.111389 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lztjk_b8d9e2a1-21ea-41ff-a5cb-778d47fa0979/registry-server/0.log" Jul 08 19:45:41.250517 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:41.249801 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2k8wg_9f73f718-d1dc-4b27-bc88-c79cbfc0a3d8/manager/0.log" Jul 08 19:45:41.276016 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:41.275957 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-574s7_069ca1b5-e6af-4fb1-9318-ae839a4896e6/limitador/0.log" Jul 08 19:45:41.335244 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:41.335209 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-slzzm_8f09ae44-b987-482f-9047-53b32f053ec3/manager/0.log" Jul 08 19:45:43.223236 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:43.223199 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-qg8sq_83d705a3-ab7b-4a88-8b16-ed9ab5c2cadb/cluster-monitoring-operator/0.log" Jul 08 19:45:43.574255 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:43.574170 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tdrgk_205a80d1-bab5-4b71-9bc0-59a4f53715b9/node-exporter/0.log" Jul 08 19:45:43.595827 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:43.595795 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tdrgk_205a80d1-bab5-4b71-9bc0-59a4f53715b9/kube-rbac-proxy/0.log" Jul 08 19:45:43.617511 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:43.617482 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tdrgk_205a80d1-bab5-4b71-9bc0-59a4f53715b9/init-textfile/0.log" Jul 08 19:45:45.278753 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.278726 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-fsjh7_6fa83f9f-b701-4b0d-b47e-a49ae5340571/networking-console-plugin/0.log" Jul 08 19:45:45.744920 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.744875 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn"] Jul 08 19:45:45.756265 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.756233 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn"] Jul 08 19:45:45.756583 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.756560 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.773885 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.773856 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-sys\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.774158 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.774134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-proc\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.774309 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.774291 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlfh6\" (UniqueName: \"kubernetes.io/projected/db510bce-b61f-4f85-8b09-5884110bcbf5-kube-api-access-wlfh6\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.774481 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.774466 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-lib-modules\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.776617 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.776576 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-podres\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.877248 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.877158 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-proc\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.877248 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.877220 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlfh6\" (UniqueName: \"kubernetes.io/projected/db510bce-b61f-4f85-8b09-5884110bcbf5-kube-api-access-wlfh6\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.877491 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.877252 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-lib-modules\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.877491 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.877278 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-podres\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.877491 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.877384 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-sys\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.877669 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.877532 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-sys\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.877669 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.877595 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-proc\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.878070 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.878030 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-lib-modules\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.878179 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.878157 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db510bce-b61f-4f85-8b09-5884110bcbf5-podres\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.887141 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.887080 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlfh6\" (UniqueName: \"kubernetes.io/projected/db510bce-b61f-4f85-8b09-5884110bcbf5-kube-api-access-wlfh6\") pod \"perf-node-gather-daemonset-24txn\" (UID: \"db510bce-b61f-4f85-8b09-5884110bcbf5\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:45.948029 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.947998 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:45:45.954753 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:45.954723 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/2.log" Jul 08 19:45:46.070936 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:46.070839 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:46.251171 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:46.251137 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn"] Jul 08 19:45:46.621736 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:46.621660 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-6259x_2311f6c3-06b0-49ae-9ae1-11a97129b50d/download-server/0.log" Jul 08 19:45:46.924739 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:46.924700 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" event={"ID":"db510bce-b61f-4f85-8b09-5884110bcbf5","Type":"ContainerStarted","Data":"4749fda67b9274e3e83768ff8d6986fc7ddc13f0954f8b32ee8edfdf93d50de5"} Jul 08 19:45:46.925059 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:46.924770 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" event={"ID":"db510bce-b61f-4f85-8b09-5884110bcbf5","Type":"ContainerStarted","Data":"0c6bb8a8c2b1dde4fade045c2bf05bebba14fa0a41a30d79cb0b1332d04e1b30"} Jul 08 19:45:46.925059 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:46.924819 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:46.941924 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:46.941865 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" podStartSLOduration=1.9418479899999999 podStartE2EDuration="1.94184799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:46.939171216 +0000 UTC m=+2692.715123687" watchObservedRunningTime="2026-07-08 19:45:46.94184799 +0000 UTC m=+2692.717800460" Jul 08 19:45:47.231465 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:47.231359 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-hnz5x_939e047c-755a-4851-a350-d00794ac7fc8/volume-data-source-validator/0.log" Jul 08 19:45:48.355584 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:48.355553 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tzqd2_c167b4f1-d95a-4ee5-8466-5a189a3600fb/dns/0.log" Jul 08 19:45:48.376995 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:48.376966 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tzqd2_c167b4f1-d95a-4ee5-8466-5a189a3600fb/kube-rbac-proxy/0.log" Jul 08 19:45:48.402856 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:48.402821 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgnx2_2cb07635-ed09-4f4d-a7d5-fc56a8c9859f/dns-node-resolver/0.log" Jul 08 19:45:49.043369 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:49.043342 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bd7xm_5f272e0f-0ed3-43f0-ae36-1456ca186b8c/node-ca/0.log" Jul 08 19:45:50.192699 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:50.192667 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cd5f7d96-8tcgf_912fa866-801d-4d31-bb36-d6bdab2322d8/kube-auth-proxy/0.log" Jul 08 19:45:50.427865 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:50.427834 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64778d56b5-wngf5_10997390-ded2-4c80-8d1f-2e6cc355830d/router/0.log" Jul 08 19:45:51.149121 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:51.149088 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pxzvm_5ef26f7e-91d4-407a-88d0-d7ea9fcf666c/serve-healthcheck-canary/0.log" Jul 08 19:45:51.643303 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:51.643266 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-f28q6_b01866af-cfdb-4883-bcd3-2f6d0f7a98f1/insights-operator/0.log" Jul 08 19:45:51.644286 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:51.644261 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-f28q6_b01866af-cfdb-4883-bcd3-2f6d0f7a98f1/insights-operator/1.log" Jul 08 19:45:51.811423 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:51.811389 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x54s2_0f2f4a79-ddf3-4258-9e98-d8ec662155d8/kube-rbac-proxy/0.log" Jul 08 19:45:51.833571 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:51.833542 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x54s2_0f2f4a79-ddf3-4258-9e98-d8ec662155d8/exporter/0.log" Jul 08 19:45:51.855518 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:51.855488 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x54s2_0f2f4a79-ddf3-4258-9e98-d8ec662155d8/extractor/0.log" Jul 08 19:45:52.944019 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:52.943987 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-24txn" Jul 08 19:45:54.018033 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:54.018004 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7btcd_6783bade-690d-4b18-95e5-a4d277e9eb53/manager/0.log" Jul 08 19:45:54.244702 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:54.244656 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pclpf_09c49ccd-c1d1-4cc5-869d-24a0e4802821/server/0.log" Jul 08 19:45:54.314389 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:54.314299 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mxh69_3182457d-49f3-4090-9360-69341a5a9e79/manager/0.log" Jul 08 19:45:54.340499 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:54.340465 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-9w4cm_c33c1230-3a74-4eb6-8226-8dea023e0b84/manager/0.log" Jul 08 19:45:54.362819 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:54.362762 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-9w4cm_c33c1230-3a74-4eb6-8226-8dea023e0b84/copy-manifests/0.log" Jul 08 19:45:54.936679 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:54.936646 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:45:54.946260 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:54.946233 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8c8kn_e0d192cc-aed5-434e-b755-a36efbd0e639/console-operator/1.log" Jul 08 19:45:56.649491 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:56.649457 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cd5f7d96-8tcgf_912fa866-801d-4d31-bb36-d6bdab2322d8/kube-auth-proxy/0.log" Jul 08 19:45:56.820736 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:56.820703 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64778d56b5-wngf5_10997390-ded2-4c80-8d1f-2e6cc355830d/router/0.log" Jul 08 19:45:58.149672 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:58.149603 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cd5f7d96-8tcgf_912fa866-801d-4d31-bb36-d6bdab2322d8/kube-auth-proxy/0.log" Jul 08 19:45:58.337988 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:45:58.337949 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64778d56b5-wngf5_10997390-ded2-4c80-8d1f-2e6cc355830d/router/0.log" Jul 08 19:46:01.122620 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:01.122585 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-299c6_31f386ae-841a-4f4b-be35-b891ed799001/migrator/0.log" Jul 08 19:46:01.146370 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:01.146341 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-299c6_31f386ae-841a-4f4b-be35-b891ed799001/graceful-termination/0.log" Jul 08 19:46:01.522185 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:01.522033 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-b75bb_4cf28b91-47d9-4dc5-8eee-80defdeddea6/kube-storage-version-migrator-operator/1.log" Jul 08 19:46:01.523472 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:01.523421 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-b75bb_4cf28b91-47d9-4dc5-8eee-80defdeddea6/kube-storage-version-migrator-operator/0.log" Jul 08 19:46:02.590104 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:02.590072 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6npns_61ca997c-4091-4c14-8fa0-b33055810105/kube-multus/0.log" Jul 08 19:46:02.616082 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:02.616054 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tjt8_6d8f321d-d047-435f-9cdd-ba893bf5ff07/kube-multus-additional-cni-plugins/0.log" Jul 08 19:46:02.638291 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:02.638265 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tjt8_6d8f321d-d047-435f-9cdd-ba893bf5ff07/egress-router-binary-copy/0.log" Jul 08 19:46:02.660672 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:02.660637 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tjt8_6d8f321d-d047-435f-9cdd-ba893bf5ff07/cni-plugins/0.log" Jul 08 19:46:02.683555 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:02.683524 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tjt8_6d8f321d-d047-435f-9cdd-ba893bf5ff07/bond-cni-plugin/0.log" Jul 08 19:46:02.719615 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:02.719589 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tjt8_6d8f321d-d047-435f-9cdd-ba893bf5ff07/routeoverride-cni/0.log" Jul 08 19:46:02.740783 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:02.740759 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tjt8_6d8f321d-d047-435f-9cdd-ba893bf5ff07/whereabouts-cni-bincopy/0.log" Jul 08 19:46:02.762083 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:02.762054 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tjt8_6d8f321d-d047-435f-9cdd-ba893bf5ff07/whereabouts-cni/0.log" Jul 08 19:46:03.242951 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:03.242918 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wzntx_ceb9c45b-e849-4da2-a8a6-ad602bf66af9/network-metrics-daemon/0.log" Jul 08 19:46:03.264624 ip-10-0-130-102 kubenswrapper[2570]: I0708 19:46:03.264587 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wzntx_ceb9c45b-e849-4da2-a8a6-ad602bf66af9/kube-rbac-proxy/0.log"