Jul 14 21:35:35.747482 ip-10-0-131-58 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 21:35:35.747493 ip-10-0-131-58 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 21:35:35.747499 ip-10-0-131-58 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 21:35:35.747741 ip-10-0-131-58 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 21:35:45.788217 ip-10-0-131-58 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 21:35:45.788237 ip-10-0-131-58 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9bac800132c04a5293422b6c9587a1f7 -- Jul 14 21:37:22.029995 ip-10-0-131-58 systemd[1]: Starting Kubernetes Kubelet... Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.490642 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495251 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495264 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495268 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495272 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495275 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495278 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495282 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 21:37:22.556774 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495285 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495288 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495291 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495294 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495296 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495299 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495302 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495305 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495308 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495310 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495313 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495316 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495319 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495321 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495324 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495327 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495330 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495333 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495335 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495338 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 21:37:22.558742 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495341 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495343 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495347 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495349 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495353 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495355 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495358 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495361 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495364 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495366 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495369 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495371 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495375 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495378 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495380 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495384 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495386 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495389 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495391 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 21:37:22.561012 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495394 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495396 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495399 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495401 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495404 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495406 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495409 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495411 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495414 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495417 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495419 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495421 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495424 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495426 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495429 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495432 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495434 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495437 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495440 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495444 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 21:37:22.562741 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495456 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495460 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495462 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495465 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495468 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495471 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495473 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495476 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495478 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495481 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495483 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495486 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495490 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495494 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495496 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495500 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495503 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495505 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495508 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495511 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 21:37:22.576860 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495513 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 21:37:22.569986 ip-10-0-131-58 systemd[1]: Started Kubernetes Kubelet. Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495516 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495518 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495521 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495523 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495526 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495529 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495531 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495533 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495536 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495539 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495545 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.495548 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496252 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496259 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496263 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496266 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496269 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496273 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496275 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 21:37:22.578148 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496278 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496281 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496283 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496286 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496289 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496291 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496294 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496296 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496301 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496305 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496308 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496311 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496313 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496316 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496319 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496322 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496324 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496327 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496329 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 21:37:22.580106 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496332 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496334 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496337 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496339 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496342 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496345 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496347 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496350 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496352 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496355 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496358 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496361 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496364 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496366 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496369 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496371 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496374 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496376 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496379 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496381 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 14 21:37:22.608522 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496384 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496387 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496389 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496392 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496395 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496397 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496400 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496402 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496405 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496407 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496412 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496415 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496418 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496420 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496422 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496425 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496428 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496431 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496436 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496441 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 21:37:22.610797 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496444 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496447 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496450 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496452 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496455 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496458 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496460 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496463 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496466 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496468 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496471 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496473 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496476 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496478 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496481 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496484 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496487 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496490 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496493 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 21:37:22.612572 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496495 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496498 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496501 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496504 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496507 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496510 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496512 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496515 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496517 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496520 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496522 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496526 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496529 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496531 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496909 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496915 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496917 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496920 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496923 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496925 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 21:37:22.615766 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496928 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496931 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496933 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496936 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496938 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496941 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496943 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496946 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496948 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496951 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496953 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496955 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496958 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496960 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496963 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496967 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496970 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496972 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496975 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496977 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496980 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 21:37:22.628612 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496982 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496986 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496991 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496995 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.496998 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497001 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497003 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497006 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497009 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497012 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497015 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497017 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497021 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497024 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497027 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497030 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497032 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497035 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 21:37:22.631349 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497038 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497041 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497044 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497046 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497049 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497051 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497054 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497056 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497059 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497062 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497064 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497067 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497069 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497072 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497074 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497077 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497081 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497084 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497086 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497089 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 21:37:22.645791 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497091 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497094 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497096 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497099 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497101 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497104 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497106 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497109 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497112 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497115 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497117 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497120 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497122 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497124 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497128 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497132 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497135 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497138 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497140 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 21:37:22.647603 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497142 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497146 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497149 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497151 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497154 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497156 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497159 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497161 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497164 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497167 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497170 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497172 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497176 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497178 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497181 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497240 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497246 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497252 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497267 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497273 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497277 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 21:37:22.799078 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497284 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497289 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497292 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497296 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497299 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497302 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497305 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497308 2567 flags.go:64] FLAG: --cgroup-root="" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497311 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497314 2567 flags.go:64] FLAG: --client-ca-file="" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497316 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497319 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497326 2567 flags.go:64] FLAG: --cluster-domain="" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497329 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497332 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497335 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497338 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497342 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497345 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497348 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497352 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497355 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497358 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497360 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 21:37:22.800242 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497364 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497367 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497372 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497374 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497377 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497380 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497383 2567 flags.go:64] FLAG: --enable-server="true" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497386 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497390 2567 flags.go:64] FLAG: --event-burst="100" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497393 2567 flags.go:64] FLAG: --event-qps="50" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497396 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497399 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497402 2567 flags.go:64] FLAG: --eviction-hard="" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497405 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497408 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497411 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497414 2567 flags.go:64] FLAG: --eviction-soft="" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497417 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497420 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497423 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497427 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497430 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497433 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497436 2567 flags.go:64] FLAG: --feature-gates="" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497439 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 21:37:22.801079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497442 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497445 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497448 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497452 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497455 2567 flags.go:64] FLAG: --help="false" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497458 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-131-58.ec2.internal" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497461 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497464 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497468 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497471 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497474 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497477 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497480 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497483 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497486 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497488 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497491 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497494 2567 flags.go:64] FLAG: --kube-reserved="" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497497 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497500 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497503 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497506 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497509 2567 flags.go:64] FLAG: --lock-file="" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497511 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 21:37:22.802093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497514 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497517 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497522 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497526 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497529 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497532 2567 flags.go:64] FLAG: --logging-format="text" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497535 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497538 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497540 2567 flags.go:64] FLAG: --manifest-url="" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497543 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497547 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497552 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497556 2567 flags.go:64] FLAG: --max-pods="110" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497559 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497561 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497564 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497568 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497572 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497575 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497578 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497585 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497601 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497606 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 21:37:22.803708 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497609 2567 flags.go:64] FLAG: --pod-cidr="" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497612 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497618 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497621 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497624 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497627 2567 flags.go:64] FLAG: --port="10250" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497630 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497633 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04e241690b64f4ec7" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497636 2567 flags.go:64] FLAG: --qos-reserved="" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497639 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497642 2567 flags.go:64] FLAG: --register-node="true" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497645 2567 flags.go:64] FLAG: --register-with-taints="" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497650 2567 flags.go:64] FLAG: --registry-burst="10" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497653 2567 flags.go:64] FLAG: --registry-qps="5" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497656 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497658 2567 flags.go:64] FLAG: --reserved-memory="" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497662 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497665 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497668 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497671 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497673 2567 flags.go:64] FLAG: --runonce="false" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497678 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497681 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497684 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497686 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 21:37:22.804369 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497689 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497692 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497696 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497711 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497714 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497717 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497720 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497723 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497726 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497728 2567 flags.go:64] FLAG: --system-cgroups="" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497731 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497736 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497739 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497742 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497746 2567 flags.go:64] FLAG: --tls-min-version="" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497748 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497751 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497754 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497757 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497762 2567 flags.go:64] FLAG: --v="2" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497766 2567 flags.go:64] FLAG: --version="false" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497770 2567 flags.go:64] FLAG: --vmodule="" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497773 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.497776 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 21:37:22.805847 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497920 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497926 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497929 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497932 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497937 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497939 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497942 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497946 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497949 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497952 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497955 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497959 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497962 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497964 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497967 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497970 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497972 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497975 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497977 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497980 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 21:37:22.806526 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497983 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497985 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497987 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497990 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497992 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497995 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.497997 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498001 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498004 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498006 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498009 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498011 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498014 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498016 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498019 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498021 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498025 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498028 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498030 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498033 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498036 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 21:37:22.938462 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498038 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498041 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498043 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498051 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498054 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498057 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498059 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498061 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498064 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498066 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498069 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498071 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498073 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498076 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498078 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498081 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498083 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498086 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498090 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 21:37:22.939413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498095 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498098 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498100 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498103 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498105 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498108 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498110 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498113 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498116 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498119 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498122 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498124 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498127 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498129 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498132 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498134 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498137 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498140 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498143 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498145 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 21:37:22.940063 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498148 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498150 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498153 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498155 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498158 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498160 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498162 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498165 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498168 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498170 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498172 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498176 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498179 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498181 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498184 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498187 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498191 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498194 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 21:37:22.940633 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.498197 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.498775 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.507793 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.507808 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.511952 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.511965 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512943 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512949 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512953 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512957 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512960 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512963 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512966 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512968 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512972 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 21:37:22.941133 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512974 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512977 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512980 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512982 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512985 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512988 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512990 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512993 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512995 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.512998 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513001 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513003 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513014 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513017 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513020 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513023 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513025 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513028 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513240 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513243 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 21:37:22.941593 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513245 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513250 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513255 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513463 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513467 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513470 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513667 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513684 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513687 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513894 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513897 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513901 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513903 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513906 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513909 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513912 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513914 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513918 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513921 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 21:37:22.942137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513924 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513927 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513929 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513932 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513935 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513938 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513941 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513943 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513946 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513949 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513952 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513955 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513957 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513959 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513962 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513965 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513968 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513971 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513973 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513976 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 21:37:22.942718 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513979 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513982 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513984 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513987 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513989 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513992 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513994 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513997 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.513999 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514002 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514004 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514007 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514012 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514015 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514018 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514021 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514023 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514026 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514030 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 21:37:22.943253 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514033 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514036 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514039 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514042 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514044 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514047 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514050 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514053 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514055 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514058 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514062 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514065 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.514070 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514194 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514199 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 21:37:22.943819 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514203 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514206 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514209 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514212 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514215 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514217 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514220 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514223 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514225 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514228 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514232 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514235 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514238 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514240 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514243 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514245 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514248 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514250 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514252 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514255 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 21:37:22.944229 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514257 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514260 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514262 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514265 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514268 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514271 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514273 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514276 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514283 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514286 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514289 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514292 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514295 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514298 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514300 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514303 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514305 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514308 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514310 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 21:37:22.944812 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514313 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514317 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514320 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514324 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514328 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514330 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514333 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514336 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514339 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514341 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514344 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514346 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514349 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514351 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514354 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514356 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514358 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514361 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514363 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 21:37:22.945311 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514366 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514369 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514372 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514375 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514378 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514380 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514383 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514387 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514390 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514393 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514397 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514400 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514402 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514405 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514407 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514410 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514414 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514417 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514420 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 21:37:22.945853 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514423 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514425 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514428 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514430 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514433 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514435 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514437 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514440 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514442 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514445 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514447 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514450 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514452 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514454 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514457 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514461 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514463 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514466 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514468 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 21:37:22.946388 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:22.514471 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.514476 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.514583 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.518017 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.519326 2567 server.go:1019] "Starting client certificate rotation" Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.519425 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.519468 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.521638 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.522848 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.532970 2567 log.go:25] "Validated CRI v1 runtime API" Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.537887 2567 log.go:25] "Validated CRI v1 image API" Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.539428 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 21:37:22.946948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.542670 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7d23f611-71b9-4a79-ac16-2245443fedbc:/dev/nvme0n1p3 aba1ebba-4ce3-4104-82ba-f575bf9e3468:/dev/nvme0n1p4] Jul 14 21:37:22.947295 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.542685 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 21:37:22.947398 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.548494 2567 manager.go:216] Machine: {Timestamp:2026-07-14 21:37:22.548040266 +0000 UTC m=+0.386171327 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097623 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29c74d2645dd259ac2ffe4757a1f9b SystemUUID:ec29c74d-2645-dd25-9ac2-ffe4757a1f9b BootID:9bac8001-32c0-4a52-9342-2b6c9587a1f7 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8c:1f:d0:41:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8c:1f:d0:41:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:53:74:ab:1a:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 21:37:22.947398 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.548582 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 21:37:22.947398 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.548650 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 21:37:22.947398 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.552396 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 21:37:22.947398 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.552423 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-58.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 21:37:22.947398 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.553742 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 21:37:22.947398 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.553755 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 21:37:22.947398 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.553761 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.554440 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.554576 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.555976 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.559279 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.559401 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.559434 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.559453 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.559470 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.559484 2567 kubelet.go:398] "Adding apiserver pod source" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.559495 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.559864 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.559885 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.562074 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.564379 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.564406 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.564552 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.564564 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.564570 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.564575 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.564583 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.564590 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.565175 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.565182 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.565188 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.565194 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.565202 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.565211 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.565999 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.566006 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.569199 2567 server.go:1268] "Started kubelet" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.569274 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.569349 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.569871 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.570539 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-58.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.570608 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.570660 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.570719 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.572055 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 14 21:37:22.948005 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.575055 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-plqs6" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.574365 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-58.ec2.internal.18c245b42e87363e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-58.ec2.internal,UID:ip-10-0-131-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-58.ec2.internal,},FirstTimestamp:2026-07-14 21:37:22.569180734 +0000 UTC m=+0.407311795,LastTimestamp:2026-07-14 21:37:22.569180734 +0000 UTC m=+0.407311795,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-58.ec2.internal,}" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.575898 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.578419 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.578433 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.578483 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579090 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579108 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579122 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579202 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579210 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579592 2567 factory.go:55] Registering systemd factory Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579606 2567 factory.go:223] Registration of the systemd container factory successfully Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579835 2567 factory.go:153] Registering CRI-O factory Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579846 2567 factory.go:223] Registration of the crio container factory successfully Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579888 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579923 2567 factory.go:103] Registering Raw factory Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.579939 2567 manager.go:1196] Started watching for new ooms in manager Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.580259 2567 manager.go:349] Starting recovery of all containers Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.584043 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-plqs6" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.584181 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.584262 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.590884 2567 manager.go:354] Recovery completed Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.597248 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.598908 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.598929 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.598939 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.599365 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.599373 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.599386 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.599395 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.600002 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jul 14 21:37:22.949037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.600023 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.600032 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.600458 2567 policy_none.go:49] "None policy: Start" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.600474 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.600485 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.601286 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-58.ec2.internal.18c245b4304cfca0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-58.ec2.internal,UID:ip-10-0-131-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-58.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-58.ec2.internal,},FirstTimestamp:2026-07-14 21:37:22.598919328 +0000 UTC m=+0.437050390,LastTimestamp:2026-07-14 21:37:22.598919328 +0000 UTC m=+0.437050390,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-58.ec2.internal,}" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.601379 2567 policy_none.go:47] "Start" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.672234 2567 manager.go:337] "Starting Device Plugin manager" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.672284 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.672294 2567 server.go:87] "Starting device plugin registration server" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.672476 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.672489 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.672551 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.672615 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.672623 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.673116 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.673259 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.727644 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.728741 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.728785 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.728810 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.728850 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.731646 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.773404 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.774172 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.774202 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.774216 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.774242 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.787736 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.787753 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-58.ec2.internal\": node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.811227 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.829292 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal"] Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.829344 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 21:37:23.111781 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.831616 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.831634 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.831643 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.833249 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.833378 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.833403 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.834265 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.834292 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.834268 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.834304 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.834345 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.834387 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.840136 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.840157 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.840738 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientMemory" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.840759 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.840771 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeHasSufficientPID" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.859226 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-58.ec2.internal\" not found" node="ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.864508 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-58.ec2.internal\" not found" node="ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.880973 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/11ebf2b3606c12ff044395928735acf2-config\") pod \"kube-apiserver-proxy-ip-10-0-131-58.ec2.internal\" (UID: \"11ebf2b3606c12ff044395928735acf2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.880992 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a58359b5cdd7f4549d70ede60555141b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a58359b5cdd7f4549d70ede60555141b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.881007 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a58359b5cdd7f4549d70ede60555141b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a58359b5cdd7f4549d70ede60555141b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:22.912258 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.981977 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/11ebf2b3606c12ff044395928735acf2-config\") pod \"kube-apiserver-proxy-ip-10-0-131-58.ec2.internal\" (UID: \"11ebf2b3606c12ff044395928735acf2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.112741 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.981999 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a58359b5cdd7f4549d70ede60555141b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a58359b5cdd7f4549d70ede60555141b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.113386 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.982015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a58359b5cdd7f4549d70ede60555141b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a58359b5cdd7f4549d70ede60555141b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.113386 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.982039 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a58359b5cdd7f4549d70ede60555141b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a58359b5cdd7f4549d70ede60555141b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.113386 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.982059 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a58359b5cdd7f4549d70ede60555141b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal\" (UID: \"a58359b5cdd7f4549d70ede60555141b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.113386 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:22.982072 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/11ebf2b3606c12ff044395928735acf2-config\") pod \"kube-apiserver-proxy-ip-10-0-131-58.ec2.internal\" (UID: \"11ebf2b3606c12ff044395928735acf2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.113386 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:23.015641 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:23.277278 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:23.116327 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:23.277278 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:23.161488 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.277278 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:23.167721 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jul 14 21:37:23.277278 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:23.216923 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:23.465411 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:23.317406 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:23.465411 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:23.417890 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:23.620518 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:23.518432 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:23.620518 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:23.518460 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 21:37:23.620518 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:23.518589 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 21:37:23.620518 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:23.588374 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 21:32:23 +0000 UTC" deadline="2028-03-14 18:48:09.812762858 +0000 UTC" Jul 14 21:37:23.620518 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:23.589013 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14613h10m46.223955154s" Jul 14 21:37:23.620518 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:23.618896 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:24.841239 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:24.835095 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:24.967815 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:24.870262 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 21:37:24.967815 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:24.872262 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 21:37:24.967815 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:24.935474 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:25.087286 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:25.035956 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:25.206614 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:25.136355 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:25.326149 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:25.237011 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-58.ec2.internal\" not found" Jul 14 21:37:25.326149 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:25.247218 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 21:37:25.326149 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:25.294822 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" Jul 14 21:37:25.349279 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:25.346886 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 21:37:25.349279 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:25.347770 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" Jul 14 21:37:25.453433 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:25.406253 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 21:37:25.710211 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:25.675589 2567 apiserver.go:52] "Watching apiserver" Jul 14 21:37:25.710211 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:25.695779 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 21:37:26.134166 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.134104 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 21:37:26.135135 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.135113 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-whzjm","openshift-ovn-kubernetes/ovnkube-node-m25ff","kube-system/global-pull-secret-syncer-t8xrx","kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh","openshift-cluster-node-tuning-operator/tuned-gbz2c","openshift-dns/node-resolver-mrpd6","openshift-image-registry/node-ca-w69lg","openshift-multus/multus-v462f","openshift-multus/network-metrics-daemon-5x8kg","kube-system/konnectivity-agent-lxx6t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal","openshift-multus/multus-additional-cni-plugins-dnpzg","openshift-network-diagnostics/network-check-target-kxbsp"] Jul 14 21:37:26.135135 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.135126 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 21:37:26.136427 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.136411 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:26.136499 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.136475 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:26.137589 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.137569 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:26.138619 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.138600 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:26.138709 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.138666 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:26.139808 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.139785 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.140135 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.140121 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 21:37:26.140547 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.140531 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-57frc\"" Jul 14 21:37:26.140627 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.140560 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 21:37:26.140979 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.140965 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.142590 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.142572 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v462f" Jul 14 21:37:26.142724 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.142707 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 21:37:26.143185 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.143170 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 21:37:26.143250 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.143227 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wvptx\"" Jul 14 21:37:26.143784 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.143769 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.144274 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.144260 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m9g66\"" Jul 14 21:37:26.144524 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.144506 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 21:37:26.144667 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.144655 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 21:37:26.145035 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.145020 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.145526 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.145512 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 21:37:26.145678 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.145665 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 21:37:26.145751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.145741 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 21:37:26.146032 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.146016 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b9nqd\"" Jul 14 21:37:26.146084 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.146071 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 21:37:26.146257 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.146243 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 21:37:26.146481 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.146469 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.149535 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.149489 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.150185 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.150169 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 21:37:26.150300 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.150285 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 21:37:26.151828 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.151814 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.153546 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.153529 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:26.153628 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.153582 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:26.154250 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154233 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qjj8n\"" Jul 14 21:37:26.154373 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154241 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 21:37:26.154373 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154296 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 21:37:26.154373 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154353 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 21:37:26.154604 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154467 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 21:37:26.154604 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154485 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 21:37:26.154604 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154588 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 21:37:26.155177 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154655 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9djtc\"" Jul 14 21:37:26.155177 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154697 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 21:37:26.155177 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154769 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m8blk\"" Jul 14 21:37:26.155177 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.154842 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fxc85\"" Jul 14 21:37:26.155177 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.155016 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 21:37:26.155177 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.155084 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 21:37:26.155177 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.155096 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 21:37:26.155177 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.155148 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 21:37:26.155689 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.155288 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 21:37:26.155689 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.155655 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rg4fm\"" Jul 14 21:37:26.156939 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.156922 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 21:37:26.159526 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.159508 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 21:37:26.161700 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.161681 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 21:37:26.173551 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.173533 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8hvw4" Jul 14 21:37:26.186692 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.186667 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8hvw4" Jul 14 21:37:26.195908 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.195892 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 21:37:26.204468 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.204453 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 21:37:26.206300 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-kubernetes\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.206396 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206307 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-system-cni-dir\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.206396 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7701eb16-bd8d-4e30-8020-97298a371fc8-host-slash\") pod \"iptables-alerter-whzjm\" (UID: \"7701eb16-bd8d-4e30-8020-97298a371fc8\") " pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.206396 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ee8da63-127d-47f2-a318-ead45a97069f-serviceca\") pod \"node-ca-w69lg\" (UID: \"9ee8da63-127d-47f2-a318-ead45a97069f\") " pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.206396 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.206567 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206415 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-sysctl-conf\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.206567 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ltsq\" (UniqueName: \"kubernetes.io/projected/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-kube-api-access-4ltsq\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.206567 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206454 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-cni-binary-copy\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.206567 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p8f4\" (UniqueName: \"kubernetes.io/projected/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-kube-api-access-9p8f4\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.206567 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206485 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-systemd-units\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.206567 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-run-netns\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.206567 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-systemd\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.206820 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-etc-selinux\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.206820 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206591 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-slash\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.206820 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-etc-openvswitch\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.206820 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-run-netns\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.206820 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206646 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-etc-kubernetes\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.206820 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206660 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-kubelet\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.206820 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-cnibin\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.206820 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/059bca4a-0e12-4c97-b08e-f9187ad029e3-dbus\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:26.206820 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206764 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-system-cni-dir\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.206820 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-run-openvswitch\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4b76\" (UniqueName: \"kubernetes.io/projected/7701eb16-bd8d-4e30-8020-97298a371fc8-kube-api-access-b4b76\") pod \"iptables-alerter-whzjm\" (UID: \"7701eb16-bd8d-4e30-8020-97298a371fc8\") " pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206872 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f85b4ed-0f33-438a-b4b9-e372a56b9f5e-konnectivity-ca\") pod \"konnectivity-agent-lxx6t\" (UID: \"3f85b4ed-0f33-438a-b4b9-e372a56b9f5e\") " pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206886 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-host\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-os-release\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206928 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-run-k8s-cni-cncf-io\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.206968 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-cni-netd\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207007 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp9m8\" (UniqueName: \"kubernetes.io/projected/9ee8da63-127d-47f2-a318-ead45a97069f-kube-api-access-tp9m8\") pod \"node-ca-w69lg\" (UID: \"9ee8da63-127d-47f2-a318-ead45a97069f\") " pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207095 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-sys\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207124 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-tuned\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207147 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcdtb\" (UniqueName: \"kubernetes.io/projected/d33e8571-4a04-44b7-af21-3f8ec39a8b94-kube-api-access-gcdtb\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207194 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.207227 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207217 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56578618-4070-4ec5-b8ed-2a2f0e2ae063-env-overrides\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-sysconfig\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207381 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-registration-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207397 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mk2p\" (UniqueName: \"kubernetes.io/projected/bb32bcf9-14d8-45f9-a488-034b14c1a8de-kube-api-access-9mk2p\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207413 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-run-ovn-kubernetes\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0c86769-7d8f-436f-b7df-a55cd8fe3cb5-tmp-dir\") pod \"node-resolver-mrpd6\" (UID: \"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5\") " pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-cnibin\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-hostroot\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-daemon-config\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-run-multus-certs\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56578618-4070-4ec5-b8ed-2a2f0e2ae063-ovn-node-metrics-cert\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-os-release\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z7zn\" (UniqueName: \"kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn\") pod \"network-check-target-kxbsp\" (UID: \"fa7053cc-d7e9-435c-bf21-29f6097186e6\") " pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:26.207812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-cni-dir\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207702 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-log-socket\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f4jb\" (UniqueName: \"kubernetes.io/projected/f0c86769-7d8f-436f-b7df-a55cd8fe3cb5-kube-api-access-2f4jb\") pod \"node-resolver-mrpd6\" (UID: \"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5\") " pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207777 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-socket-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207802 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-sys-fs\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207824 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-var-lib-openvswitch\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207852 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207876 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-socket-dir-parent\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-var-lib-kubelet\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-conf-dir\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207953 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-run-systemd\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.207978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56578618-4070-4ec5-b8ed-2a2f0e2ae063-ovnkube-script-lib\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208013 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f85b4ed-0f33-438a-b4b9-e372a56b9f5e-agent-certs\") pod \"konnectivity-agent-lxx6t\" (UID: \"3f85b4ed-0f33-438a-b4b9-e372a56b9f5e\") " pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:26.208429 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208079 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d33e8571-4a04-44b7-af21-3f8ec39a8b94-tmp\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-var-lib-cni-bin\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-node-log\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208162 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7701eb16-bd8d-4e30-8020-97298a371fc8-iptables-alerter-script\") pod \"iptables-alerter-whzjm\" (UID: \"7701eb16-bd8d-4e30-8020-97298a371fc8\") " pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208184 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-sysctl-d\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208226 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-lib-modules\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208277 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-var-lib-kubelet\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-var-lib-cni-multus\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208349 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0c86769-7d8f-436f-b7df-a55cd8fe3cb5-hosts-file\") pod \"node-resolver-mrpd6\" (UID: \"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5\") " pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208437 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-device-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-run-ovn\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56578618-4070-4ec5-b8ed-2a2f0e2ae063-ovnkube-config\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208509 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ee8da63-127d-47f2-a318-ead45a97069f-host\") pod \"node-ca-w69lg\" (UID: \"9ee8da63-127d-47f2-a318-ead45a97069f\") " pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.209037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208532 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-run\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.209519 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208555 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.209519 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208580 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/059bca4a-0e12-4c97-b08e-f9187ad029e3-kubelet-config\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:26.209519 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g55c5\" (UniqueName: \"kubernetes.io/projected/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-kube-api-access-g55c5\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:26.209519 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-cni-bin\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.209519 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29xm8\" (UniqueName: \"kubernetes.io/projected/56578618-4070-4ec5-b8ed-2a2f0e2ae063-kube-api-access-29xm8\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.209519 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.208673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-modprobe-d\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.309802 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309776 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.309802 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56578618-4070-4ec5-b8ed-2a2f0e2ae063-env-overrides\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.309966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-sysconfig\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.309966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309834 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:26.309966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309848 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-registration-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.309966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309866 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mk2p\" (UniqueName: \"kubernetes.io/projected/bb32bcf9-14d8-45f9-a488-034b14c1a8de-kube-api-access-9mk2p\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.309966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309890 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-run-ovn-kubernetes\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.309966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309897 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-sysconfig\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.309966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309910 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.309966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0c86769-7d8f-436f-b7df-a55cd8fe3cb5-tmp-dir\") pod \"node-resolver-mrpd6\" (UID: \"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5\") " pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.309966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309933 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-registration-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.309966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.309950 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-run-ovn-kubernetes\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.309997 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310021 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-cnibin\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310048 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-hostroot\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.310070 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs podName:1e5e89e0-7530-4ca8-8781-aa159d84b7aa nodeName:}" failed. No retries permitted until 2026-07-14 21:37:26.810046095 +0000 UTC m=+3.532553258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs") pod "network-metrics-daemon-5x8kg" (UID: "1e5e89e0-7530-4ca8-8781-aa159d84b7aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310087 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-hostroot\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-daemon-config\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310136 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-cnibin\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-run-multus-certs\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56578618-4070-4ec5-b8ed-2a2f0e2ae063-ovn-node-metrics-cert\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310178 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0c86769-7d8f-436f-b7df-a55cd8fe3cb5-tmp-dir\") pod \"node-resolver-mrpd6\" (UID: \"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5\") " pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-os-release\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z7zn\" (UniqueName: \"kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn\") pod \"network-check-target-kxbsp\" (UID: \"fa7053cc-d7e9-435c-bf21-29f6097186e6\") " pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310228 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-run-multus-certs\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310240 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-cni-dir\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.310495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310262 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-log-socket\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310265 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-os-release\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310289 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f4jb\" (UniqueName: \"kubernetes.io/projected/f0c86769-7d8f-436f-b7df-a55cd8fe3cb5-kube-api-access-2f4jb\") pod \"node-resolver-mrpd6\" (UID: \"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5\") " pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310293 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-cni-dir\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310313 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-socket-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310313 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-log-socket\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-sys-fs\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310377 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-var-lib-openvswitch\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310401 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-socket-dir-parent\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310432 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-socket-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310447 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-var-lib-kubelet\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310453 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56578618-4070-4ec5-b8ed-2a2f0e2ae063-env-overrides\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310462 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-var-lib-openvswitch\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.311096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310555 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-conf-dir\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310576 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-var-lib-kubelet\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310589 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-sys-fs\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-run-systemd\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310613 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-conf-dir\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310614 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-socket-dir-parent\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56578618-4070-4ec5-b8ed-2a2f0e2ae063-ovnkube-script-lib\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310661 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-run-systemd\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310707 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-multus-daemon-config\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310713 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310710 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310757 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f85b4ed-0f33-438a-b4b9-e372a56b9f5e-agent-certs\") pod \"konnectivity-agent-lxx6t\" (UID: \"3f85b4ed-0f33-438a-b4b9-e372a56b9f5e\") " pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d33e8571-4a04-44b7-af21-3f8ec39a8b94-tmp\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-var-lib-cni-bin\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-node-log\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.311751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310924 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310944 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7701eb16-bd8d-4e30-8020-97298a371fc8-iptables-alerter-script\") pod \"iptables-alerter-whzjm\" (UID: \"7701eb16-bd8d-4e30-8020-97298a371fc8\") " pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310971 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-var-lib-cni-bin\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310997 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-node-log\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.310974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-sysctl-d\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311036 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-lib-modules\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311061 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-var-lib-kubelet\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311076 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-sysctl-d\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311093 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-var-lib-cni-multus\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0c86769-7d8f-436f-b7df-a55cd8fe3cb5-hosts-file\") pod \"node-resolver-mrpd6\" (UID: \"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5\") " pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311161 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-lib-modules\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311162 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0c86769-7d8f-436f-b7df-a55cd8fe3cb5-hosts-file\") pod \"node-resolver-mrpd6\" (UID: \"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5\") " pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311162 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-var-lib-kubelet\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.312241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311197 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-var-lib-cni-multus\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311209 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56578618-4070-4ec5-b8ed-2a2f0e2ae063-ovnkube-script-lib\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.311249 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.311302 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret podName:059bca4a-0e12-4c97-b08e-f9187ad029e3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:26.811285555 +0000 UTC m=+3.533792729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret") pod "global-pull-secret-syncer-t8xrx" (UID: "059bca4a-0e12-4c97-b08e-f9187ad029e3") : object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311317 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-device-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311357 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-run-ovn\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56578618-4070-4ec5-b8ed-2a2f0e2ae063-ovnkube-config\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311387 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ee8da63-127d-47f2-a318-ead45a97069f-host\") pod \"node-ca-w69lg\" (UID: \"9ee8da63-127d-47f2-a318-ead45a97069f\") " pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311402 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-run\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311429 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311432 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-run-ovn\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311466 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/059bca4a-0e12-4c97-b08e-f9187ad029e3-kubelet-config\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311468 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-device-dir\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311489 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g55c5\" (UniqueName: \"kubernetes.io/projected/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-kube-api-access-g55c5\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:26.312812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311511 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-cni-bin\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311525 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/059bca4a-0e12-4c97-b08e-f9187ad029e3-kubelet-config\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29xm8\" (UniqueName: \"kubernetes.io/projected/56578618-4070-4ec5-b8ed-2a2f0e2ae063-kube-api-access-29xm8\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311555 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-modprobe-d\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311564 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ee8da63-127d-47f2-a318-ead45a97069f-host\") pod \"node-ca-w69lg\" (UID: \"9ee8da63-127d-47f2-a318-ead45a97069f\") " pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-kubernetes\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311600 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-system-cni-dir\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311617 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-run\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311619 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7701eb16-bd8d-4e30-8020-97298a371fc8-host-slash\") pod \"iptables-alerter-whzjm\" (UID: \"7701eb16-bd8d-4e30-8020-97298a371fc8\") " pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311646 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7701eb16-bd8d-4e30-8020-97298a371fc8-host-slash\") pod \"iptables-alerter-whzjm\" (UID: \"7701eb16-bd8d-4e30-8020-97298a371fc8\") " pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311670 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ee8da63-127d-47f2-a318-ead45a97069f-serviceca\") pod \"node-ca-w69lg\" (UID: \"9ee8da63-127d-47f2-a318-ead45a97069f\") " pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-sysctl-conf\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311748 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ltsq\" (UniqueName: \"kubernetes.io/projected/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-kube-api-access-4ltsq\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.313241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311774 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-cni-binary-copy\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p8f4\" (UniqueName: \"kubernetes.io/projected/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-kube-api-access-9p8f4\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311825 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-systemd-units\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311840 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-run-netns\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311853 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-kubernetes\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-systemd\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311961 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-run-netns\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.311974 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7701eb16-bd8d-4e30-8020-97298a371fc8-iptables-alerter-script\") pod \"iptables-alerter-whzjm\" (UID: \"7701eb16-bd8d-4e30-8020-97298a371fc8\") " pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312018 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-system-cni-dir\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312117 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-sysctl-conf\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312301 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-cni-binary-copy\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312344 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-etc-selinux\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312374 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-systemd\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.313768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-slash\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312401 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312407 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-slash\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-etc-openvswitch\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-run-netns\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312452 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-cni-bin\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312464 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-etc-openvswitch\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312489 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-systemd-units\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-etc-kubernetes\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312538 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-modprobe-d\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312541 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-kubelet\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-cnibin\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/059bca4a-0e12-4c97-b08e-f9187ad029e3-dbus\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312612 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb32bcf9-14d8-45f9-a488-034b14c1a8de-etc-selinux\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312628 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-system-cni-dir\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.314285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312673 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-etc-kubernetes\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-run-openvswitch\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312728 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-cnibin\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4b76\" (UniqueName: \"kubernetes.io/projected/7701eb16-bd8d-4e30-8020-97298a371fc8-kube-api-access-b4b76\") pod \"iptables-alerter-whzjm\" (UID: \"7701eb16-bd8d-4e30-8020-97298a371fc8\") " pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312773 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-run-netns\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312775 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ee8da63-127d-47f2-a318-ead45a97069f-serviceca\") pod \"node-ca-w69lg\" (UID: \"9ee8da63-127d-47f2-a318-ead45a97069f\") " pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312676 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-system-cni-dir\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312811 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56578618-4070-4ec5-b8ed-2a2f0e2ae063-ovnkube-config\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312911 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-run-openvswitch\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312937 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-kubelet\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312937 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/059bca4a-0e12-4c97-b08e-f9187ad029e3-dbus\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.312988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f85b4ed-0f33-438a-b4b9-e372a56b9f5e-konnectivity-ca\") pod \"konnectivity-agent-lxx6t\" (UID: \"3f85b4ed-0f33-438a-b4b9-e372a56b9f5e\") " pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313019 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-host\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313103 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-host\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313107 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-os-release\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.315007 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-run-k8s-cni-cncf-io\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313162 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-cni-netd\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313192 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp9m8\" (UniqueName: \"kubernetes.io/projected/9ee8da63-127d-47f2-a318-ead45a97069f-kube-api-access-tp9m8\") pod \"node-ca-w69lg\" (UID: \"9ee8da63-127d-47f2-a318-ead45a97069f\") " pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313222 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-host-run-k8s-cni-cncf-io\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313242 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-sys\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313282 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-os-release\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313283 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-tuned\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313341 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcdtb\" (UniqueName: \"kubernetes.io/projected/d33e8571-4a04-44b7-af21-3f8ec39a8b94-kube-api-access-gcdtb\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313546 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313617 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d33e8571-4a04-44b7-af21-3f8ec39a8b94-sys\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.313612 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56578618-4070-4ec5-b8ed-2a2f0e2ae063-host-cni-netd\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.314015 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f85b4ed-0f33-438a-b4b9-e372a56b9f5e-konnectivity-ca\") pod \"konnectivity-agent-lxx6t\" (UID: \"3f85b4ed-0f33-438a-b4b9-e372a56b9f5e\") " pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.314422 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56578618-4070-4ec5-b8ed-2a2f0e2ae063-ovn-node-metrics-cert\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.314437 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d33e8571-4a04-44b7-af21-3f8ec39a8b94-tmp\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.315798 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.314444 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f85b4ed-0f33-438a-b4b9-e372a56b9f5e-agent-certs\") pod \"konnectivity-agent-lxx6t\" (UID: \"3f85b4ed-0f33-438a-b4b9-e372a56b9f5e\") " pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:26.316509 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.315120 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d33e8571-4a04-44b7-af21-3f8ec39a8b94-etc-tuned\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.319998 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.319977 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mk2p\" (UniqueName: \"kubernetes.io/projected/bb32bcf9-14d8-45f9-a488-034b14c1a8de-kube-api-access-9mk2p\") pod \"aws-ebs-csi-driver-node-gjzwh\" (UID: \"bb32bcf9-14d8-45f9-a488-034b14c1a8de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.322049 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.322024 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f4jb\" (UniqueName: \"kubernetes.io/projected/f0c86769-7d8f-436f-b7df-a55cd8fe3cb5-kube-api-access-2f4jb\") pod \"node-resolver-mrpd6\" (UID: \"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5\") " pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.322571 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.322553 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 21:37:26.322672 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.322579 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 21:37:26.322672 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.322591 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7z7zn for pod openshift-network-diagnostics/network-check-target-kxbsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:26.322672 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.322653 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn podName:fa7053cc-d7e9-435c-bf21-29f6097186e6 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:26.822637681 +0000 UTC m=+3.545144842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7z7zn" (UniqueName: "kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn") pod "network-check-target-kxbsp" (UID: "fa7053cc-d7e9-435c-bf21-29f6097186e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:26.322940 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.322922 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcdtb\" (UniqueName: \"kubernetes.io/projected/d33e8571-4a04-44b7-af21-3f8ec39a8b94-kube-api-access-gcdtb\") pod \"tuned-gbz2c\" (UID: \"d33e8571-4a04-44b7-af21-3f8ec39a8b94\") " pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.323037 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.323016 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ltsq\" (UniqueName: \"kubernetes.io/projected/71dd26fb-78f7-4c5d-9f94-dad4b028b09f-kube-api-access-4ltsq\") pod \"multus-additional-cni-plugins-dnpzg\" (UID: \"71dd26fb-78f7-4c5d-9f94-dad4b028b09f\") " pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.324394 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.324378 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p8f4\" (UniqueName: \"kubernetes.io/projected/6495e7f9-5f55-4719-8a5d-e8ae290e2efa-kube-api-access-9p8f4\") pod \"multus-v462f\" (UID: \"6495e7f9-5f55-4719-8a5d-e8ae290e2efa\") " pod="openshift-multus/multus-v462f" Jul 14 21:37:26.325212 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.325194 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp9m8\" (UniqueName: \"kubernetes.io/projected/9ee8da63-127d-47f2-a318-ead45a97069f-kube-api-access-tp9m8\") pod \"node-ca-w69lg\" (UID: \"9ee8da63-127d-47f2-a318-ead45a97069f\") " pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.325534 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.325512 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29xm8\" (UniqueName: \"kubernetes.io/projected/56578618-4070-4ec5-b8ed-2a2f0e2ae063-kube-api-access-29xm8\") pod \"ovnkube-node-m25ff\" (UID: \"56578618-4070-4ec5-b8ed-2a2f0e2ae063\") " pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.325728 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.325712 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4b76\" (UniqueName: \"kubernetes.io/projected/7701eb16-bd8d-4e30-8020-97298a371fc8-kube-api-access-b4b76\") pod \"iptables-alerter-whzjm\" (UID: \"7701eb16-bd8d-4e30-8020-97298a371fc8\") " pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.326582 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.326567 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g55c5\" (UniqueName: \"kubernetes.io/projected/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-kube-api-access-g55c5\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:26.457098 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.457041 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:26.464688 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:26.464667 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f85b4ed_0f33_438a_b4b9_e372a56b9f5e.slice/crio-ed4e52b86d43693e3385d9284a219c2a2ed1582a29f0e5c6e14c92867884f47f WatchSource:0}: Error finding container ed4e52b86d43693e3385d9284a219c2a2ed1582a29f0e5c6e14c92867884f47f: Status 404 returned error can't find the container with id ed4e52b86d43693e3385d9284a219c2a2ed1582a29f0e5c6e14c92867884f47f Jul 14 21:37:26.484021 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.483994 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mrpd6" Jul 14 21:37:26.490636 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:26.490617 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c86769_7d8f_436f_b7df_a55cd8fe3cb5.slice/crio-e0065e34560ebc67891995d87f6b70742bf12fae93b7a551eab9998e3c33354b WatchSource:0}: Error finding container e0065e34560ebc67891995d87f6b70742bf12fae93b7a551eab9998e3c33354b: Status 404 returned error can't find the container with id e0065e34560ebc67891995d87f6b70742bf12fae93b7a551eab9998e3c33354b Jul 14 21:37:26.506477 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.506459 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" Jul 14 21:37:26.511247 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.511232 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v462f" Jul 14 21:37:26.512820 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:26.512803 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb32bcf9_14d8_45f9_a488_034b14c1a8de.slice/crio-6c6285e070a563c92aa6fe147b452b11283862e2e56cc6f7a1fa4f23b2bc4bcc WatchSource:0}: Error finding container 6c6285e070a563c92aa6fe147b452b11283862e2e56cc6f7a1fa4f23b2bc4bcc: Status 404 returned error can't find the container with id 6c6285e070a563c92aa6fe147b452b11283862e2e56cc6f7a1fa4f23b2bc4bcc Jul 14 21:37:26.517206 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.516851 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" Jul 14 21:37:26.519261 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:26.519175 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6495e7f9_5f55_4719_8a5d_e8ae290e2efa.slice/crio-e17edb908e3cc9ad2fcd541d9e48bfb3d6e096c18e923b2c0fc358e19b0cd5de WatchSource:0}: Error finding container e17edb908e3cc9ad2fcd541d9e48bfb3d6e096c18e923b2c0fc358e19b0cd5de: Status 404 returned error can't find the container with id e17edb908e3cc9ad2fcd541d9e48bfb3d6e096c18e923b2c0fc358e19b0cd5de Jul 14 21:37:26.522881 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.522860 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" Jul 14 21:37:26.525847 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:26.525820 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33e8571_4a04_44b7_af21_3f8ec39a8b94.slice/crio-1885abc1ce3d2f27c8ff03741feb515500b217a82ed9ceec0176f37e81452276 WatchSource:0}: Error finding container 1885abc1ce3d2f27c8ff03741feb515500b217a82ed9ceec0176f37e81452276: Status 404 returned error can't find the container with id 1885abc1ce3d2f27c8ff03741feb515500b217a82ed9ceec0176f37e81452276 Jul 14 21:37:26.529123 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.529100 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:26.530137 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:26.530118 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71dd26fb_78f7_4c5d_9f94_dad4b028b09f.slice/crio-8189ad8350b73cd4a0f128865446e06a9129f675bf5273d0f604470ef65e5cbb WatchSource:0}: Error finding container 8189ad8350b73cd4a0f128865446e06a9129f675bf5273d0f604470ef65e5cbb: Status 404 returned error can't find the container with id 8189ad8350b73cd4a0f128865446e06a9129f675bf5273d0f604470ef65e5cbb Jul 14 21:37:26.534203 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.534188 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-whzjm" Jul 14 21:37:26.536413 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:26.536391 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56578618_4070_4ec5_b8ed_2a2f0e2ae063.slice/crio-fde2edb6cd4d4b3adcb5c54500356eeca362f968f6c8bdfdf0775b026002b8cd WatchSource:0}: Error finding container fde2edb6cd4d4b3adcb5c54500356eeca362f968f6c8bdfdf0775b026002b8cd: Status 404 returned error can't find the container with id fde2edb6cd4d4b3adcb5c54500356eeca362f968f6c8bdfdf0775b026002b8cd Jul 14 21:37:26.538190 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.538169 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w69lg" Jul 14 21:37:26.544275 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:26.544258 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7701eb16_bd8d_4e30_8020_97298a371fc8.slice/crio-44c9d09d659377f8b0b717c15bad328d9e8317efd425fbd28d32f67e9da8610b WatchSource:0}: Error finding container 44c9d09d659377f8b0b717c15bad328d9e8317efd425fbd28d32f67e9da8610b: Status 404 returned error can't find the container with id 44c9d09d659377f8b0b717c15bad328d9e8317efd425fbd28d32f67e9da8610b Jul 14 21:37:26.547047 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:37:26.547028 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee8da63_127d_47f2_a318_ead45a97069f.slice/crio-5dcf0f86aed7310df33a0faa303996464f2d1f6ed87b7960439f9ade9b8e2794 WatchSource:0}: Error finding container 5dcf0f86aed7310df33a0faa303996464f2d1f6ed87b7960439f9ade9b8e2794: Status 404 returned error can't find the container with id 5dcf0f86aed7310df33a0faa303996464f2d1f6ed87b7960439f9ade9b8e2794 Jul 14 21:37:26.816410 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.816334 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:26.816410 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.816406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:26.816599 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.816501 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:26.816599 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.816542 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret podName:059bca4a-0e12-4c97-b08e-f9187ad029e3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:27.816530247 +0000 UTC m=+4.539037408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret") pod "global-pull-secret-syncer-t8xrx" (UID: "059bca4a-0e12-4c97-b08e-f9187ad029e3") : object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:26.816874 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.816847 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:26.817004 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.816918 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs podName:1e5e89e0-7530-4ca8-8781-aa159d84b7aa nodeName:}" failed. No retries permitted until 2026-07-14 21:37:27.816901209 +0000 UTC m=+4.539408374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs") pod "network-metrics-daemon-5x8kg" (UID: "1e5e89e0-7530-4ca8-8781-aa159d84b7aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:26.851841 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.851792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w69lg" event={"ID":"9ee8da63-127d-47f2-a318-ead45a97069f","Type":"ContainerStarted","Data":"5dcf0f86aed7310df33a0faa303996464f2d1f6ed87b7960439f9ade9b8e2794"} Jul 14 21:37:26.853716 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.853688 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-whzjm" event={"ID":"7701eb16-bd8d-4e30-8020-97298a371fc8","Type":"ContainerStarted","Data":"44c9d09d659377f8b0b717c15bad328d9e8317efd425fbd28d32f67e9da8610b"} Jul 14 21:37:26.855431 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.855350 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" event={"ID":"56578618-4070-4ec5-b8ed-2a2f0e2ae063","Type":"ContainerStarted","Data":"fde2edb6cd4d4b3adcb5c54500356eeca362f968f6c8bdfdf0775b026002b8cd"} Jul 14 21:37:26.856815 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.856790 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" event={"ID":"d33e8571-4a04-44b7-af21-3f8ec39a8b94","Type":"ContainerStarted","Data":"1885abc1ce3d2f27c8ff03741feb515500b217a82ed9ceec0176f37e81452276"} Jul 14 21:37:26.858181 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.858153 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v462f" event={"ID":"6495e7f9-5f55-4719-8a5d-e8ae290e2efa","Type":"ContainerStarted","Data":"e17edb908e3cc9ad2fcd541d9e48bfb3d6e096c18e923b2c0fc358e19b0cd5de"} Jul 14 21:37:26.859716 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.859678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" event={"ID":"bb32bcf9-14d8-45f9-a488-034b14c1a8de","Type":"ContainerStarted","Data":"6c6285e070a563c92aa6fe147b452b11283862e2e56cc6f7a1fa4f23b2bc4bcc"} Jul 14 21:37:26.861185 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.861148 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lxx6t" event={"ID":"3f85b4ed-0f33-438a-b4b9-e372a56b9f5e","Type":"ContainerStarted","Data":"ed4e52b86d43693e3385d9284a219c2a2ed1582a29f0e5c6e14c92867884f47f"} Jul 14 21:37:26.862388 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.862365 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" event={"ID":"71dd26fb-78f7-4c5d-9f94-dad4b028b09f","Type":"ContainerStarted","Data":"8189ad8350b73cd4a0f128865446e06a9129f675bf5273d0f604470ef65e5cbb"} Jul 14 21:37:26.863704 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.863679 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mrpd6" event={"ID":"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5","Type":"ContainerStarted","Data":"e0065e34560ebc67891995d87f6b70742bf12fae93b7a551eab9998e3c33354b"} Jul 14 21:37:26.864851 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.864828 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" event={"ID":"a58359b5cdd7f4549d70ede60555141b","Type":"ContainerStarted","Data":"1366559da8f7edd146dc42bb4ab17f0a59de33592f5f22d5d7ea59861b0646f8"} Jul 14 21:37:26.866060 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.866035 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" event={"ID":"11ebf2b3606c12ff044395928735acf2","Type":"ContainerStarted","Data":"8f611383bea07ba7eb9e5d38b44a17e9984362939968ec3171e5a3b29941760a"} Jul 14 21:37:26.917751 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:26.917722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z7zn\" (UniqueName: \"kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn\") pod \"network-check-target-kxbsp\" (UID: \"fa7053cc-d7e9-435c-bf21-29f6097186e6\") " pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:26.917889 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.917869 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 21:37:26.917957 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.917890 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 21:37:26.917957 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.917904 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7z7zn for pod openshift-network-diagnostics/network-check-target-kxbsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:26.918062 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:26.917959 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn podName:fa7053cc-d7e9-435c-bf21-29f6097186e6 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:27.917941902 +0000 UTC m=+4.640449076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7z7zn" (UniqueName: "kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn") pod "network-check-target-kxbsp" (UID: "fa7053cc-d7e9-435c-bf21-29f6097186e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:27.190117 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:27.189967 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 21:32:26 +0000 UTC" deadline="2027-12-18 16:05:02.906017599 +0000 UTC" Jul 14 21:37:27.190117 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:27.190025 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12522h27m35.715996776s" Jul 14 21:37:27.826352 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:27.825581 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:27.826352 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:27.825660 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:27.826352 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.825811 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:27.826352 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.825875 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs podName:1e5e89e0-7530-4ca8-8781-aa159d84b7aa nodeName:}" failed. No retries permitted until 2026-07-14 21:37:29.825856696 +0000 UTC m=+6.548363860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs") pod "network-metrics-daemon-5x8kg" (UID: "1e5e89e0-7530-4ca8-8781-aa159d84b7aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:27.826352 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.826257 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:27.826352 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.826306 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret podName:059bca4a-0e12-4c97-b08e-f9187ad029e3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:29.826290284 +0000 UTC m=+6.548797461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret") pod "global-pull-secret-syncer-t8xrx" (UID: "059bca4a-0e12-4c97-b08e-f9187ad029e3") : object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:27.848292 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:27.847474 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:27.848292 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.847585 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:27.848292 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:27.847994 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:27.848292 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.848082 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:27.848292 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:27.848149 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:27.848292 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.848232 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:27.926572 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:27.926540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z7zn\" (UniqueName: \"kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn\") pod \"network-check-target-kxbsp\" (UID: \"fa7053cc-d7e9-435c-bf21-29f6097186e6\") " pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:27.927107 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.926728 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 21:37:27.927107 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.926760 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 21:37:27.927107 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.926774 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7z7zn for pod openshift-network-diagnostics/network-check-target-kxbsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:27.927107 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:27.926836 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn podName:fa7053cc-d7e9-435c-bf21-29f6097186e6 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:29.926817654 +0000 UTC m=+6.649324828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7z7zn" (UniqueName: "kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn") pod "network-check-target-kxbsp" (UID: "fa7053cc-d7e9-435c-bf21-29f6097186e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:28.190866 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:28.190779 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 21:32:26 +0000 UTC" deadline="2027-12-26 05:12:43.97313612 +0000 UTC" Jul 14 21:37:28.190866 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:28.190818 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12703h35m15.782322841s" Jul 14 21:37:29.842988 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:29.842952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:29.843453 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:29.843037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:29.843453 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.843184 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:29.843453 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.843231 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:29.843453 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.843247 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs podName:1e5e89e0-7530-4ca8-8781-aa159d84b7aa nodeName:}" failed. No retries permitted until 2026-07-14 21:37:33.843228566 +0000 UTC m=+10.565735732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs") pod "network-metrics-daemon-5x8kg" (UID: "1e5e89e0-7530-4ca8-8781-aa159d84b7aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:29.843453 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.843312 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret podName:059bca4a-0e12-4c97-b08e-f9187ad029e3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:33.843294657 +0000 UTC m=+10.565801824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret") pod "global-pull-secret-syncer-t8xrx" (UID: "059bca4a-0e12-4c97-b08e-f9187ad029e3") : object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:29.847769 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:29.847747 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:29.847898 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.847874 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:29.847959 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:29.847926 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:29.848011 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.847992 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:29.848062 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:29.848055 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:29.848151 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.848129 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:29.944780 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:29.944179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z7zn\" (UniqueName: \"kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn\") pod \"network-check-target-kxbsp\" (UID: \"fa7053cc-d7e9-435c-bf21-29f6097186e6\") " pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:29.944780 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.944369 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 21:37:29.944780 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.944390 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 21:37:29.944780 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.944404 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7z7zn for pod openshift-network-diagnostics/network-check-target-kxbsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:29.944780 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:29.944458 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn podName:fa7053cc-d7e9-435c-bf21-29f6097186e6 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:33.944440004 +0000 UTC m=+10.666947168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7z7zn" (UniqueName: "kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn") pod "network-check-target-kxbsp" (UID: "fa7053cc-d7e9-435c-bf21-29f6097186e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:31.847609 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:31.847574 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:31.848052 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:31.847697 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:31.848133 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:31.848057 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:31.848182 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:31.848140 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:31.848240 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:31.848202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:31.848297 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:31.848273 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:33.845513 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:33.845476 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:33.845957 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.845584 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:33.845957 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:33.845923 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:33.846110 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.846024 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:33.846166 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:33.846096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:33.846214 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.846174 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:33.879356 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:33.879031 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:33.879356 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:33.879104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:33.879356 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.879233 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:33.879356 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.879234 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:33.879356 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.879294 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs podName:1e5e89e0-7530-4ca8-8781-aa159d84b7aa nodeName:}" failed. No retries permitted until 2026-07-14 21:37:41.879273672 +0000 UTC m=+18.601780836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs") pod "network-metrics-daemon-5x8kg" (UID: "1e5e89e0-7530-4ca8-8781-aa159d84b7aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:33.879356 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.879312 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret podName:059bca4a-0e12-4c97-b08e-f9187ad029e3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:41.879303376 +0000 UTC m=+18.601810544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret") pod "global-pull-secret-syncer-t8xrx" (UID: "059bca4a-0e12-4c97-b08e-f9187ad029e3") : object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:33.980342 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:33.980294 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z7zn\" (UniqueName: \"kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn\") pod \"network-check-target-kxbsp\" (UID: \"fa7053cc-d7e9-435c-bf21-29f6097186e6\") " pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:33.980477 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.980436 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 21:37:33.980477 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.980454 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 21:37:33.980477 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.980463 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7z7zn for pod openshift-network-diagnostics/network-check-target-kxbsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:33.980611 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:33.980517 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn podName:fa7053cc-d7e9-435c-bf21-29f6097186e6 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:41.980499494 +0000 UTC m=+18.703006655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7z7zn" (UniqueName: "kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn") pod "network-check-target-kxbsp" (UID: "fa7053cc-d7e9-435c-bf21-29f6097186e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:35.845867 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:35.845828 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:35.846362 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:35.845963 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:35.846433 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:35.846405 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:35.846567 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:35.846544 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:35.846639 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:35.846615 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:35.846714 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:35.846696 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:37.844724 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:37.844688 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:37.845178 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:37.844688 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:37.845178 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:37.844859 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:37.845178 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:37.844908 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:37.845178 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:37.844719 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:37.845178 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:37.845002 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:39.845635 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:39.845601 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:39.846040 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:39.845610 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:39.846040 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:39.845735 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:39.846040 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:39.845814 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:39.846040 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:39.845610 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:39.846040 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:39.845896 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:41.845767 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:41.845731 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:41.846288 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:41.845732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:41.846288 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:41.845862 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:41.846288 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:41.845876 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:41.846288 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:41.845990 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:41.846288 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:41.846098 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:41.939964 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:41.939938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:41.940095 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:41.939986 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:41.940095 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:41.940071 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:41.940095 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:41.940072 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:41.940194 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:41.940118 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret podName:059bca4a-0e12-4c97-b08e-f9187ad029e3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:57.940102666 +0000 UTC m=+34.662609843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret") pod "global-pull-secret-syncer-t8xrx" (UID: "059bca4a-0e12-4c97-b08e-f9187ad029e3") : object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:41.940194 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:41.940132 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs podName:1e5e89e0-7530-4ca8-8781-aa159d84b7aa nodeName:}" failed. No retries permitted until 2026-07-14 21:37:57.940125293 +0000 UTC m=+34.662632453 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs") pod "network-metrics-daemon-5x8kg" (UID: "1e5e89e0-7530-4ca8-8781-aa159d84b7aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:42.040720 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:42.040691 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z7zn\" (UniqueName: \"kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn\") pod \"network-check-target-kxbsp\" (UID: \"fa7053cc-d7e9-435c-bf21-29f6097186e6\") " pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:42.040861 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:42.040825 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 21:37:42.040861 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:42.040838 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 21:37:42.040861 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:42.040847 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7z7zn for pod openshift-network-diagnostics/network-check-target-kxbsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:42.040952 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:42.040906 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn podName:fa7053cc-d7e9-435c-bf21-29f6097186e6 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:58.04088203 +0000 UTC m=+34.763389202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7z7zn" (UniqueName: "kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn") pod "network-check-target-kxbsp" (UID: "fa7053cc-d7e9-435c-bf21-29f6097186e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:43.845517 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:43.845492 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:43.845961 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:43.845590 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:43.845961 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:43.845676 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:43.845961 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:43.845763 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:43.845961 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:43.845802 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:43.845961 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:43.845866 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:45.845571 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:45.845509 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:45.845571 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:45.845526 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:45.846071 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:45.845642 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:45.846071 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:45.845711 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:45.846071 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:45.845775 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:45.846071 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:45.845847 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:46.912898 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.912740 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" event={"ID":"11ebf2b3606c12ff044395928735acf2","Type":"ContainerStarted","Data":"d35c2e72ad32558f79b0f57ed3e5d443541bd93e30515dc6ff7a60044850e173"} Jul 14 21:37:46.914753 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.914735 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:37:46.915095 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.915073 2567 generic.go:356] "Generic (PLEG): container finished" podID="56578618-4070-4ec5-b8ed-2a2f0e2ae063" containerID="74bc12937fb83557c9820060c87e7ef35a6c1236d1a8047fd4cb8ce35b43f146" exitCode=1 Jul 14 21:37:46.915185 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.915138 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" event={"ID":"56578618-4070-4ec5-b8ed-2a2f0e2ae063","Type":"ContainerStarted","Data":"d0d00401f786709f3e4bf4ed782d44dfa6f3c1d9458128fc6570b8efa7e5e1cf"} Jul 14 21:37:46.915245 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.915196 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" event={"ID":"56578618-4070-4ec5-b8ed-2a2f0e2ae063","Type":"ContainerDied","Data":"74bc12937fb83557c9820060c87e7ef35a6c1236d1a8047fd4cb8ce35b43f146"} Jul 14 21:37:46.915245 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.915232 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" event={"ID":"56578618-4070-4ec5-b8ed-2a2f0e2ae063","Type":"ContainerStarted","Data":"f6c4a077c3cab71293e1ac3defb534751903828fb61d9f9d3074f4a491409070"} Jul 14 21:37:46.916494 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.916473 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" event={"ID":"d33e8571-4a04-44b7-af21-3f8ec39a8b94","Type":"ContainerStarted","Data":"fb3f26cccd0a92b5c86cec599094540961b1847bd477116831af16c28f50c387"} Jul 14 21:37:46.917665 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.917649 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v462f" event={"ID":"6495e7f9-5f55-4719-8a5d-e8ae290e2efa","Type":"ContainerStarted","Data":"59922665ff2deb9d9b4f184727d083adf4b0acbfb1abcdc4933e5c3f1c37bc3e"} Jul 14 21:37:46.944387 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.944315 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-58.ec2.internal" podStartSLOduration=21.944295838 podStartE2EDuration="21.944295838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:46.943674588 +0000 UTC m=+23.666181794" watchObservedRunningTime="2026-07-14 21:37:46.944295838 +0000 UTC m=+23.666803022" Jul 14 21:37:46.966858 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.966813 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gbz2c" podStartSLOduration=3.077676075 podStartE2EDuration="22.966797242s" totalImagesPullingTime="19.889121167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:46.966645858 +0000 UTC m=+23.689153076" watchObservedRunningTime="2026-07-14 21:37:46.966797242 +0000 UTC m=+23.689304424" Jul 14 21:37:46.990500 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:46.990443 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v462f" podStartSLOduration=4.073305671 podStartE2EDuration="23.990425026s" totalImagesPullingTime="19.917119355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:46.988704099 +0000 UTC m=+23.711211299" watchObservedRunningTime="2026-07-14 21:37:46.990425026 +0000 UTC m=+23.712932209" Jul 14 21:37:47.845537 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.845377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:47.845696 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.845384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:47.845696 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:47.845615 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:47.845778 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:47.845705 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:47.845778 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.845384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:47.845855 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:47.845780 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:47.920934 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.920863 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mrpd6" event={"ID":"f0c86769-7d8f-436f-b7df-a55cd8fe3cb5","Type":"ContainerStarted","Data":"3aba6e81b066442208116c122aa52845d92051044861b76f83ce8bf6ff7b48bf"} Jul 14 21:37:47.922595 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.922558 2567 generic.go:356] "Generic (PLEG): container finished" podID="a58359b5cdd7f4549d70ede60555141b" containerID="7a1b6d027ce0c29bea43f1cae5452251c9b08908c613ce6d4aad1dd26e3dc885" exitCode=0 Jul 14 21:37:47.922711 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.922644 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" event={"ID":"a58359b5cdd7f4549d70ede60555141b","Type":"ContainerDied","Data":"7a1b6d027ce0c29bea43f1cae5452251c9b08908c613ce6d4aad1dd26e3dc885"} Jul 14 21:37:47.924287 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.924264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w69lg" event={"ID":"9ee8da63-127d-47f2-a318-ead45a97069f","Type":"ContainerStarted","Data":"dd9c725b641b321b53ee24b70db9fc965b595412e8900f2d3fecaf517cec09ff"} Jul 14 21:37:47.928354 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.928312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-whzjm" event={"ID":"7701eb16-bd8d-4e30-8020-97298a371fc8","Type":"ContainerStarted","Data":"459399f38d9c7af4a3863e97cb0aad5f6a3ff051218bcf396fe164df7a7615d3"} Jul 14 21:37:47.932011 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.931992 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:37:47.932468 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.932438 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" event={"ID":"56578618-4070-4ec5-b8ed-2a2f0e2ae063","Type":"ContainerStarted","Data":"596e74c1098d710b2cf966e1cd47a36f0d147e6f4ae412b191cc05f4e276fbbb"} Jul 14 21:37:47.932540 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.932515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" event={"ID":"56578618-4070-4ec5-b8ed-2a2f0e2ae063","Type":"ContainerStarted","Data":"e2574a447fa25fddf8004a0ee538377fd40c885ddcb2022f4049b20de08c6dd6"} Jul 14 21:37:47.932583 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.932561 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" event={"ID":"56578618-4070-4ec5-b8ed-2a2f0e2ae063","Type":"ContainerStarted","Data":"80c41c183dade3294580bc90b2c1cbef8912299df4eff624225d2806bd94bf67"} Jul 14 21:37:47.933921 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.933900 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" event={"ID":"bb32bcf9-14d8-45f9-a488-034b14c1a8de","Type":"ContainerStarted","Data":"ad2cf5825856a076e19cbb285bfaf63464a5fb30ce272ca32346902032479576"} Jul 14 21:37:47.935434 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.935413 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lxx6t" event={"ID":"3f85b4ed-0f33-438a-b4b9-e372a56b9f5e","Type":"ContainerStarted","Data":"65b27106662b4c90479a50b3025072fb5864a14e7f8ff1406ba85d34183e271f"} Jul 14 21:37:47.936849 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.936827 2567 generic.go:356] "Generic (PLEG): container finished" podID="71dd26fb-78f7-4c5d-9f94-dad4b028b09f" containerID="166353fedf8df6f9437347d98c91237653c2e811cc718abf919d3d4a45f57cd2" exitCode=0 Jul 14 21:37:47.936938 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.936879 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" event={"ID":"71dd26fb-78f7-4c5d-9f94-dad4b028b09f","Type":"ContainerDied","Data":"166353fedf8df6f9437347d98c91237653c2e811cc718abf919d3d4a45f57cd2"} Jul 14 21:37:47.944728 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.944682 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mrpd6" podStartSLOduration=5.019566708 podStartE2EDuration="24.944668338s" totalImagesPullingTime="19.92510163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:47.943990178 +0000 UTC m=+24.666497360" watchObservedRunningTime="2026-07-14 21:37:47.944668338 +0000 UTC m=+24.667175519" Jul 14 21:37:47.991636 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:47.991468 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lxx6t" podStartSLOduration=5.040132313 podStartE2EDuration="24.99144994s" totalImagesPullingTime="19.951317627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:47.991066295 +0000 UTC m=+24.713573469" watchObservedRunningTime="2026-07-14 21:37:47.99144994 +0000 UTC m=+24.713957122" Jul 14 21:37:48.030688 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:48.030628 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-whzjm" podStartSLOduration=4.159475018 podStartE2EDuration="24.030609529s" totalImagesPullingTime="19.871134511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:48.013672335 +0000 UTC m=+24.736179519" watchObservedRunningTime="2026-07-14 21:37:48.030609529 +0000 UTC m=+24.753116713" Jul 14 21:37:48.031176 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:48.031138 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w69lg" podStartSLOduration=4.161837822 podStartE2EDuration="24.03112084s" totalImagesPullingTime="19.869283018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:48.030758759 +0000 UTC m=+24.753265924" watchObservedRunningTime="2026-07-14 21:37:48.03112084 +0000 UTC m=+24.753628024" Jul 14 21:37:48.616003 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:48.615980 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 21:37:48.803198 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:48.803065 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T21:37:48.616001564Z","UUID":"243f2e3b-fb2a-4491-902a-c45043b810af","Handler":null,"Name":"","Endpoint":""} Jul 14 21:37:48.806072 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:48.806050 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 21:37:48.806189 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:48.806101 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 21:37:48.941480 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:48.941424 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" event={"ID":"bb32bcf9-14d8-45f9-a488-034b14c1a8de","Type":"ContainerStarted","Data":"0bdd3836759e5ac30c9e080464f8b1806335a151077c3d67e57502ee56e5e85d"} Jul 14 21:37:48.943760 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:48.943364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" event={"ID":"a58359b5cdd7f4549d70ede60555141b","Type":"ContainerStarted","Data":"4e60b13e04e0afab15a2d022cbe1fdb4f660fd8c08f90fda2cba24f57bf0c957"} Jul 14 21:37:49.845134 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:49.845114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:49.845276 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:49.845215 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:49.845276 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:49.845120 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:49.845276 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:49.845240 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:49.845448 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:49.845320 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:49.845448 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:49.845431 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:49.948842 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:49.948822 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:37:49.949294 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:49.949264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" event={"ID":"56578618-4070-4ec5-b8ed-2a2f0e2ae063","Type":"ContainerStarted","Data":"1b862ef953e04b3abec8e3cf9ddc658f639949d1b322a8b4d9c2f66f0288a60a"} Jul 14 21:37:49.952223 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:49.952193 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" event={"ID":"bb32bcf9-14d8-45f9-a488-034b14c1a8de","Type":"ContainerStarted","Data":"9ddc0fa7faba470078eb70e9b8a3810159f35b26dd4bbd10177229574935a949"} Jul 14 21:37:49.976812 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:49.976772 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gjzwh" podStartSLOduration=4.866493191 podStartE2EDuration="26.976759241s" totalImagesPullingTime="22.11026605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:49.976686562 +0000 UTC m=+26.699193745" watchObservedRunningTime="2026-07-14 21:37:49.976759241 +0000 UTC m=+26.699266422" Jul 14 21:37:49.977269 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:49.977236 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-58.ec2.internal" podStartSLOduration=24.977223776 podStartE2EDuration="24.977223776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:48.970221626 +0000 UTC m=+25.692728810" watchObservedRunningTime="2026-07-14 21:37:49.977223776 +0000 UTC m=+26.699730959" Jul 14 21:37:50.548479 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:50.548445 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:50.548984 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:50.548966 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:50.954086 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:50.954009 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:50.954584 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:50.954564 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lxx6t" Jul 14 21:37:51.845506 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:51.845475 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:51.845728 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:51.845492 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:51.845728 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:51.845618 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:51.845728 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:51.845494 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:51.845728 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:51.845700 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:51.845928 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:51.845847 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:52.960740 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:52.960586 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:37:52.961409 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:52.961076 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" event={"ID":"56578618-4070-4ec5-b8ed-2a2f0e2ae063","Type":"ContainerStarted","Data":"153f360f3871044e8547628f9e7d9d48d66cffa30c8171527171f9c5875e268d"} Jul 14 21:37:52.964791 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:52.962119 2567 scope.go:117] "RemoveContainer" containerID="74bc12937fb83557c9820060c87e7ef35a6c1236d1a8047fd4cb8ce35b43f146" Jul 14 21:37:52.964910 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:52.964839 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:52.965471 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:52.964965 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:52.965471 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:52.965114 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:52.966811 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:52.966740 2567 generic.go:356] "Generic (PLEG): container finished" podID="71dd26fb-78f7-4c5d-9f94-dad4b028b09f" containerID="c384c9277b424e37396b1cb642045679389382811b8ef0daf6085858724b7774" exitCode=0 Jul 14 21:37:52.966811 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:52.966792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" event={"ID":"71dd26fb-78f7-4c5d-9f94-dad4b028b09f","Type":"ContainerDied","Data":"c384c9277b424e37396b1cb642045679389382811b8ef0daf6085858724b7774"} Jul 14 21:37:52.978604 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:52.978581 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:52.980311 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:52.980296 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:37:53.846016 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:53.845989 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:53.846197 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:53.846064 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:53.846197 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:53.846152 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:53.846350 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:53.846242 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:53.846350 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:53.846283 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:53.846350 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:53.846343 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:53.972491 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:53.972461 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:37:53.973063 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:53.972823 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" event={"ID":"56578618-4070-4ec5-b8ed-2a2f0e2ae063","Type":"ContainerStarted","Data":"36385e4b82f342009111e8ed6186c5d69d29c30a49dd307193ccec0c4a5e1dc8"} Jul 14 21:37:54.021033 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:54.020962 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" podStartSLOduration=10.090320317 podStartE2EDuration="30.020947571s" totalImagesPullingTime="19.930627254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:54.019684839 +0000 UTC m=+30.742192022" watchObservedRunningTime="2026-07-14 21:37:54.020947571 +0000 UTC m=+30.743454780" Jul 14 21:37:54.407184 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:54.406965 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kxbsp"] Jul 14 21:37:54.407368 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:54.407203 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:54.407368 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:54.407275 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:54.409957 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:54.409933 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8xrx"] Jul 14 21:37:54.410074 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:54.410048 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:54.410173 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:54.410150 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:54.410515 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:54.410496 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5x8kg"] Jul 14 21:37:54.410609 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:54.410595 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:54.410707 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:54.410686 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:54.976551 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:54.976520 2567 generic.go:356] "Generic (PLEG): container finished" podID="71dd26fb-78f7-4c5d-9f94-dad4b028b09f" containerID="0b256b610ea0369db28943ff9ea4cd98095c591602266e0e08de34bd4b06be6a" exitCode=0 Jul 14 21:37:54.976997 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:54.976597 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" event={"ID":"71dd26fb-78f7-4c5d-9f94-dad4b028b09f","Type":"ContainerDied","Data":"0b256b610ea0369db28943ff9ea4cd98095c591602266e0e08de34bd4b06be6a"} Jul 14 21:37:55.844658 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:55.844626 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:55.844658 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:55.844641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:55.844658 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:55.844626 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:55.844893 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:55.844747 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:55.844893 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:55.844813 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:55.844893 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:55.844856 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:56.983096 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:56.983064 2567 generic.go:356] "Generic (PLEG): container finished" podID="71dd26fb-78f7-4c5d-9f94-dad4b028b09f" containerID="72ac0457b2fa55bbce0efd2be6a2e46f287ac3af23bc1b57bfc2957378cf04f9" exitCode=0 Jul 14 21:37:56.983522 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:56.983107 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" event={"ID":"71dd26fb-78f7-4c5d-9f94-dad4b028b09f","Type":"ContainerDied","Data":"72ac0457b2fa55bbce0efd2be6a2e46f287ac3af23bc1b57bfc2957378cf04f9"} Jul 14 21:37:57.845000 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:57.844967 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:57.845000 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:57.844999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:57.845217 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:57.845003 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:57.845217 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:57.845095 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:57.845217 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:57.845176 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:37:57.845481 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:57.845447 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:57.952652 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:57.952617 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:57.952816 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:57.952681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:57.952816 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:57.952787 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:57.952931 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:57.952843 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs podName:1e5e89e0-7530-4ca8-8781-aa159d84b7aa nodeName:}" failed. No retries permitted until 2026-07-14 21:38:29.952826606 +0000 UTC m=+66.675333793 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs") pod "network-metrics-daemon-5x8kg" (UID: "1e5e89e0-7530-4ca8-8781-aa159d84b7aa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 21:37:57.952931 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:57.952788 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:57.952931 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:57.952874 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret podName:059bca4a-0e12-4c97-b08e-f9187ad029e3 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:29.952868442 +0000 UTC m=+66.675375615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret") pod "global-pull-secret-syncer-t8xrx" (UID: "059bca4a-0e12-4c97-b08e-f9187ad029e3") : object "kube-system"/"original-pull-secret" not registered Jul 14 21:37:58.053499 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:58.053453 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z7zn\" (UniqueName: \"kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn\") pod \"network-check-target-kxbsp\" (UID: \"fa7053cc-d7e9-435c-bf21-29f6097186e6\") " pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:58.053901 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:58.053651 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 21:37:58.053901 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:58.053677 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 21:37:58.053901 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:58.053691 2567 projected.go:196] Error preparing data for projected volume kube-api-access-7z7zn for pod openshift-network-diagnostics/network-check-target-kxbsp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:58.053901 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:58.053746 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn podName:fa7053cc-d7e9-435c-bf21-29f6097186e6 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:30.053727002 +0000 UTC m=+66.776234162 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7z7zn" (UniqueName: "kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn") pod "network-check-target-kxbsp" (UID: "fa7053cc-d7e9-435c-bf21-29f6097186e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 21:37:59.845451 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:59.845415 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:37:59.845854 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:59.845414 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:37:59.845854 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:59.845539 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxbsp" podUID="fa7053cc-d7e9-435c-bf21-29f6097186e6" Jul 14 21:37:59.845854 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:37:59.845419 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:37:59.845854 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:59.845603 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8xrx" podUID="059bca4a-0e12-4c97-b08e-f9187ad029e3" Jul 14 21:37:59.845854 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:37:59.845713 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5x8kg" podUID="1e5e89e0-7530-4ca8-8781-aa159d84b7aa" Jul 14 21:38:00.550306 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.550274 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-58.ec2.internal" event="NodeReady" Jul 14 21:38:00.550497 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.550427 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 21:38:00.593901 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.593868 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bf4dd44f6-ftd9p"] Jul 14 21:38:00.623485 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.623460 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7v8ph"] Jul 14 21:38:00.623651 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.623601 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.626815 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.626787 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 21:38:00.627178 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.627156 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 21:38:00.627304 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.627205 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 21:38:00.627478 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.627460 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tcngh\"" Jul 14 21:38:00.636040 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.633447 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 21:38:00.641425 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.641405 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-78f9r"] Jul 14 21:38:00.641555 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.641535 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.644234 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.644074 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 21:38:00.644474 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.644457 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zdsh8\"" Jul 14 21:38:00.644576 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.644457 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 21:38:00.659514 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.659493 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf4dd44f6-ftd9p"] Jul 14 21:38:00.659606 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.659534 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7v8ph"] Jul 14 21:38:00.659606 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.659560 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-78f9r"] Jul 14 21:38:00.659606 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.659570 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-78f9r" Jul 14 21:38:00.662443 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.662428 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cq9kr\"" Jul 14 21:38:00.662951 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.662930 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 21:38:00.663041 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.662986 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 21:38:00.663130 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.663113 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 21:38:00.772270 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772236 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmbbd\" (UniqueName: \"kubernetes.io/projected/c5eed469-033d-404f-96c9-8a6d58c80e95-kube-api-access-jmbbd\") pod \"ingress-canary-78f9r\" (UID: \"c5eed469-033d-404f-96c9-8a6d58c80e95\") " pod="openshift-ingress-canary/ingress-canary-78f9r" Jul 14 21:38:00.772441 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-certificates\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.772441 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.772441 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4a4ca48-2859-429b-97f1-6f4357d7d325-tmp-dir\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.772441 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.772608 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772459 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-installation-pull-secrets\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.772608 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772530 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4a4ca48-2859-429b-97f1-6f4357d7d325-config-volume\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.772608 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ctlk\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-kube-api-access-4ctlk\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.772608 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772606 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5eed469-033d-404f-96c9-8a6d58c80e95-cert\") pod \"ingress-canary-78f9r\" (UID: \"c5eed469-033d-404f-96c9-8a6d58c80e95\") " pod="openshift-ingress-canary/ingress-canary-78f9r" Jul 14 21:38:00.772756 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-bound-sa-token\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.772756 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f65c437-f61d-47d9-b2f9-2b2c44004077-ca-trust-extracted\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.772756 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772698 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-trusted-ca\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.772756 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxp8q\" (UniqueName: \"kubernetes.io/projected/e4a4ca48-2859-429b-97f1-6f4357d7d325-kube-api-access-hxp8q\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.772915 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.772795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-image-registry-private-configuration\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.873609 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4a4ca48-2859-429b-97f1-6f4357d7d325-config-volume\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.873609 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ctlk\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-kube-api-access-4ctlk\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5eed469-033d-404f-96c9-8a6d58c80e95-cert\") pod \"ingress-canary-78f9r\" (UID: \"c5eed469-033d-404f-96c9-8a6d58c80e95\") " pod="openshift-ingress-canary/ingress-canary-78f9r" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-bound-sa-token\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873658 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f65c437-f61d-47d9-b2f9-2b2c44004077-ca-trust-extracted\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873684 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-trusted-ca\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxp8q\" (UniqueName: \"kubernetes.io/projected/e4a4ca48-2859-429b-97f1-6f4357d7d325-kube-api-access-hxp8q\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-image-registry-private-configuration\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmbbd\" (UniqueName: \"kubernetes.io/projected/c5eed469-033d-404f-96c9-8a6d58c80e95-kube-api-access-jmbbd\") pod \"ingress-canary-78f9r\" (UID: \"c5eed469-033d-404f-96c9-8a6d58c80e95\") " pod="openshift-ingress-canary/ingress-canary-78f9r" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-certificates\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873872 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4a4ca48-2859-429b-97f1-6f4357d7d325-tmp-dir\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.873943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-installation-pull-secrets\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.874121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.874069 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f65c437-f61d-47d9-b2f9-2b2c44004077-ca-trust-extracted\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.874761 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.874250 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4a4ca48-2859-429b-97f1-6f4357d7d325-config-volume\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.874761 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:00.874355 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 21:38:00.874761 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:00.874409 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls podName:e4a4ca48-2859-429b-97f1-6f4357d7d325 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:01.374391312 +0000 UTC m=+38.096898483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls") pod "dns-default-7v8ph" (UID: "e4a4ca48-2859-429b-97f1-6f4357d7d325") : secret "dns-default-metrics-tls" not found Jul 14 21:38:00.874761 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:00.874615 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 21:38:00.874761 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:00.874634 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf4dd44f6-ftd9p: secret "image-registry-tls" not found Jul 14 21:38:00.874761 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:00.874745 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls podName:9f65c437-f61d-47d9-b2f9-2b2c44004077 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:01.374723998 +0000 UTC m=+38.097231158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls") pod "image-registry-5bf4dd44f6-ftd9p" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077") : secret "image-registry-tls" not found Jul 14 21:38:00.874761 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.874746 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4a4ca48-2859-429b-97f1-6f4357d7d325-tmp-dir\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.878268 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.878163 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-image-registry-private-configuration\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.878406 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.878183 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5eed469-033d-404f-96c9-8a6d58c80e95-cert\") pod \"ingress-canary-78f9r\" (UID: \"c5eed469-033d-404f-96c9-8a6d58c80e95\") " pod="openshift-ingress-canary/ingress-canary-78f9r" Jul 14 21:38:00.878406 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.878197 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-installation-pull-secrets\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.884463 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.884433 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmbbd\" (UniqueName: \"kubernetes.io/projected/c5eed469-033d-404f-96c9-8a6d58c80e95-kube-api-access-jmbbd\") pod \"ingress-canary-78f9r\" (UID: \"c5eed469-033d-404f-96c9-8a6d58c80e95\") " pod="openshift-ingress-canary/ingress-canary-78f9r" Jul 14 21:38:00.885398 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.885374 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-bound-sa-token\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.885872 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.885853 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ctlk\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-kube-api-access-4ctlk\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.886157 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.886140 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxp8q\" (UniqueName: \"kubernetes.io/projected/e4a4ca48-2859-429b-97f1-6f4357d7d325-kube-api-access-hxp8q\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:00.888397 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.888365 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-certificates\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.888609 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.888587 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-trusted-ca\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:00.969120 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:00.969087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-78f9r" Jul 14 21:38:01.189591 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.189565 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-78f9r"] Jul 14 21:38:01.240001 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:01.239978 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5eed469_033d_404f_96c9_8a6d58c80e95.slice/crio-138ae1926ef3d6412a9e8d01c4ddf74e24da8ea1908e7c4dd1c2939dc6cb9b8b WatchSource:0}: Error finding container 138ae1926ef3d6412a9e8d01c4ddf74e24da8ea1908e7c4dd1c2939dc6cb9b8b: Status 404 returned error can't find the container with id 138ae1926ef3d6412a9e8d01c4ddf74e24da8ea1908e7c4dd1c2939dc6cb9b8b Jul 14 21:38:01.378499 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.378475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:01.378608 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.378510 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:01.378662 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:01.378613 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 21:38:01.378662 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:01.378624 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf4dd44f6-ftd9p: secret "image-registry-tls" not found Jul 14 21:38:01.378662 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:01.378633 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 21:38:01.378758 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:01.378672 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls podName:9f65c437-f61d-47d9-b2f9-2b2c44004077 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:02.378657875 +0000 UTC m=+39.101165038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls") pod "image-registry-5bf4dd44f6-ftd9p" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077") : secret "image-registry-tls" not found Jul 14 21:38:01.378758 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:01.378685 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls podName:e4a4ca48-2859-429b-97f1-6f4357d7d325 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:02.378679479 +0000 UTC m=+39.101186640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls") pod "dns-default-7v8ph" (UID: "e4a4ca48-2859-429b-97f1-6f4357d7d325") : secret "dns-default-metrics-tls" not found Jul 14 21:38:01.845376 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.845344 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:38:01.845553 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.845388 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:38:01.845553 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.845344 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:38:01.849703 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.849683 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 21:38:01.852043 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.851874 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2rjnp\"" Jul 14 21:38:01.852451 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.852429 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 21:38:01.852909 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.852890 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bkps7\"" Jul 14 21:38:01.853289 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.853230 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 21:38:01.853411 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.853363 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 21:38:01.997403 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:01.997365 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-78f9r" event={"ID":"c5eed469-033d-404f-96c9-8a6d58c80e95","Type":"ContainerStarted","Data":"138ae1926ef3d6412a9e8d01c4ddf74e24da8ea1908e7c4dd1c2939dc6cb9b8b"} Jul 14 21:38:02.000979 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:02.000949 2567 generic.go:356] "Generic (PLEG): container finished" podID="71dd26fb-78f7-4c5d-9f94-dad4b028b09f" containerID="0ac473afdba4c2b36d06a0c84372f9b48aaeddee2cbe63e7d0c4c63c26c04cde" exitCode=0 Jul 14 21:38:02.001092 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:02.000995 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" event={"ID":"71dd26fb-78f7-4c5d-9f94-dad4b028b09f","Type":"ContainerDied","Data":"0ac473afdba4c2b36d06a0c84372f9b48aaeddee2cbe63e7d0c4c63c26c04cde"} Jul 14 21:38:02.387527 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:02.387437 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:02.387527 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:02.387491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:02.387743 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:02.387613 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 21:38:02.387743 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:02.387635 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf4dd44f6-ftd9p: secret "image-registry-tls" not found Jul 14 21:38:02.387743 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:02.387613 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 21:38:02.387743 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:02.387699 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls podName:9f65c437-f61d-47d9-b2f9-2b2c44004077 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:04.387679837 +0000 UTC m=+41.110187011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls") pod "image-registry-5bf4dd44f6-ftd9p" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077") : secret "image-registry-tls" not found Jul 14 21:38:02.387743 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:02.387716 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls podName:e4a4ca48-2859-429b-97f1-6f4357d7d325 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:04.387707411 +0000 UTC m=+41.110214580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls") pod "dns-default-7v8ph" (UID: "e4a4ca48-2859-429b-97f1-6f4357d7d325") : secret "dns-default-metrics-tls" not found Jul 14 21:38:03.007780 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:03.007532 2567 generic.go:356] "Generic (PLEG): container finished" podID="71dd26fb-78f7-4c5d-9f94-dad4b028b09f" containerID="68d41382266429db6faf398c6c3952d37c3f987d565d24493fffce1631e9b7fb" exitCode=0 Jul 14 21:38:03.008215 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:03.007626 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" event={"ID":"71dd26fb-78f7-4c5d-9f94-dad4b028b09f","Type":"ContainerDied","Data":"68d41382266429db6faf398c6c3952d37c3f987d565d24493fffce1631e9b7fb"} Jul 14 21:38:04.011192 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:04.011160 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-78f9r" event={"ID":"c5eed469-033d-404f-96c9-8a6d58c80e95","Type":"ContainerStarted","Data":"b888269cf97771f7e86c21b7befd229de6f9281773d66dd90bf040de1fb27410"} Jul 14 21:38:04.014169 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:04.014145 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" event={"ID":"71dd26fb-78f7-4c5d-9f94-dad4b028b09f","Type":"ContainerStarted","Data":"2f1e2297459d43029c2afea00167a8eab275a62aef6fdbba58711988d8ade839"} Jul 14 21:38:04.054011 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:04.053939 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-78f9r" podStartSLOduration=1.828504874 podStartE2EDuration="4.053926778s" totalImagesPullingTime="2.225421904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:04.053824955 +0000 UTC m=+40.776332137" watchObservedRunningTime="2026-07-14 21:38:04.053926778 +0000 UTC m=+40.776433960" Jul 14 21:38:04.137857 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:04.137818 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dnpzg" podStartSLOduration=9.460712237 podStartE2EDuration="40.137803068s" totalImagesPullingTime="30.677090831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:04.137694526 +0000 UTC m=+40.860201707" watchObservedRunningTime="2026-07-14 21:38:04.137803068 +0000 UTC m=+40.860310250" Jul 14 21:38:04.404014 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:04.403929 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:04.404014 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:04.403965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:04.404253 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:04.404063 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 21:38:04.404253 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:04.404069 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 21:38:04.404253 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:04.404140 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls podName:e4a4ca48-2859-429b-97f1-6f4357d7d325 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:08.404124853 +0000 UTC m=+45.126632016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls") pod "dns-default-7v8ph" (UID: "e4a4ca48-2859-429b-97f1-6f4357d7d325") : secret "dns-default-metrics-tls" not found Jul 14 21:38:04.404253 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:04.404072 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf4dd44f6-ftd9p: secret "image-registry-tls" not found Jul 14 21:38:04.404253 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:04.404245 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls podName:9f65c437-f61d-47d9-b2f9-2b2c44004077 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:08.404225735 +0000 UTC m=+45.126732916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls") pod "image-registry-5bf4dd44f6-ftd9p" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077") : secret "image-registry-tls" not found Jul 14 21:38:05.221752 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.221717 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv"] Jul 14 21:38:05.223784 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.223763 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv" Jul 14 21:38:05.226285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.226263 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 21:38:05.226405 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.226344 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 21:38:05.226591 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.226575 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-htjhq\"" Jul 14 21:38:05.240855 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.240829 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv"] Jul 14 21:38:05.410155 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.410126 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg7rk\" (UniqueName: \"kubernetes.io/projected/12cbe965-d430-4f06-a2f2-219d6ca92a66-kube-api-access-rg7rk\") pod \"migrator-7f59b54f6c-rwcsv\" (UID: \"12cbe965-d430-4f06-a2f2-219d6ca92a66\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv" Jul 14 21:38:05.510688 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.510666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg7rk\" (UniqueName: \"kubernetes.io/projected/12cbe965-d430-4f06-a2f2-219d6ca92a66-kube-api-access-rg7rk\") pod \"migrator-7f59b54f6c-rwcsv\" (UID: \"12cbe965-d430-4f06-a2f2-219d6ca92a66\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv" Jul 14 21:38:05.522785 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.522757 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg7rk\" (UniqueName: \"kubernetes.io/projected/12cbe965-d430-4f06-a2f2-219d6ca92a66-kube-api-access-rg7rk\") pod \"migrator-7f59b54f6c-rwcsv\" (UID: \"12cbe965-d430-4f06-a2f2-219d6ca92a66\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv" Jul 14 21:38:05.532544 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.532524 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv" Jul 14 21:38:05.672533 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.672505 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv"] Jul 14 21:38:05.675649 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:05.675626 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12cbe965_d430_4f06_a2f2_219d6ca92a66.slice/crio-07b28d516ba1ac76aec005c1d7f43fdeb4acb0022cb461bc0546c10378852cfe WatchSource:0}: Error finding container 07b28d516ba1ac76aec005c1d7f43fdeb4acb0022cb461bc0546c10378852cfe: Status 404 returned error can't find the container with id 07b28d516ba1ac76aec005c1d7f43fdeb4acb0022cb461bc0546c10378852cfe Jul 14 21:38:05.925400 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.925335 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5lpx2"] Jul 14 21:38:05.927735 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.927720 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:05.935824 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.935808 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 21:38:05.936726 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.936710 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 21:38:05.936813 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.936798 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 21:38:05.937755 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.937739 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 21:38:05.937842 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.937826 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-62q7v\"" Jul 14 21:38:05.954849 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:05.954827 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5lpx2"] Jul 14 21:38:06.020304 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.020274 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv" event={"ID":"12cbe965-d430-4f06-a2f2-219d6ca92a66","Type":"ContainerStarted","Data":"07b28d516ba1ac76aec005c1d7f43fdeb4acb0022cb461bc0546c10378852cfe"} Jul 14 21:38:06.116528 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.116497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6d62602-e5ad-441b-a09c-63f87bcfacdb-data-volume\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.116687 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.116537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.116687 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.116590 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz4sh\" (UniqueName: \"kubernetes.io/projected/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-api-access-dz4sh\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.116687 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.116670 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.116863 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.116707 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a6d62602-e5ad-441b-a09c-63f87bcfacdb-crio-socket\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.217453 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.217376 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6d62602-e5ad-441b-a09c-63f87bcfacdb-data-volume\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.217453 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.217421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.217688 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:06.217498 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 21:38:06.217688 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:06.217569 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm podName:a6d62602-e5ad-441b-a09c-63f87bcfacdb nodeName:}" failed. No retries permitted until 2026-07-14 21:38:06.717547073 +0000 UTC m=+43.440054264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lpx2" (UID: "a6d62602-e5ad-441b-a09c-63f87bcfacdb") : configmap "kube-rbac-proxy" not found Jul 14 21:38:06.217688 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.217588 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz4sh\" (UniqueName: \"kubernetes.io/projected/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-api-access-dz4sh\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.217688 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.217639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.217688 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.217682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a6d62602-e5ad-441b-a09c-63f87bcfacdb-crio-socket\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.217930 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.217738 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6d62602-e5ad-441b-a09c-63f87bcfacdb-data-volume\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.217930 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:06.217846 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 21:38:06.217930 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.217864 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a6d62602-e5ad-441b-a09c-63f87bcfacdb-crio-socket\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.217930 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:06.217897 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls podName:a6d62602-e5ad-441b-a09c-63f87bcfacdb nodeName:}" failed. No retries permitted until 2026-07-14 21:38:06.717885247 +0000 UTC m=+43.440392408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lpx2" (UID: "a6d62602-e5ad-441b-a09c-63f87bcfacdb") : secret "insights-runtime-extractor-tls" not found Jul 14 21:38:06.228466 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.228444 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz4sh\" (UniqueName: \"kubernetes.io/projected/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-api-access-dz4sh\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.721970 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.721936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.722116 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:06.722046 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:06.722116 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:06.722101 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 21:38:06.722199 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:06.722138 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 21:38:06.722199 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:06.722171 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls podName:a6d62602-e5ad-441b-a09c-63f87bcfacdb nodeName:}" failed. No retries permitted until 2026-07-14 21:38:07.722152488 +0000 UTC m=+44.444659669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lpx2" (UID: "a6d62602-e5ad-441b-a09c-63f87bcfacdb") : secret "insights-runtime-extractor-tls" not found Jul 14 21:38:06.722199 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:06.722186 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm podName:a6d62602-e5ad-441b-a09c-63f87bcfacdb nodeName:}" failed. No retries permitted until 2026-07-14 21:38:07.722180232 +0000 UTC m=+44.444687391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lpx2" (UID: "a6d62602-e5ad-441b-a09c-63f87bcfacdb") : configmap "kube-rbac-proxy" not found Jul 14 21:38:07.027350 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.027305 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv" event={"ID":"12cbe965-d430-4f06-a2f2-219d6ca92a66","Type":"ContainerStarted","Data":"c6cedc066faeed77edde31facd641d0232c585abad2e799f95b311cabba60d33"} Jul 14 21:38:07.027495 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.027391 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv" event={"ID":"12cbe965-d430-4f06-a2f2-219d6ca92a66","Type":"ContainerStarted","Data":"5af9d758ce23a7088e36cca3054fedd795e07f0334f75cceea452edba45e5bdf"} Jul 14 21:38:07.047141 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.047099 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-rwcsv" podStartSLOduration=0.982765265 podStartE2EDuration="2.047082431s" totalImagesPullingTime="1.064317166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:07.046083546 +0000 UTC m=+43.768590742" watchObservedRunningTime="2026-07-14 21:38:07.047082431 +0000 UTC m=+43.769589614" Jul 14 21:38:07.731810 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.731777 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:07.732157 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.731859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:07.732157 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:07.731922 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 21:38:07.732157 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:07.731940 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 21:38:07.732157 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:07.731983 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm podName:a6d62602-e5ad-441b-a09c-63f87bcfacdb nodeName:}" failed. No retries permitted until 2026-07-14 21:38:09.731970904 +0000 UTC m=+46.454478065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lpx2" (UID: "a6d62602-e5ad-441b-a09c-63f87bcfacdb") : configmap "kube-rbac-proxy" not found Jul 14 21:38:07.732157 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:07.731997 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls podName:a6d62602-e5ad-441b-a09c-63f87bcfacdb nodeName:}" failed. No retries permitted until 2026-07-14 21:38:09.73198954 +0000 UTC m=+46.454496699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lpx2" (UID: "a6d62602-e5ad-441b-a09c-63f87bcfacdb") : secret "insights-runtime-extractor-tls" not found Jul 14 21:38:07.854834 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.854805 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-dn8xh"] Jul 14 21:38:07.886491 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.886466 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-dn8xh"] Jul 14 21:38:07.886633 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.886549 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:07.889317 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.889295 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 14 21:38:07.889460 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.889436 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 14 21:38:07.890526 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.890511 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vvn5b\"" Jul 14 21:38:07.890615 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.890513 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 14 21:38:07.890678 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:07.890517 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 14 21:38:08.033693 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.033667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgjpd\" (UniqueName: \"kubernetes.io/projected/b10bfa75-8be3-46cf-aef9-0f4d1e734fc8-kube-api-access-fgjpd\") pod \"service-ca-79f68b9f4f-dn8xh\" (UID: \"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:08.033832 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.033721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b10bfa75-8be3-46cf-aef9-0f4d1e734fc8-signing-key\") pod \"service-ca-79f68b9f4f-dn8xh\" (UID: \"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:08.033832 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.033740 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b10bfa75-8be3-46cf-aef9-0f4d1e734fc8-signing-cabundle\") pod \"service-ca-79f68b9f4f-dn8xh\" (UID: \"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:08.135056 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.135015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjpd\" (UniqueName: \"kubernetes.io/projected/b10bfa75-8be3-46cf-aef9-0f4d1e734fc8-kube-api-access-fgjpd\") pod \"service-ca-79f68b9f4f-dn8xh\" (UID: \"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:08.135207 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.135111 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b10bfa75-8be3-46cf-aef9-0f4d1e734fc8-signing-key\") pod \"service-ca-79f68b9f4f-dn8xh\" (UID: \"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:08.135207 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.135139 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b10bfa75-8be3-46cf-aef9-0f4d1e734fc8-signing-cabundle\") pod \"service-ca-79f68b9f4f-dn8xh\" (UID: \"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:08.135965 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.135940 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b10bfa75-8be3-46cf-aef9-0f4d1e734fc8-signing-cabundle\") pod \"service-ca-79f68b9f4f-dn8xh\" (UID: \"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:08.137733 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.137710 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b10bfa75-8be3-46cf-aef9-0f4d1e734fc8-signing-key\") pod \"service-ca-79f68b9f4f-dn8xh\" (UID: \"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:08.149596 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.149577 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgjpd\" (UniqueName: \"kubernetes.io/projected/b10bfa75-8be3-46cf-aef9-0f4d1e734fc8-kube-api-access-fgjpd\") pod \"service-ca-79f68b9f4f-dn8xh\" (UID: \"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:08.195008 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.194988 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" Jul 14 21:38:08.341929 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.341902 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-dn8xh"] Jul 14 21:38:08.344759 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:08.344730 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10bfa75_8be3_46cf_aef9_0f4d1e734fc8.slice/crio-4b09ba334cb71d65a18779610a696b4fadb49efada5994faeb4ac024ce589579 WatchSource:0}: Error finding container 4b09ba334cb71d65a18779610a696b4fadb49efada5994faeb4ac024ce589579: Status 404 returned error can't find the container with id 4b09ba334cb71d65a18779610a696b4fadb49efada5994faeb4ac024ce589579 Jul 14 21:38:08.437056 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.437026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:08.437200 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.437143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:08.437200 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:08.437185 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 21:38:08.437200 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:08.437200 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf4dd44f6-ftd9p: secret "image-registry-tls" not found Jul 14 21:38:08.437295 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:08.437233 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 21:38:08.437295 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:08.437254 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls podName:9f65c437-f61d-47d9-b2f9-2b2c44004077 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:16.437237942 +0000 UTC m=+53.159745102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls") pod "image-registry-5bf4dd44f6-ftd9p" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077") : secret "image-registry-tls" not found Jul 14 21:38:08.437295 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:08.437272 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls podName:e4a4ca48-2859-429b-97f1-6f4357d7d325 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:16.437261433 +0000 UTC m=+53.159768593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls") pod "dns-default-7v8ph" (UID: "e4a4ca48-2859-429b-97f1-6f4357d7d325") : secret "dns-default-metrics-tls" not found Jul 14 21:38:08.523263 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:08.523240 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mrpd6_f0c86769-7d8f-436f-b7df-a55cd8fe3cb5/dns-node-resolver/0.log" Jul 14 21:38:09.034334 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:09.034279 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" event={"ID":"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8","Type":"ContainerStarted","Data":"4b09ba334cb71d65a18779610a696b4fadb49efada5994faeb4ac024ce589579"} Jul 14 21:38:09.526235 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:09.526213 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w69lg_9ee8da63-127d-47f2-a318-ead45a97069f/node-ca/0.log" Jul 14 21:38:09.745144 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:09.745103 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:09.745344 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:09.745241 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 21:38:09.745344 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:09.745272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:09.745344 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:09.745315 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm podName:a6d62602-e5ad-441b-a09c-63f87bcfacdb nodeName:}" failed. No retries permitted until 2026-07-14 21:38:13.745291809 +0000 UTC m=+50.467798971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lpx2" (UID: "a6d62602-e5ad-441b-a09c-63f87bcfacdb") : configmap "kube-rbac-proxy" not found Jul 14 21:38:09.745530 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:09.745383 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 21:38:09.745530 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:09.745432 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls podName:a6d62602-e5ad-441b-a09c-63f87bcfacdb nodeName:}" failed. No retries permitted until 2026-07-14 21:38:13.745417 +0000 UTC m=+50.467924160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lpx2" (UID: "a6d62602-e5ad-441b-a09c-63f87bcfacdb") : secret "insights-runtime-extractor-tls" not found Jul 14 21:38:09.925121 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:09.924991 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-78f9r_c5eed469-033d-404f-96c9-8a6d58c80e95/serve-healthcheck-canary/0.log" Jul 14 21:38:10.324396 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:10.324359 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rwcsv_12cbe965-d430-4f06-a2f2-219d6ca92a66/migrator/0.log" Jul 14 21:38:10.527581 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:10.527546 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rwcsv_12cbe965-d430-4f06-a2f2-219d6ca92a66/graceful-termination/0.log" Jul 14 21:38:11.040500 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:11.040463 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" event={"ID":"b10bfa75-8be3-46cf-aef9-0f4d1e734fc8","Type":"ContainerStarted","Data":"bf8bc083a5f90022b96fadf000396a5632681b743e026fa53cd05b6dee19ddbe"} Jul 14 21:38:11.074996 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:11.074942 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-dn8xh" podStartSLOduration=1.775571346 podStartE2EDuration="4.074925746s" totalImagesPullingTime="2.2993544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:11.07463192 +0000 UTC m=+47.797139102" watchObservedRunningTime="2026-07-14 21:38:11.074925746 +0000 UTC m=+47.797432927" Jul 14 21:38:13.777710 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:13.777673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:13.778093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:13.777761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:13.778093 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:13.777836 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 21:38:13.778093 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:13.777888 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm podName:a6d62602-e5ad-441b-a09c-63f87bcfacdb nodeName:}" failed. No retries permitted until 2026-07-14 21:38:21.777875275 +0000 UTC m=+58.500382435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5lpx2" (UID: "a6d62602-e5ad-441b-a09c-63f87bcfacdb") : configmap "kube-rbac-proxy" not found Jul 14 21:38:13.778093 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:13.777834 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 21:38:13.778093 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:13.777977 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls podName:a6d62602-e5ad-441b-a09c-63f87bcfacdb nodeName:}" failed. No retries permitted until 2026-07-14 21:38:21.777962353 +0000 UTC m=+58.500469513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5lpx2" (UID: "a6d62602-e5ad-441b-a09c-63f87bcfacdb") : secret "insights-runtime-extractor-tls" not found Jul 14 21:38:16.500764 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:16.500723 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:16.500764 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:16.500760 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:16.502974 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:16.502947 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4a4ca48-2859-429b-97f1-6f4357d7d325-metrics-tls\") pod \"dns-default-7v8ph\" (UID: \"e4a4ca48-2859-429b-97f1-6f4357d7d325\") " pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:16.503085 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:16.503056 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls\") pod \"image-registry-5bf4dd44f6-ftd9p\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:16.536609 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:16.536581 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:16.551722 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:16.551702 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:16.696034 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:16.695867 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf4dd44f6-ftd9p"] Jul 14 21:38:16.698410 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:16.698386 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f65c437_f61d_47d9_b2f9_2b2c44004077.slice/crio-041f193253f7e7c42915460e1d1ba8f5b0f13cf8d26ca06af65f297759743561 WatchSource:0}: Error finding container 041f193253f7e7c42915460e1d1ba8f5b0f13cf8d26ca06af65f297759743561: Status 404 returned error can't find the container with id 041f193253f7e7c42915460e1d1ba8f5b0f13cf8d26ca06af65f297759743561 Jul 14 21:38:16.703365 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:16.703243 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7v8ph"] Jul 14 21:38:16.705443 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:16.705420 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a4ca48_2859_429b_97f1_6f4357d7d325.slice/crio-5eaedcba23bf7d745712d0dc1c430dfa58f483c0497ff7faa047b329b292bf65 WatchSource:0}: Error finding container 5eaedcba23bf7d745712d0dc1c430dfa58f483c0497ff7faa047b329b292bf65: Status 404 returned error can't find the container with id 5eaedcba23bf7d745712d0dc1c430dfa58f483c0497ff7faa047b329b292bf65 Jul 14 21:38:17.058382 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:17.058283 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" event={"ID":"9f65c437-f61d-47d9-b2f9-2b2c44004077","Type":"ContainerStarted","Data":"e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6"} Jul 14 21:38:17.058541 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:17.058404 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:17.058541 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:17.058427 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" event={"ID":"9f65c437-f61d-47d9-b2f9-2b2c44004077","Type":"ContainerStarted","Data":"041f193253f7e7c42915460e1d1ba8f5b0f13cf8d26ca06af65f297759743561"} Jul 14 21:38:17.059502 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:17.059462 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7v8ph" event={"ID":"e4a4ca48-2859-429b-97f1-6f4357d7d325","Type":"ContainerStarted","Data":"5eaedcba23bf7d745712d0dc1c430dfa58f483c0497ff7faa047b329b292bf65"} Jul 14 21:38:17.084836 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:17.084793 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" podStartSLOduration=21.084778064 podStartE2EDuration="21.084778064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:37:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:17.083196577 +0000 UTC m=+53.805703778" watchObservedRunningTime="2026-07-14 21:38:17.084778064 +0000 UTC m=+53.807285247" Jul 14 21:38:19.069818 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:19.069789 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7v8ph" event={"ID":"e4a4ca48-2859-429b-97f1-6f4357d7d325","Type":"ContainerStarted","Data":"6cb68b7e4a3fd7efa6a4cad78f7b8fe35fb38e5cbd18fba914d6b34c8ba9fb96"} Jul 14 21:38:20.075487 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:20.075443 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7v8ph" event={"ID":"e4a4ca48-2859-429b-97f1-6f4357d7d325","Type":"ContainerStarted","Data":"17bd7bf614123ec8ba64ffdf040b7a5043bf4e9d0f4dc4b31aad957654761cf7"} Jul 14 21:38:20.075870 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:20.075591 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:20.110721 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:20.110672 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7v8ph" podStartSLOduration=17.878207023 podStartE2EDuration="20.110658757s" totalImagesPullingTime="2.232451734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:20.109899864 +0000 UTC m=+56.832407046" watchObservedRunningTime="2026-07-14 21:38:20.110658757 +0000 UTC m=+56.833165940" Jul 14 21:38:21.842181 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:21.842144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:21.842749 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:21.842211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:21.842749 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:21.842724 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6d62602-e5ad-441b-a09c-63f87bcfacdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:21.844491 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:21.844464 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6d62602-e5ad-441b-a09c-63f87bcfacdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5lpx2\" (UID: \"a6d62602-e5ad-441b-a09c-63f87bcfacdb\") " pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:22.136136 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:22.136069 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5lpx2" Jul 14 21:38:22.291295 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:22.291266 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5lpx2"] Jul 14 21:38:22.294281 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:22.294253 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d62602_e5ad_441b_a09c_63f87bcfacdb.slice/crio-8c25ef8526c905a733d4734407ffd164cf3a66af96214b7c941325a6c0076841 WatchSource:0}: Error finding container 8c25ef8526c905a733d4734407ffd164cf3a66af96214b7c941325a6c0076841: Status 404 returned error can't find the container with id 8c25ef8526c905a733d4734407ffd164cf3a66af96214b7c941325a6c0076841 Jul 14 21:38:23.085755 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:23.085714 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lpx2" event={"ID":"a6d62602-e5ad-441b-a09c-63f87bcfacdb","Type":"ContainerStarted","Data":"8c25ef8526c905a733d4734407ffd164cf3a66af96214b7c941325a6c0076841"} Jul 14 21:38:24.987970 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:24.987937 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m25ff" Jul 14 21:38:27.102313 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:27.102240 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lpx2" event={"ID":"a6d62602-e5ad-441b-a09c-63f87bcfacdb","Type":"ContainerStarted","Data":"aaffd6ed015613837b0a723c80ed16e0746004b2176bdc23ad622551703187f7"} Jul 14 21:38:27.102313 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:27.102296 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lpx2" event={"ID":"a6d62602-e5ad-441b-a09c-63f87bcfacdb","Type":"ContainerStarted","Data":"ee148420544e9961c78c0da3355818d12ec4032733ace4d01fd4107d0994c78d"} Jul 14 21:38:28.325410 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.325382 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf4dd44f6-ftd9p"] Jul 14 21:38:28.341543 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.339438 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq"] Jul 14 21:38:28.342819 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.342795 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" Jul 14 21:38:28.349664 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.349631 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xqg8l\"" Jul 14 21:38:28.353259 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.353228 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 21:38:28.353380 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.353262 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 21:38:28.353579 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.353561 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 21:38:28.354976 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.354956 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4"] Jul 14 21:38:28.357123 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.357104 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.358456 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.358436 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq"] Jul 14 21:38:28.359722 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.359705 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 21:38:28.366617 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.366595 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 14 21:38:28.366832 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.366812 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 14 21:38:28.367483 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.367396 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 14 21:38:28.381793 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.381774 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 14 21:38:28.387216 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.387194 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4"] Jul 14 21:38:28.395583 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.395558 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjt8k\" (UniqueName: \"kubernetes.io/projected/5b45c33a-ad05-4c17-af99-f6ef554fa977-kube-api-access-hjt8k\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.395677 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.395593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8vw\" (UniqueName: \"kubernetes.io/projected/5a8a92b6-3131-4b12-aeed-4815d37bd1de-kube-api-access-2v8vw\") pod \"managed-serviceaccount-addon-agent-5c7c986468-v24nq\" (UID: \"5a8a92b6-3131-4b12-aeed-4815d37bd1de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" Jul 14 21:38:28.395677 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.395614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-ca\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.395677 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.395632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b45c33a-ad05-4c17-af99-f6ef554fa977-additional-service-ca\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.395677 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.395662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-hub\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.395868 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.395740 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.395868 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.395765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.395868 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.395793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a8a92b6-3131-4b12-aeed-4815d37bd1de-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c7c986468-v24nq\" (UID: \"5a8a92b6-3131-4b12-aeed-4815d37bd1de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" Jul 14 21:38:28.440802 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.440770 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78d858d5f8-z5plx"] Jul 14 21:38:28.444142 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.444116 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.478164 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.478139 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78d858d5f8-z5plx"] Jul 14 21:38:28.497241 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497211 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4fe1cd4-dde0-482a-9e31-4773115cc36e-bound-sa-token\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.497412 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.497412 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.497412 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497397 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4fe1cd4-dde0-482a-9e31-4773115cc36e-registry-certificates\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.497564 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a8a92b6-3131-4b12-aeed-4815d37bd1de-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c7c986468-v24nq\" (UID: \"5a8a92b6-3131-4b12-aeed-4815d37bd1de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" Jul 14 21:38:28.497564 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4fe1cd4-dde0-482a-9e31-4773115cc36e-installation-pull-secrets\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.497564 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4fe1cd4-dde0-482a-9e31-4773115cc36e-image-registry-private-configuration\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.497655 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjt8k\" (UniqueName: \"kubernetes.io/projected/5b45c33a-ad05-4c17-af99-f6ef554fa977-kube-api-access-hjt8k\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.497655 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8vw\" (UniqueName: \"kubernetes.io/projected/5a8a92b6-3131-4b12-aeed-4815d37bd1de-kube-api-access-2v8vw\") pod \"managed-serviceaccount-addon-agent-5c7c986468-v24nq\" (UID: \"5a8a92b6-3131-4b12-aeed-4815d37bd1de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" Jul 14 21:38:28.497655 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1cd4-dde0-482a-9e31-4773115cc36e-ca-trust-extracted\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.497766 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497668 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-ca\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.497766 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497695 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b45c33a-ad05-4c17-af99-f6ef554fa977-additional-service-ca\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.497766 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59n6z\" (UniqueName: \"kubernetes.io/projected/c4fe1cd4-dde0-482a-9e31-4773115cc36e-kube-api-access-59n6z\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.497766 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4fe1cd4-dde0-482a-9e31-4773115cc36e-registry-tls\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.497943 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4fe1cd4-dde0-482a-9e31-4773115cc36e-trusted-ca\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.497943 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.497801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-hub\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.498595 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.498548 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b45c33a-ad05-4c17-af99-f6ef554fa977-additional-service-ca\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.500620 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.500599 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.500712 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.500667 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-ca\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.500755 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.500727 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a8a92b6-3131-4b12-aeed-4815d37bd1de-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c7c986468-v24nq\" (UID: \"5a8a92b6-3131-4b12-aeed-4815d37bd1de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" Jul 14 21:38:28.501001 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.500974 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-hub\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.501931 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.501906 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5b45c33a-ad05-4c17-af99-f6ef554fa977-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.512252 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.512227 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjt8k\" (UniqueName: \"kubernetes.io/projected/5b45c33a-ad05-4c17-af99-f6ef554fa977-kube-api-access-hjt8k\") pod \"cluster-proxy-proxy-agent-858f6677c4-ljcl4\" (UID: \"5b45c33a-ad05-4c17-af99-f6ef554fa977\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.513639 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.513615 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8vw\" (UniqueName: \"kubernetes.io/projected/5a8a92b6-3131-4b12-aeed-4815d37bd1de-kube-api-access-2v8vw\") pod \"managed-serviceaccount-addon-agent-5c7c986468-v24nq\" (UID: \"5a8a92b6-3131-4b12-aeed-4815d37bd1de\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" Jul 14 21:38:28.599249 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.599161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4fe1cd4-dde0-482a-9e31-4773115cc36e-installation-pull-secrets\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.599249 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.599202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4fe1cd4-dde0-482a-9e31-4773115cc36e-image-registry-private-configuration\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.599249 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.599222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1cd4-dde0-482a-9e31-4773115cc36e-ca-trust-extracted\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.599520 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.599415 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59n6z\" (UniqueName: \"kubernetes.io/projected/c4fe1cd4-dde0-482a-9e31-4773115cc36e-kube-api-access-59n6z\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.599520 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.599463 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4fe1cd4-dde0-482a-9e31-4773115cc36e-registry-tls\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.599520 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.599490 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4fe1cd4-dde0-482a-9e31-4773115cc36e-trusted-ca\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.599673 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.599548 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4fe1cd4-dde0-482a-9e31-4773115cc36e-bound-sa-token\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.599673 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.599613 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4fe1cd4-dde0-482a-9e31-4773115cc36e-ca-trust-extracted\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.599673 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.599623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4fe1cd4-dde0-482a-9e31-4773115cc36e-registry-certificates\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.600584 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.600516 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4fe1cd4-dde0-482a-9e31-4773115cc36e-registry-certificates\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.600959 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.600932 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4fe1cd4-dde0-482a-9e31-4773115cc36e-trusted-ca\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.602626 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.602600 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4fe1cd4-dde0-482a-9e31-4773115cc36e-image-registry-private-configuration\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.602735 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.602639 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4fe1cd4-dde0-482a-9e31-4773115cc36e-installation-pull-secrets\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.602735 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.602608 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4fe1cd4-dde0-482a-9e31-4773115cc36e-registry-tls\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.615289 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.615230 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59n6z\" (UniqueName: \"kubernetes.io/projected/c4fe1cd4-dde0-482a-9e31-4773115cc36e-kube-api-access-59n6z\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.616814 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.616791 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4fe1cd4-dde0-482a-9e31-4773115cc36e-bound-sa-token\") pod \"image-registry-78d858d5f8-z5plx\" (UID: \"c4fe1cd4-dde0-482a-9e31-4773115cc36e\") " pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:28.663408 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.663378 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" Jul 14 21:38:28.672218 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.672193 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" Jul 14 21:38:28.769246 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:28.769213 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:29.416069 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:29.416040 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78d858d5f8-z5plx"] Jul 14 21:38:29.418924 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:29.418721 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4fe1cd4_dde0_482a_9e31_4773115cc36e.slice/crio-c8267a2b1bc015e1b5d7a06be1dfa82600e8168da2cd8315f7bdf74e83eb4e31 WatchSource:0}: Error finding container c8267a2b1bc015e1b5d7a06be1dfa82600e8168da2cd8315f7bdf74e83eb4e31: Status 404 returned error can't find the container with id c8267a2b1bc015e1b5d7a06be1dfa82600e8168da2cd8315f7bdf74e83eb4e31 Jul 14 21:38:29.634150 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:29.634070 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq"] Jul 14 21:38:29.638228 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:29.638194 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4"] Jul 14 21:38:29.642621 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:29.641925 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b45c33a_ad05_4c17_af99_f6ef554fa977.slice/crio-cfa1a7032fdad505a15753ce361c6ee1ca501dbfa323531c96e1a48381acec62 WatchSource:0}: Error finding container cfa1a7032fdad505a15753ce361c6ee1ca501dbfa323531c96e1a48381acec62: Status 404 returned error can't find the container with id cfa1a7032fdad505a15753ce361c6ee1ca501dbfa323531c96e1a48381acec62 Jul 14 21:38:30.011302 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.011268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:38:30.011480 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.011319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:38:30.014186 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.014163 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 21:38:30.014914 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.014899 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 21:38:30.023875 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.023855 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/059bca4a-0e12-4c97-b08e-f9187ad029e3-original-pull-secret\") pod \"global-pull-secret-syncer-t8xrx\" (UID: \"059bca4a-0e12-4c97-b08e-f9187ad029e3\") " pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:38:30.023950 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.023888 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e5e89e0-7530-4ca8-8781-aa159d84b7aa-metrics-certs\") pod \"network-metrics-daemon-5x8kg\" (UID: \"1e5e89e0-7530-4ca8-8781-aa159d84b7aa\") " pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:38:30.066884 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.066858 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bkps7\"" Jul 14 21:38:30.070201 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.070184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8xrx" Jul 14 21:38:30.074139 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.074125 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5x8kg" Jul 14 21:38:30.081006 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.080988 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7v8ph" Jul 14 21:38:30.114371 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.113849 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z7zn\" (UniqueName: \"kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn\") pod \"network-check-target-kxbsp\" (UID: \"fa7053cc-d7e9-435c-bf21-29f6097186e6\") " pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:38:30.117531 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.117194 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 21:38:30.123513 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.123397 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5lpx2" event={"ID":"a6d62602-e5ad-441b-a09c-63f87bcfacdb","Type":"ContainerStarted","Data":"bfb77abb68196b40ca54d79c213adef5c97887ce35331b501a02a0cb8e158a90"} Jul 14 21:38:30.125138 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.125081 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" event={"ID":"5b45c33a-ad05-4c17-af99-f6ef554fa977","Type":"ContainerStarted","Data":"cfa1a7032fdad505a15753ce361c6ee1ca501dbfa323531c96e1a48381acec62"} Jul 14 21:38:30.127454 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.127100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" event={"ID":"c4fe1cd4-dde0-482a-9e31-4773115cc36e","Type":"ContainerStarted","Data":"34b68737eaa2dd189851b95cea3d30a91a48a32a028e7e68b49040f6e5db6194"} Jul 14 21:38:30.127454 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.127144 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" event={"ID":"c4fe1cd4-dde0-482a-9e31-4773115cc36e","Type":"ContainerStarted","Data":"c8267a2b1bc015e1b5d7a06be1dfa82600e8168da2cd8315f7bdf74e83eb4e31"} Jul 14 21:38:30.127895 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.127822 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 21:38:30.128080 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.128040 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:30.130456 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.130364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" event={"ID":"5a8a92b6-3131-4b12-aeed-4815d37bd1de","Type":"ContainerStarted","Data":"8acad93efeb8d0b5f8c353a9f7eb4569abc84bd915beb1dc66255ad3504380be"} Jul 14 21:38:30.141902 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.141847 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z7zn\" (UniqueName: \"kubernetes.io/projected/fa7053cc-d7e9-435c-bf21-29f6097186e6-kube-api-access-7z7zn\") pod \"network-check-target-kxbsp\" (UID: \"fa7053cc-d7e9-435c-bf21-29f6097186e6\") " pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:38:30.185841 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.184319 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5lpx2" podStartSLOduration=18.276073507 podStartE2EDuration="25.184294414s" totalImagesPullingTime="6.908220907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:38:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:30.152974138 +0000 UTC m=+66.875481346" watchObservedRunningTime="2026-07-14 21:38:30.184294414 +0000 UTC m=+66.906801597" Jul 14 21:38:30.185841 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.184991 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" podStartSLOduration=2.184976557 podStartE2EDuration="2.184976557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:30.184571549 +0000 UTC m=+66.907078733" watchObservedRunningTime="2026-07-14 21:38:30.184976557 +0000 UTC m=+66.907483723" Jul 14 21:38:30.242651 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.242505 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8xrx"] Jul 14 21:38:30.247145 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:30.247103 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059bca4a_0e12_4c97_b08e_f9187ad029e3.slice/crio-e1aed0cb272d9536487e7b477ccbc41b3054b939a0d3ad025b5a68a5039e4474 WatchSource:0}: Error finding container e1aed0cb272d9536487e7b477ccbc41b3054b939a0d3ad025b5a68a5039e4474: Status 404 returned error can't find the container with id e1aed0cb272d9536487e7b477ccbc41b3054b939a0d3ad025b5a68a5039e4474 Jul 14 21:38:30.271418 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.271342 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5x8kg"] Jul 14 21:38:30.274961 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:30.274884 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5e89e0_7530_4ca8_8781_aa159d84b7aa.slice/crio-f5d44cba64169ac8092679ec71f189e23baeab56096087f0e9f9fda3dde9bd24 WatchSource:0}: Error finding container f5d44cba64169ac8092679ec71f189e23baeab56096087f0e9f9fda3dde9bd24: Status 404 returned error can't find the container with id f5d44cba64169ac8092679ec71f189e23baeab56096087f0e9f9fda3dde9bd24 Jul 14 21:38:30.361377 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.361289 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2rjnp\"" Jul 14 21:38:30.369411 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.369379 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:38:30.566590 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:30.566466 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kxbsp"] Jul 14 21:38:30.570656 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:30.570624 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7053cc_d7e9_435c_bf21_29f6097186e6.slice/crio-f2b98cf5c65afcbf08c6417228a354795b338e7ed39990483faff65299a11313 WatchSource:0}: Error finding container f2b98cf5c65afcbf08c6417228a354795b338e7ed39990483faff65299a11313: Status 404 returned error can't find the container with id f2b98cf5c65afcbf08c6417228a354795b338e7ed39990483faff65299a11313 Jul 14 21:38:31.138353 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:31.138300 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kxbsp" event={"ID":"fa7053cc-d7e9-435c-bf21-29f6097186e6","Type":"ContainerStarted","Data":"f2b98cf5c65afcbf08c6417228a354795b338e7ed39990483faff65299a11313"} Jul 14 21:38:31.145817 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:31.145707 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8xrx" event={"ID":"059bca4a-0e12-4c97-b08e-f9187ad029e3","Type":"ContainerStarted","Data":"e1aed0cb272d9536487e7b477ccbc41b3054b939a0d3ad025b5a68a5039e4474"} Jul 14 21:38:31.148056 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:31.147899 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5x8kg" event={"ID":"1e5e89e0-7530-4ca8-8781-aa159d84b7aa","Type":"ContainerStarted","Data":"f5d44cba64169ac8092679ec71f189e23baeab56096087f0e9f9fda3dde9bd24"} Jul 14 21:38:38.184663 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.184622 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kxbsp" event={"ID":"fa7053cc-d7e9-435c-bf21-29f6097186e6","Type":"ContainerStarted","Data":"158cb7bb2258c9c103de402da86a74e97cb010ebea232306856490d6fa524539"} Jul 14 21:38:38.185299 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.184690 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:38:38.186631 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.186606 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" event={"ID":"5b45c33a-ad05-4c17-af99-f6ef554fa977","Type":"ContainerStarted","Data":"07e465d622c60014805236f539624a112edc32a3bf3f6094ad0567ffbefbc1f2"} Jul 14 21:38:38.186752 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.186643 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" event={"ID":"5b45c33a-ad05-4c17-af99-f6ef554fa977","Type":"ContainerStarted","Data":"6d10c4d711c9d60262614de62114d6043b454efabd540141a44a072b1c56bf26"} Jul 14 21:38:38.186752 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.186661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" event={"ID":"5b45c33a-ad05-4c17-af99-f6ef554fa977","Type":"ContainerStarted","Data":"c0ebd8e9b55b0a15284cec8880e91600119a7d22cdcd16d226fd7a3887339350"} Jul 14 21:38:38.187997 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.187972 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8xrx" event={"ID":"059bca4a-0e12-4c97-b08e-f9187ad029e3","Type":"ContainerStarted","Data":"e8472b1199a87b32358ecc75235cc0ba05e3419317922ad739ac39d203e26613"} Jul 14 21:38:38.189364 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.189345 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" event={"ID":"5a8a92b6-3131-4b12-aeed-4815d37bd1de","Type":"ContainerStarted","Data":"099946b8b36bf437c321762e122ac3c389a8a28de3395d46ee0fe614042ac6bd"} Jul 14 21:38:38.190855 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.190835 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5x8kg" event={"ID":"1e5e89e0-7530-4ca8-8781-aa159d84b7aa","Type":"ContainerStarted","Data":"23d2568d1391525071b239f8513464e446055d069a69bc5f8162b4f4cac36db1"} Jul 14 21:38:38.190934 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.190871 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5x8kg" event={"ID":"1e5e89e0-7530-4ca8-8781-aa159d84b7aa","Type":"ContainerStarted","Data":"5f7119203821c7184ef804d7ee4303d1bce7f2a169c1f6159bb6535ce323f40f"} Jul 14 21:38:38.209162 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.209118 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kxbsp" podStartSLOduration=68.469615551 podStartE2EDuration="1m15.209106522s" totalImagesPullingTime="6.739490971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:38.207909156 +0000 UTC m=+74.930416338" watchObservedRunningTime="2026-07-14 21:38:38.209106522 +0000 UTC m=+74.931613704" Jul 14 21:38:38.227806 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.227769 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5x8kg" podStartSLOduration=68.206603514 podStartE2EDuration="1m15.227756546s" totalImagesPullingTime="7.021153032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:38.227025742 +0000 UTC m=+74.949532925" watchObservedRunningTime="2026-07-14 21:38:38.227756546 +0000 UTC m=+74.950263728" Jul 14 21:38:38.246443 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.246406 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t8xrx" podStartSLOduration=67.174376135 podStartE2EDuration="1m14.246394123s" totalImagesPullingTime="7.072017988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:38.245431681 +0000 UTC m=+74.967938863" watchObservedRunningTime="2026-07-14 21:38:38.246394123 +0000 UTC m=+74.968901301" Jul 14 21:38:38.264251 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.264213 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7c986468-v24nq" podStartSLOduration=2.601938648 podStartE2EDuration="10.264202022s" totalImagesPullingTime="7.662263374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:38.263136337 +0000 UTC m=+74.985643520" watchObservedRunningTime="2026-07-14 21:38:38.264202022 +0000 UTC m=+74.986709203" Jul 14 21:38:38.292870 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.292833 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-858f6677c4-ljcl4" podStartSLOduration=2.612316234 podStartE2EDuration="10.292818228s" totalImagesPullingTime="7.680501994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:38.292262996 +0000 UTC m=+75.014770186" watchObservedRunningTime="2026-07-14 21:38:38.292818228 +0000 UTC m=+75.015325412" Jul 14 21:38:38.330498 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:38.330479 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:49.798938 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.798786 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rstvz"] Jul 14 21:38:49.801976 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.801958 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:49.807102 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.807073 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b4qtd\"" Jul 14 21:38:49.807218 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.807144 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 21:38:49.807387 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.807364 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 21:38:49.807514 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.807404 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 21:38:49.807514 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.807409 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 21:38:49.808176 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.808157 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 21:38:49.823903 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.823887 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 21:38:49.963573 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.963544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqfns\" (UniqueName: \"kubernetes.io/projected/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-kube-api-access-qqfns\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:49.963749 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.963587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:49.963749 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.963640 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-sys\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:49.963749 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.963655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-metrics-client-ca\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:49.963749 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.963672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-root\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:49.963749 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.963685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-tls\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:49.963749 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.963700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-wtmp\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:49.963749 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.963728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-textfile\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:49.963999 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:49.963851 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064481 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064391 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-sys\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064481 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-metrics-client-ca\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064481 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-root\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064715 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064504 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-root\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064715 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064502 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-sys\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064715 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064555 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-tls\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064715 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064596 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-wtmp\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064715 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-textfile\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064715 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064990 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064789 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-wtmp\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064990 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064795 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqfns\" (UniqueName: \"kubernetes.io/projected/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-kube-api-access-qqfns\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064990 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.064990 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.064956 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-textfile\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.065161 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.065066 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-metrics-client-ca\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.065377 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.065358 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-accelerators-collector-config\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.066871 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.066841 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-tls\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.066963 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.066846 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.077871 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.077846 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqfns\" (UniqueName: \"kubernetes.io/projected/ac5c595c-6077-47ba-bcd3-1892eecb4aa5-kube-api-access-qqfns\") pod \"node-exporter-rstvz\" (UID: \"ac5c595c-6077-47ba-bcd3-1892eecb4aa5\") " pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.112026 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.111993 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rstvz" Jul 14 21:38:50.129022 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:38:50.127467 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5c595c_6077_47ba_bcd3_1892eecb4aa5.slice/crio-1c5434b89f423ca5625d28584b67e0d3cabea3450598ecb078fab575effcb9d5 WatchSource:0}: Error finding container 1c5434b89f423ca5625d28584b67e0d3cabea3450598ecb078fab575effcb9d5: Status 404 returned error can't find the container with id 1c5434b89f423ca5625d28584b67e0d3cabea3450598ecb078fab575effcb9d5 Jul 14 21:38:50.231891 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:50.231850 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rstvz" event={"ID":"ac5c595c-6077-47ba-bcd3-1892eecb4aa5","Type":"ContainerStarted","Data":"1c5434b89f423ca5625d28584b67e0d3cabea3450598ecb078fab575effcb9d5"} Jul 14 21:38:51.153556 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:51.153534 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78d858d5f8-z5plx" Jul 14 21:38:51.236775 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:51.236741 2567 generic.go:356] "Generic (PLEG): container finished" podID="ac5c595c-6077-47ba-bcd3-1892eecb4aa5" containerID="8deead9006cf219049e112b9ab95e948143a20636a71a0c641162d4ea072b466" exitCode=0 Jul 14 21:38:51.236912 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:51.236800 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rstvz" event={"ID":"ac5c595c-6077-47ba-bcd3-1892eecb4aa5","Type":"ContainerDied","Data":"8deead9006cf219049e112b9ab95e948143a20636a71a0c641162d4ea072b466"} Jul 14 21:38:52.242190 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:52.242154 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rstvz" event={"ID":"ac5c595c-6077-47ba-bcd3-1892eecb4aa5","Type":"ContainerStarted","Data":"b3621e9eab426c74065cd9cdbe38fd250be84500e13ed1f553d08f29c146e4fe"} Jul 14 21:38:52.242594 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:52.242217 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rstvz" event={"ID":"ac5c595c-6077-47ba-bcd3-1892eecb4aa5","Type":"ContainerStarted","Data":"5942a282d8a96616a6bf2a025d45813cc545dce3b931875f1948efc4bd380a08"} Jul 14 21:38:52.267662 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:52.267612 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rstvz" podStartSLOduration=2.340964452 podStartE2EDuration="3.26759258s" totalImagesPullingTime="862.503968ms" totalInitContainerRuntime="64.12416ms" isStatefulPod=true podCreationTimestamp="2026-07-14 21:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:52.266736356 +0000 UTC m=+88.989243565" watchObservedRunningTime="2026-07-14 21:38:52.26759258 +0000 UTC m=+88.990099761" Jul 14 21:38:53.352114 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.352071 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" podUID="9f65c437-f61d-47d9-b2f9-2b2c44004077" containerName="registry" containerID="cri-o://e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6" gracePeriod=30 Jul 14 21:38:53.595338 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.595302 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:53.693225 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.693151 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f65c437-f61d-47d9-b2f9-2b2c44004077-ca-trust-extracted\") pod \"9f65c437-f61d-47d9-b2f9-2b2c44004077\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " Jul 14 21:38:53.693225 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.693199 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ctlk\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-kube-api-access-4ctlk\") pod \"9f65c437-f61d-47d9-b2f9-2b2c44004077\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " Jul 14 21:38:53.693225 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.693220 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-image-registry-private-configuration\") pod \"9f65c437-f61d-47d9-b2f9-2b2c44004077\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " Jul 14 21:38:53.693506 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.693239 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-certificates\") pod \"9f65c437-f61d-47d9-b2f9-2b2c44004077\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " Jul 14 21:38:53.693506 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.693264 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-trusted-ca\") pod \"9f65c437-f61d-47d9-b2f9-2b2c44004077\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " Jul 14 21:38:53.693506 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.693283 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-installation-pull-secrets\") pod \"9f65c437-f61d-47d9-b2f9-2b2c44004077\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " Jul 14 21:38:53.693506 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.693319 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-bound-sa-token\") pod \"9f65c437-f61d-47d9-b2f9-2b2c44004077\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " Jul 14 21:38:53.693506 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.693386 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls\") pod \"9f65c437-f61d-47d9-b2f9-2b2c44004077\" (UID: \"9f65c437-f61d-47d9-b2f9-2b2c44004077\") " Jul 14 21:38:53.693809 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.693762 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9f65c437-f61d-47d9-b2f9-2b2c44004077" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 21:38:53.693809 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.693773 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9f65c437-f61d-47d9-b2f9-2b2c44004077" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 21:38:53.695887 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.695849 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9f65c437-f61d-47d9-b2f9-2b2c44004077" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 21:38:53.695997 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.695927 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9f65c437-f61d-47d9-b2f9-2b2c44004077" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 21:38:53.696050 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.696022 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-kube-api-access-4ctlk" (OuterVolumeSpecName: "kube-api-access-4ctlk") pod "9f65c437-f61d-47d9-b2f9-2b2c44004077" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077"). InnerVolumeSpecName "kube-api-access-4ctlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 21:38:53.696091 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.696054 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9f65c437-f61d-47d9-b2f9-2b2c44004077" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 21:38:53.696258 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.696233 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9f65c437-f61d-47d9-b2f9-2b2c44004077" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 21:38:53.702409 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.702388 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f65c437-f61d-47d9-b2f9-2b2c44004077-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9f65c437-f61d-47d9-b2f9-2b2c44004077" (UID: "9f65c437-f61d-47d9-b2f9-2b2c44004077"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 21:38:53.793847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.793819 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-image-registry-private-configuration\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:38:53.793847 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.793843 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-certificates\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:38:53.793995 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.793853 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f65c437-f61d-47d9-b2f9-2b2c44004077-trusted-ca\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:38:53.793995 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.793864 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f65c437-f61d-47d9-b2f9-2b2c44004077-installation-pull-secrets\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:38:53.793995 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.793872 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-bound-sa-token\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:38:53.793995 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.793880 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-registry-tls\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:38:53.793995 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.793887 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f65c437-f61d-47d9-b2f9-2b2c44004077-ca-trust-extracted\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:38:53.793995 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:53.793897 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ctlk\" (UniqueName: \"kubernetes.io/projected/9f65c437-f61d-47d9-b2f9-2b2c44004077-kube-api-access-4ctlk\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:38:54.249315 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:54.249282 2567 generic.go:356] "Generic (PLEG): container finished" podID="9f65c437-f61d-47d9-b2f9-2b2c44004077" containerID="e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6" exitCode=0 Jul 14 21:38:54.249606 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:54.249349 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" Jul 14 21:38:54.249606 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:54.249364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" event={"ID":"9f65c437-f61d-47d9-b2f9-2b2c44004077","Type":"ContainerDied","Data":"e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6"} Jul 14 21:38:54.249606 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:54.249424 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bf4dd44f6-ftd9p" event={"ID":"9f65c437-f61d-47d9-b2f9-2b2c44004077","Type":"ContainerDied","Data":"041f193253f7e7c42915460e1d1ba8f5b0f13cf8d26ca06af65f297759743561"} Jul 14 21:38:54.249606 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:54.249456 2567 scope.go:117] "RemoveContainer" containerID="e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6" Jul 14 21:38:54.257854 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:54.257840 2567 scope.go:117] "RemoveContainer" containerID="e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6" Jul 14 21:38:54.258120 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:38:54.258098 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6\": container with ID starting with e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6 not found: ID does not exist" containerID="e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6" Jul 14 21:38:54.258166 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:54.258127 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6"} err="failed to get container status \"e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6\": rpc error: code = NotFound desc = could not find container \"e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6\": container with ID starting with e36bc64e5f2d49947172c8125797fefd93ed9f391032488266d3fa224b4321a6 not found: ID does not exist" Jul 14 21:38:54.267442 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:54.267422 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf4dd44f6-ftd9p"] Jul 14 21:38:54.273856 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:54.273837 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bf4dd44f6-ftd9p"] Jul 14 21:38:55.849541 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:38:55.849514 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f65c437-f61d-47d9-b2f9-2b2c44004077" path="/var/lib/kubelet/pods/9f65c437-f61d-47d9-b2f9-2b2c44004077/volumes" Jul 14 21:39:09.197652 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:39:09.197622 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kxbsp" Jul 14 21:42:00.291646 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.291613 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5"] Jul 14 21:42:00.292103 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.291842 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f65c437-f61d-47d9-b2f9-2b2c44004077" containerName="registry" Jul 14 21:42:00.292103 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.291852 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f65c437-f61d-47d9-b2f9-2b2c44004077" containerName="registry" Jul 14 21:42:00.292103 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.291900 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f65c437-f61d-47d9-b2f9-2b2c44004077" containerName="registry" Jul 14 21:42:00.293451 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.293436 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" Jul 14 21:42:00.297289 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.297265 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 21:42:00.298372 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.298353 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 21:42:00.299855 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.299832 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5prcv\"" Jul 14 21:42:00.333483 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.333452 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e55ddf89-6b1b-42cc-a103-be8d64556c5a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ltlr5\" (UID: \"e55ddf89-6b1b-42cc-a103-be8d64556c5a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" Jul 14 21:42:00.333714 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.333495 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrvk2\" (UniqueName: \"kubernetes.io/projected/e55ddf89-6b1b-42cc-a103-be8d64556c5a-kube-api-access-wrvk2\") pod \"openshift-lws-operator-fd8ccff4c-ltlr5\" (UID: \"e55ddf89-6b1b-42cc-a103-be8d64556c5a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" Jul 14 21:42:00.361932 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.361904 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5"] Jul 14 21:42:00.434298 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.434263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e55ddf89-6b1b-42cc-a103-be8d64556c5a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ltlr5\" (UID: \"e55ddf89-6b1b-42cc-a103-be8d64556c5a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" Jul 14 21:42:00.434507 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.434317 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrvk2\" (UniqueName: \"kubernetes.io/projected/e55ddf89-6b1b-42cc-a103-be8d64556c5a-kube-api-access-wrvk2\") pod \"openshift-lws-operator-fd8ccff4c-ltlr5\" (UID: \"e55ddf89-6b1b-42cc-a103-be8d64556c5a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" Jul 14 21:42:00.434765 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.434747 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e55ddf89-6b1b-42cc-a103-be8d64556c5a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ltlr5\" (UID: \"e55ddf89-6b1b-42cc-a103-be8d64556c5a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" Jul 14 21:42:00.444311 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.444283 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrvk2\" (UniqueName: \"kubernetes.io/projected/e55ddf89-6b1b-42cc-a103-be8d64556c5a-kube-api-access-wrvk2\") pod \"openshift-lws-operator-fd8ccff4c-ltlr5\" (UID: \"e55ddf89-6b1b-42cc-a103-be8d64556c5a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" Jul 14 21:42:00.601845 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.601745 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" Jul 14 21:42:00.724966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.724943 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5"] Jul 14 21:42:00.727817 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:42:00.727786 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode55ddf89_6b1b_42cc_a103_be8d64556c5a.slice/crio-6dd0a51574927e09a9dd79f165cf508bc115351e14314c3bc285327c84378f5b WatchSource:0}: Error finding container 6dd0a51574927e09a9dd79f165cf508bc115351e14314c3bc285327c84378f5b: Status 404 returned error can't find the container with id 6dd0a51574927e09a9dd79f165cf508bc115351e14314c3bc285327c84378f5b Jul 14 21:42:00.855953 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:00.855869 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" event={"ID":"e55ddf89-6b1b-42cc-a103-be8d64556c5a","Type":"ContainerStarted","Data":"6dd0a51574927e09a9dd79f165cf508bc115351e14314c3bc285327c84378f5b"} Jul 14 21:42:03.867116 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:03.867077 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" event={"ID":"e55ddf89-6b1b-42cc-a103-be8d64556c5a","Type":"ContainerStarted","Data":"e822c5daba8fb12d0748d578712c78d3b26bfac00fb958329008fc69b1949c2b"} Jul 14 21:42:03.886703 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:03.886655 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ltlr5" podStartSLOduration=1.70116263 podStartE2EDuration="3.886640476s" totalImagesPullingTime="2.185477846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:42:03.884957087 +0000 UTC m=+280.607464280" watchObservedRunningTime="2026-07-14 21:42:03.886640476 +0000 UTC m=+280.609147658" Jul 14 21:42:19.843097 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.843060 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp"] Jul 14 21:42:19.846009 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.845978 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.848458 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.848433 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 21:42:19.848768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.848749 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 21:42:19.848900 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.848837 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 21:42:19.848965 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.848837 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zzk6s\"" Jul 14 21:42:19.848965 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.848934 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 21:42:19.858027 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.858000 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp"] Jul 14 21:42:19.869566 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.869537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51ab05c8-96c0-4fcd-94f1-d419a226c065-tmp\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.869699 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.869575 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51ab05c8-96c0-4fcd-94f1-d419a226c065-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.869699 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.869605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51ab05c8-96c0-4fcd-94f1-d419a226c065-webhook-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.869699 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.869667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51ab05c8-96c0-4fcd-94f1-d419a226c065-manifests\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.869803 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.869754 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kvgf\" (UniqueName: \"kubernetes.io/projected/51ab05c8-96c0-4fcd-94f1-d419a226c065-kube-api-access-7kvgf\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.970566 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.970526 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51ab05c8-96c0-4fcd-94f1-d419a226c065-tmp\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.970566 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.970568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51ab05c8-96c0-4fcd-94f1-d419a226c065-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.970809 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.970696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51ab05c8-96c0-4fcd-94f1-d419a226c065-webhook-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.970809 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.970741 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51ab05c8-96c0-4fcd-94f1-d419a226c065-manifests\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.970809 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.970784 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kvgf\" (UniqueName: \"kubernetes.io/projected/51ab05c8-96c0-4fcd-94f1-d419a226c065-kube-api-access-7kvgf\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.971172 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.971149 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51ab05c8-96c0-4fcd-94f1-d419a226c065-manifests\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.972945 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.972917 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51ab05c8-96c0-4fcd-94f1-d419a226c065-tmp\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.973056 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.973035 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51ab05c8-96c0-4fcd-94f1-d419a226c065-webhook-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.973152 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.973135 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51ab05c8-96c0-4fcd-94f1-d419a226c065-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:19.980063 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:19.980041 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kvgf\" (UniqueName: \"kubernetes.io/projected/51ab05c8-96c0-4fcd-94f1-d419a226c065-kube-api-access-7kvgf\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-8vtdp\" (UID: \"51ab05c8-96c0-4fcd-94f1-d419a226c065\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:20.158424 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:20.158338 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:20.289125 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:20.289083 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp"] Jul 14 21:42:20.292500 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:42:20.292475 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ab05c8_96c0_4fcd_94f1_d419a226c065.slice/crio-fc2939336792e1f73ae661a1ca8f1e1825ea548aab92a5a9f57004f0bbb56ccf WatchSource:0}: Error finding container fc2939336792e1f73ae661a1ca8f1e1825ea548aab92a5a9f57004f0bbb56ccf: Status 404 returned error can't find the container with id fc2939336792e1f73ae661a1ca8f1e1825ea548aab92a5a9f57004f0bbb56ccf Jul 14 21:42:20.924497 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:20.924455 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" event={"ID":"51ab05c8-96c0-4fcd-94f1-d419a226c065","Type":"ContainerStarted","Data":"fc2939336792e1f73ae661a1ca8f1e1825ea548aab92a5a9f57004f0bbb56ccf"} Jul 14 21:42:23.712070 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:23.711997 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:42:23.714197 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:23.714174 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:42:23.718823 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:23.718805 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 21:42:23.937805 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:23.937664 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" event={"ID":"51ab05c8-96c0-4fcd-94f1-d419a226c065","Type":"ContainerStarted","Data":"906c2a237a535d2850210bda80d1499fa6e803e575c043b9d0edb6e2dfa38510"} Jul 14 21:42:24.942888 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:24.942853 2567 generic.go:356] "Generic (PLEG): container finished" podID="51ab05c8-96c0-4fcd-94f1-d419a226c065" containerID="906c2a237a535d2850210bda80d1499fa6e803e575c043b9d0edb6e2dfa38510" exitCode=0 Jul 14 21:42:24.943261 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:24.942921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" event={"ID":"51ab05c8-96c0-4fcd-94f1-d419a226c065","Type":"ContainerDied","Data":"906c2a237a535d2850210bda80d1499fa6e803e575c043b9d0edb6e2dfa38510"} Jul 14 21:42:25.948831 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:25.948786 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" event={"ID":"51ab05c8-96c0-4fcd-94f1-d419a226c065","Type":"ContainerStarted","Data":"df36b2347123c8820bf7169b73cd4ffe3b08bd22678bd910c2444057e3112dc0"} Jul 14 21:42:25.949246 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:25.948872 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:26.005432 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:26.005382 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" podStartSLOduration=2.665473407 podStartE2EDuration="7.00536603s" totalImagesPullingTime="3.305052668s" totalInitContainerRuntime="1.034839955s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:42:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:42:26.004440156 +0000 UTC m=+302.726947343" watchObservedRunningTime="2026-07-14 21:42:26.00536603 +0000 UTC m=+302.727873212" Jul 14 21:42:36.954023 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:36.953993 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-8vtdp" Jul 14 21:42:39.530569 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.530531 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd"] Jul 14 21:42:39.541359 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.541318 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.544715 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.544687 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 21:42:39.545775 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.545752 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 21:42:39.545948 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.545742 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pr747\"" Jul 14 21:42:39.546015 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.545818 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 21:42:39.546093 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.545845 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 21:42:39.549420 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.549396 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd"] Jul 14 21:42:39.613607 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.613574 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfcqz\" (UniqueName: \"kubernetes.io/projected/501d6b93-866b-4eb4-90f2-7228cd701818-kube-api-access-vfcqz\") pod \"kube-auth-proxy-65594b5d8c-xskbd\" (UID: \"501d6b93-866b-4eb4-90f2-7228cd701818\") " pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.613607 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.613607 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501d6b93-866b-4eb4-90f2-7228cd701818-tls-certs\") pod \"kube-auth-proxy-65594b5d8c-xskbd\" (UID: \"501d6b93-866b-4eb4-90f2-7228cd701818\") " pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.613846 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.613690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501d6b93-866b-4eb4-90f2-7228cd701818-tmp\") pod \"kube-auth-proxy-65594b5d8c-xskbd\" (UID: \"501d6b93-866b-4eb4-90f2-7228cd701818\") " pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.714286 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.714251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501d6b93-866b-4eb4-90f2-7228cd701818-tmp\") pod \"kube-auth-proxy-65594b5d8c-xskbd\" (UID: \"501d6b93-866b-4eb4-90f2-7228cd701818\") " pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.714286 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.714291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfcqz\" (UniqueName: \"kubernetes.io/projected/501d6b93-866b-4eb4-90f2-7228cd701818-kube-api-access-vfcqz\") pod \"kube-auth-proxy-65594b5d8c-xskbd\" (UID: \"501d6b93-866b-4eb4-90f2-7228cd701818\") " pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.714577 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.714311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501d6b93-866b-4eb4-90f2-7228cd701818-tls-certs\") pod \"kube-auth-proxy-65594b5d8c-xskbd\" (UID: \"501d6b93-866b-4eb4-90f2-7228cd701818\") " pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.716713 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.716671 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501d6b93-866b-4eb4-90f2-7228cd701818-tmp\") pod \"kube-auth-proxy-65594b5d8c-xskbd\" (UID: \"501d6b93-866b-4eb4-90f2-7228cd701818\") " pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.716896 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.716879 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501d6b93-866b-4eb4-90f2-7228cd701818-tls-certs\") pod \"kube-auth-proxy-65594b5d8c-xskbd\" (UID: \"501d6b93-866b-4eb4-90f2-7228cd701818\") " pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.725187 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.725161 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfcqz\" (UniqueName: \"kubernetes.io/projected/501d6b93-866b-4eb4-90f2-7228cd701818-kube-api-access-vfcqz\") pod \"kube-auth-proxy-65594b5d8c-xskbd\" (UID: \"501d6b93-866b-4eb4-90f2-7228cd701818\") " pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.852265 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.852197 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" Jul 14 21:42:39.994666 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.994644 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd"] Jul 14 21:42:39.997477 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:42:39.997452 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501d6b93_866b_4eb4_90f2_7228cd701818.slice/crio-fa296e9337bb9a6876f3041d3713ed4dac40f26ccf1a6cfbeae56112f38464ea WatchSource:0}: Error finding container fa296e9337bb9a6876f3041d3713ed4dac40f26ccf1a6cfbeae56112f38464ea: Status 404 returned error can't find the container with id fa296e9337bb9a6876f3041d3713ed4dac40f26ccf1a6cfbeae56112f38464ea Jul 14 21:42:39.999547 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:39.999531 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 21:42:41.001013 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:41.000950 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" event={"ID":"501d6b93-866b-4eb4-90f2-7228cd701818","Type":"ContainerStarted","Data":"fa296e9337bb9a6876f3041d3713ed4dac40f26ccf1a6cfbeae56112f38464ea"} Jul 14 21:42:43.009144 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:43.009114 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" event={"ID":"501d6b93-866b-4eb4-90f2-7228cd701818","Type":"ContainerStarted","Data":"d21fc8d96e531c92fc289e74fd48c263358293eb75a5cb2cacde22241b843d9c"} Jul 14 21:42:43.029336 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:43.029277 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65594b5d8c-xskbd" podStartSLOduration=1.238049516 podStartE2EDuration="4.02926167s" totalImagesPullingTime="2.791212154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:42:43.028118913 +0000 UTC m=+319.750626095" watchObservedRunningTime="2026-07-14 21:42:43.02926167 +0000 UTC m=+319.751768851" Jul 14 21:42:47.606893 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.606857 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh"] Jul 14 21:42:47.610248 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.610221 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.616958 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.616931 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 21:42:47.617091 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.617009 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 21:42:47.618423 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.618394 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 21:42:47.618532 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.618495 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 21:42:47.619925 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.619903 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fb7wx\"" Jul 14 21:42:47.629375 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.629354 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh"] Jul 14 21:42:47.678728 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.678695 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3634fb73-8c44-4446-b7d3-ada8f29bd016-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.678902 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.678748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3634fb73-8c44-4446-b7d3-ada8f29bd016-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.678902 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.678823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcwlg\" (UniqueName: \"kubernetes.io/projected/3634fb73-8c44-4446-b7d3-ada8f29bd016-kube-api-access-jcwlg\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.678902 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.678892 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.679063 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.678948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.679063 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.679002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.679063 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.679036 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.780105 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.780069 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.780105 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.780108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.780362 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.780128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3634fb73-8c44-4446-b7d3-ada8f29bd016-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.780362 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.780155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3634fb73-8c44-4446-b7d3-ada8f29bd016-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.780362 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.780178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcwlg\" (UniqueName: \"kubernetes.io/projected/3634fb73-8c44-4446-b7d3-ada8f29bd016-kube-api-access-jcwlg\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.780362 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.780214 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.780558 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.780396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.781137 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.781115 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.782634 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.782608 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.782739 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.782706 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3634fb73-8c44-4446-b7d3-ada8f29bd016-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.782839 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.782818 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3634fb73-8c44-4446-b7d3-ada8f29bd016-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.782943 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.782928 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.790695 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.790673 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3634fb73-8c44-4446-b7d3-ada8f29bd016-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.791205 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.791186 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcwlg\" (UniqueName: \"kubernetes.io/projected/3634fb73-8c44-4446-b7d3-ada8f29bd016-kube-api-access-jcwlg\") pod \"istiod-openshift-gateway-94bb8fbfd-hjjsh\" (UID: \"3634fb73-8c44-4446-b7d3-ada8f29bd016\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:47.921661 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:47.921594 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:48.061148 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:48.061125 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh"] Jul 14 21:42:48.063497 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:42:48.063469 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3634fb73_8c44_4446_b7d3_ada8f29bd016.slice/crio-8829d35cd2acfa4f4d027183a803bd801eb96b8fab8fc5e3972712da32e5f6e5 WatchSource:0}: Error finding container 8829d35cd2acfa4f4d027183a803bd801eb96b8fab8fc5e3972712da32e5f6e5: Status 404 returned error can't find the container with id 8829d35cd2acfa4f4d027183a803bd801eb96b8fab8fc5e3972712da32e5f6e5 Jul 14 21:42:49.032634 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:49.032504 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" event={"ID":"3634fb73-8c44-4446-b7d3-ada8f29bd016","Type":"ContainerStarted","Data":"8829d35cd2acfa4f4d027183a803bd801eb96b8fab8fc5e3972712da32e5f6e5"} Jul 14 21:42:50.453260 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:50.453220 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 21:42:50.453558 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:50.453290 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 21:42:51.042742 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:51.042690 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" event={"ID":"3634fb73-8c44-4446-b7d3-ada8f29bd016","Type":"ContainerStarted","Data":"7aa7bb40caf18a878770476866da73ee126d38c593e58cc42985bb5eb21d8e89"} Jul 14 21:42:51.042933 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:51.042781 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:42:51.044579 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:51.044537 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-hjjsh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 21:42:51.044686 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:51.044598 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" podUID="3634fb73-8c44-4446-b7d3-ada8f29bd016" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 21:42:51.116436 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:51.116371 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" podStartSLOduration=1.7287214579999999 podStartE2EDuration="4.116352066s" totalImagesPullingTime="2.387630608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:42:51.115708999 +0000 UTC m=+327.838216199" watchObservedRunningTime="2026-07-14 21:42:51.116352066 +0000 UTC m=+327.838859251" Jul 14 21:42:52.047365 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:42:52.047315 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hjjsh" Jul 14 21:43:40.885838 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:40.885758 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktfsv"] Jul 14 21:43:40.894271 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:40.894243 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" Jul 14 21:43:40.897835 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:40.897803 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2xn99\"" Jul 14 21:43:40.897835 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:40.897818 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 21:43:40.898014 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:40.897881 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 21:43:40.907619 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:40.907593 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktfsv"] Jul 14 21:43:40.976396 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:40.976359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrpc8\" (UniqueName: \"kubernetes.io/projected/12013942-db3a-4987-b6b1-db4d97aa4800-kube-api-access-wrpc8\") pod \"kuadrant-operator-catalog-ktfsv\" (UID: \"12013942-db3a-4987-b6b1-db4d97aa4800\") " pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" Jul 14 21:43:41.076851 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:41.076811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrpc8\" (UniqueName: \"kubernetes.io/projected/12013942-db3a-4987-b6b1-db4d97aa4800-kube-api-access-wrpc8\") pod \"kuadrant-operator-catalog-ktfsv\" (UID: \"12013942-db3a-4987-b6b1-db4d97aa4800\") " pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" Jul 14 21:43:41.098843 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:41.098813 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrpc8\" (UniqueName: \"kubernetes.io/projected/12013942-db3a-4987-b6b1-db4d97aa4800-kube-api-access-wrpc8\") pod \"kuadrant-operator-catalog-ktfsv\" (UID: \"12013942-db3a-4987-b6b1-db4d97aa4800\") " pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" Jul 14 21:43:41.204671 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:41.204603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" Jul 14 21:43:41.224624 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:41.224597 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktfsv"] Jul 14 21:43:41.342187 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:41.342159 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktfsv"] Jul 14 21:43:41.345539 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:43:41.345508 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12013942_db3a_4987_b6b1_db4d97aa4800.slice/crio-b1eba7db25c6635ec37fda3fea59f9b10d978b553b35d25bff07aa5dcf32db9a WatchSource:0}: Error finding container b1eba7db25c6635ec37fda3fea59f9b10d978b553b35d25bff07aa5dcf32db9a: Status 404 returned error can't find the container with id b1eba7db25c6635ec37fda3fea59f9b10d978b553b35d25bff07aa5dcf32db9a Jul 14 21:43:42.233236 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:42.233198 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" event={"ID":"12013942-db3a-4987-b6b1-db4d97aa4800","Type":"ContainerStarted","Data":"b1eba7db25c6635ec37fda3fea59f9b10d978b553b35d25bff07aa5dcf32db9a"} Jul 14 21:43:44.243303 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:44.243266 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" event={"ID":"12013942-db3a-4987-b6b1-db4d97aa4800","Type":"ContainerStarted","Data":"5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb"} Jul 14 21:43:44.243801 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:44.243311 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" podUID="12013942-db3a-4987-b6b1-db4d97aa4800" containerName="registry-server" containerID="cri-o://5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb" gracePeriod=2 Jul 14 21:43:44.261691 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:44.261649 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" podStartSLOduration=2.235437531 podStartE2EDuration="4.261633994s" totalImagesPullingTime="2.026196463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:43:44.260771688 +0000 UTC m=+380.983278891" watchObservedRunningTime="2026-07-14 21:43:44.261633994 +0000 UTC m=+380.984141176" Jul 14 21:43:44.476644 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:44.476621 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" Jul 14 21:43:44.504201 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:44.504181 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrpc8\" (UniqueName: \"kubernetes.io/projected/12013942-db3a-4987-b6b1-db4d97aa4800-kube-api-access-wrpc8\") pod \"12013942-db3a-4987-b6b1-db4d97aa4800\" (UID: \"12013942-db3a-4987-b6b1-db4d97aa4800\") " Jul 14 21:43:44.506260 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:44.506233 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12013942-db3a-4987-b6b1-db4d97aa4800-kube-api-access-wrpc8" (OuterVolumeSpecName: "kube-api-access-wrpc8") pod "12013942-db3a-4987-b6b1-db4d97aa4800" (UID: "12013942-db3a-4987-b6b1-db4d97aa4800"). InnerVolumeSpecName "kube-api-access-wrpc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 21:43:44.604772 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:44.604738 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrpc8\" (UniqueName: \"kubernetes.io/projected/12013942-db3a-4987-b6b1-db4d97aa4800-kube-api-access-wrpc8\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:43:45.247976 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:45.247943 2567 generic.go:356] "Generic (PLEG): container finished" podID="12013942-db3a-4987-b6b1-db4d97aa4800" containerID="5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb" exitCode=0 Jul 14 21:43:45.248387 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:45.247987 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" Jul 14 21:43:45.248387 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:45.247986 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" event={"ID":"12013942-db3a-4987-b6b1-db4d97aa4800","Type":"ContainerDied","Data":"5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb"} Jul 14 21:43:45.248387 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:45.248111 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ktfsv" event={"ID":"12013942-db3a-4987-b6b1-db4d97aa4800","Type":"ContainerDied","Data":"b1eba7db25c6635ec37fda3fea59f9b10d978b553b35d25bff07aa5dcf32db9a"} Jul 14 21:43:45.248387 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:45.248140 2567 scope.go:117] "RemoveContainer" containerID="5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb" Jul 14 21:43:45.256646 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:45.256631 2567 scope.go:117] "RemoveContainer" containerID="5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb" Jul 14 21:43:45.256887 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:43:45.256870 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb\": container with ID starting with 5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb not found: ID does not exist" containerID="5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb" Jul 14 21:43:45.256925 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:45.256897 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb"} err="failed to get container status \"5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb\": rpc error: code = NotFound desc = could not find container \"5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb\": container with ID starting with 5b2828aaf4fd42b804d05a29821aa0a014adafe93ccf952a7ee0307cbf85afcb not found: ID does not exist" Jul 14 21:43:45.269315 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:45.269284 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktfsv"] Jul 14 21:43:45.275059 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:45.275039 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktfsv"] Jul 14 21:43:45.849917 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:43:45.849884 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12013942-db3a-4987-b6b1-db4d97aa4800" path="/var/lib/kubelet/pods/12013942-db3a-4987-b6b1-db4d97aa4800/volumes" Jul 14 21:44:14.135660 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.135627 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds"] Jul 14 21:44:14.136108 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.135875 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12013942-db3a-4987-b6b1-db4d97aa4800" containerName="registry-server" Jul 14 21:44:14.136108 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.135885 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="12013942-db3a-4987-b6b1-db4d97aa4800" containerName="registry-server" Jul 14 21:44:14.136108 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.135931 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="12013942-db3a-4987-b6b1-db4d97aa4800" containerName="registry-server" Jul 14 21:44:14.141523 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.141502 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:14.145951 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.145930 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kcgzw\"" Jul 14 21:44:14.146584 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.146562 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 21:44:14.147280 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.147262 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 21:44:14.152965 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.152942 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds"] Jul 14 21:44:14.230106 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.230079 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgdv5\" (UniqueName: \"kubernetes.io/projected/fda592a8-9cd1-4caa-9a44-66c58b9897c2-kube-api-access-vgdv5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" (UID: \"fda592a8-9cd1-4caa-9a44-66c58b9897c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:14.230222 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.230135 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fda592a8-9cd1-4caa-9a44-66c58b9897c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" (UID: \"fda592a8-9cd1-4caa-9a44-66c58b9897c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:14.330721 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.330693 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgdv5\" (UniqueName: \"kubernetes.io/projected/fda592a8-9cd1-4caa-9a44-66c58b9897c2-kube-api-access-vgdv5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" (UID: \"fda592a8-9cd1-4caa-9a44-66c58b9897c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:14.330846 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.330748 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fda592a8-9cd1-4caa-9a44-66c58b9897c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" (UID: \"fda592a8-9cd1-4caa-9a44-66c58b9897c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:14.331095 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.331075 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fda592a8-9cd1-4caa-9a44-66c58b9897c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" (UID: \"fda592a8-9cd1-4caa-9a44-66c58b9897c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:14.342313 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.342283 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgdv5\" (UniqueName: \"kubernetes.io/projected/fda592a8-9cd1-4caa-9a44-66c58b9897c2-kube-api-access-vgdv5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" (UID: \"fda592a8-9cd1-4caa-9a44-66c58b9897c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:14.451238 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.451174 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:14.591032 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:14.590989 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds"] Jul 14 21:44:14.593677 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:44:14.593651 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda592a8_9cd1_4caa_9a44_66c58b9897c2.slice/crio-7a92fc6eab45059d801ca9545f5dd17cc34507002ceefd572818b478e3db704c WatchSource:0}: Error finding container 7a92fc6eab45059d801ca9545f5dd17cc34507002ceefd572818b478e3db704c: Status 404 returned error can't find the container with id 7a92fc6eab45059d801ca9545f5dd17cc34507002ceefd572818b478e3db704c Jul 14 21:44:15.369407 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:15.369346 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" event={"ID":"fda592a8-9cd1-4caa-9a44-66c58b9897c2","Type":"ContainerStarted","Data":"7a92fc6eab45059d801ca9545f5dd17cc34507002ceefd572818b478e3db704c"} Jul 14 21:44:18.949254 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:18.949224 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8"] Jul 14 21:44:18.953131 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:18.953110 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8" Jul 14 21:44:18.955551 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:18.955531 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 21:44:18.955674 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:18.955596 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-k6mjt\"" Jul 14 21:44:18.964387 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:18.964365 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8"] Jul 14 21:44:19.072164 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:19.072129 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2hr4\" (UniqueName: \"kubernetes.io/projected/f75847c2-d28a-4358-91a9-049c059ac057-kube-api-access-c2hr4\") pod \"dns-operator-controller-manager-864dd78c4c-rl7v8\" (UID: \"f75847c2-d28a-4358-91a9-049c059ac057\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8" Jul 14 21:44:19.172607 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:19.172568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2hr4\" (UniqueName: \"kubernetes.io/projected/f75847c2-d28a-4358-91a9-049c059ac057-kube-api-access-c2hr4\") pod \"dns-operator-controller-manager-864dd78c4c-rl7v8\" (UID: \"f75847c2-d28a-4358-91a9-049c059ac057\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8" Jul 14 21:44:19.182139 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:19.182109 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2hr4\" (UniqueName: \"kubernetes.io/projected/f75847c2-d28a-4358-91a9-049c059ac057-kube-api-access-c2hr4\") pod \"dns-operator-controller-manager-864dd78c4c-rl7v8\" (UID: \"f75847c2-d28a-4358-91a9-049c059ac057\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8" Jul 14 21:44:19.263594 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:19.263560 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8" Jul 14 21:44:20.254567 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:20.254543 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8"] Jul 14 21:44:20.257646 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:44:20.257621 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf75847c2_d28a_4358_91a9_049c059ac057.slice/crio-b218b0ede070680b9144f23ab1fcab65c6a3f08c7b56ba382020a69ed8b6082f WatchSource:0}: Error finding container b218b0ede070680b9144f23ab1fcab65c6a3f08c7b56ba382020a69ed8b6082f: Status 404 returned error can't find the container with id b218b0ede070680b9144f23ab1fcab65c6a3f08c7b56ba382020a69ed8b6082f Jul 14 21:44:20.391370 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:20.391271 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8" event={"ID":"f75847c2-d28a-4358-91a9-049c059ac057","Type":"ContainerStarted","Data":"b218b0ede070680b9144f23ab1fcab65c6a3f08c7b56ba382020a69ed8b6082f"} Jul 14 21:44:20.392631 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:20.392602 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" event={"ID":"fda592a8-9cd1-4caa-9a44-66c58b9897c2","Type":"ContainerStarted","Data":"e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a"} Jul 14 21:44:20.392864 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:20.392844 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:20.421470 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:20.421426 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" podStartSLOduration=0.844425292 podStartE2EDuration="6.421412923s" totalImagesPullingTime="5.576987631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:44:20.420144863 +0000 UTC m=+417.142652068" watchObservedRunningTime="2026-07-14 21:44:20.421412923 +0000 UTC m=+417.143920105" Jul 14 21:44:20.947036 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:20.947004 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w"] Jul 14 21:44:20.950500 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:20.950479 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:20.953417 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:20.953394 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qlw65\"" Jul 14 21:44:20.960694 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:20.960672 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w"] Jul 14 21:44:21.087191 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:21.087159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzvbt\" (UniqueName: \"kubernetes.io/projected/3111d6a0-a296-4167-8cba-67d9a9188dfa-kube-api-access-mzvbt\") pod \"limitador-operator-controller-manager-859d7b78bd-44g7w\" (UID: \"3111d6a0-a296-4167-8cba-67d9a9188dfa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:21.188107 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:21.188079 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzvbt\" (UniqueName: \"kubernetes.io/projected/3111d6a0-a296-4167-8cba-67d9a9188dfa-kube-api-access-mzvbt\") pod \"limitador-operator-controller-manager-859d7b78bd-44g7w\" (UID: \"3111d6a0-a296-4167-8cba-67d9a9188dfa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:21.198054 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:21.197993 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzvbt\" (UniqueName: \"kubernetes.io/projected/3111d6a0-a296-4167-8cba-67d9a9188dfa-kube-api-access-mzvbt\") pod \"limitador-operator-controller-manager-859d7b78bd-44g7w\" (UID: \"3111d6a0-a296-4167-8cba-67d9a9188dfa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:21.262210 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:21.262176 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:21.771462 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:21.771392 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w"] Jul 14 21:44:21.773901 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:44:21.773874 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3111d6a0_a296_4167_8cba_67d9a9188dfa.slice/crio-ddd5cbe864a9e7ddc93194bf2e60dc5fa042397d7dba361300b1368102418710 WatchSource:0}: Error finding container ddd5cbe864a9e7ddc93194bf2e60dc5fa042397d7dba361300b1368102418710: Status 404 returned error can't find the container with id ddd5cbe864a9e7ddc93194bf2e60dc5fa042397d7dba361300b1368102418710 Jul 14 21:44:22.403620 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:22.403578 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" event={"ID":"3111d6a0-a296-4167-8cba-67d9a9188dfa","Type":"ContainerStarted","Data":"ddd5cbe864a9e7ddc93194bf2e60dc5fa042397d7dba361300b1368102418710"} Jul 14 21:44:23.409649 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:23.409609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8" event={"ID":"f75847c2-d28a-4358-91a9-049c059ac057","Type":"ContainerStarted","Data":"2be12796a726fec6b939303d06afd391921147a21e57e62d4f0c519abfb643a2"} Jul 14 21:44:23.410066 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:23.409761 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8" Jul 14 21:44:23.431247 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:23.431190 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8" podStartSLOduration=3.002758424 podStartE2EDuration="5.431174064s" totalImagesPullingTime="2.42841564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:44:23.43060894 +0000 UTC m=+420.153116116" watchObservedRunningTime="2026-07-14 21:44:23.431174064 +0000 UTC m=+420.153681246" Jul 14 21:44:24.415025 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:24.414981 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" event={"ID":"3111d6a0-a296-4167-8cba-67d9a9188dfa","Type":"ContainerStarted","Data":"b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b"} Jul 14 21:44:24.415496 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:24.415047 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:24.436218 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:24.436172 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" podStartSLOduration=2.577377636 podStartE2EDuration="4.436159776s" totalImagesPullingTime="1.85878214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:44:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:44:24.434304808 +0000 UTC m=+421.156812000" watchObservedRunningTime="2026-07-14 21:44:24.436159776 +0000 UTC m=+421.158666957" Jul 14 21:44:31.399471 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:31.399442 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:33.347266 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.347222 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds"] Jul 14 21:44:33.348077 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.348044 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" containerName="manager" containerID="cri-o://e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a" gracePeriod=2 Jul 14 21:44:33.353610 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.353583 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds"] Jul 14 21:44:33.368230 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.368203 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w"] Jul 14 21:44:33.368505 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.368476 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" containerName="manager" containerID="cri-o://b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b" gracePeriod=2 Jul 14 21:44:33.370925 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.370896 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:33.372704 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.372680 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w"] Jul 14 21:44:33.377553 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.377515 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:33.379609 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.379582 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:33.382749 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.382716 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-44g7w\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:33.385225 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.385203 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf"] Jul 14 21:44:33.385519 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.385503 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" containerName="manager" Jul 14 21:44:33.385519 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.385520 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" containerName="manager" Jul 14 21:44:33.385653 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.385536 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" containerName="manager" Jul 14 21:44:33.385653 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.385542 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" containerName="manager" Jul 14 21:44:33.385653 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.385590 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" containerName="manager" Jul 14 21:44:33.385653 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.385600 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" containerName="manager" Jul 14 21:44:33.388405 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.388389 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:33.404293 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.404265 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp"] Jul 14 21:44:33.407667 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.407645 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp" Jul 14 21:44:33.408170 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.408151 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf"] Jul 14 21:44:33.424036 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.424011 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp"] Jul 14 21:44:33.430283 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.430247 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-44g7w\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:33.433467 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.433436 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:33.437061 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.437036 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:33.442161 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.442130 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-44g7w\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:33.494607 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.494567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2psf4\" (UniqueName: \"kubernetes.io/projected/759dc8a1-00b0-4734-a6b6-1c4ca8355338-kube-api-access-2psf4\") pod \"limitador-operator-controller-manager-859d7b78bd-krlnp\" (UID: \"759dc8a1-00b0-4734-a6b6-1c4ca8355338\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp" Jul 14 21:44:33.494752 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.494622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkf7r\" (UniqueName: \"kubernetes.io/projected/d9027777-c732-4fa5-b449-9d4552d2de0c-kube-api-access-tkf7r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbkcf\" (UID: \"d9027777-c732-4fa5-b449-9d4552d2de0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:33.494752 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.494672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9027777-c732-4fa5-b449-9d4552d2de0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbkcf\" (UID: \"d9027777-c732-4fa5-b449-9d4552d2de0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:33.595131 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.595102 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2psf4\" (UniqueName: \"kubernetes.io/projected/759dc8a1-00b0-4734-a6b6-1c4ca8355338-kube-api-access-2psf4\") pod \"limitador-operator-controller-manager-859d7b78bd-krlnp\" (UID: \"759dc8a1-00b0-4734-a6b6-1c4ca8355338\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp" Jul 14 21:44:33.595236 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.595209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkf7r\" (UniqueName: \"kubernetes.io/projected/d9027777-c732-4fa5-b449-9d4552d2de0c-kube-api-access-tkf7r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbkcf\" (UID: \"d9027777-c732-4fa5-b449-9d4552d2de0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:33.595303 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.595252 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9027777-c732-4fa5-b449-9d4552d2de0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbkcf\" (UID: \"d9027777-c732-4fa5-b449-9d4552d2de0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:33.595672 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.595654 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9027777-c732-4fa5-b449-9d4552d2de0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbkcf\" (UID: \"d9027777-c732-4fa5-b449-9d4552d2de0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:33.603127 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.603068 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:33.605761 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.605745 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:33.611124 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.611099 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkf7r\" (UniqueName: \"kubernetes.io/projected/d9027777-c732-4fa5-b449-9d4552d2de0c-kube-api-access-tkf7r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbkcf\" (UID: \"d9027777-c732-4fa5-b449-9d4552d2de0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:33.620389 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.620365 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:33.622866 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.622842 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-44g7w\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:33.623564 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.623548 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2psf4\" (UniqueName: \"kubernetes.io/projected/759dc8a1-00b0-4734-a6b6-1c4ca8355338-kube-api-access-2psf4\") pod \"limitador-operator-controller-manager-859d7b78bd-krlnp\" (UID: \"759dc8a1-00b0-4734-a6b6-1c4ca8355338\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp" Jul 14 21:44:33.636379 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.636352 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:33.643854 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.643831 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-44g7w\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:33.696126 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.696094 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgdv5\" (UniqueName: \"kubernetes.io/projected/fda592a8-9cd1-4caa-9a44-66c58b9897c2-kube-api-access-vgdv5\") pod \"fda592a8-9cd1-4caa-9a44-66c58b9897c2\" (UID: \"fda592a8-9cd1-4caa-9a44-66c58b9897c2\") " Jul 14 21:44:33.696258 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.696184 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fda592a8-9cd1-4caa-9a44-66c58b9897c2-extensions-socket-volume\") pod \"fda592a8-9cd1-4caa-9a44-66c58b9897c2\" (UID: \"fda592a8-9cd1-4caa-9a44-66c58b9897c2\") " Jul 14 21:44:33.696258 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.696235 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzvbt\" (UniqueName: \"kubernetes.io/projected/3111d6a0-a296-4167-8cba-67d9a9188dfa-kube-api-access-mzvbt\") pod \"3111d6a0-a296-4167-8cba-67d9a9188dfa\" (UID: \"3111d6a0-a296-4167-8cba-67d9a9188dfa\") " Jul 14 21:44:33.696610 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.696581 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda592a8-9cd1-4caa-9a44-66c58b9897c2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fda592a8-9cd1-4caa-9a44-66c58b9897c2" (UID: "fda592a8-9cd1-4caa-9a44-66c58b9897c2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 21:44:33.698267 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.698245 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3111d6a0-a296-4167-8cba-67d9a9188dfa-kube-api-access-mzvbt" (OuterVolumeSpecName: "kube-api-access-mzvbt") pod "3111d6a0-a296-4167-8cba-67d9a9188dfa" (UID: "3111d6a0-a296-4167-8cba-67d9a9188dfa"). InnerVolumeSpecName "kube-api-access-mzvbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 21:44:33.698343 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.698277 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda592a8-9cd1-4caa-9a44-66c58b9897c2-kube-api-access-vgdv5" (OuterVolumeSpecName: "kube-api-access-vgdv5") pod "fda592a8-9cd1-4caa-9a44-66c58b9897c2" (UID: "fda592a8-9cd1-4caa-9a44-66c58b9897c2"). InnerVolumeSpecName "kube-api-access-vgdv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 21:44:33.766629 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.766588 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:33.771807 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.771785 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp" Jul 14 21:44:33.797557 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.797519 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzvbt\" (UniqueName: \"kubernetes.io/projected/3111d6a0-a296-4167-8cba-67d9a9188dfa-kube-api-access-mzvbt\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:44:33.797557 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.797555 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgdv5\" (UniqueName: \"kubernetes.io/projected/fda592a8-9cd1-4caa-9a44-66c58b9897c2-kube-api-access-vgdv5\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:44:33.797783 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.797571 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fda592a8-9cd1-4caa-9a44-66c58b9897c2-extensions-socket-volume\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:44:33.849043 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.848995 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ggcds\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:33.852061 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:33.852027 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-44g7w\" is forbidden: User \"system:node:ip-10-0-131-58.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-58.ec2.internal' and this object" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:33.852760 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.852740 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3111d6a0-a296-4167-8cba-67d9a9188dfa" path="/var/lib/kubelet/pods/3111d6a0-a296-4167-8cba-67d9a9188dfa/volumes" Jul 14 21:44:33.853109 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.853094 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" path="/var/lib/kubelet/pods/fda592a8-9cd1-4caa-9a44-66c58b9897c2/volumes" Jul 14 21:44:33.925959 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.925929 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf"] Jul 14 21:44:33.928618 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:44:33.928591 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9027777_c732_4fa5_b449_9d4552d2de0c.slice/crio-9adaea1eba731b170ce3de0316afec98346920bd167123ba1883136025b9539a WatchSource:0}: Error finding container 9adaea1eba731b170ce3de0316afec98346920bd167123ba1883136025b9539a: Status 404 returned error can't find the container with id 9adaea1eba731b170ce3de0316afec98346920bd167123ba1883136025b9539a Jul 14 21:44:33.941690 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:33.941633 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp"] Jul 14 21:44:33.944209 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:44:33.944125 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759dc8a1_00b0_4734_a6b6_1c4ca8355338.slice/crio-4f0ab894ab2b520a72ae701f1d29addd41c50db4930574178478def489bb132d WatchSource:0}: Error finding container 4f0ab894ab2b520a72ae701f1d29addd41c50db4930574178478def489bb132d: Status 404 returned error can't find the container with id 4f0ab894ab2b520a72ae701f1d29addd41c50db4930574178478def489bb132d Jul 14 21:44:34.417254 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.417226 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rl7v8" Jul 14 21:44:34.464211 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.464171 2567 generic.go:356] "Generic (PLEG): container finished" podID="fda592a8-9cd1-4caa-9a44-66c58b9897c2" containerID="e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a" exitCode=0 Jul 14 21:44:34.464389 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.464239 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ggcds" Jul 14 21:44:34.464389 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.464287 2567 scope.go:117] "RemoveContainer" containerID="e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a" Jul 14 21:44:34.465710 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.465686 2567 generic.go:356] "Generic (PLEG): container finished" podID="3111d6a0-a296-4167-8cba-67d9a9188dfa" containerID="b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b" exitCode=0 Jul 14 21:44:34.466079 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.465741 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-44g7w" Jul 14 21:44:34.468942 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.468476 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp" event={"ID":"759dc8a1-00b0-4734-a6b6-1c4ca8355338","Type":"ContainerStarted","Data":"c3c617442fca9c1d2a7f0b8069d3f18c4701aebe1c8eee3b53101312e2eb5203"} Jul 14 21:44:34.468942 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.468561 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp" event={"ID":"759dc8a1-00b0-4734-a6b6-1c4ca8355338","Type":"ContainerStarted","Data":"4f0ab894ab2b520a72ae701f1d29addd41c50db4930574178478def489bb132d"} Jul 14 21:44:34.468942 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.468711 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp" Jul 14 21:44:34.469393 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.469373 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7"] Jul 14 21:44:34.473208 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.473189 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:34.473311 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.473224 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" event={"ID":"d9027777-c732-4fa5-b449-9d4552d2de0c","Type":"ContainerStarted","Data":"c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55"} Jul 14 21:44:34.473311 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.473251 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" event={"ID":"d9027777-c732-4fa5-b449-9d4552d2de0c","Type":"ContainerStarted","Data":"9adaea1eba731b170ce3de0316afec98346920bd167123ba1883136025b9539a"} Jul 14 21:44:34.473311 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.473290 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:44:34.475905 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.475888 2567 scope.go:117] "RemoveContainer" containerID="e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a" Jul 14 21:44:34.476183 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:34.476163 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a\": container with ID starting with e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a not found: ID does not exist" containerID="e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a" Jul 14 21:44:34.476274 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.476187 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a"} err="failed to get container status \"e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a\": rpc error: code = NotFound desc = could not find container \"e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a\": container with ID starting with e8329826bcd2577bb6dc1d08618f2d075b5b493ff4e42897c1c615dcce52593a not found: ID does not exist" Jul 14 21:44:34.476274 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.476204 2567 scope.go:117] "RemoveContainer" containerID="b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b" Jul 14 21:44:34.487017 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.486955 2567 scope.go:117] "RemoveContainer" containerID="b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b" Jul 14 21:44:34.487439 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:34.487387 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b\": container with ID starting with b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b not found: ID does not exist" containerID="b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b" Jul 14 21:44:34.487439 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.487428 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b"} err="failed to get container status \"b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b\": rpc error: code = NotFound desc = could not find container \"b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b\": container with ID starting with b2a1284145f26d381d0def221fd7908f5e5a6f112c1d09d078716919a981ba1b not found: ID does not exist" Jul 14 21:44:34.488366 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.488307 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7"] Jul 14 21:44:34.489696 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.489650 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp" podStartSLOduration=1.489632811 podStartE2EDuration="1.489632811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:44:34.489166266 +0000 UTC m=+431.211673473" watchObservedRunningTime="2026-07-14 21:44:34.489632811 +0000 UTC m=+431.212139994" Jul 14 21:44:34.526837 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.526789 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" podStartSLOduration=1.52677298 podStartE2EDuration="1.52677298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:44:34.525682903 +0000 UTC m=+431.248190086" watchObservedRunningTime="2026-07-14 21:44:34.52677298 +0000 UTC m=+431.249280162" Jul 14 21:44:34.604716 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.604678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h76f7\" (UID: \"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:44:34.604716 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.604721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjncp\" (UniqueName: \"kubernetes.io/projected/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-kube-api-access-wjncp\") pod \"kuadrant-operator-controller-manager-86878c769f-h76f7\" (UID: \"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:44:34.705279 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.705182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h76f7\" (UID: \"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:44:34.705279 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.705231 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjncp\" (UniqueName: \"kubernetes.io/projected/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-kube-api-access-wjncp\") pod \"kuadrant-operator-controller-manager-86878c769f-h76f7\" (UID: \"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:44:34.705648 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.705629 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h76f7\" (UID: \"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:44:34.714840 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.714806 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjncp\" (UniqueName: \"kubernetes.io/projected/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-kube-api-access-wjncp\") pod \"kuadrant-operator-controller-manager-86878c769f-h76f7\" (UID: \"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:44:34.783545 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.783508 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:44:34.922011 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:34.921981 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7"] Jul 14 21:44:34.925053 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:44:34.925024 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b64747_1fa7_4beb_9098_6d5d3b79f2e7.slice/crio-2d29b473cdb4690e3939ff08681d70421c3a71c001a687d938023f54227450cd WatchSource:0}: Error finding container 2d29b473cdb4690e3939ff08681d70421c3a71c001a687d938023f54227450cd: Status 404 returned error can't find the container with id 2d29b473cdb4690e3939ff08681d70421c3a71c001a687d938023f54227450cd Jul 14 21:44:35.476380 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:35.476342 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" event={"ID":"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7","Type":"ContainerStarted","Data":"4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2"} Jul 14 21:44:35.476806 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:35.476407 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" event={"ID":"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7","Type":"ContainerStarted","Data":"2d29b473cdb4690e3939ff08681d70421c3a71c001a687d938023f54227450cd"} Jul 14 21:44:35.476806 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:35.476437 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:44:35.506564 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:35.506519 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" podStartSLOduration=1.5065057149999999 podStartE2EDuration="1.506505715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:44:35.505368974 +0000 UTC m=+432.227876156" watchObservedRunningTime="2026-07-14 21:44:35.506505715 +0000 UTC m=+432.229012896" Jul 14 21:44:45.480829 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:45.480797 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-krlnp" Jul 14 21:44:45.481285 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:45.480874 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:46.485473 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:46.485401 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:44:46.544481 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:46.544452 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf"] Jul 14 21:44:46.544685 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:46.544665 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" podUID="d9027777-c732-4fa5-b449-9d4552d2de0c" containerName="manager" containerID="cri-o://c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55" gracePeriod=10 Jul 14 21:44:46.794426 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:46.794389 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:46.797517 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:46.797499 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkf7r\" (UniqueName: \"kubernetes.io/projected/d9027777-c732-4fa5-b449-9d4552d2de0c-kube-api-access-tkf7r\") pod \"d9027777-c732-4fa5-b449-9d4552d2de0c\" (UID: \"d9027777-c732-4fa5-b449-9d4552d2de0c\") " Jul 14 21:44:46.797584 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:46.797545 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9027777-c732-4fa5-b449-9d4552d2de0c-extensions-socket-volume\") pod \"d9027777-c732-4fa5-b449-9d4552d2de0c\" (UID: \"d9027777-c732-4fa5-b449-9d4552d2de0c\") " Jul 14 21:44:46.797926 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:46.797899 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9027777-c732-4fa5-b449-9d4552d2de0c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d9027777-c732-4fa5-b449-9d4552d2de0c" (UID: "d9027777-c732-4fa5-b449-9d4552d2de0c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 21:44:46.799445 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:46.799424 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9027777-c732-4fa5-b449-9d4552d2de0c-kube-api-access-tkf7r" (OuterVolumeSpecName: "kube-api-access-tkf7r") pod "d9027777-c732-4fa5-b449-9d4552d2de0c" (UID: "d9027777-c732-4fa5-b449-9d4552d2de0c"). InnerVolumeSpecName "kube-api-access-tkf7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 21:44:46.898580 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:46.898544 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9027777-c732-4fa5-b449-9d4552d2de0c-extensions-socket-volume\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:44:46.898580 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:46.898577 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkf7r\" (UniqueName: \"kubernetes.io/projected/d9027777-c732-4fa5-b449-9d4552d2de0c-kube-api-access-tkf7r\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:44:47.531984 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:47.531952 2567 generic.go:356] "Generic (PLEG): container finished" podID="d9027777-c732-4fa5-b449-9d4552d2de0c" containerID="c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55" exitCode=0 Jul 14 21:44:47.532386 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:47.531993 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" Jul 14 21:44:47.532386 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:47.532041 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" event={"ID":"d9027777-c732-4fa5-b449-9d4552d2de0c","Type":"ContainerDied","Data":"c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55"} Jul 14 21:44:47.532386 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:47.532092 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf" event={"ID":"d9027777-c732-4fa5-b449-9d4552d2de0c","Type":"ContainerDied","Data":"9adaea1eba731b170ce3de0316afec98346920bd167123ba1883136025b9539a"} Jul 14 21:44:47.532386 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:47.532114 2567 scope.go:117] "RemoveContainer" containerID="c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55" Jul 14 21:44:47.540775 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:47.540759 2567 scope.go:117] "RemoveContainer" containerID="c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55" Jul 14 21:44:47.541043 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:44:47.541024 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55\": container with ID starting with c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55 not found: ID does not exist" containerID="c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55" Jul 14 21:44:47.541088 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:47.541051 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55"} err="failed to get container status \"c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55\": rpc error: code = NotFound desc = could not find container \"c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55\": container with ID starting with c8ea825424ef09b4d06035f5759958f8b7a4f5536b5e1d03b08d8bc07715dc55 not found: ID does not exist" Jul 14 21:44:47.556445 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:47.556420 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf"] Jul 14 21:44:47.561162 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:47.561141 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbkcf"] Jul 14 21:44:47.850411 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:44:47.850315 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9027777-c732-4fa5-b449-9d4552d2de0c" path="/var/lib/kubelet/pods/d9027777-c732-4fa5-b449-9d4552d2de0c/volumes" Jul 14 21:45:05.800178 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.800145 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:45:05.800548 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.800444 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9027777-c732-4fa5-b449-9d4552d2de0c" containerName="manager" Jul 14 21:45:05.800548 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.800457 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9027777-c732-4fa5-b449-9d4552d2de0c" containerName="manager" Jul 14 21:45:05.800548 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.800511 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9027777-c732-4fa5-b449-9d4552d2de0c" containerName="manager" Jul 14 21:45:05.804378 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.804357 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" Jul 14 21:45:05.807052 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.807028 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 21:45:05.807153 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.807119 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mgtcm\"" Jul 14 21:45:05.819560 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.819536 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:45:05.834273 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.834250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/28bc1c48-af00-4f95-9182-e82ee7ff3e9d-config-file\") pod \"limitador-limitador-54d6d988d5-2kvcr\" (UID: \"28bc1c48-af00-4f95-9182-e82ee7ff3e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" Jul 14 21:45:05.834377 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.834296 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p79qk\" (UniqueName: \"kubernetes.io/projected/28bc1c48-af00-4f95-9182-e82ee7ff3e9d-kube-api-access-p79qk\") pod \"limitador-limitador-54d6d988d5-2kvcr\" (UID: \"28bc1c48-af00-4f95-9182-e82ee7ff3e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" Jul 14 21:45:05.856141 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.856114 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:45:05.935523 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.935494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/28bc1c48-af00-4f95-9182-e82ee7ff3e9d-config-file\") pod \"limitador-limitador-54d6d988d5-2kvcr\" (UID: \"28bc1c48-af00-4f95-9182-e82ee7ff3e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" Jul 14 21:45:05.935641 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.935546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p79qk\" (UniqueName: \"kubernetes.io/projected/28bc1c48-af00-4f95-9182-e82ee7ff3e9d-kube-api-access-p79qk\") pod \"limitador-limitador-54d6d988d5-2kvcr\" (UID: \"28bc1c48-af00-4f95-9182-e82ee7ff3e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" Jul 14 21:45:05.936136 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.936114 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/28bc1c48-af00-4f95-9182-e82ee7ff3e9d-config-file\") pod \"limitador-limitador-54d6d988d5-2kvcr\" (UID: \"28bc1c48-af00-4f95-9182-e82ee7ff3e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" Jul 14 21:45:05.945790 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:05.945767 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p79qk\" (UniqueName: \"kubernetes.io/projected/28bc1c48-af00-4f95-9182-e82ee7ff3e9d-kube-api-access-p79qk\") pod \"limitador-limitador-54d6d988d5-2kvcr\" (UID: \"28bc1c48-af00-4f95-9182-e82ee7ff3e9d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" Jul 14 21:45:06.114175 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:06.114091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" Jul 14 21:45:06.280940 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:06.280888 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:45:06.283385 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:45:06.283355 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28bc1c48_af00_4f95_9182_e82ee7ff3e9d.slice/crio-853498c35a36c1025ae40e2a9d111083e618197be44dcf7ca63665425d94a61c WatchSource:0}: Error finding container 853498c35a36c1025ae40e2a9d111083e618197be44dcf7ca63665425d94a61c: Status 404 returned error can't find the container with id 853498c35a36c1025ae40e2a9d111083e618197be44dcf7ca63665425d94a61c Jul 14 21:45:06.608607 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:06.608572 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" event={"ID":"28bc1c48-af00-4f95-9182-e82ee7ff3e9d","Type":"ContainerStarted","Data":"853498c35a36c1025ae40e2a9d111083e618197be44dcf7ca63665425d94a61c"} Jul 14 21:45:09.625081 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:09.625038 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" event={"ID":"28bc1c48-af00-4f95-9182-e82ee7ff3e9d","Type":"ContainerStarted","Data":"f6bb80fb73aba5e369d13d4cff95946541f5757dfcf2d5b7778d91705dbed8a2"} Jul 14 21:45:09.625487 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:09.625166 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" Jul 14 21:45:09.645931 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:09.645878 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" podStartSLOduration=1.883892188 podStartE2EDuration="4.645862373s" totalImagesPullingTime="2.761970185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:45:09.644989288 +0000 UTC m=+466.367496471" watchObservedRunningTime="2026-07-14 21:45:09.645862373 +0000 UTC m=+466.368369617" Jul 14 21:45:20.630841 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:45:20.630813 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2kvcr" Jul 14 21:46:21.329813 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:21.329735 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:46:37.512280 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:37.512247 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:46:49.327955 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:49.327920 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:46:51.383794 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.383757 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr"] Jul 14 21:46:51.386861 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.386837 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.390441 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.390418 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 21:46:51.390441 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.390432 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gch6t\"" Jul 14 21:46:51.390597 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.390434 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 14 21:46:51.390597 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.390435 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 21:46:51.397177 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.397159 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr"] Jul 14 21:46:51.444087 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.444061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mcjp\" (UniqueName: \"kubernetes.io/projected/3c123b26-c333-45c4-808c-32ad8202a21e-kube-api-access-2mcjp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.444207 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.444098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.444207 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.444122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.444289 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.444208 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c123b26-c333-45c4-808c-32ad8202a21e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.444289 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.444249 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.444392 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.444311 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.545295 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.545254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mcjp\" (UniqueName: \"kubernetes.io/projected/3c123b26-c333-45c4-808c-32ad8202a21e-kube-api-access-2mcjp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.545295 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.545298 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.545545 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.545352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.545545 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.545395 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c123b26-c333-45c4-808c-32ad8202a21e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.545545 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.545427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.545545 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.545470 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.545799 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.545771 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.546237 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.546166 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.546376 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.546263 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.548082 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.548060 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c123b26-c333-45c4-808c-32ad8202a21e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.548374 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.548357 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c123b26-c333-45c4-808c-32ad8202a21e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.555443 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.555420 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mcjp\" (UniqueName: \"kubernetes.io/projected/3c123b26-c333-45c4-808c-32ad8202a21e-kube-api-access-2mcjp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ld2sr\" (UID: \"3c123b26-c333-45c4-808c-32ad8202a21e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.697858 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.697771 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:46:51.833236 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:51.833207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr"] Jul 14 21:46:51.836668 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:46:51.836634 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c123b26_c333_45c4_808c_32ad8202a21e.slice/crio-a9e747249bf3d77ff26f6bd626b2741993cf39dd716a373971f3619e9342214f WatchSource:0}: Error finding container a9e747249bf3d77ff26f6bd626b2741993cf39dd716a373971f3619e9342214f: Status 404 returned error can't find the container with id a9e747249bf3d77ff26f6bd626b2741993cf39dd716a373971f3619e9342214f Jul 14 21:46:52.046268 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:52.046233 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" event={"ID":"3c123b26-c333-45c4-808c-32ad8202a21e","Type":"ContainerStarted","Data":"a9e747249bf3d77ff26f6bd626b2741993cf39dd716a373971f3619e9342214f"} Jul 14 21:46:52.716236 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:52.716203 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:46:53.052020 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:53.051990 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" event={"ID":"3c123b26-c333-45c4-808c-32ad8202a21e","Type":"ContainerStarted","Data":"930a22fb62281766a3b59f8e5d444000c98118209c02152936a2b9e3b26eb858"} Jul 14 21:46:53.072435 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:46:53.072393 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" podStartSLOduration=0.928915977 podStartE2EDuration="2.072379254s" totalImagesPullingTime="1.143463277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:46:53.070928089 +0000 UTC m=+569.793435271" watchObservedRunningTime="2026-07-14 21:46:53.072379254 +0000 UTC m=+569.794886436" Jul 14 21:47:01.698479 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:47:01.698430 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:47:01.698979 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:47:01.698548 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:47:01.710842 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:47:01.710818 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:47:02.099777 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:47:02.099748 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ld2sr" Jul 14 21:47:04.307884 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:47:04.307854 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:47:19.524206 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:47:19.524172 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:47:23.736985 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:47:23.736957 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:47:23.737417 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:47:23.737217 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:47:27.214669 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:47:27.214633 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:48:44.827052 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:48:44.827015 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:48:55.909849 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:48:55.909817 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:49:05.613520 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:49:05.613484 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:49:14.819159 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:49:14.819118 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:49:25.309757 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:49:25.309678 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:49:52.114924 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:49:52.114889 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:50:02.827139 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:50:02.827105 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:50:41.325705 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:50:41.325670 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:50:48.817087 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:50:48.817010 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:50:58.612273 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:50:58.612243 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:51:05.914282 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:51:05.914242 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:51:17.513995 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:51:17.513958 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:51:26.612962 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:51:26.612927 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:51:38.416169 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:51:38.416132 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:51:45.410215 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:51:45.410179 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:51:53.013082 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:51:53.013050 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:52:02.524175 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:52:02.524139 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:52:17.516256 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:52:17.516181 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:52:23.765556 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:52:23.765523 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:52:23.766975 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:52:23.766957 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:52:29.207898 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:52:29.207861 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:52:53.214166 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:52:53.214132 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:53:05.006766 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:53:05.006725 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:53:20.116119 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:53:20.116088 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:53:31.111848 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:53:31.111811 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:53:39.929662 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:53:39.929629 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:53:49.107610 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:53:49.107538 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:53:57.614390 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:53:57.614351 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:54:25.892317 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:25.892283 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7"] Jul 14 21:54:25.892840 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:25.892490 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" podUID="b5b64747-1fa7-4beb-9098-6d5d3b79f2e7" containerName="manager" containerID="cri-o://4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2" gracePeriod=10 Jul 14 21:54:27.834122 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.834096 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:54:27.888736 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.888700 2567 generic.go:356] "Generic (PLEG): container finished" podID="b5b64747-1fa7-4beb-9098-6d5d3b79f2e7" containerID="4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2" exitCode=0 Jul 14 21:54:27.888869 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.888754 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" Jul 14 21:54:27.888869 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.888778 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" event={"ID":"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7","Type":"ContainerDied","Data":"4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2"} Jul 14 21:54:27.888869 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.888830 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7" event={"ID":"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7","Type":"ContainerDied","Data":"2d29b473cdb4690e3939ff08681d70421c3a71c001a687d938023f54227450cd"} Jul 14 21:54:27.888869 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.888853 2567 scope.go:117] "RemoveContainer" containerID="4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2" Jul 14 21:54:27.899967 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.899912 2567 scope.go:117] "RemoveContainer" containerID="4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2" Jul 14 21:54:27.900893 ip-10-0-131-58 kubenswrapper[2567]: E0714 21:54:27.900861 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2\": container with ID starting with 4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2 not found: ID does not exist" containerID="4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2" Jul 14 21:54:27.900997 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.900906 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2"} err="failed to get container status \"4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2\": rpc error: code = NotFound desc = could not find container \"4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2\": container with ID starting with 4cec3a874bd11c23be8766b55aa3ff6873c0303ff0d68fd8557867546c9479c2 not found: ID does not exist" Jul 14 21:54:27.971331 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.971264 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjncp\" (UniqueName: \"kubernetes.io/projected/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-kube-api-access-wjncp\") pod \"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7\" (UID: \"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7\") " Jul 14 21:54:27.971331 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.971304 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-extensions-socket-volume\") pod \"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7\" (UID: \"b5b64747-1fa7-4beb-9098-6d5d3b79f2e7\") " Jul 14 21:54:27.971706 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.971683 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b5b64747-1fa7-4beb-9098-6d5d3b79f2e7" (UID: "b5b64747-1fa7-4beb-9098-6d5d3b79f2e7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 21:54:27.973200 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:27.973178 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-kube-api-access-wjncp" (OuterVolumeSpecName: "kube-api-access-wjncp") pod "b5b64747-1fa7-4beb-9098-6d5d3b79f2e7" (UID: "b5b64747-1fa7-4beb-9098-6d5d3b79f2e7"). InnerVolumeSpecName "kube-api-access-wjncp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 21:54:28.072309 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:28.072272 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjncp\" (UniqueName: \"kubernetes.io/projected/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-kube-api-access-wjncp\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:54:28.072309 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:28.072304 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7-extensions-socket-volume\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 21:54:28.212066 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:28.212040 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7"] Jul 14 21:54:28.214431 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:28.214408 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h76f7"] Jul 14 21:54:29.850461 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:54:29.850423 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5b64747-1fa7-4beb-9098-6d5d3b79f2e7" path="/var/lib/kubelet/pods/b5b64747-1fa7-4beb-9098-6d5d3b79f2e7/volumes" Jul 14 21:55:27.118534 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.118503 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x"] Jul 14 21:55:27.118928 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.118776 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b64747-1fa7-4beb-9098-6d5d3b79f2e7" containerName="manager" Jul 14 21:55:27.118928 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.118788 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b64747-1fa7-4beb-9098-6d5d3b79f2e7" containerName="manager" Jul 14 21:55:27.118928 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.118845 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5b64747-1fa7-4beb-9098-6d5d3b79f2e7" containerName="manager" Jul 14 21:55:27.121989 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.121963 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" Jul 14 21:55:27.124710 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.124690 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kcgzw\"" Jul 14 21:55:27.136317 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.136295 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x"] Jul 14 21:55:27.211129 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.211105 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26607a4e-210d-4db1-8b27-6364c3481b5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9k25x\" (UID: \"26607a4e-210d-4db1-8b27-6364c3481b5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" Jul 14 21:55:27.211222 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.211134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwtv2\" (UniqueName: \"kubernetes.io/projected/26607a4e-210d-4db1-8b27-6364c3481b5e-kube-api-access-xwtv2\") pod \"kuadrant-operator-controller-manager-86878c769f-9k25x\" (UID: \"26607a4e-210d-4db1-8b27-6364c3481b5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" Jul 14 21:55:27.312393 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.312373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26607a4e-210d-4db1-8b27-6364c3481b5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9k25x\" (UID: \"26607a4e-210d-4db1-8b27-6364c3481b5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" Jul 14 21:55:27.312473 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.312400 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwtv2\" (UniqueName: \"kubernetes.io/projected/26607a4e-210d-4db1-8b27-6364c3481b5e-kube-api-access-xwtv2\") pod \"kuadrant-operator-controller-manager-86878c769f-9k25x\" (UID: \"26607a4e-210d-4db1-8b27-6364c3481b5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" Jul 14 21:55:27.312701 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.312684 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26607a4e-210d-4db1-8b27-6364c3481b5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9k25x\" (UID: \"26607a4e-210d-4db1-8b27-6364c3481b5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" Jul 14 21:55:27.322169 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.322144 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwtv2\" (UniqueName: \"kubernetes.io/projected/26607a4e-210d-4db1-8b27-6364c3481b5e-kube-api-access-xwtv2\") pod \"kuadrant-operator-controller-manager-86878c769f-9k25x\" (UID: \"26607a4e-210d-4db1-8b27-6364c3481b5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" Jul 14 21:55:27.431966 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.431909 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" Jul 14 21:55:27.559996 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:27.559854 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x"] Jul 14 21:55:27.563049 ip-10-0-131-58 kubenswrapper[2567]: W0714 21:55:27.563025 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26607a4e_210d_4db1_8b27_6364c3481b5e.slice/crio-484b847d98435961d2db8cde3536296a9d47b6ec3316e90657b1d28561eb4404 WatchSource:0}: Error finding container 484b847d98435961d2db8cde3536296a9d47b6ec3316e90657b1d28561eb4404: Status 404 returned error can't find the container with id 484b847d98435961d2db8cde3536296a9d47b6ec3316e90657b1d28561eb4404 Jul 14 21:55:28.129727 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:28.129687 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" event={"ID":"26607a4e-210d-4db1-8b27-6364c3481b5e","Type":"ContainerStarted","Data":"82eab23891d5b190ec7687dc62edc9ce334f1874f1e70186b6b91ceaf60a6e6d"} Jul 14 21:55:28.130100 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:28.129738 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" event={"ID":"26607a4e-210d-4db1-8b27-6364c3481b5e","Type":"ContainerStarted","Data":"484b847d98435961d2db8cde3536296a9d47b6ec3316e90657b1d28561eb4404"} Jul 14 21:55:28.130100 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:28.129777 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" Jul 14 21:55:28.153358 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:28.153290 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" podStartSLOduration=1.153271517 podStartE2EDuration="1.153271517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:55:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:55:28.151591222 +0000 UTC m=+1084.874098405" watchObservedRunningTime="2026-07-14 21:55:28.153271517 +0000 UTC m=+1084.875778699" Jul 14 21:55:39.135996 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:39.135965 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9k25x" Jul 14 21:55:47.152117 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:47.152079 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:55:58.226522 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:55:58.226489 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:56:09.109793 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:56:09.109753 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:56:19.216768 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:56:19.216737 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:56:30.606247 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:56:30.606207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:56:41.610128 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:56:41.610092 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:56:50.909169 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:56:50.909087 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:57:01.148133 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:57:01.148094 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:57:12.606941 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:57:12.606904 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:57:20.011598 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:57:20.011564 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:57:23.787622 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:57:23.787596 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:57:23.789665 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:57:23.789644 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 21:57:28.512896 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:57:28.512863 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:57:37.904392 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:57:37.904349 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:57:56.807723 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:57:56.807685 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:58:06.024625 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:58:06.024585 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:58:22.003284 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:58:22.003207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:58:29.604937 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:58:29.604903 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:58:38.816303 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:58:38.816270 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:58:51.411485 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:58:51.411448 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:59:00.311881 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:59:00.311846 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:59:09.625532 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:59:09.625495 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:59:18.409801 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:59:18.409770 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:59:30.113566 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:59:30.113530 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:59:43.006474 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:59:43.006442 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 21:59:52.306735 ip-10-0-131-58 kubenswrapper[2567]: I0714 21:59:52.306655 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:00:00.143270 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:00.143239 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29734440-hbpsb"] Jul 14 22:00:00.146263 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:00.146243 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" Jul 14 22:00:00.148457 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:00.148436 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-s6ht2\"" Jul 14 22:00:00.164597 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:00.164571 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29734440-hbpsb"] Jul 14 22:00:00.198150 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:00.198121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpd88\" (UniqueName: \"kubernetes.io/projected/128f0526-9cb9-4005-996d-83aeb5191460-kube-api-access-xpd88\") pod \"maas-api-key-cleanup-29734440-hbpsb\" (UID: \"128f0526-9cb9-4005-996d-83aeb5191460\") " pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" Jul 14 22:00:00.299236 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:00.299192 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpd88\" (UniqueName: \"kubernetes.io/projected/128f0526-9cb9-4005-996d-83aeb5191460-kube-api-access-xpd88\") pod \"maas-api-key-cleanup-29734440-hbpsb\" (UID: \"128f0526-9cb9-4005-996d-83aeb5191460\") " pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" Jul 14 22:00:00.310263 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:00.310231 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpd88\" (UniqueName: \"kubernetes.io/projected/128f0526-9cb9-4005-996d-83aeb5191460-kube-api-access-xpd88\") pod \"maas-api-key-cleanup-29734440-hbpsb\" (UID: \"128f0526-9cb9-4005-996d-83aeb5191460\") " pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" Jul 14 22:00:00.457857 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:00.457785 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" Jul 14 22:00:00.584796 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:00.584773 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29734440-hbpsb"] Jul 14 22:00:00.586872 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:00:00.586843 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128f0526_9cb9_4005_996d_83aeb5191460.slice/crio-efa3926f06052867bfd38e6b426d5db0f19e9e2d0d70e13c1b85602d7da20194 WatchSource:0}: Error finding container efa3926f06052867bfd38e6b426d5db0f19e9e2d0d70e13c1b85602d7da20194: Status 404 returned error can't find the container with id efa3926f06052867bfd38e6b426d5db0f19e9e2d0d70e13c1b85602d7da20194 Jul 14 22:00:00.588776 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:00.588760 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 22:00:01.226874 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:01.226840 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:00:01.252659 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:01.252628 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" event={"ID":"128f0526-9cb9-4005-996d-83aeb5191460","Type":"ContainerStarted","Data":"efa3926f06052867bfd38e6b426d5db0f19e9e2d0d70e13c1b85602d7da20194"} Jul 14 22:00:03.262680 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:03.262637 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" event={"ID":"128f0526-9cb9-4005-996d-83aeb5191460","Type":"ContainerStarted","Data":"73713f7dc0f2c11ae7645f6a5b1fdb7adb0516f282af1f1997bde741ad39931d"} Jul 14 22:00:03.281117 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:03.281051 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" podStartSLOduration=1.06170243 podStartE2EDuration="3.281030821s" totalImagesPullingTime="2.219328391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:00:03.278736926 +0000 UTC m=+1360.001244118" watchObservedRunningTime="2026-07-14 22:00:03.281030821 +0000 UTC m=+1360.003538006" Jul 14 22:00:04.268496 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:04.268464 2567 generic.go:356] "Generic (PLEG): container finished" podID="128f0526-9cb9-4005-996d-83aeb5191460" containerID="73713f7dc0f2c11ae7645f6a5b1fdb7adb0516f282af1f1997bde741ad39931d" exitCode=0 Jul 14 22:00:04.268870 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:04.268560 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" event={"ID":"128f0526-9cb9-4005-996d-83aeb5191460","Type":"ContainerDied","Data":"73713f7dc0f2c11ae7645f6a5b1fdb7adb0516f282af1f1997bde741ad39931d"} Jul 14 22:00:05.401458 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:05.401429 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" Jul 14 22:00:05.442514 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:05.442489 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpd88\" (UniqueName: \"kubernetes.io/projected/128f0526-9cb9-4005-996d-83aeb5191460-kube-api-access-xpd88\") pod \"128f0526-9cb9-4005-996d-83aeb5191460\" (UID: \"128f0526-9cb9-4005-996d-83aeb5191460\") " Jul 14 22:00:05.444659 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:05.444638 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128f0526-9cb9-4005-996d-83aeb5191460-kube-api-access-xpd88" (OuterVolumeSpecName: "kube-api-access-xpd88") pod "128f0526-9cb9-4005-996d-83aeb5191460" (UID: "128f0526-9cb9-4005-996d-83aeb5191460"). InnerVolumeSpecName "kube-api-access-xpd88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:00:05.543856 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:05.543763 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpd88\" (UniqueName: \"kubernetes.io/projected/128f0526-9cb9-4005-996d-83aeb5191460-kube-api-access-xpd88\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:00:06.278451 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:06.278416 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" event={"ID":"128f0526-9cb9-4005-996d-83aeb5191460","Type":"ContainerDied","Data":"efa3926f06052867bfd38e6b426d5db0f19e9e2d0d70e13c1b85602d7da20194"} Jul 14 22:00:06.278612 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:06.278465 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efa3926f06052867bfd38e6b426d5db0f19e9e2d0d70e13c1b85602d7da20194" Jul 14 22:00:06.278612 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:06.278429 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734440-hbpsb" Jul 14 22:00:13.109930 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:13.109894 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:00:24.710404 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:24.710368 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:00:33.306072 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:33.306032 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:00:44.209723 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:44.209685 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:00:55.801309 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:00:55.801270 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:01:06.016501 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:01:06.016471 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:01:18.624818 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:01:18.624737 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:01:27.205913 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:01:27.205880 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:01:36.509429 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:01:36.509390 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:01:43.553154 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:01:43.553114 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:01:51.711461 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:01:51.711425 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:02:14.908146 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:02:14.908070 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:02:23.409097 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:02:23.409064 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:02:23.810304 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:02:23.810279 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 22:02:23.811947 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:02:23.811923 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 22:03:48.013153 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:03:48.013118 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:03:55.708993 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:03:55.708957 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:04:02.906543 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:04:02.906508 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:04:10.938189 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:04:10.938155 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:04:21.218634 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:04:21.218557 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:04:54.619473 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:04:54.619439 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:05:16.315148 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:05:16.315103 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:05:29.617248 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:05:29.617204 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:05:40.412025 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:05:40.411986 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:05:49.608365 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:05:49.608318 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:06:23.808573 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:06:23.808538 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:06:33.116636 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:06:33.116601 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:06:44.819613 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:06:44.819575 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:07:23.833110 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:23.833081 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 22:07:23.835406 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:23.835384 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 22:07:33.299710 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.299675 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh"] Jul 14 22:07:33.300098 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.299979 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="128f0526-9cb9-4005-996d-83aeb5191460" containerName="cleanup" Jul 14 22:07:33.300098 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.299989 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="128f0526-9cb9-4005-996d-83aeb5191460" containerName="cleanup" Jul 14 22:07:33.300098 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.300036 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="128f0526-9cb9-4005-996d-83aeb5191460" containerName="cleanup" Jul 14 22:07:33.302879 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.302863 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.308202 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.308176 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5c6d83-openshift-default-dockercfg-4nqg7\"" Jul 14 22:07:33.318079 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.318044 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh"] Jul 14 22:07:33.441395 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.441359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-socket\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.441395 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.441399 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8czl\" (UniqueName: \"kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-kube-api-access-m8czl\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.441604 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.441423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-envoy\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.441604 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.441532 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-certs\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.441674 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.441601 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-token\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.441674 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.441631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istiod-ca-cert\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.441732 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.441681 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-credential-socket\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.441732 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.441699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-podinfo\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.441792 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.441729 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-data\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543001 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.542964 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-credential-socket\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543001 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543008 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-podinfo\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543257 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543034 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-data\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543257 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-socket\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543257 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8czl\" (UniqueName: \"kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-kube-api-access-m8czl\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543257 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543100 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-envoy\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543257 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-certs\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543257 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-token\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543257 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istiod-ca-cert\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543773 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543464 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-credential-socket\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543773 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543616 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-data\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.543959 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.543936 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-certs\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.544118 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.544098 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-socket\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.544210 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.544189 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istiod-ca-cert\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.546132 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.546109 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-envoy\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.546237 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.546207 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-podinfo\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.552689 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.552633 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-token\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.553168 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.553148 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8czl\" (UniqueName: \"kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-kube-api-access-m8czl\") pod \"e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.612882 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.612847 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:33.748657 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.748633 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh"] Jul 14 22:07:33.752840 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:07:33.752797 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e83912c_90c9_4923_ae49_4e7fdb3cbd13.slice/crio-096e158ca35cf035da0f0d1a275f66df8e3f98a3e0838edc1132a5e3e295567d WatchSource:0}: Error finding container 096e158ca35cf035da0f0d1a275f66df8e3f98a3e0838edc1132a5e3e295567d: Status 404 returned error can't find the container with id 096e158ca35cf035da0f0d1a275f66df8e3f98a3e0838edc1132a5e3e295567d Jul 14 22:07:33.755408 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:33.755389 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 22:07:34.139177 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:34.139140 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" event={"ID":"9e83912c-90c9-4923-ae49-4e7fdb3cbd13","Type":"ContainerStarted","Data":"096e158ca35cf035da0f0d1a275f66df8e3f98a3e0838edc1132a5e3e295567d"} Jul 14 22:07:34.304224 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:34.304188 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:07:36.303211 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:36.303166 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:07:36.303515 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:36.303241 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:07:36.303515 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:36.303269 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:07:37.154364 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:37.154312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" event={"ID":"9e83912c-90c9-4923-ae49-4e7fdb3cbd13","Type":"ContainerStarted","Data":"eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940"} Jul 14 22:07:37.178132 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:37.178081 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" podStartSLOduration=1.6307581359999999 podStartE2EDuration="4.178065648s" totalImagesPullingTime="2.547307512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:07:37.17599192 +0000 UTC m=+1813.898499102" watchObservedRunningTime="2026-07-14 22:07:37.178065648 +0000 UTC m=+1813.900572886" Jul 14 22:07:37.613041 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:37.613005 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:37.617886 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:37.617860 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:38.159035 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:38.159003 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:38.160019 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:38.160001 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:45.512084 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:45.512052 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:07:53.160529 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:53.160435 2567 patch_prober.go:28] interesting pod/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 14 22:07:53.160529 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:53.160508 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 14 22:07:53.224414 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:53.224379 2567 generic.go:356] "Generic (PLEG): container finished" podID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerID="eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940" exitCode=0 Jul 14 22:07:53.224586 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:53.224455 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" event={"ID":"9e83912c-90c9-4923-ae49-4e7fdb3cbd13","Type":"ContainerDied","Data":"eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940"} Jul 14 22:07:53.224864 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:53.224845 2567 scope.go:117] "RemoveContainer" containerID="eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940" Jul 14 22:07:53.226713 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:53.226686 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:07:53.226780 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:53.226756 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:07:53.226824 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:53.226787 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:07:54.229971 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:54.229933 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" event={"ID":"9e83912c-90c9-4923-ae49-4e7fdb3cbd13","Type":"ContainerStarted","Data":"b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba"} Jul 14 22:07:54.613985 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:54.613944 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:54.614219 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:54.614195 2567 patch_prober.go:28] interesting pod/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 14 22:07:54.614297 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:54.614255 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 14 22:07:55.613827 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:55.613792 2567 patch_prober.go:28] interesting pod/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 14 22:07:55.614270 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:55.613850 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 14 22:07:56.613752 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:56.613717 2567 patch_prober.go:28] interesting pod/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 14 22:07:56.613929 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:56.613777 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 14 22:07:57.614147 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:57.614111 2567 patch_prober.go:28] interesting pod/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 14 22:07:57.614545 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:57.614167 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 14 22:07:58.617707 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:58.617678 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:58.618165 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:58.617955 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:07:58.618733 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:07:58.618712 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:08:07.030587 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:07.030551 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:08:51.003276 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.003239 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb"] Jul 14 22:08:51.006510 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.006494 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.009521 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.009498 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5c6d83\"/\"openshift-service-ca.crt\"" Jul 14 22:08:51.010318 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.010299 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5c6d83\"/\"kube-root-ca.crt\"" Jul 14 22:08:51.010436 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.010357 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5c6d83\"/\"default-dockercfg-2rjpw\"" Jul 14 22:08:51.010436 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.010358 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5c6d83\"/\"test-model-5c6d83-kserve-self-signed-certs\"" Jul 14 22:08:51.015076 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.015058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prl4q\" (UniqueName: \"kubernetes.io/projected/445d8f80-987b-4470-a51d-f845b0944e71-kube-api-access-prl4q\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.015163 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.015089 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-home\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.015163 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.015116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-tmp-dir\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.015163 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.015136 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/445d8f80-987b-4470-a51d-f845b0944e71-tls-certs\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.015262 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.015206 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-model-cache\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.015262 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.015234 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-dshm\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.022301 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.022269 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb"] Jul 14 22:08:51.115891 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.115853 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-model-cache\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.115891 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.115900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-dshm\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.116145 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.115928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prl4q\" (UniqueName: \"kubernetes.io/projected/445d8f80-987b-4470-a51d-f845b0944e71-kube-api-access-prl4q\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.116145 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.115952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-home\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.116145 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.115969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-tmp-dir\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.116145 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.115985 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/445d8f80-987b-4470-a51d-f845b0944e71-tls-certs\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.116366 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.116347 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-model-cache\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.116413 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.116369 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-home\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.116458 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.116441 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-tmp-dir\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.118186 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.118166 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-dshm\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.118465 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.118448 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/445d8f80-987b-4470-a51d-f845b0944e71-tls-certs\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.126316 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.126293 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prl4q\" (UniqueName: \"kubernetes.io/projected/445d8f80-987b-4470-a51d-f845b0944e71-kube-api-access-prl4q\") pod \"test-model-5c6d83-kserve-686c598f5f-ww5rb\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.315438 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.315349 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:08:51.443668 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.443631 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb"] Jul 14 22:08:51.446485 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:08:51.446457 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod445d8f80_987b_4470_a51d_f845b0944e71.slice/crio-0d9e9186e79aa3248973561aaa39ebe7b33e3d48e776a1497dd6cca312d86273 WatchSource:0}: Error finding container 0d9e9186e79aa3248973561aaa39ebe7b33e3d48e776a1497dd6cca312d86273: Status 404 returned error can't find the container with id 0d9e9186e79aa3248973561aaa39ebe7b33e3d48e776a1497dd6cca312d86273 Jul 14 22:08:51.471101 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:51.471067 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" event={"ID":"445d8f80-987b-4470-a51d-f845b0944e71","Type":"ContainerStarted","Data":"0d9e9186e79aa3248973561aaa39ebe7b33e3d48e776a1497dd6cca312d86273"} Jul 14 22:08:52.476952 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:52.476920 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" event={"ID":"445d8f80-987b-4470-a51d-f845b0944e71","Type":"ContainerStarted","Data":"1b39bdd0881fb10d66abc61b3ce5ce3751001250d3e6d655a308a1e2663c95d9"} Jul 14 22:08:52.496529 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:52.496483 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" podStartSLOduration=2.496466587 podStartE2EDuration="2.496466587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:08:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:08:52.494865625 +0000 UTC m=+1889.217372809" watchObservedRunningTime="2026-07-14 22:08:52.496466587 +0000 UTC m=+1889.218973769" Jul 14 22:08:56.111815 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:08:56.111779 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:09:01.315847 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:01.315809 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:09:01.315847 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:01.315856 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:09:01.328256 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:01.328230 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:09:01.527406 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:01.527377 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:09:14.400887 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:14.400851 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb"] Jul 14 22:09:18.209095 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:18.209058 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:09:29.421165 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.421101 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" podUID="445d8f80-987b-4470-a51d-f845b0944e71" containerName="main" containerID="cri-o://1b39bdd0881fb10d66abc61b3ce5ce3751001250d3e6d655a308a1e2663c95d9" gracePeriod=45 Jul 14 22:09:29.646521 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.646484 2567 generic.go:356] "Generic (PLEG): container finished" podID="445d8f80-987b-4470-a51d-f845b0944e71" containerID="1b39bdd0881fb10d66abc61b3ce5ce3751001250d3e6d655a308a1e2663c95d9" exitCode=0 Jul 14 22:09:29.646672 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.646575 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" event={"ID":"445d8f80-987b-4470-a51d-f845b0944e71","Type":"ContainerDied","Data":"1b39bdd0881fb10d66abc61b3ce5ce3751001250d3e6d655a308a1e2663c95d9"} Jul 14 22:09:29.668940 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.668915 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:09:29.746723 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.746635 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-dshm\") pod \"445d8f80-987b-4470-a51d-f845b0944e71\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " Jul 14 22:09:29.746723 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.746677 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-model-cache\") pod \"445d8f80-987b-4470-a51d-f845b0944e71\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " Jul 14 22:09:29.746940 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.746739 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-tmp-dir\") pod \"445d8f80-987b-4470-a51d-f845b0944e71\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " Jul 14 22:09:29.746940 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.746771 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prl4q\" (UniqueName: \"kubernetes.io/projected/445d8f80-987b-4470-a51d-f845b0944e71-kube-api-access-prl4q\") pod \"445d8f80-987b-4470-a51d-f845b0944e71\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " Jul 14 22:09:29.746940 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.746809 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/445d8f80-987b-4470-a51d-f845b0944e71-tls-certs\") pod \"445d8f80-987b-4470-a51d-f845b0944e71\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " Jul 14 22:09:29.746940 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.746858 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-home\") pod \"445d8f80-987b-4470-a51d-f845b0944e71\" (UID: \"445d8f80-987b-4470-a51d-f845b0944e71\") " Jul 14 22:09:29.747154 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.747010 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "445d8f80-987b-4470-a51d-f845b0944e71" (UID: "445d8f80-987b-4470-a51d-f845b0944e71"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:09:29.747154 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.747020 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-model-cache" (OuterVolumeSpecName: "model-cache") pod "445d8f80-987b-4470-a51d-f845b0944e71" (UID: "445d8f80-987b-4470-a51d-f845b0944e71"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:09:29.747257 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.747162 2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-model-cache\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:09:29.747257 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.747182 2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-tmp-dir\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:09:29.747388 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.747255 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-home" (OuterVolumeSpecName: "home") pod "445d8f80-987b-4470-a51d-f845b0944e71" (UID: "445d8f80-987b-4470-a51d-f845b0944e71"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:09:29.748920 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.748893 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/445d8f80-987b-4470-a51d-f845b0944e71-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "445d8f80-987b-4470-a51d-f845b0944e71" (UID: "445d8f80-987b-4470-a51d-f845b0944e71"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 22:09:29.748920 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.748902 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/445d8f80-987b-4470-a51d-f845b0944e71-kube-api-access-prl4q" (OuterVolumeSpecName: "kube-api-access-prl4q") pod "445d8f80-987b-4470-a51d-f845b0944e71" (UID: "445d8f80-987b-4470-a51d-f845b0944e71"). InnerVolumeSpecName "kube-api-access-prl4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:09:29.749089 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.748897 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-dshm" (OuterVolumeSpecName: "dshm") pod "445d8f80-987b-4470-a51d-f845b0944e71" (UID: "445d8f80-987b-4470-a51d-f845b0944e71"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:09:29.847598 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.847564 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prl4q\" (UniqueName: \"kubernetes.io/projected/445d8f80-987b-4470-a51d-f845b0944e71-kube-api-access-prl4q\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:09:29.847598 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.847593 2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/445d8f80-987b-4470-a51d-f845b0944e71-tls-certs\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:09:29.847598 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.847604 2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-home\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:09:29.847817 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:29.847611 2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/445d8f80-987b-4470-a51d-f845b0944e71-dshm\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:09:30.652224 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:30.652188 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" Jul 14 22:09:30.652224 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:30.652219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb" event={"ID":"445d8f80-987b-4470-a51d-f845b0944e71","Type":"ContainerDied","Data":"0d9e9186e79aa3248973561aaa39ebe7b33e3d48e776a1497dd6cca312d86273"} Jul 14 22:09:30.652768 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:30.652270 2567 scope.go:117] "RemoveContainer" containerID="1b39bdd0881fb10d66abc61b3ce5ce3751001250d3e6d655a308a1e2663c95d9" Jul 14 22:09:30.671962 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:30.671935 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb"] Jul 14 22:09:30.678103 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:30.678081 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-5c6d83/test-model-5c6d83-kserve-686c598f5f-ww5rb"] Jul 14 22:09:31.850859 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:09:31.850828 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="445d8f80-987b-4470-a51d-f845b0944e71" path="/var/lib/kubelet/pods/445d8f80-987b-4470-a51d-f845b0944e71/volumes" Jul 14 22:10:02.320736 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:02.320681 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:10:06.092429 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:06.092390 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh"] Jul 14 22:10:06.092882 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:06.092664 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" containerID="cri-o://b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba" gracePeriod=30 Jul 14 22:10:11.333929 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.333905 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:10:11.403800 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.403722 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-token\") pod \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " Jul 14 22:10:11.403800 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.403771 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-podinfo\") pod \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " Jul 14 22:10:11.403966 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.403811 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-credential-socket\") pod \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " Jul 14 22:10:11.403966 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.403839 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-socket\") pod \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " Jul 14 22:10:11.403966 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.403896 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-data\") pod \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " Jul 14 22:10:11.403966 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.403928 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-envoy\") pod \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " Jul 14 22:10:11.403966 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.403951 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istiod-ca-cert\") pod \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " Jul 14 22:10:11.404205 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.404003 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8czl\" (UniqueName: \"kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-kube-api-access-m8czl\") pod \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " Jul 14 22:10:11.404205 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.404030 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-certs\") pod \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\" (UID: \"9e83912c-90c9-4923-ae49-4e7fdb3cbd13\") " Jul 14 22:10:11.404205 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.404187 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e83912c-90c9-4923-ae49-4e7fdb3cbd13" (UID: "9e83912c-90c9-4923-ae49-4e7fdb3cbd13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:10:11.404388 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.404284 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e83912c-90c9-4923-ae49-4e7fdb3cbd13" (UID: "9e83912c-90c9-4923-ae49-4e7fdb3cbd13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:10:11.404388 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.404354 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-credential-socket\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:11.404491 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.404472 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e83912c-90c9-4923-ae49-4e7fdb3cbd13" (UID: "9e83912c-90c9-4923-ae49-4e7fdb3cbd13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:10:11.404548 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.404399 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e83912c-90c9-4923-ae49-4e7fdb3cbd13" (UID: "9e83912c-90c9-4923-ae49-4e7fdb3cbd13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 22:10:11.404854 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.404825 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e83912c-90c9-4923-ae49-4e7fdb3cbd13" (UID: "9e83912c-90c9-4923-ae49-4e7fdb3cbd13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:10:11.406182 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.406155 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e83912c-90c9-4923-ae49-4e7fdb3cbd13" (UID: "9e83912c-90c9-4923-ae49-4e7fdb3cbd13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 22:10:11.406287 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.406214 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e83912c-90c9-4923-ae49-4e7fdb3cbd13" (UID: "9e83912c-90c9-4923-ae49-4e7fdb3cbd13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:10:11.406353 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.406314 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e83912c-90c9-4923-ae49-4e7fdb3cbd13" (UID: "9e83912c-90c9-4923-ae49-4e7fdb3cbd13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:10:11.406500 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.406482 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-kube-api-access-m8czl" (OuterVolumeSpecName: "kube-api-access-m8czl") pod "9e83912c-90c9-4923-ae49-4e7fdb3cbd13" (UID: "9e83912c-90c9-4923-ae49-4e7fdb3cbd13"). InnerVolumeSpecName "kube-api-access-m8czl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:10:11.505066 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.505028 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8czl\" (UniqueName: \"kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-kube-api-access-m8czl\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:11.505066 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.505060 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-certs\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:11.505066 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.505071 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-token\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:11.505283 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.505079 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-podinfo\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:11.505283 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.505087 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-workload-socket\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:11.505283 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.505094 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-data\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:11.505283 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.505101 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istio-envoy\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:11.505283 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.505108 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e83912c-90c9-4923-ae49-4e7fdb3cbd13-istiod-ca-cert\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:11.828081 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.828048 2567 generic.go:356] "Generic (PLEG): container finished" podID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerID="b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba" exitCode=0 Jul 14 22:10:11.828265 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.828104 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" Jul 14 22:10:11.828265 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.828133 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" event={"ID":"9e83912c-90c9-4923-ae49-4e7fdb3cbd13","Type":"ContainerDied","Data":"b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba"} Jul 14 22:10:11.828265 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.828221 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh" event={"ID":"9e83912c-90c9-4923-ae49-4e7fdb3cbd13","Type":"ContainerDied","Data":"096e158ca35cf035da0f0d1a275f66df8e3f98a3e0838edc1132a5e3e295567d"} Jul 14 22:10:11.828265 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.828252 2567 scope.go:117] "RemoveContainer" containerID="b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba" Jul 14 22:10:11.837393 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.837374 2567 scope.go:117] "RemoveContainer" containerID="eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940" Jul 14 22:10:11.845809 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.845793 2567 scope.go:117] "RemoveContainer" containerID="b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba" Jul 14 22:10:11.846075 ip-10-0-131-58 kubenswrapper[2567]: E0714 22:10:11.846054 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba\": container with ID starting with b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba not found: ID does not exist" containerID="b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba" Jul 14 22:10:11.846132 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.846086 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba"} err="failed to get container status \"b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba\": rpc error: code = NotFound desc = could not find container \"b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba\": container with ID starting with b2e11ed1f0c82f5c1ba214e199e258f83487db41613b984403d0c5e6c4e455ba not found: ID does not exist" Jul 14 22:10:11.846132 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.846107 2567 scope.go:117] "RemoveContainer" containerID="eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940" Jul 14 22:10:11.846391 ip-10-0-131-58 kubenswrapper[2567]: E0714 22:10:11.846365 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940\": container with ID starting with eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940 not found: ID does not exist" containerID="eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940" Jul 14 22:10:11.846486 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.846397 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940"} err="failed to get container status \"eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940\": rpc error: code = NotFound desc = could not find container \"eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940\": container with ID starting with eff0e5c9d1d976dd449fb29918b31c3f894c89aa8664c43d803845d0db197940 not found: ID does not exist" Jul 14 22:10:11.852059 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.852039 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh"] Jul 14 22:10:11.858028 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:11.858006 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5c6d83-openshift-default-65c4444cfc-hm7nh"] Jul 14 22:10:13.851938 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:13.851899 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" path="/var/lib/kubelet/pods/9e83912c-90c9-4923-ae49-4e7fdb3cbd13/volumes" Jul 14 22:10:15.218771 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.218733 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:10:15.293345 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.292885 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l"] Jul 14 22:10:15.294352 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.294011 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" Jul 14 22:10:15.294352 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.294036 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" Jul 14 22:10:15.294352 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.294074 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" Jul 14 22:10:15.294352 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.294085 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" Jul 14 22:10:15.294352 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.294108 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="445d8f80-987b-4470-a51d-f845b0944e71" containerName="main" Jul 14 22:10:15.294352 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.294116 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="445d8f80-987b-4470-a51d-f845b0944e71" containerName="main" Jul 14 22:10:15.294352 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.294250 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" Jul 14 22:10:15.294352 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.294262 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="445d8f80-987b-4470-a51d-f845b0944e71" containerName="main" Jul 14 22:10:15.294352 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.294273 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e83912c-90c9-4923-ae49-4e7fdb3cbd13" containerName="istio-proxy" Jul 14 22:10:15.300082 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.300056 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.303139 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.303052 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-912f37-openshift-default-dockercfg-6v9tm\"" Jul 14 22:10:15.305021 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.304997 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l"] Jul 14 22:10:15.436533 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.436488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-credential-socket\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.436735 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.436594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8pb\" (UniqueName: \"kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-kube-api-access-rl8pb\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.436735 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.436645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-istio-token\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.436735 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.436679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-envoy\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.436735 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.436710 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-data\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.436907 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.436753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-certs\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.436907 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.436794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-socket\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.436907 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.436816 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/875190cb-d926-450c-944b-29569ff9c32c-istiod-ca-cert\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.436907 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.436879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/875190cb-d926-450c-944b-29569ff9c32c-istio-podinfo\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537301 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537264 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/875190cb-d926-450c-944b-29569ff9c32c-istiod-ca-cert\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537507 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537313 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/875190cb-d926-450c-944b-29569ff9c32c-istio-podinfo\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537507 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-credential-socket\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537507 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537403 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8pb\" (UniqueName: \"kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-kube-api-access-rl8pb\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537507 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-istio-token\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537714 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-envoy\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537714 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-data\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537714 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-certs\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537714 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-socket\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537911 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537776 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-credential-socket\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.537985 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.537964 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-data\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.538063 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.538041 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-certs\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.538140 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.538091 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/875190cb-d926-450c-944b-29569ff9c32c-istiod-ca-cert\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.538197 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.538149 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-socket\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.539972 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.539948 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-envoy\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.540054 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.540022 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/875190cb-d926-450c-944b-29569ff9c32c-istio-podinfo\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.548348 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.548185 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-istio-token\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.548348 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.548290 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8pb\" (UniqueName: \"kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-kube-api-access-rl8pb\") pod \"e2e-api-b-912f37-openshift-default-75f766796f-6z75l\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.612914 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.612877 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:15.753198 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.753154 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l"] Jul 14 22:10:15.756636 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:10:15.756611 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875190cb_d926_450c_944b_29569ff9c32c.slice/crio-59fe9d39d531b26dd2ec7dd543d6669f1d955d12d55ccf68ef40f05baf3e309a WatchSource:0}: Error finding container 59fe9d39d531b26dd2ec7dd543d6669f1d955d12d55ccf68ef40f05baf3e309a: Status 404 returned error can't find the container with id 59fe9d39d531b26dd2ec7dd543d6669f1d955d12d55ccf68ef40f05baf3e309a Jul 14 22:10:15.758671 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.758632 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:10:15.758756 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.758703 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:10:15.758756 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.758735 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:10:15.852423 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.852391 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" event={"ID":"875190cb-d926-450c-944b-29569ff9c32c","Type":"ContainerStarted","Data":"6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7"} Jul 14 22:10:15.852614 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.852438 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" event={"ID":"875190cb-d926-450c-944b-29569ff9c32c","Type":"ContainerStarted","Data":"59fe9d39d531b26dd2ec7dd543d6669f1d955d12d55ccf68ef40f05baf3e309a"} Jul 14 22:10:15.875873 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:15.875806 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" podStartSLOduration=0.875785109 podStartE2EDuration="875.785109ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:10:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:10:15.872543623 +0000 UTC m=+1972.595050834" watchObservedRunningTime="2026-07-14 22:10:15.875785109 +0000 UTC m=+1972.598292293" Jul 14 22:10:16.613793 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:16.613756 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:16.618587 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:16.618563 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:16.854632 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:16.854596 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:16.855770 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:16.855748 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:28.908869 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:28.908831 2567 generic.go:356] "Generic (PLEG): container finished" podID="875190cb-d926-450c-944b-29569ff9c32c" containerID="6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7" exitCode=0 Jul 14 22:10:28.909289 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:28.908911 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" event={"ID":"875190cb-d926-450c-944b-29569ff9c32c","Type":"ContainerDied","Data":"6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7"} Jul 14 22:10:28.909350 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:28.909320 2567 scope.go:117] "RemoveContainer" containerID="6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7" Jul 14 22:10:28.910301 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:28.910273 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:10:28.910397 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:28.910363 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:10:28.910435 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:28.910397 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:10:29.017613 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:29.017577 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:10:29.914965 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:29.914928 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" event={"ID":"875190cb-d926-450c-944b-29569ff9c32c","Type":"ContainerStarted","Data":"5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e"} Jul 14 22:10:30.613941 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:30.613901 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:30.615065 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:30.615037 2567 patch_prober.go:28] interesting pod/e2e-api-b-912f37-openshift-default-75f766796f-6z75l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 14 22:10:30.615183 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:30.615089 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 14 22:10:31.613707 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:31.613670 2567 patch_prober.go:28] interesting pod/e2e-api-b-912f37-openshift-default-75f766796f-6z75l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 14 22:10:31.614095 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:31.613741 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 14 22:10:31.861042 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:31.861006 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:32.614083 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:32.614044 2567 patch_prober.go:28] interesting pod/e2e-api-b-912f37-openshift-default-75f766796f-6z75l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 14 22:10:32.614521 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:32.614104 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 14 22:10:33.688964 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:33.688918 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:33.692350 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:33.692311 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:40.807062 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:40.807024 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:10:45.585190 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:45.585159 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l"] Jul 14 22:10:45.585673 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:45.585409 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" containerID="cri-o://5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e" gracePeriod=30 Jul 14 22:10:48.691696 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:48.691657 2567 patch_prober.go:28] interesting pod/e2e-api-b-912f37-openshift-default-75f766796f-6z75l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 14 22:10:48.692141 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:48.691732 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 22:10:50.837581 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.837550 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:50.917218 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.917144 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-envoy\") pod \"875190cb-d926-450c-944b-29569ff9c32c\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " Jul 14 22:10:50.917218 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.917180 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/875190cb-d926-450c-944b-29569ff9c32c-istiod-ca-cert\") pod \"875190cb-d926-450c-944b-29569ff9c32c\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " Jul 14 22:10:50.917218 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.917200 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-istio-token\") pod \"875190cb-d926-450c-944b-29569ff9c32c\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " Jul 14 22:10:50.917464 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.917222 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-socket\") pod \"875190cb-d926-450c-944b-29569ff9c32c\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " Jul 14 22:10:50.917464 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.917246 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-certs\") pod \"875190cb-d926-450c-944b-29569ff9c32c\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " Jul 14 22:10:50.917597 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.917564 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "875190cb-d926-450c-944b-29569ff9c32c" (UID: "875190cb-d926-450c-944b-29569ff9c32c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:10:50.917674 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.917596 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "875190cb-d926-450c-944b-29569ff9c32c" (UID: "875190cb-d926-450c-944b-29569ff9c32c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:10:50.917674 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.917631 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/875190cb-d926-450c-944b-29569ff9c32c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "875190cb-d926-450c-944b-29569ff9c32c" (UID: "875190cb-d926-450c-944b-29569ff9c32c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 22:10:50.919858 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.919829 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "875190cb-d926-450c-944b-29569ff9c32c" (UID: "875190cb-d926-450c-944b-29569ff9c32c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:10:50.919964 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:50.919861 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-istio-token" (OuterVolumeSpecName: "istio-token") pod "875190cb-d926-450c-944b-29569ff9c32c" (UID: "875190cb-d926-450c-944b-29569ff9c32c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:10:51.006433 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.006401 2567 generic.go:356] "Generic (PLEG): container finished" podID="875190cb-d926-450c-944b-29569ff9c32c" containerID="5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e" exitCode=0 Jul 14 22:10:51.006617 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.006453 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" Jul 14 22:10:51.006617 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.006492 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" event={"ID":"875190cb-d926-450c-944b-29569ff9c32c","Type":"ContainerDied","Data":"5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e"} Jul 14 22:10:51.006617 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.006556 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l" event={"ID":"875190cb-d926-450c-944b-29569ff9c32c","Type":"ContainerDied","Data":"59fe9d39d531b26dd2ec7dd543d6669f1d955d12d55ccf68ef40f05baf3e309a"} Jul 14 22:10:51.006617 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.006586 2567 scope.go:117] "RemoveContainer" containerID="5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e" Jul 14 22:10:51.014854 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.014840 2567 scope.go:117] "RemoveContainer" containerID="6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7" Jul 14 22:10:51.017936 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.017919 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-credential-socket\") pod \"875190cb-d926-450c-944b-29569ff9c32c\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " Jul 14 22:10:51.018035 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.017949 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl8pb\" (UniqueName: \"kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-kube-api-access-rl8pb\") pod \"875190cb-d926-450c-944b-29569ff9c32c\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " Jul 14 22:10:51.018035 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.017970 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-data\") pod \"875190cb-d926-450c-944b-29569ff9c32c\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " Jul 14 22:10:51.018141 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.018035 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/875190cb-d926-450c-944b-29569ff9c32c-istio-podinfo\") pod \"875190cb-d926-450c-944b-29569ff9c32c\" (UID: \"875190cb-d926-450c-944b-29569ff9c32c\") " Jul 14 22:10:51.018230 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.018193 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "875190cb-d926-450c-944b-29569ff9c32c" (UID: "875190cb-d926-450c-944b-29569ff9c32c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:10:51.018293 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.018225 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-envoy\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:51.018293 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.018244 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/875190cb-d926-450c-944b-29569ff9c32c-istiod-ca-cert\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:51.018293 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.018257 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-istio-token\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:51.018293 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.018271 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-socket\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:51.018293 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.018283 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-workload-certs\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:51.018818 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.018799 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-data" (OuterVolumeSpecName: "istio-data") pod "875190cb-d926-450c-944b-29569ff9c32c" (UID: "875190cb-d926-450c-944b-29569ff9c32c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:10:51.020033 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.020009 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-kube-api-access-rl8pb" (OuterVolumeSpecName: "kube-api-access-rl8pb") pod "875190cb-d926-450c-944b-29569ff9c32c" (UID: "875190cb-d926-450c-944b-29569ff9c32c"). InnerVolumeSpecName "kube-api-access-rl8pb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:10:51.020138 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.020091 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/875190cb-d926-450c-944b-29569ff9c32c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "875190cb-d926-450c-944b-29569ff9c32c" (UID: "875190cb-d926-450c-944b-29569ff9c32c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 22:10:51.022601 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.022582 2567 scope.go:117] "RemoveContainer" containerID="5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e" Jul 14 22:10:51.022850 ip-10-0-131-58 kubenswrapper[2567]: E0714 22:10:51.022825 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e\": container with ID starting with 5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e not found: ID does not exist" containerID="5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e" Jul 14 22:10:51.022895 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.022859 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e"} err="failed to get container status \"5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e\": rpc error: code = NotFound desc = could not find container \"5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e\": container with ID starting with 5320f8d7028cf8bf6e72a1487b1d89999b759ddb768a44762b81ed3441cfc29e not found: ID does not exist" Jul 14 22:10:51.022895 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.022875 2567 scope.go:117] "RemoveContainer" containerID="6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7" Jul 14 22:10:51.023100 ip-10-0-131-58 kubenswrapper[2567]: E0714 22:10:51.023083 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7\": container with ID starting with 6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7 not found: ID does not exist" containerID="6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7" Jul 14 22:10:51.023152 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.023106 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7"} err="failed to get container status \"6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7\": rpc error: code = NotFound desc = could not find container \"6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7\": container with ID starting with 6a1b935a11110d6105f3722406c52cf25af9148adb5564232dac8d94741bc5e7 not found: ID does not exist" Jul 14 22:10:51.119539 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.119501 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-credential-socket\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:51.119539 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.119530 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl8pb\" (UniqueName: \"kubernetes.io/projected/875190cb-d926-450c-944b-29569ff9c32c-kube-api-access-rl8pb\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:51.119539 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.119540 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/875190cb-d926-450c-944b-29569ff9c32c-istio-data\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:51.119539 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.119549 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/875190cb-d926-450c-944b-29569ff9c32c-istio-podinfo\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:10:51.328668 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.328636 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l"] Jul 14 22:10:51.333619 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.333595 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-912f37-openshift-default-75f766796f-6z75l"] Jul 14 22:10:51.850847 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:51.850814 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="875190cb-d926-450c-944b-29569ff9c32c" path="/var/lib/kubelet/pods/875190cb-d926-450c-944b-29569ff9c32c/volumes" Jul 14 22:10:54.216712 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.216681 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:10:54.388540 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.388508 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn"] Jul 14 22:10:54.388813 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.388799 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" Jul 14 22:10:54.388856 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.388816 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" Jul 14 22:10:54.388856 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.388832 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" Jul 14 22:10:54.388856 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.388841 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" Jul 14 22:10:54.388985 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.388916 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" Jul 14 22:10:54.388985 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.388928 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="875190cb-d926-450c-944b-29569ff9c32c" containerName="istio-proxy" Jul 14 22:10:54.391792 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.391763 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.394776 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.394752 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e98c02-openshift-default-dockercfg-466tg\"" Jul 14 22:10:54.404445 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.404423 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn"] Jul 14 22:10:54.448462 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.448414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-credential-socket\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.448605 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.448475 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-istio-token\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.448605 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.448511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-data\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.448605 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.448555 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-socket\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.448737 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.448625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89bed26c-e97f-432c-9784-b81420a06efd-istio-podinfo\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.448737 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.448680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-envoy\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.448737 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.448724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-certs\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.448836 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.448748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89bed26c-e97f-432c-9784-b81420a06efd-istiod-ca-cert\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.448836 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.448763 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9bwb\" (UniqueName: \"kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-kube-api-access-w9bwb\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.549408 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.549363 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-envoy\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.549577 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.549425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-certs\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.549577 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.549457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89bed26c-e97f-432c-9784-b81420a06efd-istiod-ca-cert\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.549577 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.549485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9bwb\" (UniqueName: \"kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-kube-api-access-w9bwb\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.550134 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.549791 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-credential-socket\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.550254 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.550171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-istio-token\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.550254 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.549884 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-certs\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.550254 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.550219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-data\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.550473 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.550277 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89bed26c-e97f-432c-9784-b81420a06efd-istiod-ca-cert\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.550473 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.550288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-socket\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.550473 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.550092 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-credential-socket\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.550473 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.550386 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89bed26c-e97f-432c-9784-b81420a06efd-istio-podinfo\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.550473 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.550462 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-data\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.550684 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.550555 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-socket\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.552082 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.552047 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-envoy\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.552752 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.552735 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89bed26c-e97f-432c-9784-b81420a06efd-istio-podinfo\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.561674 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.561652 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9bwb\" (UniqueName: \"kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-kube-api-access-w9bwb\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.561996 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.561979 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-istio-token\") pod \"e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.702087 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.702050 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:54.834115 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.834087 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn"] Jul 14 22:10:54.835949 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:10:54.835914 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89bed26c_e97f_432c_9784_b81420a06efd.slice/crio-708c69a014bd2ee97d747e43b0d0179fdc2cc90077fcb63ab51c9e45ace2f668 WatchSource:0}: Error finding container 708c69a014bd2ee97d747e43b0d0179fdc2cc90077fcb63ab51c9e45ace2f668: Status 404 returned error can't find the container with id 708c69a014bd2ee97d747e43b0d0179fdc2cc90077fcb63ab51c9e45ace2f668 Jul 14 22:10:54.838036 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.838006 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:10:54.838148 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.838110 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:10:54.838211 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:54.838158 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:10:55.026633 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:55.026600 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" event={"ID":"89bed26c-e97f-432c-9784-b81420a06efd","Type":"ContainerStarted","Data":"551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed"} Jul 14 22:10:55.026813 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:55.026661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" event={"ID":"89bed26c-e97f-432c-9784-b81420a06efd","Type":"ContainerStarted","Data":"708c69a014bd2ee97d747e43b0d0179fdc2cc90077fcb63ab51c9e45ace2f668"} Jul 14 22:10:55.049268 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:55.049213 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" podStartSLOduration=1.049191017 podStartE2EDuration="1.049191017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:10:55.047620376 +0000 UTC m=+2011.770127558" watchObservedRunningTime="2026-07-14 22:10:55.049191017 +0000 UTC m=+2011.771698199" Jul 14 22:10:55.702340 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:55.702294 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:55.707047 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:55.707022 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:56.031464 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:56.031437 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:10:56.032441 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:10:56.032421 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:11:03.208179 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:03.208144 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:11:11.033161 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:11.033122 2567 patch_prober.go:28] interesting pod/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 14 22:11:11.033611 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:11.033190 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 14 22:11:11.103065 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:11.103034 2567 generic.go:356] "Generic (PLEG): container finished" podID="89bed26c-e97f-432c-9784-b81420a06efd" containerID="551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed" exitCode=0 Jul 14 22:11:11.103237 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:11.103074 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" event={"ID":"89bed26c-e97f-432c-9784-b81420a06efd","Type":"ContainerDied","Data":"551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed"} Jul 14 22:11:11.103462 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:11.103447 2567 scope.go:117] "RemoveContainer" containerID="551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed" Jul 14 22:11:11.104516 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:11.104484 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:11:11.104589 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:11.104572 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:11:11.104624 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:11.104613 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 14 22:11:12.109070 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:12.109031 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" event={"ID":"89bed26c-e97f-432c-9784-b81420a06efd","Type":"ContainerStarted","Data":"ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f"} Jul 14 22:11:12.702649 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:12.702616 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:11:12.702866 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:12.702844 2567 patch_prober.go:28] interesting pod/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 14 22:11:12.702910 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:12.702892 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 14 22:11:13.702669 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:13.702634 2567 patch_prober.go:28] interesting pod/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 14 22:11:13.703015 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:13.702691 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 14 22:11:14.703043 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:14.703005 2567 patch_prober.go:28] interesting pod/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 14 22:11:14.703458 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:14.703063 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 14 22:11:15.702930 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:15.702896 2567 patch_prober.go:28] interesting pod/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 14 22:11:15.703119 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:15.702951 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 14 22:11:16.706366 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:16.706312 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:11:16.706751 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:16.706709 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:11:16.707410 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:16.707391 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:11:25.502094 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:25.502064 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:11:51.086930 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.086897 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs"] Jul 14 22:11:51.090377 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.090357 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.093767 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.093745 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e98c02\"/\"kube-root-ca.crt\"" Jul 14 22:11:51.093892 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.093846 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e98c02\"/\"openshift-service-ca.crt\"" Jul 14 22:11:51.093892 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.093864 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e98c02\"/\"auth-test-model-e98c02-kserve-self-signed-certs\"" Jul 14 22:11:51.093892 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.093854 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e98c02\"/\"default-dockercfg-m8b29\"" Jul 14 22:11:51.101284 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.101260 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs"] Jul 14 22:11:51.118508 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.118484 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-dshm\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.118614 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.118520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tmp-dir\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.118614 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.118576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p9xj\" (UniqueName: \"kubernetes.io/projected/a339d8e0-b089-489e-a4fc-e5bccf9e8588-kube-api-access-7p9xj\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.118614 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.118610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-home\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.118750 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.118628 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tls-certs\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.118750 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.118650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-model-cache\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.219606 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.219568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-dshm\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.219606 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.219611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tmp-dir\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.219852 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.219652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p9xj\" (UniqueName: \"kubernetes.io/projected/a339d8e0-b089-489e-a4fc-e5bccf9e8588-kube-api-access-7p9xj\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.219852 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.219693 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-home\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.219852 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.219712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tls-certs\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.219852 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.219734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-model-cache\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.220122 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.220098 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tmp-dir\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.220189 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.220143 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-home\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.220231 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.220187 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-model-cache\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.221970 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.221953 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-dshm\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.222136 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.222122 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tls-certs\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.230104 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.230075 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p9xj\" (UniqueName: \"kubernetes.io/projected/a339d8e0-b089-489e-a4fc-e5bccf9e8588-kube-api-access-7p9xj\") pod \"auth-test-model-e98c02-kserve-5bf86945b7-cncxs\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.400006 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.399917 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:11:51.531967 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:51.531942 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs"] Jul 14 22:11:51.534061 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:11:51.534033 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda339d8e0_b089_489e_a4fc_e5bccf9e8588.slice/crio-ea73750b16af5665b9ad14241f1dd97470996ebfc4abb30f42c01ae15b7e3899 WatchSource:0}: Error finding container ea73750b16af5665b9ad14241f1dd97470996ebfc4abb30f42c01ae15b7e3899: Status 404 returned error can't find the container with id ea73750b16af5665b9ad14241f1dd97470996ebfc4abb30f42c01ae15b7e3899 Jul 14 22:11:52.287450 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:52.287417 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" event={"ID":"a339d8e0-b089-489e-a4fc-e5bccf9e8588","Type":"ContainerStarted","Data":"01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227"} Jul 14 22:11:52.287884 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:52.287459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" event={"ID":"a339d8e0-b089-489e-a4fc-e5bccf9e8588","Type":"ContainerStarted","Data":"ea73750b16af5665b9ad14241f1dd97470996ebfc4abb30f42c01ae15b7e3899"} Jul 14 22:11:52.312243 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:52.312199 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" podStartSLOduration=1.312184233 podStartE2EDuration="1.312184233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:11:52.310640958 +0000 UTC m=+2069.033148141" watchObservedRunningTime="2026-07-14 22:11:52.312184233 +0000 UTC m=+2069.034691414" Jul 14 22:11:54.609069 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:11:54.609033 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:12:01.400209 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:12:01.400176 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:12:01.400658 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:12:01.400223 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:12:01.417668 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:12:01.417639 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:12:02.341056 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:12:02.341027 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:12:13.415394 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:12:13.415360 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:12:23.859223 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:12:23.859195 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 22:12:23.862277 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:12:23.862255 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 22:12:30.118494 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:12:30.118460 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:12:45.222809 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:12:45.222769 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:13:02.132162 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:13:02.132125 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:13:17.717914 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:13:17.717831 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:13:31.319490 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:13:31.319453 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:13:46.125459 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:13:46.125427 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:13:52.810312 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:13:52.810281 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs"] Jul 14 22:14:03.131204 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:03.131169 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:14:07.830058 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:07.829997 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" podUID="a339d8e0-b089-489e-a4fc-e5bccf9e8588" containerName="main" containerID="cri-o://01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227" gracePeriod=45 Jul 14 22:14:08.071055 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.071025 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:14:08.171666 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.171567 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-dshm\") pod \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " Jul 14 22:14:08.171666 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.171621 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tls-certs\") pod \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " Jul 14 22:14:08.171666 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.171639 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-model-cache\") pod \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " Jul 14 22:14:08.171941 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.171675 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tmp-dir\") pod \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " Jul 14 22:14:08.171941 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.171722 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-home\") pod \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " Jul 14 22:14:08.171941 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.171748 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p9xj\" (UniqueName: \"kubernetes.io/projected/a339d8e0-b089-489e-a4fc-e5bccf9e8588-kube-api-access-7p9xj\") pod \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\" (UID: \"a339d8e0-b089-489e-a4fc-e5bccf9e8588\") " Jul 14 22:14:08.171941 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.171906 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-model-cache" (OuterVolumeSpecName: "model-cache") pod "a339d8e0-b089-489e-a4fc-e5bccf9e8588" (UID: "a339d8e0-b089-489e-a4fc-e5bccf9e8588"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:14:08.172149 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.172038 2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-model-cache\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:14:08.172203 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.172147 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a339d8e0-b089-489e-a4fc-e5bccf9e8588" (UID: "a339d8e0-b089-489e-a4fc-e5bccf9e8588"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:14:08.172256 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.172226 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-home" (OuterVolumeSpecName: "home") pod "a339d8e0-b089-489e-a4fc-e5bccf9e8588" (UID: "a339d8e0-b089-489e-a4fc-e5bccf9e8588"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:14:08.174036 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.174005 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a339d8e0-b089-489e-a4fc-e5bccf9e8588" (UID: "a339d8e0-b089-489e-a4fc-e5bccf9e8588"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 22:14:08.174170 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.174038 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a339d8e0-b089-489e-a4fc-e5bccf9e8588-kube-api-access-7p9xj" (OuterVolumeSpecName: "kube-api-access-7p9xj") pod "a339d8e0-b089-489e-a4fc-e5bccf9e8588" (UID: "a339d8e0-b089-489e-a4fc-e5bccf9e8588"). InnerVolumeSpecName "kube-api-access-7p9xj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:14:08.174170 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.174092 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-dshm" (OuterVolumeSpecName: "dshm") pod "a339d8e0-b089-489e-a4fc-e5bccf9e8588" (UID: "a339d8e0-b089-489e-a4fc-e5bccf9e8588"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:14:08.272840 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.272796 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p9xj\" (UniqueName: \"kubernetes.io/projected/a339d8e0-b089-489e-a4fc-e5bccf9e8588-kube-api-access-7p9xj\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:14:08.272840 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.272832 2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-dshm\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:14:08.272840 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.272845 2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tls-certs\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:14:08.273076 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.272857 2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-tmp-dir\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:14:08.273076 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.272868 2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a339d8e0-b089-489e-a4fc-e5bccf9e8588-home\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:14:08.879732 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.879701 2567 generic.go:356] "Generic (PLEG): container finished" podID="a339d8e0-b089-489e-a4fc-e5bccf9e8588" containerID="01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227" exitCode=0 Jul 14 22:14:08.880163 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.879737 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" event={"ID":"a339d8e0-b089-489e-a4fc-e5bccf9e8588","Type":"ContainerDied","Data":"01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227"} Jul 14 22:14:08.880163 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.879743 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" Jul 14 22:14:08.880163 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.879764 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs" event={"ID":"a339d8e0-b089-489e-a4fc-e5bccf9e8588","Type":"ContainerDied","Data":"ea73750b16af5665b9ad14241f1dd97470996ebfc4abb30f42c01ae15b7e3899"} Jul 14 22:14:08.880163 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.879786 2567 scope.go:117] "RemoveContainer" containerID="01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227" Jul 14 22:14:08.889025 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.889003 2567 scope.go:117] "RemoveContainer" containerID="01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227" Jul 14 22:14:08.889361 ip-10-0-131-58 kubenswrapper[2567]: E0714 22:14:08.889337 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227\": container with ID starting with 01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227 not found: ID does not exist" containerID="01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227" Jul 14 22:14:08.889478 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.889369 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227"} err="failed to get container status \"01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227\": rpc error: code = NotFound desc = could not find container \"01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227\": container with ID starting with 01b58fef462cd12181b0e3ffa48d39059e43dc6b07e8bb591663f9f9cc238227 not found: ID does not exist" Jul 14 22:14:08.908135 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.908105 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs"] Jul 14 22:14:08.914181 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:08.914159 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/auth-test-model-e98c02-kserve-5bf86945b7-cncxs"] Jul 14 22:14:09.851111 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:09.851069 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a339d8e0-b089-489e-a4fc-e5bccf9e8588" path="/var/lib/kubelet/pods/a339d8e0-b089-489e-a4fc-e5bccf9e8588/volumes" Jul 14 22:14:30.304150 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:30.304113 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:14:55.520080 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:14:55.519996 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:15:00.134091 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.134041 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb"] Jul 14 22:15:00.134534 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.134479 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a339d8e0-b089-489e-a4fc-e5bccf9e8588" containerName="main" Jul 14 22:15:00.134534 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.134495 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a339d8e0-b089-489e-a4fc-e5bccf9e8588" containerName="main" Jul 14 22:15:00.134605 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.134578 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a339d8e0-b089-489e-a4fc-e5bccf9e8588" containerName="main" Jul 14 22:15:00.137545 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.137527 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb"] Jul 14 22:15:00.137666 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.137646 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb" Jul 14 22:15:00.140466 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.140445 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-s6ht2\"" Jul 14 22:15:00.140710 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.140693 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29734455-gk6gb"] Jul 14 22:15:00.140796 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.140784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb" Jul 14 22:15:00.143846 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.143826 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734455-gk6gb" Jul 14 22:15:00.150287 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.150261 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb"] Jul 14 22:15:00.150890 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.150872 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb"] Jul 14 22:15:00.152404 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.152387 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29734455-gk6gb"] Jul 14 22:15:00.189227 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.189183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bz7b\" (UniqueName: \"kubernetes.io/projected/c401c2be-8951-47b7-818e-dd7344eff27b-kube-api-access-9bz7b\") pod \"maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb\" (UID: \"c401c2be-8951-47b7-818e-dd7344eff27b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb" Jul 14 22:15:00.289890 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.289851 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ltc2\" (UniqueName: \"kubernetes.io/projected/5b34ffc5-f518-44b9-80d1-fd93c0bb1397-kube-api-access-5ltc2\") pod \"maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb\" (UID: \"5b34ffc5-f518-44b9-80d1-fd93c0bb1397\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb" Jul 14 22:15:00.290065 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.289901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bz7b\" (UniqueName: \"kubernetes.io/projected/c401c2be-8951-47b7-818e-dd7344eff27b-kube-api-access-9bz7b\") pod \"maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb\" (UID: \"c401c2be-8951-47b7-818e-dd7344eff27b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb" Jul 14 22:15:00.290065 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.289991 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cq6p\" (UniqueName: \"kubernetes.io/projected/b954298b-1254-4c7f-a764-531092b3ec99-kube-api-access-5cq6p\") pod \"maas-api-key-cleanup-29734455-gk6gb\" (UID: \"b954298b-1254-4c7f-a764-531092b3ec99\") " pod="opendatahub/maas-api-key-cleanup-29734455-gk6gb" Jul 14 22:15:00.299473 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.299439 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bz7b\" (UniqueName: \"kubernetes.io/projected/c401c2be-8951-47b7-818e-dd7344eff27b-kube-api-access-9bz7b\") pod \"maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb\" (UID: \"c401c2be-8951-47b7-818e-dd7344eff27b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb" Jul 14 22:15:00.391029 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.390941 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ltc2\" (UniqueName: \"kubernetes.io/projected/5b34ffc5-f518-44b9-80d1-fd93c0bb1397-kube-api-access-5ltc2\") pod \"maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb\" (UID: \"5b34ffc5-f518-44b9-80d1-fd93c0bb1397\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb" Jul 14 22:15:00.391029 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.390994 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cq6p\" (UniqueName: \"kubernetes.io/projected/b954298b-1254-4c7f-a764-531092b3ec99-kube-api-access-5cq6p\") pod \"maas-api-key-cleanup-29734455-gk6gb\" (UID: \"b954298b-1254-4c7f-a764-531092b3ec99\") " pod="opendatahub/maas-api-key-cleanup-29734455-gk6gb" Jul 14 22:15:00.400155 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.400129 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ltc2\" (UniqueName: \"kubernetes.io/projected/5b34ffc5-f518-44b9-80d1-fd93c0bb1397-kube-api-access-5ltc2\") pod \"maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb\" (UID: \"5b34ffc5-f518-44b9-80d1-fd93c0bb1397\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb" Jul 14 22:15:00.400244 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.400155 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cq6p\" (UniqueName: \"kubernetes.io/projected/b954298b-1254-4c7f-a764-531092b3ec99-kube-api-access-5cq6p\") pod \"maas-api-key-cleanup-29734455-gk6gb\" (UID: \"b954298b-1254-4c7f-a764-531092b3ec99\") " pod="opendatahub/maas-api-key-cleanup-29734455-gk6gb" Jul 14 22:15:00.450900 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.450865 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb" Jul 14 22:15:00.463139 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.463059 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb" Jul 14 22:15:00.470141 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.470102 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734455-gk6gb" Jul 14 22:15:00.821912 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.821883 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb"] Jul 14 22:15:00.824406 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:15:00.824376 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc401c2be_8951_47b7_818e_dd7344eff27b.slice/crio-beeed233b76eadb11b4476413e46d45b8ae05838dade52a63fd84f6fd6b57ef0 WatchSource:0}: Error finding container beeed233b76eadb11b4476413e46d45b8ae05838dade52a63fd84f6fd6b57ef0: Status 404 returned error can't find the container with id beeed233b76eadb11b4476413e46d45b8ae05838dade52a63fd84f6fd6b57ef0 Jul 14 22:15:00.846620 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.846592 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb"] Jul 14 22:15:00.848611 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:00.848591 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29734455-gk6gb"] Jul 14 22:15:00.854618 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:15:00.854552 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b34ffc5_f518_44b9_80d1_fd93c0bb1397.slice/crio-94b2ea8b1477cebfb5b1d3134b8bbc8f08d4953f5149f7b6686458d8325e322e WatchSource:0}: Error finding container 94b2ea8b1477cebfb5b1d3134b8bbc8f08d4953f5149f7b6686458d8325e322e: Status 404 returned error can't find the container with id 94b2ea8b1477cebfb5b1d3134b8bbc8f08d4953f5149f7b6686458d8325e322e Jul 14 22:15:00.854864 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:15:00.854844 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb954298b_1254_4c7f_a764_531092b3ec99.slice/crio-1e09fcb1ec7bcd7e4993a936b434b6a1fd771839edc2d6c36698aa735413196d WatchSource:0}: Error finding container 1e09fcb1ec7bcd7e4993a936b434b6a1fd771839edc2d6c36698aa735413196d: Status 404 returned error can't find the container with id 1e09fcb1ec7bcd7e4993a936b434b6a1fd771839edc2d6c36698aa735413196d Jul 14 22:15:01.108061 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:01.107971 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734455-gk6gb" event={"ID":"b954298b-1254-4c7f-a764-531092b3ec99","Type":"ContainerStarted","Data":"1e09fcb1ec7bcd7e4993a936b434b6a1fd771839edc2d6c36698aa735413196d"} Jul 14 22:15:01.109123 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:01.109095 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb" event={"ID":"5b34ffc5-f518-44b9-80d1-fd93c0bb1397","Type":"ContainerStarted","Data":"94b2ea8b1477cebfb5b1d3134b8bbc8f08d4953f5149f7b6686458d8325e322e"} Jul 14 22:15:01.110203 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:01.110182 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb" event={"ID":"c401c2be-8951-47b7-818e-dd7344eff27b","Type":"ContainerStarted","Data":"beeed233b76eadb11b4476413e46d45b8ae05838dade52a63fd84f6fd6b57ef0"} Jul 14 22:15:02.116777 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:02.116743 2567 generic.go:356] "Generic (PLEG): container finished" podID="5b34ffc5-f518-44b9-80d1-fd93c0bb1397" containerID="f4e1e28af4c60e21d54e7acb196eb098e0eb2f53f7d3dce77d15af3eb39414f8" exitCode=0 Jul 14 22:15:02.117252 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:02.116821 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb" event={"ID":"5b34ffc5-f518-44b9-80d1-fd93c0bb1397","Type":"ContainerDied","Data":"f4e1e28af4c60e21d54e7acb196eb098e0eb2f53f7d3dce77d15af3eb39414f8"} Jul 14 22:15:02.118354 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:02.118333 2567 generic.go:356] "Generic (PLEG): container finished" podID="c401c2be-8951-47b7-818e-dd7344eff27b" containerID="2bb60365946f42e9a8f5a1d42cbad28e4c34375bebb37a263d9fd3f2afd9a622" exitCode=0 Jul 14 22:15:02.118442 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:02.118403 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb" event={"ID":"c401c2be-8951-47b7-818e-dd7344eff27b","Type":"ContainerDied","Data":"2bb60365946f42e9a8f5a1d42cbad28e4c34375bebb37a263d9fd3f2afd9a622"} Jul 14 22:15:02.119760 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:02.119739 2567 generic.go:356] "Generic (PLEG): container finished" podID="b954298b-1254-4c7f-a764-531092b3ec99" containerID="7b7361cdbb4135b6dc45d91155d6a83c364d2bb8117100ada7f63bd604683e73" exitCode=0 Jul 14 22:15:02.119844 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:02.119790 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734455-gk6gb" event={"ID":"b954298b-1254-4c7f-a764-531092b3ec99","Type":"ContainerDied","Data":"7b7361cdbb4135b6dc45d91155d6a83c364d2bb8117100ada7f63bd604683e73"} Jul 14 22:15:03.260947 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.260917 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb" Jul 14 22:15:03.303853 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.303830 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734455-gk6gb" Jul 14 22:15:03.306485 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.306463 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb" Jul 14 22:15:03.312374 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.312351 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bz7b\" (UniqueName: \"kubernetes.io/projected/c401c2be-8951-47b7-818e-dd7344eff27b-kube-api-access-9bz7b\") pod \"c401c2be-8951-47b7-818e-dd7344eff27b\" (UID: \"c401c2be-8951-47b7-818e-dd7344eff27b\") " Jul 14 22:15:03.314270 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.314247 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c401c2be-8951-47b7-818e-dd7344eff27b-kube-api-access-9bz7b" (OuterVolumeSpecName: "kube-api-access-9bz7b") pod "c401c2be-8951-47b7-818e-dd7344eff27b" (UID: "c401c2be-8951-47b7-818e-dd7344eff27b"). InnerVolumeSpecName "kube-api-access-9bz7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:15:03.412910 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.412812 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ltc2\" (UniqueName: \"kubernetes.io/projected/5b34ffc5-f518-44b9-80d1-fd93c0bb1397-kube-api-access-5ltc2\") pod \"5b34ffc5-f518-44b9-80d1-fd93c0bb1397\" (UID: \"5b34ffc5-f518-44b9-80d1-fd93c0bb1397\") " Jul 14 22:15:03.412910 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.412854 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cq6p\" (UniqueName: \"kubernetes.io/projected/b954298b-1254-4c7f-a764-531092b3ec99-kube-api-access-5cq6p\") pod \"b954298b-1254-4c7f-a764-531092b3ec99\" (UID: \"b954298b-1254-4c7f-a764-531092b3ec99\") " Jul 14 22:15:03.413086 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.413006 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bz7b\" (UniqueName: \"kubernetes.io/projected/c401c2be-8951-47b7-818e-dd7344eff27b-kube-api-access-9bz7b\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:15:03.414894 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.414870 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b34ffc5-f518-44b9-80d1-fd93c0bb1397-kube-api-access-5ltc2" (OuterVolumeSpecName: "kube-api-access-5ltc2") pod "5b34ffc5-f518-44b9-80d1-fd93c0bb1397" (UID: "5b34ffc5-f518-44b9-80d1-fd93c0bb1397"). InnerVolumeSpecName "kube-api-access-5ltc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:15:03.414957 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.414899 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b954298b-1254-4c7f-a764-531092b3ec99-kube-api-access-5cq6p" (OuterVolumeSpecName: "kube-api-access-5cq6p") pod "b954298b-1254-4c7f-a764-531092b3ec99" (UID: "b954298b-1254-4c7f-a764-531092b3ec99"). InnerVolumeSpecName "kube-api-access-5cq6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:15:03.514114 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.514079 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ltc2\" (UniqueName: \"kubernetes.io/projected/5b34ffc5-f518-44b9-80d1-fd93c0bb1397-kube-api-access-5ltc2\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:15:03.514114 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:03.514109 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cq6p\" (UniqueName: \"kubernetes.io/projected/b954298b-1254-4c7f-a764-531092b3ec99-kube-api-access-5cq6p\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:15:04.130461 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:04.130378 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb" Jul 14 22:15:04.130615 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:04.130379 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb" event={"ID":"5b34ffc5-f518-44b9-80d1-fd93c0bb1397","Type":"ContainerDied","Data":"94b2ea8b1477cebfb5b1d3134b8bbc8f08d4953f5149f7b6686458d8325e322e"} Jul 14 22:15:04.130615 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:04.130512 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94b2ea8b1477cebfb5b1d3134b8bbc8f08d4953f5149f7b6686458d8325e322e" Jul 14 22:15:04.131695 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:04.131669 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb" Jul 14 22:15:04.131796 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:04.131691 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb" event={"ID":"c401c2be-8951-47b7-818e-dd7344eff27b","Type":"ContainerDied","Data":"beeed233b76eadb11b4476413e46d45b8ae05838dade52a63fd84f6fd6b57ef0"} Jul 14 22:15:04.131796 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:04.131731 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="beeed233b76eadb11b4476413e46d45b8ae05838dade52a63fd84f6fd6b57ef0" Jul 14 22:15:04.133080 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:04.133065 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734455-gk6gb" Jul 14 22:15:04.133170 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:04.133083 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734455-gk6gb" event={"ID":"b954298b-1254-4c7f-a764-531092b3ec99","Type":"ContainerDied","Data":"1e09fcb1ec7bcd7e4993a936b434b6a1fd771839edc2d6c36698aa735413196d"} Jul 14 22:15:04.133170 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:04.133123 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e09fcb1ec7bcd7e4993a936b434b6a1fd771839edc2d6c36698aa735413196d" Jul 14 22:15:12.617227 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:12.617189 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:15:29.318150 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:29.318108 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:15:54.993775 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.993741 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk"] Jul 14 22:15:54.994126 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.994058 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b954298b-1254-4c7f-a764-531092b3ec99" containerName="cleanup" Jul 14 22:15:54.994126 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.994070 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b954298b-1254-4c7f-a764-531092b3ec99" containerName="cleanup" Jul 14 22:15:54.994126 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.994087 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b34ffc5-f518-44b9-80d1-fd93c0bb1397" containerName="cleanup" Jul 14 22:15:54.994126 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.994093 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b34ffc5-f518-44b9-80d1-fd93c0bb1397" containerName="cleanup" Jul 14 22:15:54.994126 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.994104 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c401c2be-8951-47b7-818e-dd7344eff27b" containerName="cleanup" Jul 14 22:15:54.994126 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.994110 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c401c2be-8951-47b7-818e-dd7344eff27b" containerName="cleanup" Jul 14 22:15:54.994309 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.994164 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c401c2be-8951-47b7-818e-dd7344eff27b" containerName="cleanup" Jul 14 22:15:54.994309 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.994171 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b34ffc5-f518-44b9-80d1-fd93c0bb1397" containerName="cleanup" Jul 14 22:15:54.994309 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.994177 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b954298b-1254-4c7f-a764-531092b3ec99" containerName="cleanup" Jul 14 22:15:54.997291 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:54.997270 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.000894 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.000869 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e98c02\"/\"default-dockercfg-m8b29\"" Jul 14 22:15:55.001019 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.000911 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e98c02\"/\"kube-root-ca.crt\"" Jul 14 22:15:55.001019 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.000945 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e98c02\"/\"openshift-service-ca.crt\"" Jul 14 22:15:55.001019 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.000911 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e98c02\"/\"rate-test-model-e98c02-kserve-self-signed-certs\"" Jul 14 22:15:55.008577 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.008549 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk"] Jul 14 22:15:55.145705 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.145185 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tls-certs\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.145705 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.145269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-model-cache\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.145705 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.145311 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-home\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.145705 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.145380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tmp-dir\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.145705 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.145406 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-dshm\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.145705 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.145435 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8xnk\" (UniqueName: \"kubernetes.io/projected/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-kube-api-access-x8xnk\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.246934 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.246837 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-model-cache\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.246934 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.246902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-home\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.247173 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.246946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tmp-dir\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.247173 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.246971 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-dshm\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.247173 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.246999 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8xnk\" (UniqueName: \"kubernetes.io/projected/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-kube-api-access-x8xnk\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.247173 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.247057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tls-certs\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.247399 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.247305 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-model-cache\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.247399 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.247370 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-home\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.247563 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.247540 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tmp-dir\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.249843 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.249820 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-dshm\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.250078 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.250062 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tls-certs\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.256579 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.256560 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8xnk\" (UniqueName: \"kubernetes.io/projected/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-kube-api-access-x8xnk\") pod \"rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.307572 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.307537 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:15:55.440969 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:55.440944 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk"] Jul 14 22:15:55.443369 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:15:55.443336 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ebadd08_fcb3_4ff7_b1d0_9f0ed899ed9a.slice/crio-2bf0e1ba7cc4930b4c81b638c2da540fe1d617f427578b2f7c82b53df8f6528a WatchSource:0}: Error finding container 2bf0e1ba7cc4930b4c81b638c2da540fe1d617f427578b2f7c82b53df8f6528a: Status 404 returned error can't find the container with id 2bf0e1ba7cc4930b4c81b638c2da540fe1d617f427578b2f7c82b53df8f6528a Jul 14 22:15:56.382448 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:56.382404 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" event={"ID":"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a","Type":"ContainerStarted","Data":"0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8"} Jul 14 22:15:56.382448 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:56.382450 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" event={"ID":"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a","Type":"ContainerStarted","Data":"2bf0e1ba7cc4930b4c81b638c2da540fe1d617f427578b2f7c82b53df8f6528a"} Jul 14 22:15:56.405064 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:56.405014 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" podStartSLOduration=2.40500133 podStartE2EDuration="2.40500133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:15:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:15:56.404476659 +0000 UTC m=+2313.126983840" watchObservedRunningTime="2026-07-14 22:15:56.40500133 +0000 UTC m=+2313.127508513" Jul 14 22:15:59.216843 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:15:59.216811 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:16:05.307972 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:05.307936 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:16:05.308509 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:05.308009 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:16:05.320940 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:05.320914 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:16:05.435742 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:05.435711 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:16:32.116173 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:32.116090 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:16:46.214228 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:46.214192 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:16:53.213203 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:53.213161 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk"] Jul 14 22:16:55.365717 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:55.365670 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb"] Jul 14 22:16:55.367770 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:55.367745 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-e8c0aa-29734455-mmmgb"] Jul 14 22:16:55.851446 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:55.851412 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b34ffc5-f518-44b9-80d1-fd93c0bb1397" path="/var/lib/kubelet/pods/5b34ffc5-f518-44b9-80d1-fd93c0bb1397/volumes" Jul 14 22:16:59.220630 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:16:59.220594 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:17:08.232519 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.232474 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" podUID="1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" containerName="main" containerID="cri-o://0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8" gracePeriod=45 Jul 14 22:17:08.482823 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.482764 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:17:08.570578 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.570524 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8xnk\" (UniqueName: \"kubernetes.io/projected/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-kube-api-access-x8xnk\") pod \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " Jul 14 22:17:08.570764 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.570597 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tls-certs\") pod \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " Jul 14 22:17:08.570764 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.570624 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tmp-dir\") pod \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " Jul 14 22:17:08.570764 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.570655 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-home\") pod \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " Jul 14 22:17:08.570764 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.570705 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-model-cache\") pod \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " Jul 14 22:17:08.570764 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.570736 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-dshm\") pod \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\" (UID: \"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a\") " Jul 14 22:17:08.571010 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.570901 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" (UID: "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:17:08.571010 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.570983 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-home" (OuterVolumeSpecName: "home") pod "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" (UID: "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:17:08.571124 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.571022 2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tmp-dir\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:08.571124 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.571109 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" (UID: "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:17:08.572756 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.572727 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-kube-api-access-x8xnk" (OuterVolumeSpecName: "kube-api-access-x8xnk") pod "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" (UID: "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a"). InnerVolumeSpecName "kube-api-access-x8xnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:17:08.572908 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.572892 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" (UID: "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 22:17:08.572955 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.572901 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-dshm" (OuterVolumeSpecName: "dshm") pod "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" (UID: "1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:17:08.672295 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.672259 2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-tls-certs\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:08.672295 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.672287 2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-home\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:08.672295 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.672297 2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-model-cache\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:08.672295 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.672305 2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-dshm\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:08.672557 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.672314 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8xnk\" (UniqueName: \"kubernetes.io/projected/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a-kube-api-access-x8xnk\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:08.710459 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.710427 2567 generic.go:356] "Generic (PLEG): container finished" podID="1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" containerID="0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8" exitCode=0 Jul 14 22:17:08.710633 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.710468 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" Jul 14 22:17:08.710633 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.710515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" event={"ID":"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a","Type":"ContainerDied","Data":"0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8"} Jul 14 22:17:08.710633 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.710559 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk" event={"ID":"1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a","Type":"ContainerDied","Data":"2bf0e1ba7cc4930b4c81b638c2da540fe1d617f427578b2f7c82b53df8f6528a"} Jul 14 22:17:08.710633 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.710580 2567 scope.go:117] "RemoveContainer" containerID="0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8" Jul 14 22:17:08.719586 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.719569 2567 scope.go:117] "RemoveContainer" containerID="0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8" Jul 14 22:17:08.719824 ip-10-0-131-58 kubenswrapper[2567]: E0714 22:17:08.719802 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8\": container with ID starting with 0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8 not found: ID does not exist" containerID="0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8" Jul 14 22:17:08.719870 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.719833 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8"} err="failed to get container status \"0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8\": rpc error: code = NotFound desc = could not find container \"0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8\": container with ID starting with 0a18f265ea3d7d7a3c138386a0494d26950a3fb6f5b153219d994bbbecff57c8 not found: ID does not exist" Jul 14 22:17:08.732715 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.732693 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk"] Jul 14 22:17:08.737548 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:08.737496 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e98c02/rate-test-model-e98c02-kserve-5bc75ffdbc-6c4jk"] Jul 14 22:17:09.852067 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:09.852032 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" path="/var/lib/kubelet/pods/1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a/volumes" Jul 14 22:17:23.882573 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:23.882543 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 22:17:23.885558 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:23.885532 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m25ff_56578618-4070-4ec5-b8ed-2a2f0e2ae063/ovn-acl-logging/0.log" Jul 14 22:17:39.280959 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:39.280925 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb"] Jul 14 22:17:39.284027 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:39.284003 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-e98c02-29734455-cqgxb"] Jul 14 22:17:39.849823 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:39.849790 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c401c2be-8951-47b7-818e-dd7344eff27b" path="/var/lib/kubelet/pods/c401c2be-8951-47b7-818e-dd7344eff27b/volumes" Jul 14 22:17:42.008081 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:42.008045 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2kvcr"] Jul 14 22:17:46.074691 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:46.074652 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn"] Jul 14 22:17:46.075131 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:46.074871 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" containerID="cri-o://ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f" gracePeriod=30 Jul 14 22:17:46.709397 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:46.709354 2567 patch_prober.go:28] interesting pod/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 22:17:46.709559 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:46.709423 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 22:17:51.336239 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.336212 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:17:51.430115 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430034 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-istio-token\") pod \"89bed26c-e97f-432c-9784-b81420a06efd\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " Jul 14 22:17:51.430115 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430071 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89bed26c-e97f-432c-9784-b81420a06efd-istio-podinfo\") pod \"89bed26c-e97f-432c-9784-b81420a06efd\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " Jul 14 22:17:51.430115 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430097 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-envoy\") pod \"89bed26c-e97f-432c-9784-b81420a06efd\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " Jul 14 22:17:51.430409 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430130 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-certs\") pod \"89bed26c-e97f-432c-9784-b81420a06efd\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " Jul 14 22:17:51.430409 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430181 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-data\") pod \"89bed26c-e97f-432c-9784-b81420a06efd\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " Jul 14 22:17:51.430409 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430221 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9bwb\" (UniqueName: \"kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-kube-api-access-w9bwb\") pod \"89bed26c-e97f-432c-9784-b81420a06efd\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " Jul 14 22:17:51.430409 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430251 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-socket\") pod \"89bed26c-e97f-432c-9784-b81420a06efd\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " Jul 14 22:17:51.430409 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430293 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-credential-socket\") pod \"89bed26c-e97f-432c-9784-b81420a06efd\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " Jul 14 22:17:51.430409 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430320 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89bed26c-e97f-432c-9784-b81420a06efd-istiod-ca-cert\") pod \"89bed26c-e97f-432c-9784-b81420a06efd\" (UID: \"89bed26c-e97f-432c-9784-b81420a06efd\") " Jul 14 22:17:51.430689 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430542 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "89bed26c-e97f-432c-9784-b81420a06efd" (UID: "89bed26c-e97f-432c-9784-b81420a06efd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:17:51.430689 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430575 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "89bed26c-e97f-432c-9784-b81420a06efd" (UID: "89bed26c-e97f-432c-9784-b81420a06efd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:17:51.430689 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430647 2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-certs\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:51.430807 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430777 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "89bed26c-e97f-432c-9784-b81420a06efd" (UID: "89bed26c-e97f-432c-9784-b81420a06efd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:17:51.430891 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.430849 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89bed26c-e97f-432c-9784-b81420a06efd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "89bed26c-e97f-432c-9784-b81420a06efd" (UID: "89bed26c-e97f-432c-9784-b81420a06efd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 22:17:51.431749 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.431721 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-data" (OuterVolumeSpecName: "istio-data") pod "89bed26c-e97f-432c-9784-b81420a06efd" (UID: "89bed26c-e97f-432c-9784-b81420a06efd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:17:51.432448 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.432423 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-istio-token" (OuterVolumeSpecName: "istio-token") pod "89bed26c-e97f-432c-9784-b81420a06efd" (UID: "89bed26c-e97f-432c-9784-b81420a06efd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:17:51.432535 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.432514 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-kube-api-access-w9bwb" (OuterVolumeSpecName: "kube-api-access-w9bwb") pod "89bed26c-e97f-432c-9784-b81420a06efd" (UID: "89bed26c-e97f-432c-9784-b81420a06efd"). InnerVolumeSpecName "kube-api-access-w9bwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 22:17:51.432711 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.432685 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "89bed26c-e97f-432c-9784-b81420a06efd" (UID: "89bed26c-e97f-432c-9784-b81420a06efd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 22:17:51.432711 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.432685 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89bed26c-e97f-432c-9784-b81420a06efd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "89bed26c-e97f-432c-9784-b81420a06efd" (UID: "89bed26c-e97f-432c-9784-b81420a06efd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 22:17:51.531394 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.531362 2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-credential-socket\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:51.531394 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.531387 2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89bed26c-e97f-432c-9784-b81420a06efd-istiod-ca-cert\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:51.531581 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.531396 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-istio-token\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:51.531581 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.531416 2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89bed26c-e97f-432c-9784-b81420a06efd-istio-podinfo\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:51.531581 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.531424 2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-envoy\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:51.531581 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.531432 2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-istio-data\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:51.531581 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.531440 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9bwb\" (UniqueName: \"kubernetes.io/projected/89bed26c-e97f-432c-9784-b81420a06efd-kube-api-access-w9bwb\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:51.531581 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.531449 2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89bed26c-e97f-432c-9784-b81420a06efd-workload-socket\") on node \"ip-10-0-131-58.ec2.internal\" DevicePath \"\"" Jul 14 22:17:51.896861 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.896825 2567 generic.go:356] "Generic (PLEG): container finished" podID="89bed26c-e97f-432c-9784-b81420a06efd" containerID="ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f" exitCode=0 Jul 14 22:17:51.897017 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.896872 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" Jul 14 22:17:51.897017 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.896903 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" event={"ID":"89bed26c-e97f-432c-9784-b81420a06efd","Type":"ContainerDied","Data":"ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f"} Jul 14 22:17:51.897017 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.896946 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn" event={"ID":"89bed26c-e97f-432c-9784-b81420a06efd","Type":"ContainerDied","Data":"708c69a014bd2ee97d747e43b0d0179fdc2cc90077fcb63ab51c9e45ace2f668"} Jul 14 22:17:51.897017 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.896968 2567 scope.go:117] "RemoveContainer" containerID="ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f" Jul 14 22:17:51.905250 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.905233 2567 scope.go:117] "RemoveContainer" containerID="551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed" Jul 14 22:17:51.912623 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.912601 2567 scope.go:117] "RemoveContainer" containerID="ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f" Jul 14 22:17:51.912861 ip-10-0-131-58 kubenswrapper[2567]: E0714 22:17:51.912841 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f\": container with ID starting with ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f not found: ID does not exist" containerID="ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f" Jul 14 22:17:51.913121 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.912870 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f"} err="failed to get container status \"ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f\": rpc error: code = NotFound desc = could not find container \"ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f\": container with ID starting with ff8102d2e17a30ea5a0e3f6535949c79f5b54a0f2e8fd73ae5c5941e2a845a3f not found: ID does not exist" Jul 14 22:17:51.913121 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.912887 2567 scope.go:117] "RemoveContainer" containerID="551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed" Jul 14 22:17:51.913121 ip-10-0-131-58 kubenswrapper[2567]: E0714 22:17:51.913110 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed\": container with ID starting with 551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed not found: ID does not exist" containerID="551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed" Jul 14 22:17:51.913386 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.913129 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed"} err="failed to get container status \"551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed\": rpc error: code = NotFound desc = could not find container \"551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed\": container with ID starting with 551d4006128ab72e5e98c2c9509d67de8f21c7fe9029f4e9a2e0cfe2132f6fed not found: ID does not exist" Jul 14 22:17:51.915614 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.915594 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn"] Jul 14 22:17:51.920220 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:51.920201 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e98c02-openshift-default-7968d6b947-98jrn"] Jul 14 22:17:52.153052 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:52.152925 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29734440-hbpsb_128f0526-9cb9-4005-996d-83aeb5191460/cleanup/0.log" Jul 14 22:17:52.276785 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:52.276760 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29734455-gk6gb_b954298b-1254-4c7f-a764-531092b3ec99/cleanup/0.log" Jul 14 22:17:52.914288 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:52.914258 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55cf7c4c-8vtdp_51ab05c8-96c0-4fcd-94f1-d419a226c065/copy-manifests/0.log" Jul 14 22:17:52.927785 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:52.927752 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55cf7c4c-8vtdp_51ab05c8-96c0-4fcd-94f1-d419a226c065/manager/0.log" Jul 14 22:17:53.850462 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:53.850432 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89bed26c-e97f-432c-9784-b81420a06efd" path="/var/lib/kubelet/pods/89bed26c-e97f-432c-9784-b81420a06efd/volumes" Jul 14 22:17:54.876938 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:54.876891 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rl7v8_f75847c2-d28a-4358-91a9-049c059ac057/manager/0.log" Jul 14 22:17:55.271902 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:55.271868 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9k25x_26607a4e-210d-4db1-8b27-6364c3481b5e/manager/0.log" Jul 14 22:17:55.397454 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:55.397427 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2kvcr_28bc1c48-af00-4f95-9182-e82ee7ff3e9d/limitador/0.log" Jul 14 22:17:55.523363 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:55.523257 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-krlnp_759dc8a1-00b0-4734-a6b6-1c4ca8355338/manager/0.log" Jul 14 22:17:56.034512 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:56.034485 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hjjsh_3634fb73-8c44-4446-b7d3-ada8f29bd016/discovery/0.log" Jul 14 22:17:56.277184 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:56.277158 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65594b5d8c-xskbd_501d6b93-866b-4eb4-90f2-7228cd701818/kube-auth-proxy/0.log" Jul 14 22:17:57.409991 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:17:57.409964 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ld2sr_3c123b26-c333-45c4-808c-32ad8202a21e/main/0.log" Jul 14 22:18:05.254427 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:05.254400 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t8xrx_059bca4a-0e12-4c97-b08e-f9187ad029e3/global-pull-secret-syncer/0.log" Jul 14 22:18:05.440802 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:05.440774 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lxx6t_3f85b4ed-0f33-438a-b4b9-e372a56b9f5e/konnectivity-agent/0.log" Jul 14 22:18:05.524178 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:05.524078 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-58.ec2.internal_11ebf2b3606c12ff044395928735acf2/haproxy/0.log" Jul 14 22:18:10.848994 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:10.848962 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rl7v8_f75847c2-d28a-4358-91a9-049c059ac057/manager/0.log" Jul 14 22:18:11.055841 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:11.055812 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9k25x_26607a4e-210d-4db1-8b27-6364c3481b5e/manager/0.log" Jul 14 22:18:11.107432 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:11.107354 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2kvcr_28bc1c48-af00-4f95-9182-e82ee7ff3e9d/limitador/0.log" Jul 14 22:18:11.180081 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:11.180041 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-krlnp_759dc8a1-00b0-4734-a6b6-1c4ca8355338/manager/0.log" Jul 14 22:18:13.555038 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:13.555008 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rstvz_ac5c595c-6077-47ba-bcd3-1892eecb4aa5/node-exporter/0.log" Jul 14 22:18:13.579342 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:13.579301 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rstvz_ac5c595c-6077-47ba-bcd3-1892eecb4aa5/kube-rbac-proxy/0.log" Jul 14 22:18:13.607880 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:13.607855 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rstvz_ac5c595c-6077-47ba-bcd3-1892eecb4aa5/init-textfile/0.log" Jul 14 22:18:15.459844 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.459808 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2"] Jul 14 22:18:15.460223 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.460111 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" Jul 14 22:18:15.460223 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.460124 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" Jul 14 22:18:15.460223 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.460134 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" containerName="main" Jul 14 22:18:15.460223 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.460140 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" containerName="main" Jul 14 22:18:15.460223 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.460155 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" Jul 14 22:18:15.460223 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.460160 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" Jul 14 22:18:15.460223 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.460219 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" Jul 14 22:18:15.460477 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.460229 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ebadd08-fcb3-4ff7-b1d0-9f0ed899ed9a" containerName="main" Jul 14 22:18:15.460477 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.460235 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="89bed26c-e97f-432c-9784-b81420a06efd" containerName="istio-proxy" Jul 14 22:18:15.463079 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.463063 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.465932 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.465909 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7zq7r\"/\"kube-root-ca.crt\"" Jul 14 22:18:15.466050 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.465999 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7zq7r\"/\"default-dockercfg-t7ph4\"" Jul 14 22:18:15.466407 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.466393 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7zq7r\"/\"openshift-service-ca.crt\"" Jul 14 22:18:15.471767 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.471747 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2"] Jul 14 22:18:15.486815 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.486783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-lib-modules\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.486815 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.486816 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-podres\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.487003 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.486873 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-proc\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.487003 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.486900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhj2h\" (UniqueName: \"kubernetes.io/projected/06d591ea-67c8-4917-8dc3-b657c32f4fa6-kube-api-access-xhj2h\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.487003 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.486955 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-sys\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.587986 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.587939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-sys\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.587986 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.587996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-lib-modules\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.588205 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.588017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-podres\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.588205 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.588042 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-proc\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.588205 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.588061 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhj2h\" (UniqueName: \"kubernetes.io/projected/06d591ea-67c8-4917-8dc3-b657c32f4fa6-kube-api-access-xhj2h\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.588205 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.588062 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-sys\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.588205 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.588142 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-proc\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.588205 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.588192 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-podres\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.588423 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.588196 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06d591ea-67c8-4917-8dc3-b657c32f4fa6-lib-modules\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.597981 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.597952 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhj2h\" (UniqueName: \"kubernetes.io/projected/06d591ea-67c8-4917-8dc3-b657c32f4fa6-kube-api-access-xhj2h\") pod \"perf-node-gather-daemonset-w2pv2\" (UID: \"06d591ea-67c8-4917-8dc3-b657c32f4fa6\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.773653 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.773619 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:15.908598 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:15.908521 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2"] Jul 14 22:18:15.911011 ip-10-0-131-58 kubenswrapper[2567]: W0714 22:18:15.910986 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod06d591ea_67c8_4917_8dc3_b657c32f4fa6.slice/crio-1c2140d0468a20454760f38714dba3e528cbea0c33ba815f6b2b90f24023eee1 WatchSource:0}: Error finding container 1c2140d0468a20454760f38714dba3e528cbea0c33ba815f6b2b90f24023eee1: Status 404 returned error can't find the container with id 1c2140d0468a20454760f38714dba3e528cbea0c33ba815f6b2b90f24023eee1 Jul 14 22:18:16.012686 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:16.012649 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" event={"ID":"06d591ea-67c8-4917-8dc3-b657c32f4fa6","Type":"ContainerStarted","Data":"1c2140d0468a20454760f38714dba3e528cbea0c33ba815f6b2b90f24023eee1"} Jul 14 22:18:17.018500 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:17.018464 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" event={"ID":"06d591ea-67c8-4917-8dc3-b657c32f4fa6","Type":"ContainerStarted","Data":"7b2ba6cdb2ee691c1d291ffed7d5c610fb9ca7300f7b7ae146e5fd5ecf35dfaf"} Jul 14 22:18:17.018894 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:17.018562 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:17.044589 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:17.044520 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" podStartSLOduration=2.044498975 podStartE2EDuration="2.044498975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:18:17.041570075 +0000 UTC m=+2453.764077278" watchObservedRunningTime="2026-07-14 22:18:17.044498975 +0000 UTC m=+2453.767006158" Jul 14 22:18:18.458257 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:18.458231 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7v8ph_e4a4ca48-2859-429b-97f1-6f4357d7d325/dns/0.log" Jul 14 22:18:18.484027 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:18.484001 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7v8ph_e4a4ca48-2859-429b-97f1-6f4357d7d325/kube-rbac-proxy/0.log" Jul 14 22:18:18.680770 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:18.680737 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mrpd6_f0c86769-7d8f-436f-b7df-a55cd8fe3cb5/dns-node-resolver/0.log" Jul 14 22:18:19.275162 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:19.275131 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78d858d5f8-z5plx_c4fe1cd4-dde0-482a-9e31-4773115cc36e/registry/0.log" Jul 14 22:18:19.354078 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:19.354048 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w69lg_9ee8da63-127d-47f2-a318-ead45a97069f/node-ca/0.log" Jul 14 22:18:20.500412 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:20.500383 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hjjsh_3634fb73-8c44-4446-b7d3-ada8f29bd016/discovery/0.log" Jul 14 22:18:20.549491 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:20.549467 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65594b5d8c-xskbd_501d6b93-866b-4eb4-90f2-7228cd701818/kube-auth-proxy/0.log" Jul 14 22:18:21.484155 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:21.484126 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-78f9r_c5eed469-033d-404f-96c9-8a6d58c80e95/serve-healthcheck-canary/0.log" Jul 14 22:18:22.185128 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:22.185102 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lpx2_a6d62602-e5ad-441b-a09c-63f87bcfacdb/kube-rbac-proxy/0.log" Jul 14 22:18:22.210749 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:22.210724 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lpx2_a6d62602-e5ad-441b-a09c-63f87bcfacdb/exporter/0.log" Jul 14 22:18:22.235163 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:22.235132 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5lpx2_a6d62602-e5ad-441b-a09c-63f87bcfacdb/extractor/0.log" Jul 14 22:18:23.032274 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:23.032246 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-w2pv2" Jul 14 22:18:25.145169 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:25.145139 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29734440-hbpsb_128f0526-9cb9-4005-996d-83aeb5191460/cleanup/0.log" Jul 14 22:18:25.173434 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:25.173404 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29734455-gk6gb_b954298b-1254-4c7f-a764-531092b3ec99/cleanup/0.log" Jul 14 22:18:25.560540 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:25.560505 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55cf7c4c-8vtdp_51ab05c8-96c0-4fcd-94f1-d419a226c065/manager/0.log" Jul 14 22:18:25.580366 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:25.580342 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55cf7c4c-8vtdp_51ab05c8-96c0-4fcd-94f1-d419a226c065/copy-manifests/0.log" Jul 14 22:18:26.327258 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:26.327226 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hjjsh_3634fb73-8c44-4446-b7d3-ada8f29bd016/discovery/0.log" Jul 14 22:18:26.367196 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:26.367167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65594b5d8c-xskbd_501d6b93-866b-4eb4-90f2-7228cd701818/kube-auth-proxy/0.log" Jul 14 22:18:27.199235 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:27.199207 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ltlr5_e55ddf89-6b1b-42cc-a103-be8d64556c5a/openshift-lws-operator/0.log" Jul 14 22:18:27.840891 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:27.840860 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hjjsh_3634fb73-8c44-4446-b7d3-ada8f29bd016/discovery/0.log" Jul 14 22:18:27.870378 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:27.870351 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65594b5d8c-xskbd_501d6b93-866b-4eb4-90f2-7228cd701818/kube-auth-proxy/0.log" Jul 14 22:18:32.312487 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:32.312456 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rwcsv_12cbe965-d430-4f06-a2f2-219d6ca92a66/migrator/0.log" Jul 14 22:18:32.344716 ip-10-0-131-58 kubenswrapper[2567]: I0714 22:18:32.344682 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-rwcsv_12cbe965-d430-4f06-a2f2-219d6ca92a66/graceful-termination/0.log"